Techniques for outputting content

WO2025260106A3PCT designated stage Publication Date: 2026-03-26APPLE INC
View PDF 2 Cites 0 Cited by

Patent Information

Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Filing Date
2025-09-29
Publication Date
2026-03-26

AI Technical Summary

Technical Problem

Existing computer systems lack dynamic response mechanisms to adapt visual representations of software objects based on environmental changes and user interactions, leading to suboptimal user engagement and interaction.

Method used

A method and system that dynamically adjusts the visual characteristics of software objects in response to detected inputs and context changes, using criteria-based responses to enhance user interaction and engagement.

Benefits of technology

Enhances user interaction by adapting visual representations in real-time to user inputs and environmental changes, improving engagement and responsiveness.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure US2025048550_26032026_PF_FP_ABST
    Figure US2025048550_26032026_PF_FP_ABST
Patent Text Reader

Abstract

The present disclosure generally relates to outputting content, providing dynamic responses to input, and addressing changes in an environment.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNIQUES FOR OUTPUTTING CONTENTCROSS-REFERENCE TO RELATED APPLICATIONS

[0001] This international patent application claims benefit of U.S. Provisional Patent Application Serial No. 63 / 889,105, entitled "TECHNIQUES FOR OUTPUTTING CONTENT" filed September 26, 2025, of U.S. Provisional Patent Application Serial No. 63 / 700,051, entitled "TECHNIQUES FOR OUTPUTTING CONTENT" filed September 27, 2024, of U.S. Provisional Patent Application Serial No. 63 / 700,462, entitled "USER INTERFACES FOR PROVIDING DYNAMIC RESPONSES TO INPUT" filed September 27, 2024, and U.S. Provisional Patent Application Serial No. 63 / 700,583, entitled "TECHNIQUES FOR ADDRESSING CHANGES IN AN ENVIRONMENT" filed September 27, 2024, which are hereby incorporated by reference in their entireties for all purposes.BACKGROUND

[0002] Computer systems provide notifications to alert users of environmental changes impacting their operations, while electronic devices display representations of software objects based on detected contexts and issue responses to inputs that vary depending on the input or other factors.SUMMARY

[0003] In some embodiments, a method that is performed at a computer system that is in communication with one or more display components, one or more input components, and one or more output components is described. In some embodiments, the method comprises: while displaying, via the one or more display components, a representation of a software object with a first set of one or more visual characteristics, detecting, via the one or more input components, an input; and in response to detecting the input: in accordance with a determination that a first set of one or more criteria issatis fied, wherein the first set of one or more criteria includes a criterion that is satis fied when a current context is a first type of context : outputting, via the one or more output components , a first response ; and while outputting the first response , displaying, via the one or more display components , the representation of the software obj ect with a second set of one or more visual characteristics di f ferent from the first set of one or more visual characteristics ; and in accordance with a determination that a second set of one or more criteria, di f ferent from the first set of one or more criteria, is satis fied, wherein the second set of one or more criteria includes a criterion that is satis fied when the current context is a second type of context di f ferent from the first type of context : outputting, via the one or more output components , a second response ; and while outputting the second response , displaying, via the one or more display components , the representation of the software obj ect with a third set of one or more visual characteristics di f ferent from the first set of one or more visual characteristics and the second set of one or more visual characteristics .

[0004] In some embodiments , a non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more display components , one or more input components , and one or more output components is described . In some embodiments , the one or more programs includes instructions for : while displaying, via the one or more display components , a representation of a software obj ect with a first set of one or more visual characteristics , detecting, via the one or more input components , an input ; and in response to detecting the input : in accordance with a determination that a first set of one or more criteria is satis fied, wherein the first set of one or more criteriaincludes a criterion that is satis fied when a current context is a first type of context : outputting, via the one or more output components , a first response ; and while outputting the first response , displaying, via the one or more display components , the representation of the software obj ect with a second set of one or more visual characteristics di f ferent from the first set of one or more visual characteristics ; and in accordance with a determination that a second set of one or more criteria, di f ferent from the first set of one or more criteria, is satis fied, wherein the second set of one or more criteria includes a criterion that is satis fied when the current context is a second type of context di f ferent from the first type of context : outputting, via the one or more output components , a second response ; and while outputting the second response , displaying, via the one or more display components , the representation of the software obj ect with a third set of one or more visual characteristics di f ferent from the first set of one or more visual characteristics and the second set of one or more visual characteristics .

[0005] In some embodiments , a transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more display components , one or more input components , and one or more output components is described . In some embodiments , the one or more programs includes instructions for : while displaying, via the one or more display components , a representation of a software obj ect with a first set of one or more visual characteristics , detecting, via the one or more input components , an input ; and in response to detecting the input : in accordance with a determination that a first set of one or more criteria is satis fied, wherein the first set of one or more criteria includes a criterion that is satis fied when a current contextis a first type of context: outputting, via the one or more output components, a first response; and while outputting the first response, displaying, via the one or more display components, the representation of the software object with a second set of one or more visual characteristics different from the first set of one or more visual characteristics; and in accordance with a determination that a second set of one or more criteria, different from the first set of one or more criteria, is satisfied, wherein the second set of one or more criteria includes a criterion that is satisfied when the current context is a second type of context different from the first type of context: outputting, via the one or more output components, a second response; and while outputting the second response, displaying, via the one or more display components, the representation of the software object with a third set of one or more visual characteristics different from the first set of one or more visual characteristics and the second set of one or more visual characteristics.

[0006] In some embodiments, a computer system configured to communicate with one or more display components, one or more input components, and one or more output components is described. In some embodiments, the computer system comprises one or more processors and memory storing one or more programs configured to be executed by the one or more processors. In some embodiments, the one or more programs includes instructions for: while displaying, via the one or more display components, a representation of a software object with a first set of one or more visual characteristics, detecting, via the one or more input components, an input; and in response to detecting the input: in accordance with a determination that a first set of one or more criteria is satisfied, wherein the first set of one or more criteria includes a criterion that is satisfied when a current contextis a first type of context: outputting, via the one or more output components, a first response; and while outputting the first response, displaying, via the one or more display components, the representation of the software object with a second set of one or more visual characteristics different from the first set of one or more visual characteristics; and in accordance with a determination that a second set of one or more criteria, different from the first set of one or more criteria, is satisfied, wherein the second set of one or more criteria includes a criterion that is satisfied when the current context is a second type of context different from the first type of context: outputting, via the one or more output components, a second response; and while outputting the second response, displaying, via the one or more display components, the representation of the software object with a third set of one or more visual characteristics different from the first set of one or more visual characteristics and the second set of one or more visual characteristics.

[0007] In some embodiments, a computer system configured to communicate with one or more display components, one or more input components, and one or more output components is described. In some embodiments, the computer system comprises means for performing each of the following steps: while displaying, via the one or more display components, a representation of a software object with a first set of one or more visual characteristics, detecting, via the one or more input components, an input; and in response to detecting the input: in accordance with a determination that a first set of one or more criteria is satisfied, wherein the first set of one or more criteria includes a criterion that is satisfied when a current context is a first type of context: outputting, via the one or more output components, a first response; and while outputting the first response, displaying, via the oneor more display components, the representation of the software object with a second set of one or more visual characteristics different from the first set of one or more visual characteristics; and in accordance with a determination that a second set of one or more criteria, different from the first set of one or more criteria, is satisfied, wherein the second set of one or more criteria includes a criterion that is satisfied when the current context is a second type of context different from the first type of context: outputting, via the one or more output components, a second response; and while outputting the second response, displaying, via the one or more display components, the representation of the software object with a third set of one or more visual characteristics different from the first set of one or more visual characteristics and the second set of one or more visual characteristics .

[0008] In some embodiments, a computer program product is described. In some embodiments, the computer program product comprises one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more display components, one or more input components, and one or more output components. In some embodiments, the one or more programs include instructions for: while displaying, via the one or more display components, a representation of a software object with a first set of one or more visual characteristics, detecting, via the one or more input components, an input; and in response to detecting the input: in accordance with a determination that a first set of one or more criteria is satisfied, wherein the first set of one or more criteria includes a criterion that is satisfied when a current context is a first type of context: outputting, via the one or more output components, a first response; and while outputting the first response, displaying, via the oneor more display components, the representation of the software object with a second set of one or more visual characteristics different from the first set of one or more visual characteristics; and in accordance with a determination that a second set of one or more criteria, different from the first set of one or more criteria, is satisfied, wherein the second set of one or more criteria includes a criterion that is satisfied when the current context is a second type of context different from the first type of context: outputting, via the one or more output components, a second response; and while outputting the second response, displaying, via the one or more display components, the representation of the software object with a third set of one or more visual characteristics different from the first set of one or more visual characteristics and the second set of one or more visual characteristics .

[0009] In some embodiments, a method that is performed at a computer system that is in communication with one or more display components and one or more input devices is described. In some embodiments, the method comprises: displaying, via the one or more display components, a representation of a software object in a first manner; while displaying the representation of the software object in the first manner, detecting, via the one or more input devices, an input from a subject; in response to detecting the input from the subject: in accordance with a determination that a first set of one or more criteria is satisfied, wherein the first set of one or more criteria includes a criterion that is satisfied when the input from the subject corresponds to an object in an environment including the computer system, displaying, via the one or more display components, the representation of the software object in a second manner different from the first manner, wherein the object is different from the subject; andin accordance with a determination that a second set of one or more criteria is satisfied, maintaining display of, via the one or more display components, the representation of the software object in the first manner, wherein the second set of one or more criteria is different from the first set of one or more criteria.

[0010] In some embodiments, a non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more display components and one or more input devices is described. In some embodiments, the one or more programs includes instructions for: displaying, via the one or more display components, a representation of a software object in a first manner; while displaying the representation of the software object in the first manner, detecting, via the one or more input devices, an input from a subject; in response to detecting the input from the subject: in accordance with a determination that a first set of one or more criteria is satisfied, wherein the first set of one or more criteria includes a criterion that is satisfied when the input from the subject corresponds to an object in an environment including the computer system, displaying, via the one or more display components, the representation of the software object in a second manner different from the first manner, wherein the object is different from the subject; and in accordance with a determination that a second set of one or more criteria is satisfied, maintaining display of, via the one or more display components, the representation of the software object in the first manner, wherein the second set of one or more criteria is different from the first set of one or more criteria.

[0011] In some embodiments, a transitory computer-readable storage medium storing one or more programs configured to beexecuted by one or more processors of a computer system that is in communication with one or more display components and one or more input devices is described. In some embodiments, the one or more programs includes instructions for: displaying, via the one or more display components, a representation of a software object in a first manner; while displaying the representation of the software object in the first manner, detecting, via the one or more input devices, an input from a subject; in response to detecting the input from the subject: in accordance with a determination that a first set of one or more criteria is satisfied, wherein the first set of one or more criteria includes a criterion that is satisfied when the input from the subject corresponds to an object in an environment including the computer system, displaying, via the one or more display components, the representation of the software object in a second manner different from the first manner, wherein the object is different from the subject; and in accordance with a determination that a second set of one or more criteria is satisfied, maintaining display of, via the one or more display components, the representation of the software object in the first manner, wherein the second set of one or more criteria is different from the first set of one or more criteria.

[0012] In some embodiments, a computer system configured to communicate with one or more display components and one or more input devices is described. In some embodiments, the computer system comprises one or more processors and memory storing one or more programs configured to be executed by the one or more processors. In some embodiments, the one or more programs includes instructions for: displaying, via the one or more display components, a representation of a software object in a first manner; while displaying the representation of the software object in the first manner, detecting, via the one ormore input devices, an input from a subject; in response to detecting the input from the subject: in accordance with a determination that a first set of one or more criteria is satisfied, wherein the first set of one or more criteria includes a criterion that is satisfied when the input from the subject corresponds to an object in an environment including the computer system, displaying, via the one or more display components, the representation of the software object in a second manner different from the first manner, wherein the object is different from the subject; and in accordance with a determination that a second set of one or more criteria is satisfied, maintaining display of, via the one or more display components, the representation of the software object in the first manner, wherein the second set of one or more criteria is different from the first set of one or more criteria.

[0013] In some embodiments, a computer system configured to communicate with one or more display components and one or more input devices is described. In some embodiments, the computer system comprises means for performing each of the following steps: displaying, via the one or more display components, a representation of a software object in a first manner; while displaying the representation of the software object in the first manner, detecting, via the one or more input devices, an input from a subject; in response to detecting the input from the subject: in accordance with a determination that a first set of one or more criteria is satisfied, wherein the first set of one or more criteria includes a criterion that is satisfied when the input from the subject corresponds to an object in an environment including the computer system, displaying, via the one or more display components, the representation of the software object in a second manner different from the first manner, wherein the object is different from the subject; and in accordance with adetermination that a second set of one or more criteria is satisfied, maintaining display of, via the one or more display components, the representation of the software object in the first manner, wherein the second set of one or more criteria is different from the first set of one or more criteria.

[0014] In some embodiments, a computer program product is described. In some embodiments, the computer program product comprises one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more display components and one or more input devices. In some embodiments, the one or more programs include instructions for: displaying, via the one or more display components, a representation of a software object in a first manner; while displaying the representation of the software object in the first manner, detecting, via the one or more input devices, an input from a subject; in response to detecting the input from the subject: in accordance with a determination that a first set of one or more criteria is satisfied, wherein the first set of one or more criteria includes a criterion that is satisfied when the input from the subject corresponds to an object in an environment including the computer system, displaying, via the one or more display components, the representation of the software object in a second manner different from the first manner, wherein the object is different from the subject; and in accordance with a determination that a second set of one or more criteria is satisfied, maintaining display of, via the one or more display components, the representation of the software object in the first manner, wherein the second set of one or more criteria is different from the first set of one or more criteria.

[0015] In some embodiments, a method that is performed at a computer system that is in communication with one or more display components, one or more input devices, and one or moreoutput devices is described. In some embodiments, the method comprises: while the computer system is directed at a subject, detecting, via the one or more input devices, attention of the subject; in response to detecting the attention of the subject: in accordance with a determination that the attention of the subject satisfies a set of one or more criteria, wherein the set of one or more criteria includes a criterion that is satisfied when the attention of the subject is not directed to the computer system, directing the computer system away from being directed to the subject; and in accordance with a determination that the attention of the subject does not satisfy the set of one or more criteria, maintaining direction of the computer system to the subject.

[0016] In some embodiments, a non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more display components, one or more input devices, and one or more output devices is described. In some embodiments, the one or more programs includes instructions for: while the computer system is directed at a subject, detecting, via the one or more input devices, attention of the subject; in response to detecting the attention of the subject: in accordance with a determination that the attention of the subject satisfies a set of one or more criteria, wherein the set of one or more criteria includes a criterion that is satisfied when the attention of the subject is not directed to the computer system, directing the computer system away from being directed to the subject; and in accordance with a determination that the attention of the subject does not satisfy the set of one or more criteria, maintaining direction of the computer system to the subject.

[0017] In some embodiments, a transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more display components, one or more input devices, and one or more output devices is described. In some embodiments, the one or more programs includes instructions for: while the computer system is directed at a subject, detecting, via the one or more input devices, attention of the subject; in response to detecting the attention of the subject: in accordance with a determination that the attention of the subject satisfies a set of one or more criteria, wherein the set of one or more criteria includes a criterion that is satisfied when the attention of the subject is not directed to the computer system, directing the computer system away from being directed to the subject; and in accordance with a determination that the attention of the subject does not satisfy the set of one or more criteria, maintaining direction of the computer system to the subject.

[0018] In some embodiments, a computer system configured to communicate with one or more display components, one or more input devices, and one or more output devices is described. In some embodiments, the computer system comprises one or more processors and memory storing one or more programs configured to be executed by the one or more processors. In some embodiments, the one or more programs includes instructions for: while the computer system is directed at a subject, detecting, via the one or more input devices, attention of the subject; in response to detecting the attention of the subject: in accordance with a determination that the attention of the subject satisfies a set of one or more criteria, wherein the set of one or more criteria includes a criterion that is satisfied when the attention of the subject is notdirected to the computer system, directing the computer system away from being directed to the subject; and in accordance with a determination that the attention of the subject does not satisfy the set of one or more criteria, maintaining direction of the computer system to the subject.

[0019] In some embodiments, a computer system configured to communicate with one or more display components, one or more input devices, and one or more output devices is described. In some embodiments, the computer system comprises means for performing each of the following steps: while the computer system is directed at a subject, detecting, via the one or more input devices, attention of the subject; in response to detecting the attention of the subject: in accordance with a determination that the attention of the subject satisfies a set of one or more criteria, wherein the set of one or more criteria includes a criterion that is satisfied when the attention of the subject is not directed to the computer system, directing the computer system away from being directed to the subject; and in accordance with a determination that the attention of the subject does not satisfy the set of one or more criteria, maintaining direction of the computer system to the subject.

[0020] In some embodiments, a computer program product is described. In some embodiments, the computer program product comprises one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more display components, one or more input devices, and one or more output devices. In some embodiments, the one or more programs include instructions for: while the computer system is directed at a subject, detecting, via the one or more input devices, attention of the subject; in response to detecting the attention of the subject: in accordance with a determination that the attentionof the subject satisfies a set of one or more criteria, wherein the set of one or more criteria includes a criterion that is satisfied when the attention of the subject is not directed to the computer system, directing the computer system away from being directed to the subject; and in accordance with a determination that the attention of the subject does not satisfy the set of one or more criteria, maintaining direction of the computer system to the subject.

[0021] In some embodiments, a method that is performed at a computer system that is in communication with one or more input devices and one or more display components is described. In some embodiments, the method comprises: while displaying, via the one or more display components, a representation of a software object, detecting, via the one or more input devices, movement of a subject; and in response to detecting the movement of the subject: in accordance with a determination that the subject satisfies a first set of one or more criteria, directing the representation of the software object in a first manner; and in accordance with a determination that the subject satisfies a second set of one or more criteria, directing the representation of the software object in a second manner, wherein the second set of one or more criteria is different from the first set of one or more criteria, wherein the second manner is different from the first manner.

[0022] In some embodiments, a non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more input devices and one or more display components is described. In some embodiments, the one or more programs includes instructions for: while displaying, via the one or more display components, a representation of a software object, detecting, via the one or more input devices, movement of a subject; and in response todetecting the movement of the subject: in accordance with a determination that the subject satisfies a first set of one or more criteria, directing the representation of the software object in a first manner; and in accordance with a determination that the subject satisfies a second set of one or more criteria, directing the representation of the software object in a second manner, wherein the second set of one or more criteria is different from the first set of one or more criteria, wherein the second manner is different from the first manner.

[0023] In some embodiments, a transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more input devices and one or more display components is described. In some embodiments, the one or more programs includes instructions for: while displaying, via the one or more display components, a representation of a software object, detecting, via the one or more input devices, movement of a subject; and in response to detecting the movement of the subject: in accordance with a determination that the subject satisfies a first set of one or more criteria, directing the representation of the software object in a first manner; and in accordance with a determination that the subject satisfies a second set of one or more criteria, directing the representation of the software object in a second manner, wherein the second set of one or more criteria is different from the first set of one or more criteria, wherein the second manner is different from the first manner.

[0024] In some embodiments, a computer system configured to communicate with one or more input devices and one or more display components is described. In some embodiments, the computer system comprises one or more processors and memorystoring one or more programs configured to be executed by the one or more processors. In some embodiments, the one or more programs includes instructions for: while displaying, via the one or more display components, a representation of a software object, detecting, via the one or more input devices, movement of a subject; and in response to detecting the movement of the subject: in accordance with a determination that the subject satisfies a first set of one or more criteria, directing the representation of the software object in a first manner; and in accordance with a determination that the subject satisfies a second set of one or more criteria, directing the representation of the software object in a second manner, wherein the second set of one or more criteria is different from the first set of one or more criteria, wherein the second manner is different from the first manner.

[0025] In some embodiments, a computer system configured to communicate with one or more input devices and one or more display components is described. In some embodiments, the computer system comprises means for performing each of the following steps: while displaying, via the one or more display components, a representation of a software object, detecting, via the one or more input devices, movement of a subject; and in response to detecting the movement of the subject: in accordance with a determination that the subject satisfies a first set of one or more criteria, directing the representation of the software object in a first manner; and in accordance with a determination that the subject satisfies a second set of one or more criteria, directing the representation of the software object in a second manner, wherein the second set of one or more criteria is different from the first set of one or more criteria, wherein the second manner is different from the first manner.

[0026] In some embodiments, a computer program product is described. In some embodiments, the computer program product comprises one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more input devices and one or more display components. In some embodiments, the one or more programs include instructions for: while displaying, via the one or more display components, a representation of a software object, detecting, via the one or more input devices, movement of a subject; and in response to detecting the movement of the subject: in accordance with a determination that the subject satisfies a first set of one or more criteria, directing the representation of the software object in a first manner; and in accordance with a determination that the subject satisfies a second set of one or more criteria, directing the representation of the software object in a second manner, wherein the second set of one or more criteria is different from the first set of one or more criteria, wherein the second manner is different from the first manner. .

[0027] In some embodiments, a method that is performed at a computer system that is in communication with one or more input devices and one or more movement components is described. In some embodiments, the method comprises: while a portion of the computer system is in a first position in an environment, detecting, via the one or more inputs devices, a set of one or more inputs; and in response to detecting the set of one or more inputs: in accordance with a determination that the attention of a user does not satisfy a first attention threshold, moving, via the one or more movement components, the portion of the computer system to a second position with a first level of intensity; and in accordance with a determination that the attention of the user satisfies the first attention threshold, forgoing moving, via the one ormore movement components , the portion of the computer system to the second position .

[0028] In some embodiments , a non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more input devices and one or more movement components is described . In some embodiments , the one or more programs includes instructions for : while a portion of the computer system is in a first position in an environment , detecting, via the one or more inputs devices , a set of one or more inputs ; and in response to detecting the set of one or more inputs : in accordance with a determination that the attention of a user does not satis fy a first attention threshold, moving, via the one or more movement components , the portion of the computer system to a second position with a first level of intensity; and in accordance with a determination that the attention of the user satis fies the first attention threshold, forgoing moving, via the one or more movement components , the portion of the computer system to the second position .

[0029] In some embodiments , a transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more input devices and one or more movement components is described . In some embodiments , the one or more programs includes instructions for : while a portion of the computer system is in a first position in an environment , detecting, via the one or more inputs devices , a set of one or more inputs ; and in response to detecting the set of one or more inputs : in accordance with a determination that the attention of a user does not satis fy a first attention threshold, moving, via the one or more movement components , the portion of the computer system to a secondposition with a first level of intensity; and in accordance with a determination that the attention of the user satis fies the first attention threshold, forgoing moving, via the one or more movement components , the portion of the computer system to the second position .

[0030] In some embodiments , a computer system configured to communicate with one or more input devices and one or more movement components is described . In some embodiments , the computer system comprises one or more processors and memory storing one or more programs configured to be executed by the one or more processors . In some embodiments , the one or more programs includes instructions for : while a portion of the computer system is in a first position in an environment , detecting, via the one or more inputs devices , a set of one or more inputs ; and in response to detecting the set of one or more inputs : in accordance with a determination that the attention of a user does not satis fy a first attention threshold, moving, via the one or more movement components , the portion of the computer system to a second position with a first level of intensity; and in accordance with a determination that the attention of the user satis fies the first attention threshold, forgoing moving, via the one or more movement components , the portion of the computer system to the second position .

[0031] In some embodiments , a computer system configured to communicate with one or more input devices and one or more movement components is described . In some embodiments , the computer system comprises means for performing each of the following steps : while a portion of the computer system is in a first position in an environment , detecting, via the one or more inputs devices , a set of one or more inputs ; and in response to detecting the set of one or more inputs : in accordance with a determination that the attention of a userdoes not satis fy a first attention threshold, moving, via the one or more movement components , the portion of the computer system to a second position with a first level of intensity; and in accordance with a determination that the attention of the user satis fies the first attention threshold, forgoing moving, via the one or more movement components , the portion of the computer system to the second position .

[0032] In some embodiments , a computer program product is described . In some embodiments , the computer program product comprises one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more input devices and one or more movement components . In some embodiments , the one or more programs include instructions for : while a portion of the computer system is in a first position in an environment , detecting, via the one or more inputs devices , a set of one or more inputs ; and in response to detecting the set of one or more inputs : in accordance with a determination that the attention of a user does not satis fy a first attention threshold, moving, via the one or more movement components , the portion of the computer system to a second position with a first level of intensity; and in accordance with a determination that the attention of the user satis fies the first attention threshold, forgoing moving, via the one or more movement components , the portion of the computer system to the second position .

[0033] In some embodiments , a method that is performed at a computer system that is in communication with one or more input devices is described . In some embodiments , the method comprises : while a portion of the computer system is directed to a first user in an environment , detecting, via the one or more input devices , an attention of a second user in the environment , wherein the second user is di f ferent from thefirst user ; and after detecting the attention of the second user in the environment : in accordance with a determination that the attention of the second user with respect to the computer system satis fies a first attention threshold, performing a first operation corresponding to the second user ; and in accordance with a determination that the attention of the second user with respect to the computer system satis fies a second attention threshold di f ferent from the first attention threshold, performing a second operation corresponding to the second user, wherein the second operation is di f ferent from the first operation .

[0034] In some embodiments , a non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more input devices is described . In some embodiments , the one or more programs includes instructions for : while a portion of the computer system is directed to a first user in an environment , detecting, via the one or more input devices , an attention of a second user in the environment , wherein the second user is di f ferent from the first user ; and after detecting the attention of the second user in the environment : in accordance with a determination that the attention of the second user with respect to the computer system satis fies a first attention threshold, performing a first operation corresponding to the second user ; and in accordance with a determination that the attention of the second user with respect to the computer system satis fies a second attention threshold di f ferent from the first attention threshold, performing a second operation corresponding to the second user, wherein the second operation is di f ferent from the first operation .

[0035] In some embodiments , a transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more input devices is described . In some embodiments , the one or more programs includes instructions for : while a portion of the computer system is directed to a first user in an environment , detecting, via the one or more input devices , an attention of a second user in the environment , wherein the second user is di f ferent from the first user ; and after detecting the attention of the second user in the environment : in accordance with a determination that the attention of the second user with respect to the computer system satis fies a first attention threshold, performing a first operation corresponding to the second user ; and in accordance with a determination that the attention of the second user with respect to the computer system satis fies a second attention threshold di f ferent from the first attention threshold, performing a second operation corresponding to the second user, wherein the second operation is di f ferent from the first operation .

[0036] In some embodiments , a computer system configured to communicate with one or more input devices is described . In some embodiments , the computer system comprises one or more processors and memory storing one or more programs configured to be executed by the one or more processors . In some embodiments , the one or more programs includes instructions for : while a portion of the computer system is directed to a first user in an environment , detecting, via the one or more input devices , an attention of a second user in the environment , wherein the second user is di f ferent from the first user ; and after detecting the attention of the second user in the environment : in accordance with a determinationthat the attention of the second user with respect to the computer system satis fies a first attention threshold, performing a first operation corresponding to the second user ; and in accordance with a determination that the attention of the second user with respect to the computer system satis fies a second attention threshold di f ferent from the first attention threshold, performing a second operation corresponding to the second user, wherein the second operation is di f ferent from the first operation .

[0037] In some embodiments , a computer system configured to communicate with one or more input devices is described . In some embodiments , the computer system comprises means for performing each of the following steps : while a portion of the computer system is directed to a first user in an environment , detecting, via the one or more input devices , an attention of a second user in the environment , wherein the second user is di f ferent from the first user ; and after detecting the attention of the second user in the environment : in accordance with a determination that the attention of the second user with respect to the computer system satis fies a first attention threshold, performing a first operation corresponding to the second user ; and in accordance with a determination that the attention of the second user with respect to the computer system satis fies a second attention threshold di f ferent from the first attention threshold, performing a second operation corresponding to the second user, wherein the second operation is di f ferent from the first operation .

[0038] In some embodiments , a computer program product is described . In some embodiments , the computer program product comprises one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more input devices . In someembodiments , the one or more programs include instructions for : while a portion of the computer system is directed to a first user in an environment , detecting, via the one or more input devices , an attention of a second user in the environment , wherein the second user is di f ferent from the first user ; and after detecting the attention of the second user in the environment : in accordance with a determination that the attention of the second user with respect to the computer system satis fies a first attention threshold, performing a first operation corresponding to the second user ; and in accordance with a determination that the attention of the second user with respect to the computer system satis fies a second attention threshold di f ferent from the first attention threshold, performing a second operation corresponding to the second user, wherein the second operation is di f ferent from the first operation .

[0039] In some embodiments , a method that is performed at a computer system that is in communication with one or more input devices is described . In some embodiments , the method comprises : while a portion of the computer system is in a first position in an environment , detecting, via the one or more inputs devices , an attention of one or more users in the environment ; and in response to detecting the attention of the one or more users in the environment : in accordance with a determination that a first set of one or more criteria is satis fied, wherein the first set of one or more criteria includes a first criterion that is satis fied when the attention corresponds to a first obj ect at a second position in the environment , wherein the first set of one or more criteria includes a second criterion that is satis fied when a number of the one or more users exceeds a non- zero threshold, changing the computer system from a first state to a second state di f ferent from the first state ; and in accordance with adetermination that a second set of one or more criteria is satis fied, wherein the second set of one or more criteria includes a third criterion that is satis fied when the attention corresponds to the first obj ect at the second position in the environment , wherein the second set of one or more criteria includes a fourth criterion that is satis fied when the number of the one or more users does not exceed the non- zero threshold, forgoing changing the computer system from the first state to the second state .

[0040] In some embodiments , a non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more input devices is described . In some embodiments , the one or more programs includes instructions for : while a portion of the computer system is in a first position in an environment , detecting, via the one or more inputs devices , an attention of one or more users in the environment ; and in response to detecting the attention of the one or more users in the environment : in accordance with a determination that a first set of one or more criteria is satis fied, wherein the first set of one or more criteria includes a first criterion that is satis fied when the attention corresponds to a first obj ect at a second position in the environment , wherein the first set of one or more criteria includes a second criterion that is satis fied when a number of the one or more users exceeds a non- zero threshold, changing the computer system from a first state to a second state di f ferent from the first state ; and in accordance with a determination that a second set of one or more criteria is satis fied, wherein the second set of one or more criteria includes a third criterion that is satis fied when the attention corresponds to the first obj ect at the second position in the environment , wherein the second set ofone or more criteria includes a fourth criterion that is satis fied when the number of the one or more users does not exceed the non- zero threshold, forgoing changing the computer system from the first state to the second state .

[0041] In some embodiments , a transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more input devices is described . In some embodiments , the one or more programs includes instructions for : while a portion of the computer system is in a first position in an environment , detecting, via the one or more inputs devices , an attention of one or more users in the environment ; and in response to detecting the attention of the one or more users in the environment : in accordance with a determination that a first set of one or more criteria is satis fied, wherein the first set of one or more criteria includes a first criterion that is satis fied when the attention corresponds to a first obj ect at a second position in the environment , wherein the first set of one or more criteria includes a second criterion that is satis fied when a number of the one or more users exceeds a non- zero threshold, changing the computer system from a first state to a second state di f ferent from the first state ; and in accordance with a determination that a second set of one or more criteria is satis fied, wherein the second set of one or more criteria includes a third criterion that is satis fied when the attention corresponds to the first obj ect at the second position in the environment , wherein the second set of one or more criteria includes a fourth criterion that is satis fied when the number of the one or more users does not exceed the non- zero threshold, forgoing changing the computer system from the first state to the second state .

[0042] In some embodiments , a computer system configured to communicate with one or more input devices is described . In some embodiments , the computer system comprises one or more processors and memory storing one or more programs configured to be executed by the one or more processors . In some embodiments , the one or more programs includes instructions for : while a portion of the computer system is in a first position in an environment , detecting, via the one or more inputs devices , an attention of one or more users in the environment ; and in response to detecting the attention of the one or more users in the environment : in accordance with a determination that a first set of one or more criteria is satis fied, wherein the first set of one or more criteria includes a first criterion that is satis fied when the attention corresponds to a first obj ect at a second position in the environment , wherein the first set of one or more criteria includes a second criterion that is satis fied when a number of the one or more users exceeds a non- zero threshold, changing the computer system from a first state to a second state di f ferent from the first state ; and in accordance with a determination that a second set of one or more criteria is satis fied, wherein the second set of one or more criteria includes a third criterion that is satis fied when the attention corresponds to the first obj ect at the second position in the environment , wherein the second set of one or more criteria includes a fourth criterion that is satis fied when the number of the one or more users does not exceed the non- zero threshold, forgoing changing the computer system from the first state to the second state .

[0043] In some embodiments , a computer system configured to communicate with one or more input devices is described . In some embodiments , the computer system comprises means for performing each of the following steps : while a portion of thecomputer system is in a first position in an environment , detecting, via the one or more inputs devices , an attention of one or more users in the environment ; and in response to detecting the attention of the one or more users in the environment : in accordance with a determination that a first set of one or more criteria is satis fied, wherein the first set of one or more criteria includes a first criterion that is satis fied when the attention corresponds to a first obj ect at a second position in the environment , wherein the first set of one or more criteria includes a second criterion that is satis fied when a number of the one or more users exceeds a non- zero threshold, changing the computer system from a first state to a second state di f ferent from the first state ; and in accordance with a determination that a second set of one or more criteria is satis fied, wherein the second set of one or more criteria includes a third criterion that is satis fied when the attention corresponds to the first obj ect at the second position in the environment , wherein the second set of one or more criteria includes a fourth criterion that is satis fied when the number of the one or more users does not exceed the non- zero threshold, forgoing changing the computer system from the first state to the second state .

[0044] In some embodiments , a computer program product is described . In some embodiments , the computer program product comprises one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more input devices . In some embodiments , the one or more programs include instructions for : while a portion of the computer system is in a first position in an environment , detecting, via the one or more inputs devices , an attention of one or more users in the environment ; and in response to detecting the attention of the one or more users in the environment : in accordance with adetermination that a first set of one or more criteria is satis fied, wherein the first set of one or more criteria includes a first criterion that is satis fied when the attention corresponds to a first obj ect at a second position in the environment , wherein the first set of one or more criteria includes a second criterion that is satis fied when a number of the one or more users exceeds a non- zero threshold, changing the computer system from a first state to a second state di f ferent from the first state ; and in accordance with a determination that a second set of one or more criteria is satis fied, wherein the second set of one or more criteria includes a third criterion that is satis fied when the attention corresponds to the first obj ect at the second position in the environment , wherein the second set of one or more criteria includes a fourth criterion that is satis fied when the number of the one or more users does not exceed the non- zero threshold, forgoing changing the computer system from the first state to the second state .

[0045] In some embodiments , a method that is performed at a computer system that is in communication with one or more input devices and one or more output devices including a display component is described . In some embodiments , the method comprises : detecting, via the one or more input devices , an input ; and in response to detecting the input , outputting, via the one or more output devices , a response to the input , including : in accordance with a determination that the input corresponds to a first context , displaying, via the display component , a first avatar representation that moves in a first manner based on the response and according to a first set of one or more learned characteristics ; and in accordance with a determination that the input corresponds to a second context , di f ferent from the first context , displaying, via the display component , a second avatar representation that movesin a second manner, di f ferent from the first manner, based on the response and according to a second set of one or more learned characteristics , di f ferent from the first set of one or more learned characteristics .

[0046] In some embodiments , a non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more input devices and one or more output devices including a display component is described . In some embodiments , the one or more programs includes instructions for : detecting, via the one or more input devices , an input ; and in response to detecting the input , outputting, via the one or more output devices , a response to the input , including : in accordance with a determination that the input corresponds to a first context , displaying, via the display component , a first avatar representation that moves in a first manner based on the response and according to a first set of one or more learned characteristics ; and in accordance with a determination that the input corresponds to a second context , di f ferent from the first context , displaying, via the display component , a second avatar representation that moves in a second manner, di f ferent from the first manner, based on the response and according to a second set of one or more learned characteristics , di f ferent from the first set of one or more learned characteristics .

[0047] In some embodiments , a transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more input devices and one or more output devices including a display component is described . In some embodiments , the one or more programs includes instructions for : detecting, via the one or more input devices , an input ; and in response to detecting theinput, outputting, via the one or more output devices, a response to the input, including: in accordance with a determination that the input corresponds to a first context, displaying, via the display component, a first avatar representation that moves in a first manner based on the response and according to a first set of one or more learned characteristics; and in accordance with a determination that the input corresponds to a second context, different from the first context, displaying, via the display component, a second avatar representation that moves in a second manner, different from the first manner, based on the response and according to a second set of one or more learned characteristics, different from the first set of one or more learned characteristics.

[0048] In some embodiments, a computer system configured to communicate with one or more input devices and one or more output devices including a display component is described. In some embodiments, the computer system comprises one or more processors and memory storing one or more programs configured to be executed by the one or more processors. In some embodiments, the one or more programs includes instructions for: detecting, via the one or more input devices, an input; and in response to detecting the input, outputting, via the one or more output devices, a response to the input, including: in accordance with a determination that the input corresponds to a first context, displaying, via the display component, a first avatar representation that moves in a first manner based on the response and according to a first set of one or more learned characteristics; and in accordance with a determination that the input corresponds to a second context, different from the first context, displaying, via the display component, a second avatar representation that moves in a second manner, different from the first manner, based on the response and according to a second set of one or more learnedcharacteristics, different from the first set of one or more learned characteristics.

[0049] In some embodiments, a computer system configured to communicate with one or more input devices and one or more output devices including a display component is described. In some embodiments, the computer system comprises means for performing each of the following steps: detecting, via the one or more input devices, an input; and in response to detecting the input, outputting, via the one or more output devices, a response to the input, including: in accordance with a determination that the input corresponds to a first context, displaying, via the display component, a first avatar representation that moves in a first manner based on the response and according to a first set of one or more learned characteristics; and in accordance with a determination that the input corresponds to a second context, different from the first context, displaying, via the display component, a second avatar representation that moves in a second manner, different from the first manner, based on the response and according to a second set of one or more learned characteristics, different from the first set of one or more learned characteristics.

[0050] In some embodiments, a computer program product is described. In some embodiments, the computer program product comprises one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more input devices and one or more output devices including a display component. In some embodiments, the one or more programs include instructions for: detecting, via the one or more input devices, an input; and in response to detecting the input, outputting, via the one or more output devices, a response to the input, including: in accordance with a determination that the input corresponds to a first context, displaying, via the displaycomponent, a first avatar representation that moves in a first manner based on the response and according to a first set of one or more learned characteristics; and in accordance with a determination that the input corresponds to a second context, different from the first context, displaying, via the display component, a second avatar representation that moves in a second manner, different from the first manner, based on the response and according to a second set of one or more learned characteristics, different from the first set of one or more learned characteristics.

[0051] In some embodiments, a method that is performed at a computer system that is in communication with one or more output devices, one or more input devices, and a movement component is described. In some embodiments, the method comprises: detecting, via the one or more input devices, an input; and in response to detecting the input: in accordance with a determination that the computer system was operating with respect to a first profile for a user before detecting the input, moving, via the movement component, in a first manner; and in accordance with a determination that the computer system was operating with respect to a second profile, different from the first profile, for the user before detecting the input, moving, via the movement component, in a second manner different from the first manner.

[0052] In some embodiments, a non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more output devices, one or more input devices, and a movement component is described. In some embodiments, the one or more programs includes instructions for: detecting, via the one or more input devices, an input; and in response to detecting the input: in accordance with a determination that the computer system wasoperating with respect to a first profile for a user before detecting the input, moving, via the movement component, in a first manner; and in accordance with a determination that the computer system was operating with respect to a second profile, different from the first profile, for the user before detecting the input, moving, via the movement component, in a second manner different from the first manner.

[0053] In some embodiments, a transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more output devices, one or more input devices, and a movement component is described. In some embodiments, the one or more programs includes instructions for: detecting, via the one or more input devices, an input; and in response to detecting the input: in accordance with a determination that the computer system was operating with respect to a first profile for a user before detecting the input, moving, via the movement component, in a first manner; and in accordance with a determination that the computer system was operating with respect to a second profile, different from the first profile, for the user before detecting the input, moving, via the movement component, in a second manner different from the first manner.

[0054] In some embodiments, a computer system configured to communicate with one or more output devices, one or more input devices, and a movement component is described. In some embodiments, the computer system comprises one or more processors and memory storing one or more programs configured to be executed by the one or more processors. In some embodiments, the one or more programs includes instructions for: detecting, via the one or more input devices, an input; and in response to detecting the input: in accordance with a determination that the computer system was operating withrespect to a first profile for a user before detecting the input, moving, via the movement component, in a first manner; and in accordance with a determination that the computer system was operating with respect to a second profile, different from the first profile, for the user before detecting the input, moving, via the movement component, in a second manner different from the first manner.

[0055] In some embodiments, a computer system configured to communicate with one or more output devices, one or more input devices, and a movement component is described. In some embodiments, the computer system comprises means for performing each of the following steps: detecting, via the one or more input devices, an input; and in response to detecting the input: in accordance with a determination that the computer system was operating with respect to a first profile for a user before detecting the input, moving, via the movement component, in a first manner; and in accordance with a determination that the computer system was operating with respect to a second profile, different from the first profile, for the user before detecting the input, moving, via the movement component, in a second manner different from the first manner.

[0056] In some embodiments, a computer program product is described. In some embodiments, the computer program product comprises one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more output devices, one or more input devices, and a movement component. In some embodiments, the one or more programs include instructions for: detecting, via the one or more input devices, an input; and in response to detecting the input: in accordance with a determination that the computer system was operating with respect to a first profile for a user before detecting the input, moving, via themovement component, in a first manner; and in accordance with a determination that the computer system was operating with respect to a second profile, different from the first profile, for the user before detecting the input, moving, via the movement component, in a second manner different from the first manner.

[0057] Executable instructions for performing techniques below are, optionally, included in a non-transitory computer- readable storage medium or other computer program product configured for execution by one or more processors. Executable instructions for performing such techniques are, optionally, included in a transitory computer-readable storage medium or other computer program product configured for execution by one or more processors.DESCRIPTION OF THE FIGURES

[0058] For a better understanding of the various described embodiments, reference should be made to the Detailed Description below, in conjunction with the following drawings in which like reference numerals refer to corresponding parts throughout the figures.

[0059] FIG. 1A is a block diagram illustrating a computer system in accordance with some embodiments.

[0060] FIGS. 1B-1G illustrate the use of Application Programming Interfaces (APIs) to perform operations.

[0061] FIGS. 2A-2C are diagrams illustrating exemplary components and user interfaces of an electronic device in accordance with some embodiments.

[0062] FIG. 3 is a block diagram illustrating exemplary components of a device in accordance with some embodiments.

[0063] FIG. 4 is a functional diagram of an exemplary actuator device in accordance with some embodiments.

[0064] FIG. 5 is a functional diagram of an exemplary software system in accordance with some embodiments.

[0065] FIGS. 6A-6D illustrate exemplary user interfaces for outputting content in accordance with some embodiments.

[0066] FIG. 7 is a flow diagram illustrating a process for outputting content in accordance with some embodiments.

[0067] FIGS. 8A-8F illustrate exemplary user interfaces for responding to inputs for different user interfaces in accordance with some embodiments.

[0068] FIG. 9 is a flow diagram illustrating a process for displaying representation of a software object based on presence of an object in accordance with some embodiments.

[0069] FIG. 10 is a flow diagram illustrating a process for directing attention of a representation of a software object in accordance with some embodiments.

[0070] FIGS. 11A-11F illustrate exemplary user interfaces for interacting with subjects in accordance with some embodiments.

[0071] FIG. 12 is a flow diagram illustrating a process for directing attention of a representation of a software object based on movement of a subject in accordance with some embodiments .

[0072] FIGS. 13A-13F illustrate exemplary user interfaces for acknowledging a change in an environment in accordance with some embodiments.

[0073] FIG. 14 is a flow diagram illustrating a method for acknowledging a change in an environment in accordance with some embodiments.

[0074] FIG. 15 is a flow diagram illustrating a method for acknowledging another user in an environment in accordance with some embodiments.

[0075] FIGS. 16A-16C illustrate exemplary user interfaces for acknowledging a change in user attention in accordance with some embodiments.

[0076] FIG. 17 is a flow diagram illustrating a method for acknowledging a change in user attention in accordance with some embodiments.

[0077] FIGS. 18A-18F illustrate exemplary user interfaces for providing dynamic responses to input in accordance with some embodiments .

[0078] FIG. 19 is a flow diagram illustrating a method for outputting a response that includes context dependent movement in accordance with some embodiments.

[0079] FIG. 20 is a flow diagram illustrating a method for moving in a profile dependent manner in accordance with some embodiments .DETAILED DESCRIPTION

[0080] The description herein sets forth exemplary processes, components, parameters, and the like. While specific examples are set out herein, it should be recognized that such embodiments should not be understood as limiting the scope of the present disclosure to the explicit descriptions of the examples set forth herein but instead should be understood as providing illustrative examples.

[0081] One or more steps of the processes described herein can be predicated on, rely on and / or be contingent on one or more conditions being satis fied . In some embodiments , a process is performed by iterating and / or repeating one or more processes multiple times . In some embodiments , contingent steps can be satis fied within and / or across di f ferent iterations of a single process and still be within the scope of the processes described herein . For example , for a given process that includes two or more steps that are contingent on di f ferent conditions , one of ordinary skill in the art would understand that the given process is considered to have been performed even when a process is repeated multiple times until and / or before the contingent steps are satis fied . In some embodiments , performance of multiple iterations of a process are not required to practice any one or more of the claims as presented herein . For example , system, electronic device , computer-readable medium, and / or method claims can be made , used, and / or performed without iteratively repeating a process . In some embodiments , the system, electronic device , computer-readable medium, and / or method claims include and / or utili ze instructions for performing one or more steps that are contingent upon one or more conditions being satis fied .Because such instructions are stored in one or more processors and / or at one or more memory locations , the system, electronic device , computer-readable medium, and / or method claims can include and / or utili ze logic that determines whether the one or more conditions have been satis fied without requiring the steps of a process to be repeated and / or iterated multiple times .

[0082] Although elements are described below using numerical descriptors , such as "a first" and / or "a second, " these elements do not correspond to order or distinct representations and should not be limited to the statednumerical term. In some embodiments, these terms simply used as prefix to distinguish a reference to one element from a reference to another element. For example, a "first" device and a "second" device can be two separate references to the same device. In contrast, for example, a "first" device and a "second" device can be a reference to two different devices (e.g., not the same device and / or not the same type of device) . For example, a first computer system and a second computer system do not correspond to a first and a second in time, and merely are used to distinguish between two computer systems. As such, the first computer system can be termed a second computer system, and the second computer system can be termed a first computer system without departing from the scope of the various described embodiments.

[0083] For description of various elements and examples, the use of certain terminology is used to provide productive descriptions of the subject matter below and should not be read as limiting. As used to describe various examples herein, the singular forms of "a, " "an, " and "the" should not be interpreted as precluding or excluding the plural forms as well, unless the context clearly indicates otherwise. As well, "and / or" is used to encompasses any and all possible combinations of one or more associated listed items. For example, "x and / or y" should be interpreted as including "x, " or "y, " as well as "x and y" as possible permutations. Further, the use of the terms "includes," "including," "comprises," and / or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and / or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.

[0084] When describing choices and / or logical possibilities, the term "if" is, optionally, construed to mean "when," "upon," "in response to determining," "in response to detecting," or "in accordance with a determination that" depending on the context. Similarly, the phrase "if it is determined" or "if [a stated condition or event] is detected" is, optionally, construed to mean "upon determining," "in response to determining," "upon detecting [the stated condition or event] ," "in response to detecting [the stated condition or event] ," or "in accordance with a determination that [the stated condition or event]" depending on the context .

[0085] The processes described below enhance the operability of the devices and make the user-device and / or user-device interfaces more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating / interacting with the device) through various techniques, including by providing improved feedback (e.g., visual, haptic, acoustic, and / or tactile feedback) to the user, reducing the number of inputs needed to perform an operation, providing additional control options without cluttering the user interface with additional displayed controls, performing an operation when a set of conditions has been met without requiring further input (e.g., input by a user) , and / or additional techniques, such as increasing the security and / or privacy of the computer system and reducing burn-in of one or more portions of a user interface of a display. These techniques also reduce power usage and improve battery life of the device by enabling the user to use the device more quickly and efficiently.

[0086] Below, FIGS. 1A-1G, 2A-2C, and 3-5 provide a description of exemplary devices for performing the techniques for outputting content, providing dynamic responses to input,and addressing changes in an environment. FIGS. 6A-6D illustrate exemplary user interfaces for providing expressive responses in accordance with some embodiments. FIG. 7 is a flow diagram illustrating a process for outputting content in accordance with some embodiments. The user interfaces in FIGS. 6A-6D are used to illustrate the processes described below, including the processes in FIG. 7. FIGS. 8A-8F illustrate exemplary user interfaces for responding to inputs for different user interfaces in accordance with some embodiments. FIG. 9 is a flow diagram illustrating a process for displaying representation of a software object based on presence of an object in accordance with some embodiments. The user interfaces in FIGS. 8A-8F are used to illustrate the processes described below, including the processes in FIG. 9. FIG. 10 is a flow diagram illustrating a process for directing attention of a representation of a software object in accordance with some embodiments. The user interfaces in FIGS. 8A-8F are used to illustrate the processes described below, including the processes in FIG. 10. FIGS. 11A-11F illustrate exemplary user interfaces for interacting with subjects in accordance with some embodiments. FIG. 12 is a flow diagram illustrating a process for directing attention of a representation of a software object based on movement of a subject in accordance with some embodiments. The user interfaces in FIGS. 11A-11F are used to illustrate the processes described below, including the processes in FIG. 12. FIGS. 13A-13F illustrate exemplary user interfaces for acknowledging a change in an environment in accordance with some embodiments. FIG. 14 is a flow diagram illustrating a method for acknowledging a change in an environment in accordance with some embodiments. The user interfaces in FIGS. 13A-13F are used to illustrate the processes described below, including the processes in FIG. 14. FIG. 15 is a flow diagram illustrating a method for acknowledging another user in an environment in accordancewith some embodiments. The user interfaces in FIGS. 13A-13F are used to illustrate the processes described below, including the processes in FIG. 15. FIGS. 16A-16C illustrate exemplary user interfaces for acknowledging a change in user attention in accordance with some embodiments. FIG. 17 is a flow diagram illustrating a method for acknowledging a change in user attention in accordance with some embodiments. The user interfaces in FIGS. 16A-17C are used to illustrate the processes described below, including the processes in FIG. 17. FIGS. 18A-18F illustrate exemplary user interfaces for providing dynamic responses to input in accordance with some embodiments. FIG. 19 is a flow diagram illustrating a method for outputting a response that includes context dependent movement in accordance with some embodiments. The user interfaces in FIGS. 18A-18F are used to illustrate the processes described below, including the processes in FIG. 19. FIG. 20 is a flow diagram illustrating a method for moving in a profile dependent manner in accordance with some embodiments. The user interfaces in FIGS. 18A-18F are used to illustrate the processes described below, including the processes in FIG. 20.

[0087] FIG. 1A depicts a block diagram of computer system 100 (e.g., electronic device and / or electronic system) , which includes a set of electronic components in communication with (e.g., connected to and / or in wired or wireless communication with) each other. It should be understood that computer system 100 is merely an example of a computer system that can be used to perform one or more functions described herein. It should be understood that one or more other computer systems can be used to perform one or more functions described herein. Additionally, while FIG. 1A depicts a computer architecture of computer system 100, other computer architectures (e.g., including fewer components, more components, and / or similarcomponents) of a computer system can be used to perform one or more functions described herein.

[0088] In some embodiments, computer system 100 can correspond to (e.g., be and / or include) a system on a chip, a personal computer system, a desktop computer, a laptop computer, a tablet, a smart phone, a wearable device, a fitness tracking device, a smart watch, a head-mounted display ("HMD") device, a communal device (e.g., thermostat, smart speaker, and / or additional home-based computer systems) , an accessory (e.g., light, switch, air conditioner, heater, fan, window cover, lock, media playback device, speaker, gaming console, and / or television) , a controller, a hub, a server system, and / or a sensor .

[0089] In some embodiments, a sensor is and / or includes one or more hardware components having an ability to perform one or more operations for detecting (e.g., sensing, generating, and / or processing) states, conditions, and / or information about a physical environment in a vicinity of the sensor. For example, a sensor can be configured to detect conditions surrounding the sensor, detect conditions in one or more directions casting away from the sensor, and / or detect conditions based on contact of the sensor with a feature of the physical environment. In some embodiments, a hardware component of a sensor includes a sensing component (e.g., a temperature and / or image sensor) , a receiving component (e.g., a radio and / or laser receiver) , and / or a transmitting component (e.g., a radio and / or laser transmitter) . In some embodiments, a sensor includes an angle sensor, a force sensor, a contact sensor, a non-contact sensor, a breakage sensor, a flow sensor, a gas sensor, a chemical sensor, a particle sensor, a humidity sensor, a moisture sensor, a precipitation sensor, an image sensor (e.g., an RGB camera and / or an infrared sensor) , a photoelectric sensor (e.g.,ambient light and / or solar light) , a position sensor (e.g., a global positioning system) , a pressure sensor, a temperature sensor, a proximity sensor, a radiation sensor, an inertial measurement unit ("IMU") , an accelerometer, a compass, a leak sensor, a level sensor, a metal sensor, a microphone, a motion sensor, a range sensor, a depth sensor (e.g., RADAR and / or LiDAR) , a speed sensor, a time-of-f light sensor, a torque sensor, and an ultrasonic sensor, a vacancy sensor, a presence sensor, a voltage sensor, a current sensor, a resistivity sensor, a conductivity sensor, a capacitive sensor, and / or a water sensor. While only a single computer system is depicted in FIG. 1A, functionality described herein can be implemented with a single computer system or with two or more computer systems operating together. In some embodiments, computer system 100 includes one or more sensors, as described herein. In some embodiments, information about the physical environment is captured by combining data from one sensor with data from one or more additional sensors (e.g., one or more additional sensors that are part of the computer system and / or one or more additional computer systems) .

[0090] As illustrated in FIG. 1A, computer system 100 includes processor subsystem 110, memory 120, and I / O interface 130. In some embodiments, memory 120 is a system memory in communication with processor subsystem 110. In some embodiments, one or more electronic components of computer system 100 are electrically connected to each other via interconnect 150, which allows communication between the electronic components of computer system 100. For example, interconnect 150 can be a system bus, one or more memory locations, and / or additional electrical channels for connecting multiple components of computer system 100. In some embodiments, I / O interface 130 is connected, via a wired and / or wireless connection, to I / O device 140. In someembodiments, computer system 100 includes a single component includes and / or encompasses both of I / O interface 130 and I / O device 140, such that the functionality of I / O interface 130 and I / O device 140 is provided by the single component. It should be understood that computer system 100 can include one or more I / O interfaces communicating with one or more I / O devices. In some embodiments, computer system 100 includes multiple processor subsystems (e.g., processor subsystem 110) , each electrically connected to each other and / or one or more other components of computer system 100 via interconnect 150.

[0091] In some embodiments, processor subsystem 110 is and / or includes one or more processors and / or individual processing units that have a capability for executing instructions (e.g., programs, systems, and / or interrupts) to perform one or more of the functions described herein. For example, operating- system-level and / or application-level instructions are executed by processor subsystem 110. In some embodiments, processor subsystem 110 includes one or more components (e.g., implemented as software, hardware, and / or a combination thereof) capable of performing, supporting, and / or interpreting machine-learning instructions and / or operations. For example, computer system 100 can perform operations according to a machine-learning model that is local to computer system 100. In some embodiments, computer system 100 communicates with (e.g., executes instructions corresponding to and / or performs calculations on) a remote interactive knowledge base (e.g., a processing resource that implements an artificial intelligence model, a machine-learning model, and / or a large language model) to perform operations that are otherwise outside a set of capabilities of computer system 100. For example, computer system 100 can determine a set of inputs (e.g., data, instructions, and / or parameters) to theinteractive knowledge base for performing requested machinelearning operations.

[0092] In some embodiments, memory 120 is in communication with processor subsystem 110 and can be implemented by a variety of different physical, non-transitory memory media. In some embodiments, computer system 100 includes multiple memory components and / or multiple types of memory components. In some embodiments, each of the multiple memory components is connected to processor subsystem 110 directly and / or via interconnect 150. For example, memory 120 can be implemented using a storage array, a removable flash drive, a storage area network (e.g., SAN) , hard disk storage, flash memory, removable disk storage, optical drive storage, floppy disk storage, random access memory (e.g., SDRAM, DDR SDRAM, EDO RAM, RAMBUS RAM and / or RAM- SRAM ) , and / or read only memory (e.g., EEPROM and / or PROM) . In some embodiments, processor subsystem 110 and / or interconnect 150 is connected to one or more memory controllers that are electrically connected to memory 120.

[0093] In some embodiments, one or more instructions are executed by processor subsystem 110. For example, memory 120 can include a computer-readable medium (e.g., transitory or non-transitory computer-readable medium) usable to store (e.g., configured to store, assigned to store, and / or storing) one or more instructions to be executed by processor subsystem 110. In some embodiments, each instruction stored by memory 120 and executed by processor subsystem 110 corresponds to an operation for completing one or more of the functions described herein. For example, memory 120 can store program instructions to implement the functionality associated with processes 700, 900, 1100, 1200, 1400, 1500, 1700, 1800 (e.g., FIG. 7, 9, 11, 12, 14, 15, 17, and / or 18) described below.

[0094] In some embodiments, I / O interface 130 enables computer system 100 to communicate with other devices. In some embodiments, I / O interface 130 is and / or includes one or more interfaces of one or more types. In some embodiments, I / O interface 130 is and / or includes a bridge chip (e.g., Southbridge) from a front-side bus to one or more back-side buses. In some embodiments, I / O interface 130 enables communication with I / O device 140 and / or one or more other I / O devices, via one or more corresponding buses and / or other interfaces. For example, an I / O device can include one or more: physical user-interface devices (e.g., a mouse, a physical keyboard, and / or a joystick) , network interface devices (e.g., to a local or wide-area network) , storage devices (e.g., as described herein with respect to memory 120) , auditory and / or visual output devices (e.g., light, screen, speaker, and / or projector) , and / or sensor devices (e.g., as described herein with respect to sensors) . In some embodiments, the visual output device is referred to as a display component. For example, the display component can be configured to provide visual output, such as displaying images on a physically viewable medium, such as via an LED display or image projection. As used herein, "displaying" content includes causing a component to display the content (e.g., video data decoded and / or rendered by a display controller) by transmitting, via a wired or wireless connection, data (e.g., image data and / or video data) to an integrated and / or external display component to visually produce the content.

[0095] In some embodiments, computer system 100 includes a component that integrates I / O device 140 with one or more other components, such as I / O interface 130. In some embodiments, I / O device 140 is separate from one or more other components of computer system 100 (e.g., is a discrete component) . In some embodiments, I / O device 140 includes anetwork interface device that permits computer system 100 to connect to (e.g., communicate with) a network or one or more other computer systems, such as via a wired or wireless connection. In some embodiments, a network interface device can include Wi-Fi, Ethernet, USB, Thunderbolt, Bluetooth, NFC, and so forth. For example, computer system 100 can utilize an NFC connection to facilitate a bank, credit, financial, token (e.g., fungible or non-fungible token) , and / or cryptocurrency transaction between computer system 100 and another computer system within a vicinity of computer system 100.

[0096] In some embodiments, I / O device 140 is and / or includes one or more components for detecting a user (e.g., a subject, a person, an animal, an object, and / or a computer system different from the computer system) and / or an input (e.g., a tap input, a non-tap input, a swipe input, a hold-and-drag input, a verbal input, an acoustic command, an acoustic statement, an acoustic request, a gaze input, an air gesture, and / or a mouse click) from a user. In some embodiments, I / O device 140 enables computer system 100 to identify users associated with an account and / or users not associated with any account. For example, computer system 100 can detect a known user (e.g., a user associated with an account) and access information about the user using the user's account. In some embodiments, as part of computer system 100 detecting a user, computer system 100 detects that the user's account is associated with (e.g., is identified with respect to and / or included in) a group of accounts (and / or associated users) . For example, computer system 100 can access information associated with a group of accounts in response to detecting a member of the group. In some embodiments, an account corresponding to a user can be associated with one or more additional accounts and / or one or more additional computer systems. For example, computer system 100 can detect such oneor more additional computer systems and / or detect one or more computer systems for detecting the user. In some embodiments, computer system 100 detects one or more unknown users (e.g., users not associated with any account) and enables one or more guest accounts for the one or more unknown users to utilize computer system 100, for example with limited access.

[0097] In some embodiments, I / O device 140 is and / or includes one or more cameras. In some embodiments, a camera is and / or includes one or more image sensors (e.g., one or more optical sensors and / or one or more depth camera sensors) that provide computer system 100 with the ability to detect a user and / or a user's expressions, movements, and / or gestures (e.g., hand gestures and / or air gestures) as inputs. In some embodiments, an air gesture is a gesture that is detected without requiring the user to touch an input element that is part of computer system 100 (or independently of an input element that is a part of computer system 100) . For example, an air gesture can be based on detected motion of a portion of the user' s body through the air including motion of the user' s body relative to an absolute reference (e.g., a distance of the user's hand relative to the ground and / or an angle of the user's arm relative to the ground) , relative to another portion of the user's body (e.g., movement of one hand of the user relative to another hand of the user, movement of a hand of the user relative to a shoulder of the user, and / or movement of a finger of the user relative to another finger or portion of a hand of the user) , and / or absolute motion of a portion of the user's body (e.g., a shake gesture that includes a predetermined speed or amount of rotation of a portion of the user's body and / or a tap gesture that includes movement of a hand in a predetermined pose by a predetermined amount and / or speed) . In some embodiments, the one or more cameras enable computer system 100 to transmit image, pictorial, and / or videoinformation to an application. For example, computer system 100 can complete a video phone call by transmitting image and / or video data captured by a camera to an application that manages the video phone call.

[0098] In some embodiments, I / O device 140 is and / or includes one or more microphones. For example, computer system 100 can use a microphone to obtain data and / or information from a user without requiring a contact input. In some embodiments, a microphone enables computer system 100 to detect speech and / or verbal input from a user. In some embodiments, computer system 100 utilizes speech input to manage one or more functions of a personal assistant. For example, a user can make a verbal request for computer system 100 to perform an action and / or obtain information for the user. In some embodiments, computer system 100 utilizes speech input (e.g., along with one or more other input techniques and / or output techniques) to request and / or detect information from a user without requiring the user to make physical contact with computer system 100.

[0099] In some embodiments, I / O device 140 is and / or includes one or more physical input mediums for a user to interact directly with computer system 100. In some embodiments, a physical input medium includes one or more physical buttons (e.g., one or more touch sensitive non-depressible components and / or one or more tactile depressible buttons) , a touch sensitive display component, a mouse, and / or a keyboard. In some embodiments, one or more physical input mediums are part of computer system 100. In some embodiments, one or more physical input mediums are connected to computer system 100 (e.g., together and / or separately) , such as via one or more I / O interfaces.

[0100] In some embodiments, I / O device 140 is and / or includes one or more display components for outputting information(e.g., a display component, a display screen, a projector, a touch-sensitive display, an audio generation component, a speaker, and / or a haptic output device) . In some embodiments, computer system 100 operates I / O device 140 to convey information and / or a state of computer system 100. In some embodiments, I / O device 140 is and / or includes a tactile output device. For example, a tactile output device can be a haptic component that enables computer system 100 to convey information to a user in contact with (e.g., touching, holding, and / or close to) computer system 100. In some embodiments, I / O device 140 includes one or more components for outputting visual outputs (e.g., an image, video, animation, augmented reality overlay, 3D rendering, motion graphics, data visualization, and / or digital art) . For example, computer system 100 can display content from one or more applications and / or system processes. For another example, computer system 100 can display a widget (e.g., a control that displays real-time information and / or data) corresponding to one or more applications.

[0101] In some embodiments, I / O device 140 is and / or includes one or more audio components for outputting audio (e.g., speakers, smart speakers, television speakers, home theater systems, soundbars, earphones, earbuds, headphones, augmented reality headset speakers, audio jacks, optical audio outputs, Bluetooth audio outputs, HDMI audio outputs, and / or audio sensors) . In some embodiments, computer system 100 is able to output audio through I / O device 140. For example, computer system 100 can output audio-based content and / or information to a user via I / O device 140. In some embodiments, I / O device 140 enables spatial audio (e.g., an audio output corresponding to an environment) . For example, computer system 100 can detect materials and / or objects within an environment and / oralter the audio pattern, intensity, and / or waveform to compensate for varying characteristics of the environment.

[0102] Referring now to FIGS. 1B-1G, implementations within the scope of the present disclosure can be partially or entirely realized using a tangible computer-readable storage medium (and / or multiple tangible computer-readable storage media of one or more types) encoding one or more computer- readable instructions. It should be recognized that computer- readable instructions can be organized in any format, including applications, processes, widgets, software, and / or hardware components.

[0103] Implementations within the scope of the present disclosure include a computer-readable storage medium that encodes instructions organized as an application (e.g., application 170 of FIG. ID) that, when executed by one or more processing units, control an electronic device (e.g., device 168 of FIG. ID) to perform the process of FIG. IB, the process of FIG. 1C, and / or one or more other processes and / or methods described herein.

[0104] It should be recognized that application 170 can be an application of any suitable type including, for example, one or more of a browser application, a media application, a messaging application, a health application, a fitness application, a digital payments application, a social network application, a maps application, a communication application, and / or an application that functions as an execution environment for plug-ins, widgets, or other applications. In some embodiments, application 170 is an application that is pre-installed on device 168 prior to or upon purchase (e.g., a first-party application) . In some embodiments, application 170 is an application that is provided to device 168 via an operating system update file (e.g., a first-party applicationor a second-party application) . In some embodiments, application 170 is an application that is provided via an application store. In some embodiments, the application store can be pre-installed on device 168 prior to or upon purchase (e.g., a first-party application store) . In some embodiments, the application store is a third-party application store (e.g., an application store that is read from a storage device, downloaded via a network, and / or provided by another application store) .

[0105] Referring now to FIG. IB and FIG. IF, at block 160, an application (e.g., application 170 of FIG. ID) obtains information. In some embodiments, the information is obtained from one or more hardware components of device 168 (shown in FIG. ID) . In some embodiments, the information is obtained from one or more software modules of device 168. In some embodiments, the information is obtained from one or more hardware components external to device 168 (e.g., a server, a peripheral device, and / or an accessory device) . In some embodiments, the information includes user information, environment information, hardware information, historical information, event information, positional information, time information, notification information, electronic device state information, weather information, media information, and / or motion information. In some embodiments, at block 162, in response to and / or after obtaining the information at block 160, the application provides the information to a system (e.g., system 180 of FIG. IE) .

[0106] Referring now to FIG. 1C and FIG. 1G, at block 164, an application (e.g., application 170 of FIG. ID) obtains information. In some embodiments, the information includes user information, environment information, hardware information, historical information, event information, positional information, time information, notificationinformation, electronic device state information, weather information, media information, and / or motion information. In some embodiments, at block 166, in response to and / or after obtaining the information, the application performs one or more operations with the information. In some embodiments, the one or more operations includes displaying the information, providing a notification based on the information, sending a message based on the information, setting a reminder based on the information, controlling a user interface of a fitness application based on the information, controlling a user interface of a health application based on the information, controlling a focus mode based on the information, adding a calendar entry based on the information, and / or calling an API of a system (e.g., system 180 of FIG. IE) based on the information .

[0107] In some embodiments, one or more steps of the process of FIG. IB and / or the process of FIG. 1C is performed in response to a trigger. In some embodiments, the trigger includes a user input, a notification received from system 180, a detection of an event, and / or a response to a call to an API provided by system 180.

[0108] In some embodiments, the instructions of application 170, when executed, control device 168 to perform the process of FIG. IB and / or the process of FIG. 1C by calling an application programming interface ("API") , such as API 176 provided by system 180. It should be recognized that calling API 176 is optional. In some embodiments, application 170 performs at least a portion of the process of FIG. IB and / or the process of FIG. 1C without calling API 176.

[0109] In some embodiments, one or more steps of the process of FIG. IB and / or the process of FIG. 1C includes calling API 176 using one or more parameters defined by API 176. In someembodiments, the one or more parameters include a data structure, an object, an object class, a key, a constant, a variable, a data type, a pointer, an array, a list and / or a pointer to a function and / or a method, and / or another way to reference data or another item to be passed via API 176.

[0110] Referring to FIG. ID, device 168 is illustrated. In some embodiments, device 168 is a personal computing device, a smart phone, a tablet, a smart watch, a fitness tracker, a head mounted display ("HMD") device, a media device, a speaker, a communal device, and / or a television. As illustrated in FIG. ID, device 168 includes application 170. Application 170 includes application implementation module 172 and API-calling module 174. It should be recognized that device 168 and / or application 170 can include more, fewer, and / or different components than those illustrated in FIG. ID.

[0111] Referring to FIG. IE, system 180 is illustrated. In some embodiments, system 180 is an operating system hosted on device 168. As illustrated in FIG. IE, system 180 (e.g., an operating system of device 168) includes API 176 and implementation module 178. It should be recognized that system 180 can include more, fewer, and / or different components than those illustrated in FIG. IE.

[0112] In some embodiments, application implementation module 172 includes a set of one or more instructions corresponding to one or more operations performed by application 170. For example, when application 170 is a messaging application, application implementation module 172 can include instructions to receive and / or send messages. For another example, when application 170 is a calendar application, application implementation module 172 can include instructions to create, edit, track, and / or view calendar appointments. In some embodiments, application implementation module 172communicates with API-calling module 174 to communicate with system 180 via API 176.

[0113] In some embodiments, API 176 is a software module (e.g., a collection of computer-readable instructions) that provides an interface for another module (e.g., API-calling module 174) to access and / or use one or more functions, procedures, data structures, methods, classes, and / or other services provided by implementation module 178 of system 180. For example, API-calling module 174 can access a feature of implementation module 178 through one or more API calls and / or invocations (e.g., embodied by a method call and / or a function) exposed by API 176 (e.g., a software and / or hardware module that can receive API calls, respond to API calls, and / or send API calls) . For another example, API-calling module 174 can pass data and / or control information using one or more parameters via the API calls or invocations. In some embodiments, API 176 allows application 170 to use a service provided by a Software Development Kit ("SDK") library. In some embodiments, application 170 incorporates a call to a function and / or a method provided by the SDK library and / or provided by API 176. In some embodiments, application 170 uses data types or objects defined in the SDK library and provided by API 176. In some embodiments, API-calling module 174 makes an API call via API 176 to access and use a feature of implementation module 178 that is specified by API 176. In such embodiments, implementation module 178 can return a value via API 176 to API-calling module 174 in response to the API call. The value can report to application 170 the capabilities or state of a hardware component of device 168, including those related to aspects such as processing capability, output capabilities and state, input capabilities and state, storage capacity and / or state, power state, and / or communications capability. In some embodiments, API 176 is implemented inpart by firmware, microcode, and / or other low-level logic that executes, at least in part, on the hardware component.

[0114] In some embodiments, API 176 allows a developer of API- calling module 174 (e.g., a third-party developer) to leverage one or more features provided by implementation module 178. In such embodiments, there can be one or more API-calling modules, such as API-calling module 174, that communicate with implementation module 178. In some embodiments, API 176 allows multiple API-calling modules written in different programming languages to communicate with implementation module 178 while API 176 is implemented in terms of a specific programming language. For example, API 176 can include features for translating calls and returns between implementation module 178 and API-calling module 174. In some embodiments, API- calling module 174 calls APIs from different providers such as a set of APIs from a plug-in provider, a set of APIs from an operating system provider, and / or a set of APIs from another provider (e.g., the provider of a software library) and / or creator .

[0115] Examples of API 176 include a device detection API (e.g., for locating nearby electronic devices, media devices, and / or smartphones) , a pairing API (e.g., for establishing a secure connection with an accessory) , a UIKit API (e.g., for generating user interfaces) , an application store API, a payment API, a push notification API, a networking API, a WiFi API, a Bluetooth API, an NFC API, a UWB API, a location detection API, a locator API, a maps API, a health sensor API, a sensor API, a messaging API, a streaming API, a collaboration API, a video conferencing API, an advertising services API, a web browser API (e.g., WebKit API) , a vehicle API, a fitness API, a smart home API, a contact transfer API, a photos API, a camera API, and / or an image processing API. In some embodiments, a sensor API is and / or includes an API foraccessing data associated with a sensor of device 168. For example, the sensor API can provide access to raw sensor data. For another example, the sensor API can provide data derived (and / or generated) from the raw sensor data. In some embodiments, the sensor data is and / or includes image data, video data, temperature data, audio data, heart rate data, inertial measurement unit ("IMU") data, location data, GPS data, LiDAR data, and / or camera data. In some embodiments, the sensor is and / or includes one or more of an optical sensor, accelerometer, gyroscope, proximity sensor, temperature sensor, infrared sensor, heartrate sensor, barometer, temperature sensor, and / or biometric sensor.

[0116] In some embodiments, implementation module 178 is a system software module that is configured to perform one or more operations in response to receiving an API call via API 176. In some embodiments, the system is an operating system and / or server system. In some embodiments, the software module is a collection of computer-readable instructions. In some embodiments, implementation module 178 is configured to provide an API response (e.g., via API 176) as a result of processing an API call. By way of example, implementation module 178 and API-calling module 174 can each be any one of an operating system, a device driver, a library, an API, an application program, and / or another module. It should be understood that implementation module 178 and API-calling module 174 can be the same type of module as each other or different types of modules from each other. In some embodiments, implementation module 178 is embodied at least in part in firmware, microcode, and / or hardware logic.

[0117] In some embodiments, implementation module 178 returns a value through API 176 in response to an API call from API- calling module 174. While API 176 defines the syntax and result of an API call (e.g., how to invoke the API call andwhat the API call does) , API 176 need not indicate how implementation module 178 accomplishes the function specified by the API call. In some embodiments, various API calls are transferred via the one or more application programming interfaces between API-calling module 174 and implementation module 178. Transferring the API calls can include initiating, invoking, issuing, receiving, calling, returning, and / or responding to the function calls and / or messages. In other words, transferring can describe actions by either of API- calling module 174 or implementation module 178. In some embodiments, a function call and / or other invocation of API 176 sends and / or receives one or more parameters through a parameter list and / or other structure.

[0118] In some embodiments, implementation module 178 provides multiple APIs. In such embodiments, each API provides a different view of functionality implemented by implementation module 178 and / or with different aspects of functionality implemented by implementation module 178. For example, one API of implementation module 178 can provide a first set of functions and can be exposed to third-party developers. In this example, another API of implementation module 178 can be hidden (e.g., not exposed) and provide a subset of the first set of functions as well as a second set of functions, such as testing and / or debugging functions, which are not in the first set of functions. In some embodiments, implementation module 178 calls one or more other components via an underlying API. In such embodiments, implementation module 178 is both an API- calling module and an implementation module. It should be recognized that implementation module 178 can include additional functions, procedures, data structures, methods, classes, and / or other services that are not necessarily specified through API 176 and are not available to API-calling module 174. It should also be recognized that API-callingmodule 174 can be on the same system as implementation module 178 and / or can be located remotely and access implementation module 178 using API 176 over a network. In some embodiments, API-calling module 174, API 176, and / or implementation module 178 are stored in a machine-readable medium, which includes any mechanism for storing information in a form readable by a machine (e.g., a computer and / or other data processing system) . For example, a machine-readable medium can be and / or include magnetic disks, flash memory devices, optical disks, random access memory, and / or read only memory.

[0119] An application programming interface ("API") is an interface between a first software process and a second software process that specifies a format for communication between the first software process and the second software process. Limited APIs, such as private APIs or partner APIs, are APIs that are accessible to a limited set of software processes. Public APIs are APIs that are accessible to a wider set of software processes. Some APIs enable software processes to communicate about or set a state of one or more input devices (e.g., one or more touch sensors, visual sensors, motion / orientation sensors, proximity sensors, pressure sensors, intensity sensors, buttons, switches, rotatable elements, sound sensors, wireless proximity sensors, biometric sensors, and / or external controllers) . Some APIs enable software processes to communicate about and / or set a state of one or more output generation components (e.g., one or more tactile output generation components, one or more display generation components, and / or one or more audio output generation components) . Some APIs enable particular capabilities (e.g., text entry, scrolling, handwriting, image editing, and / or image creation) to be accessed, used, and / or performed by a software process (e.g., generating one or more outputs for use by a software process based on one or moreinputs from the software process) . Some APIs enable content from a software process to be inserted into a template and / or displayed in a user interface that has a layout and / or behaviors that are specified by the template.

[0120] Many software platforms include a set of frameworks that provides the core objects and / or core behaviors that a software developer can utilize to build software applications for use on the software platform. Software developers can use these objects to display content onscreen, to interact with that content, and to manage interactions with the software platform. Software applications rely on the set of frameworks for their basic behavior, and the set of frameworks provides many ways for the software developer to customize the behavior of the application to match the specific needs of the software application. Many of these core objects and core behaviors are accessed via one or more APIs. An API will typically specify a format for communication between software processes, including specifying and grouping available functions, variables, and protocols. An API call (and / or an API request) will typically be sent from a sending software process to a receiving software process to accomplish one or more of the following: the sending software process providing information to the receiving software process (e.g., for the receiving software process to take action on) , the sending software process requesting information from the receiving software process (e.g., for the sending software process to take action on) , the sending software process providing information to the receiving software process about action taken by the sending software process, or the sending software process requesting action by the receiving software process. Interaction with a device (e.g., using a user interface) can include the transfer and / or receipt of one or more API calls between multiple different software processes (e.g., an application and anoperating system, different portions of an operating system, or different applications) . For example, when an input is detected, the direct sensor data can be processed into one or more input events that are provided (e.g., via one or more APIs) to a receiving software process that makes one or more determinations based on the input events. In this example, the receiving software process can send (e.g., via one or more APIs) information to a software process to perform an operation (e.g., change a device state and / or user interface) based on the determination. While a determination and an operation performed in response could be made by the same software process, the determination could alternatively be made in a first software process and / or relayed (e.g., via one or more APIs) to a second software process, different from the first software process, which causes the operation to be performed by the second software process. Alternatively, the second software process could relay instructions (e.g., via one or more APIs) to a third software process, different from the first software process and / or the second software process, to perform the operation. It should be understood that some or all user interactions with a computer system could involve one or more API calls within a step of interacting with the computer system (e.g., between different software components of the computer system or between a software component of the computer system and a software component of one or more other computer systems) . It should be understood that some or all user interactions with a computer system could involve one or more API calls between steps of interacting with the computer system (e.g., between different software components of the computer system or between a software component of the computer system and a software component of one or more other computer systems) .

[0121] In some embodiments, the application can be any suitable type of application, including, for example, one or more of a browser application, a media application, a messaging application, a health application, a fitness application, a digital payments application, a social network application, a maps application, a communication application, and / or an application that functions as an execution environment for plug-ins, widgets, or other applications.

[0122] In some embodiments, the application is an application that is pre-installed on the first computer system prior to or upon purchase (e.g., a first-party application) . In some embodiments, the application is an application that is provided to the first computer system via an operating system update file (e.g., a first-party application) . In some embodiments, the application is an application that is provided via an application store. In some embodiments, the application store is pre-installed on the first computer system prior to or upon purchase (e.g., a first-party application store) and allows download of one or more applications. In some embodiments, the application store is a third-party application store (e.g., an application store that is read from a storage device, downloaded via a network, and / or provided by another device) . In some embodiments, the application is a third-party application (e.g., an app that is provided by an application store, downloaded via a network, and / or read from a storage device) . In some embodiments, the application controls the first computer system to perform processes 700, 900, 1000, 1200, 1400, 1500, 1700, 1900, and 2000 (e.g., FIGS. 7, 9, 10, 12, 14, 15, 17, 19, and 20) by calling an application programming interface ("API") provided by the system process using one or more parameters.

[0123] In some embodiments, exemplary APIs provided by the system process include one or more of a device detection API(e.g., for locating nearby electronic devices, media devices, and / or smartphones) , a pairing API (e.g., for establishing a secure connection with an accessory) , a UIKit API (e.g., for generating user interfaces) , an application store API, a payment API, a push notification API, a networking API, a WiFi API, a Bluetooth API, an NFC API, a UWB API, a location detection API, a locator API, a maps API, a health sensor API, a sensor API, a messaging API, a streaming API, a collaboration API, a video conferencing API, an advertising services API, a web browser API (e.g., WebKit API) , a vehicle API, a fitness API, a smart home API, a contact transfer API, a photos API, a camera API, and / or an image processing API.

[0124] In some embodiments, at least one API is a software module (e.g., a collection of computer-readable instructions) that provides an interface that allows another module (e.g., an API-calling module) to access and / or use one or more functions, procedures, data structures, methods, classes, and / or other services provided by application implementation module 172. In some embodiments, the API defines one or more parameters that are passed between API-calling module 174 and application implementation module 172. In some embodiments, API 176 defines a first API call that can be provided by API- calling module 174. In some embodiments, application implementation module 172 is a system software module (e.g., a collection of computer-readable instructions) that is configured to perform an operation in response to receiving an API call via API 176. In some embodiments, application implementation module 172 is constructed to provide an API response (via the API) as a result of processing an API call. In some embodiments, application implementation module 172 is included in device 168 that runs application 170. In some embodiments, the implementation module is included in anelectronic device that is separate from device 168 that runs application 170.

[0125] FIGS. 2A-5 illustrate exemplary components and user interfaces of device 200 in accordance with some embodiments. Device 200 can represent computer system 100 and / or include one or more features of computer system 100. In the examples described with respect to FIGS. 2A-5, device 200 is a laptop computer. It should be recognized that device 200 is not limited to being a laptop computer and that device 200 can be one or more other devices. For example, device 200 can be a communal device, such as a smart speaker, a smart display, and / or a television. In some embodiments, a communal device is configured to provide functionality to multiple users (e.g., at the same time and / or at different times) . In such embodiments, the communal device can be set up and / or administered by a single user. For another example, device 200 can be a personal device, such as a desktop computer, a tablet, a smart phone, a smart watch, a fitness tracking device, and / or a head mounted display device. In some embodiments, a personal device is configured to provide functionality to a single user, such as when the single user is logged into the personal device.

[0126] FIGS. 2A-2C illustrate device 200 in three different configurations. As illustrated in FIG. 2A, device 200 is a laptop computer (also referred to herein as a "laptop") that includes base portion 200-2 and display portion 200-1. In some embodiments, base portion 200-2 can be arranged to rest horizontally on a surface, such as a desk, as shown in FIG. 2A. In some embodiments, display portion 200-1 is connected to base portion 200-2 at connection 200-3 (e.g., a hinge, a motorized arm, one or more connection points, and / or a joint) . In some embodiments, connection 200-3 enables display portion 200-1 to pivot and / or change orientation with respect to baseportion 200-2. For example, device 200 can pivot at connection 200-3 to rotate display portion 200-1 and / or device 200 to one or more configurations corresponding to an "OFF" state (e.g., as further described herein in relation to FIG. 2C) . In some embodiments, a configuration corresponding to an "OFF" state is a configuration in which device 200 is in a particular pose. For example, the particular pose can be one in which display portion 200-1 is arranged to be parallel to base portion 200-2 or forming a particular angle (e.g., 60-degree angle) with respect to base portion 200-2. In some embodiments, in the "OFF" state, an area in which content is displayed by device 200 is arranged in a manner that corresponds to (e.g., is associated with, represents, and / or is configured to accompany) the "OFF" state (e.g., not visible, facing down, and / or obscuring the area in which content is displayed) . In some embodiments, in the "OFF" state, an area in which content is displayed by device 200 is not arranged in a manner that corresponds to (e.g., is associated with, represents, and / or is configured to accompany) the "OFF" state. For example, when not in the "OFF" state, device 200 can be arranged within a range of different open configurations (e.g., in which display portion 200-1 is not parallel to base portion 200-2 and the area in which content is displayed by device 200 is visible and / or not obscured) . It should be recognized that display portion 200-1 being parallel to base portion 200-2 is an example of a configuration corresponding to an "OFF" state (e.g., a closed position) of device 200. In some embodiments, one or more other configurations, such as the configuration illustrated in FIG. 2C, could corresponding to the "OFF" state.

[0127] FIG. 2A illustrates device 200 in a corresponding pose on the left and display screen 200-4 (providing an area in which content is displayed by device 200) on the right. Asillustrated in FIG. 2A, device 200 is in a first configuration(e.g., display portion 200-1 is perpendicular to base portion 200-2 forming a 90-degree angle) . In FIG. 2A, display screen 200-4 represents what is being displayed (e.g., via a display component) by device 200 while open in the first configuration. In FIG. 2A, display screen 200-4 illustrates a state in which device 200 is "ON" (e.g., powered on, operational, awake, activated, and / or in a higher powered and / or more resource-intensive state than the "OFF" state) . In some embodiments, device 200 displays, via display screen 200- 4, one or more user interfaces (e.g., system user interfaces, application user interfaces, user interface objects, windows, controls, and / or other visual content) . In some embodiments, device 200 displays, via display screen 200-4, the one or more user interfaces while in the "ON" state. For example, in FIG. 2A, device 200 is in the "ON" state and display screen 200-4 displays user interface 200-5 that includes an application window. In some embodiments, user interface 200-5 includes (and / or is) one or more user interface objects (e.g., windows, icons, and / or other graphical objects) . For example, user interface 200-5 can include one or more graphical objects different than and / or the same as an application window.

[0128] FIG. 2B illustrates device 200 in a corresponding pose on the left and display screen 200-4 on the right. As illustrated in FIG. 2B, device 200 is in a second configuration (e.g., display portion 200-1 is angled, via connection 200-3, with respect to base portion 200-2 forming a 120-degree angle, which is larger than the angle of FIG. 2A) . In FIG. 2B, display screen 200-4 represents what is being displayed by device 200 while in the second configuration. Display screen 200-4 illustrates a state in which device 200 is "ON" (e.g., the same state as the top diagram of FIG. 2A) . In FIG. 2B, device 200 displays, via display screen 200-4,user interface 200-5 (e.g., and is the same as displayed in FIG. 2A) . In some embodiments, device 200 displays a different user interface (e.g., other than user interface 200-5) . For example, although FIG. 2B illustrates device 200 displaying the same user interface 200-5 as in FIGS. 2A while in a different configuration than that shown in FIG. 2A, device 200 can display a different user interface. In some embodiments, device 200 displays a user interface that corresponds to (e.g., is based on, related to, caused by, due to, and / or configured to accompany) a physical state (e.g., location, position, and / or orientation) , for example including content that is specific to a particular angle or specific to a current context.

[0129] FIG. 2C illustrates device 200 in a corresponding pose on the left and display screen 200-4 on the right. As illustrated in FIG. 2C, device 200 is in a third configuration (e.g., display portion 200-1 is angled, via connection 200-3, with respect to base portion 200-2 forming a 60-degree angle, which is a smaller angle than the angles of FIG. 2A and FIG. 2B) . In FIG. 2C, display screen 200-4 represents what is being displayed by device 200 while in the third configuration. In FIG. 2C, display screen 200-4 illustrates a state in which device 200 is "OFF" (e.g., not powered on, not operational, not awake, not activated, powered off, asleep, hibernating, inactive, and / or deactivated) . In some embodiments, device 200 does not display (e.g., ceases and / or forgoes displaying) the one or more user interfaces while in the "OFF" state (e.g., does not display any visual content) . In some embodiments, device 200 displays, via display screen 200-4, one or more user interfaces while in the "OFF" state. In some embodiments, device 200 displays the same user interface as or a different user interface from one or more user interfaces displayed while in the "ON" state. In some embodiments, device 200displays a user interface specific to the "OFF" state and / or a manner of displaying a user interface that is not specific to the "OFF" state. In FIG. 20, display screen 200-4 is blank because nothing is being displayed on the display of device 200 (e.g., display screen 200-4 is off and / or not displaying any user interface, such as user interface 200-5) .

[0130] In some embodiments, device 200 includes one or more components (also referred to herein as "movement components") that enable device 200 to perform (e.g., control and / or cause) movement (and / or be moved) . Performing movement can include moving a portion of device 200, moving all of device 200, and / or moving one or more other devices and / or components (e.g., that are in communication with device 200 and / or movement components of device 200) . For example, device 200 can automatically move and / or cause and / or control movement of display portion 200-1 relative to base portion 200-2, such as to any one or more of the configurations illustrated in FIGS. 2A-2C. In some embodiments, device 200 performs movement based on a state of device 200. Performing movement based on a state can facilitate certain interactions by device 200. For example, such interactions of device 200 can utilize special features, functions, modes, and / or programs that take advantage of the ability of device 200 to perform movement. Examples of such interactions include using movement to communicate (e.g., to a user) a state (e.g., on, off, hibernating, and / or sleeping) of the device, to assist with user input (e.g., reduce a distance to a user) , and / or to augment interaction behavior of the device (e.g., moving in particular ways, during an interaction with a user, that convey information such as importance and / or direction of attention) . In some embodiments, the movement performed corresponds to (e.g., is in response to, is caused by, and / or is determined and / or performed based on) one or more of adetected input, a detected context (e.g., user context and / or environmental context) , and / or a state of device 200 (e.g., a state and / or a set of multiple states) . For example, device 200 can perform a movement of display portion 200-1 such that device 200 moves from being in the first configuration illustrated in FIG. 2A to being in the second configuration illustrated in FIG. 2B. In this example, device 200 can detect that a user has rearranged with respect to device 200 (e.g., the user stood up) , and in response, device 200 can perform the movement to the second configuration so that the display is at an optimized viewing angle based on the rearranged height and / or angle of the user's eyes with respect to the display of device 200. As another example, device 200 can perform a movement such that device 200 moves from being in the first configuration illustrated in FIG. 2A to being in the third configuration illustrated in FIG. 2C. In this example, device 200 can perform the movement to the third configuration in response to detecting a state with reduced activity (e.g., the "OFF" state as described herein) . In this way, the movement of device 200 to one or more configurations can indicate a state of device 200.

[0131] FIGS. 2A-2C illustrate device 200 having a display portion that is able to move with one degree of freedom via connection 200-3 connecting display portion 200-1 to base portion 200-2. In some embodiments, device 200 includes one or more components that provide device 200 with movement in one or more degrees of freedom. For example, a movement component (e.g., an output device that allows and / or causes movement) of device 200 can include multiple degrees of freedom (e.g., six degrees of freedom including three components of translation and three components of rotation) . For example, device 200 can be implemented to be able to move display portion 200-1 in a telescoping forward or backward motion (e.g., display portion200-1 moves forward while base portion 200-2 remains stationary, for example to reduce and / or extend a viewing distance for a user) . As yet another example, device 200 can be implemented to be able to move display portion 200-1 to rotate about an axis that is perpendicular to connection 200-3 such that display portion 200-1 can turn to position the display to follow a user as they walk around device 200. While the examples shown in FIGS. 2A-2C illustrate a hinge, other movement components can be included in device 200, such as an actuator (e.g., an electric actuator, a pneumatic actuator, and / or a hydraulic actuator) , a rotatable component, a movable base, and / or a rotatable base. In some embodiments, one or more movement components can cause device 200 to move in different ways, such as to rotate (e.g., 0-360 degrees) , to move laterally (e.g., left, right, up, down, and / or any combination thereof) , and / or to tilt (e.g., 0-360 degrees) .

[0132] FIG. 3 illustrates an exemplary block diagram of device 200. In some embodiments, device 200 includes some or all of the components described with respect to FIGS. 1A-1G, 2A-2C, and 5. As illustrated in FIG. 3, device 200 has bus 200-13 that operatively couples I / O section 200-12 (also referred to as an I / O subsection and / or an I / O interface) with processors 200-11 and memory 200-10. As illustrated in FIG. 3, I / O section 200-12 is connected to output devices 200-16. In some embodiments, output devices 200-16 include one or more visual output devices (e.g., a display component, such as a display, a touch-sensitive display, a display screen, and / or a projector) , one or more audio output devices (e.g., a speaker) , one or more haptic output devices (e.g., a device that causes vibration and / or other tactile output) , and / or one or more movement components (e.g., a motor, an actuator, a mechanical linkage, one or more devices that allow and / or cause movement, and / or one or more movement components asdescribed herein) . As illustrated in FIG. 3, output devices 200-16 include movement controller 200-17 and actuator 200-18. In some embodiments, movement controller 200-17 can be any component, such as a control device, that controls actuator 200-18. For example, movement controller 200-17 can provide control signals that cause actuator 200-18 to actuate (e.g., cause physical movement) . In some embodiments, movement controller 200-17 includes one or more logic components (e.g., a processor) , one or more feedback components (e.g., a sensor) , and / or one or more control components (e.g., for applying control signals, such as a switch, a relay, and / or a control line) . In some embodiments, actuator 200-18 can be any component that performs physical movement of a portion and / or of the entirety of device 200 and / or a device coupled to and / or in contact with device 200. In some embodiments, movement controller 200-17 and actuator 200-18 are embodied in the same device and / or component as each other (e.g., a dedicated onboard movement controller 200-17 that is affixed to actuator 200-18) . In some embodiments, movement controller 200-17 and actuator 200-18 are embodied in different devices and / or components from each other (e.g., one or more processors 200-11 can function as the movement controller 200- 17 of actuator 200-18) . In some embodiments, movement controller 200-17 and / or actuator 200-18 are embodied in one or more devices other than device 200. For example, device 200 can be coupled to (e.g., temporarily and / or removably) another device and can instruct movement controller 200-17 and / or control actuator 200-18 of the other device. In some embodiments, actuator 200-18 functions to cause one or more types of mechanical movement (e.g., linear and / or rotational) in one or more manners (e.g., using electric, hydraulic, magnetic, and / or pneumatic power) . Examples of actuator 200-18 include linear actuators, electromechanical actuators, and / or rotary actuators .

[0133] As illustrated in FIG. 3, I / O section 200-12 is connected to input devices 200-14. In some embodiments, input devices 200-14 include one or more physical input devices (e.g., a button, a touch-sensitive surface, a switch, a slider, and / or a rotatable input mechanism) , one or more visual input devices (e.g., a light sensor and / or a camera) , one or more audio input devices (e.g., a microphone) , and / or other input devices (e.g., a pressure sensor, a contact intensity sensor, a ranging sensor, an accelerometer, a GPS sensor, an accelerometer, a directional sensor, a compass, a gyroscope, a temperature sensor, a motion sensor, and / or a biometric sensor) . In addition, I / O section 200-12 can be connected with communication unit 200-15 for receiving application and / or operating system data, using for example Wi-Fi, near field communication ("NFC") , Bluetooth, cellular, and / or other wireless and / or wired communication techniques.

[0134] FIG. 3 illustrates exemplary block diagram of device 200. In some embodiments, device 200 includes some or all of the components described with respect to FIGS. 1A-1G, 3, and 5B . As illustrated in FIG. 3, device 200 has bus 200-13 that operatively couples I / O section 200-12 (also referred to as an I / O subsection and / or an I / O interface) with processors 200-11 and memory 200-10. As illustrated in FIG. 3, I / O section 200- 12 is connected to output devices 200-16 (also referred to herein as "output devices") . In some embodiments, output devices 200-16 include one or more visual output devices (e.g., a display component, such as a display, a display screen, a projector, and / or a touch-sensitive display) , one or more haptic output devices (e.g., a device that causes vibration and / or other tactile output) , one or more audio output devices (e.g., a speaker) , and / or one or more movement components (e.g., an actuator, a motor, a mechanical linkage, devices that cause and / or allow movement, and / or one or moremovement components as described above) . As illustrated in FIG. 3, output devices 200-16 include two exemplary movement components (e.g., movement controller 200-17 and actuator 200- 18) . Actuator 200-18 can be any component that performs physical movement (e.g., of a portion and / or of the entirety) of a device (e.g., device 200 and / or a device coupled to and / or in contact with device 200) . Movement controller 200-17 can be any component (e.g., a control device) that controls (e.g., provides control signals to) actuator 200-18. For example, movement controller 200-17 can provide control signals that cause actuator 200-18 to actuate (e.g., cause physical movement) . In some embodiments, movement controller 200-17 includes one or more logic component (e.g., a processor) , one or more feedback component (e.g., sensor) , and / or one or more control components (e.g., for applying control signals, such as a relay, a switch, and / or a control line) . In some embodiments, movement controller 200-17 and actuator 200-18 are embodied in the same device and / or component as each other (e.g., a dedicated onboard movement controller 200-17 that is affixed to actuator 200-18) . In some embodiments, movement controller 200-17 and actuator 200-18 are embodied in different devices and / or components from each other (e.g., one or more processors 200-11 can function as the movement controller 200-17 of actuator 200-18) . In some embodiments, movement controller 200-17 and / or actuator 200-18 are embodied in a device (or one or more devices) other than device 200 (e.g., device 200 is coupled to (e.g., temporarily and / or removably) another device and can instruct movement controller 200-17 and / or control actuator 200-18 of the other device) . Actuator 200-18 can function to cause one or more types of mechanical movement (e.g., linear and / or rotational) in one or more manners (e.g., using electric, magnetic, hydraulic, and / or pneumatic power) . Examples of actuator 200-18 can include electromechanical actuators, linear actuators, and / or rotary actuators.

[0135] As illustrated in FIG. 3, I / O section 200-12 is connected to input devices 200-14. In some embodiments, input devices 200-14 include one or more visual input devices (e.g., a camera and / or a light sensor) , one or more physical input devices (e.g., a button, a slider, a switch, a touch-sensitive surface, and / or a rotatable input mechanism) , one or more audio input devices (e.g., a microphone) , and / or other input devices (e.g., accelerometer, a pressure sensor (e.g., contact intensity sensor) , a ranging sensor, a temperature sensor, a GPS sensor, an accelerometer, a directional sensor (e.g., compass) , a gyroscope, a motion sensor, and / or a biometric sensor) . In addition, I / O section 200-12 can be connected with communication unit 200-15 for receiving application and operating system data, using Wi-Fi, Bluetooth, near field communication (NFC) , cellular, and / or other wireless (and / or wired) communication techniques.

[0136] In some embodiments, memory 200-10 of device 200 can be and / or include one or more non-transitory computer-readable storage mediums for storing computer-executable instructions, which, when executed by one or more computer processors 200- 11, cause computer processors 200-llto perform the techniques described herein, including processes 700, 900, 1000, 1200, 1400, 1500, 1700, 1900, and 2000 (e.g., FIGS. 7, 9, 10, 12, 14, 15, 17, 19, and 20) . A computer-readable storage medium can be any medium that can tangibly contain or store computerexecutable instructions for use by and / or in connection with the instruction execution device, apparatus, and / or system. In some embodiments, the storage medium is a non-transitory computer-readable storage medium. The non-transitory computer- readable storage medium can include, but is not limited to, optical, magnetic, and / or semiconductor storages. Examples ofsuch storage include magnetic disks, optical discs based on CD, DVD, and / or Blu-ray technologies, as well as persistent solid-state memory such as flash and solid-state drives. In some embodiments, the storage medium is a transitory computer- readable storage medium. Device 200 is not limited to the components and configuration of FIG. 3 but rather can include other and / or additional components in a multitude of possible configurations, all of which are intended to be within the scope of this disclosure.

[0137] FIG. 4 illustrates a functional diagram of actuator 200-18 in accordance with some embodiments. As described herein, actuator 200-18 can be and / or include any component that performs physical movement. In some embodiments, actuator 200-18 operates using one or more inputs, such as control signal 200-18A and / or energy source 200-18B. For example, actuator 200-18 can be a rotary actuator that converts electric energy into rotational movement. This rotational movement can cause the movement of the display portion of device 200 described herein with respect to FIGS. 2A-2C. For example, a counterclockwise rotational movement of the actuator can cause device 200 to move to a configuration having a larger angle (e.g., the second configuration illustrated in FIG. 2B) . For another example, a clockwise (e.g., opposite) rotational movement of the actuator can cause device 200 to move to a configuration having a smaller angle (e.g., the third configuration illustrated in FIG. 2C) . In some embodiments, control signal 200-18A can indicate one or more start and / or stop instructions, a goal configuration(e.g., pose and / or location) for movement and / or actuation, a movement and / or actuation speed, a movement and / or actuation direction, an amount of time to move and / or actuate, and / or one or more other characteristics of movement and / or actuation. In some embodiments, control signal 200-18A andenergy source 200-18B are the same signal and / or input. In some embodiments, one or more additional components (e.g., mechanical and / or electric) are coupled (e.g., removably or permanently) to actuator 200-18 for affecting movement and / or actuation (e.g., mechanical linkage such as gears, a lead screw, and / or one or more other components for changing a characteristic of movement and / or actuation) . In some embodiments, actuator 200-18 includes one or more feedback components (e.g., encoder, overcurrent sensor, position sensor, and / or force sensor) that form part of a feedback loop for monitoring, controlling, modifying, and / or ceasing movement and / or actuation (e.g., slowing actuation as a goal position is reached and / or ceasing actuation if physical resistance to actuation is detected via a sensor) . In some embodiments, the one or more feedback components are included (e.g., partially and / or wholly) in a movement controller (e.g., movement controller 200-17 of FIG. 3) operatively coupled to the actuator.

[0138] Attention is now turned to functionality (e.g., features and / or capabilities) of one or more devices, such as computer system 100, device 168, and / or device 200. One such functionality is implementing a "software object," which can alternatively be referred to as an agent, a virtual assistant, an intelligent virtual assistant, a software agent, an interactive virtual assistant, a personal assistant, an intelligent personal assistant, a virtual agent, an interactive personal assistant, an intelligent interactive personal assistant, and / or an artificial intelligence ("Al") assistant. In some embodiments, a system software object is a software object provided by an operating system (e.g., of a device and / or a computer system) . In some embodiments, an application software object is a software object provided by an application.

[0139] In some embodiments, a user is (and / or represents, includes, and / or is included in) one or more of a subject, person, animal, and / or object in an environment (e.g., a physical and / or virtual environment) , such as an environment of the device. In some embodiments, a user is (and / or represents, includes, and / or is included in) an entity that is perceived (e.g., detected by the device, one or more other devices, and / or one or more components thereof) . In some embodiments, an entity is something that is distinguished from surrounding entities (e.g., pieces of environments and / or other users) and / or that is considered as a discrete logical construct via one or more components (e.g., perception components and / or other components) . In some embodiments, a user is physical. For example, a physical user can represent a user standing in front of, and being perceived by, the device. In some embodiments, a user is virtual. For example, a virtual user can represent an avatar in a virtual scene perceived by the device (e.g., the avatar is detected in a media stream received by the device and / or captured by a camera of the device) . Although presented above as examples of a "user," the terms and / or concepts referred to as "subject," "person," "animal," and / or "object" can be interchanged with "user" throughout this disclosure, unless explicitly indicated otherwise. For example, use the term "user" can likewise be understood to also refer to "user, " unless explicitly indicated otherwise. In some embodiments, a software object refers to a set of one or more functions implemented in hardware and / or software (e.g., locally and / or remotely) on a software system (e.g., a single device and / or multiple devices) .

[0140] As an example, with reference to FIGS. 2A-2C, a software object implemented at least partially on device 200 can perform operations that cause display portion 200-1 ofdevice 200 to move with respect to base portion 200-2. For example, the software object detects (e.g., perceives and determines the occurrence of) a context that includes the user standing up (e.g., based on facial detection and tracking) . In this example, in response to detecting the context that includes the user standing up, the software object causes device 200 to open and / or device 200 opens display portion 200-1 to the larger angle. As another example, the software object can detect verbal input that corresponds to (e.g., is interpreted as and / or that refers to an operation that includes) a request to move the display (e.g., "Please enter sleep mode" or "Please move my display") . In this example, in response to detecting the verbal input that corresponds to the request to move the display, the software object causes device 200 to move and / or device 200 moves display portion 200-1. In some embodiments, a software object performs operations to perceive an environment, interact with users, learn skills, retrieve knowledge, acquire knowledge, and / or perform tasks. The software object can, for example, perform these and / or other operations in response to user input and / or automatically (e.g., at an appropriate time determined based on a perceived context) .

[0141] FIG. 5 illustrates a functional diagram of an exemplary software system 200-20. As illustrated in FIG. 5, software system 200-20 is illustrated as a box with a boundary that encloses input devices 200-22, software object components 200- 24, and output devices 200-26. In some embodiments, software system 200-20 includes more, fewer, and / or different components than those that are illustrated in FIG. 5. In some embodiments, software system 200-20 is implemented on a single device (e.g., computer system 100, device 168, or device 200) . In some embodiments, software system 200-20 is implemented on multiple devices. In some embodiments, one or more componentsof software system 200-20 illustrated in and / or described with respect to FIG. 5 are external to but operatively coupled to software system 200-20 (e.g., an external device, an external sensor, an external actuator, an external display component, an external speaker, an accessory, and / or an external database) . In some embodiments, one or more components of software system 200-20 are local to one or more other components of software system 200-20. In some embodiments, one or more components of software system 200-20 are remote from one or more other components of software system 200-20.Examples of operations for and / or with which a software object can be used include providing intelligent interaction capabilities (e.g., due to in part to one or more machinelearning ("ML") models such as a large language model ("LLM") ) for responding and / or causing operations to be performed; performing tasks (e.g., a set of operations for achieving a particular goal) (e.g., automatically and / or intelligently ) detecting, recognizing, and / or classifying a user in the environment; detecting and / or responding to input (e.g., air gestures, verbal input, and / or physical input, such as touch input and / or force inputs to physical hardware components (e.g., knobs, button, and / or sliders) ) ; tracking a user's face, eyes, and / or body (e.g., to move with the user and / or identify an activity and / or intent of the user) ; detecting context (e.g., user context, environmental context, and / or operating context) ; moving (e.g., changing location, position, orientation, and / or pose) ; and / or performing one or more operations in response to input, context, and / or stimulus (e.g., an object or event that is external and / or internal to the device and that causes one or more responsive operations by a device) . In some embodiments, a software object performs operations in response to non-contact inputs, such as air gestures and / or natural language commands. The preceding list is meant to be illustrative of operations that can beperformed using a software object but is not meant to be an exhaustive list. It should be recognized that other operations fall within the intended scope of the capabilities of a software object.

[0142] In some embodiments, input devices 200-22 includes components for performing sensing and / or communications functions of software system 200-20. As illustrated in FIG. 5, input devices 200-22 includes one or more sensors 200-22A. One or more sensors 200-22A can include any component that functions to detect data corresponding to a physical environment. Examples of one or more sensors 200-22A include a contact sensor, a camera, a light sensor, a microphone, an accelerometer, a position sensor, a pressure sensor, a temperature sensor, and / or an olfactory sensor. This list is not intended to be exhaustive, and one or more sensors 200-22A can include other sensors not explicitly identified herein that detect, generate, and / or otherwise provide data that can be used (e.g., stored, processed, and / or transformed) for detecting data corresponding to a physical environment. As illustrated in FIG. 5, input devices 200-22 includes one or more communications components 200-22B. One or more communications components 200-22B can include any component that functions to send and / or receive communications (e.g., a network interface component, an antenna, an encoder, a decoder, a modem, and / or a communication protocol stack) internal and / or external to software system 200-20. Communications components 200-22B can be between different devices and / or between components of the same device. The communications can include control signals and / or data (e.g., instructions, files, application data, messages, and / or media streams) . In some embodiments, input devices 200-22 includes more, fewer, and / or different components than thoseillustrated in FIG. 5. In some embodiments, input devices 200- 22 are implemented in hardware and / or software.

[0143] In some embodiments, software object components 200-24 includes components that manage and / or carry out functions of a software object of software system 200-20. As illustrated in FIG. 5, software object components 200-24 includes the following functional components: coordination, task flow, and / or orchestration component 200-24A, administration component 200-24B, perception component 200-24C, evaluation component 200-24D, interaction component 200-24E, policy and decision component 200-24F, knowledge component 200-24G, learning component 200-24H, models component 200-241, and APIs component 200-24J. Each of these components is described herein. Notably, this list of software object components 200- 24 is not intended to be exhaustive, and software object components 200-24 can include other functional components not explicitly identified herein that can be used (e.g., processed, stored, and / or transformed) for performing any function of a software object, such as those described herein. In some embodiments, software object components 200-24 includes more, fewer, and / or different components than those illustrated in FIG. 5. In some embodiments, software object components 200-24 is implemented in hardware and / or software.

[0144] In some embodiments, task flow, coordination, and / or orchestration component 200-24A performs operations that enable a software object to handle coordination between various components. For example, operations can include handling a data processing task flow to move from perception component 200-24C (e.g., that detects speech input) to models component 200-241 (e.g., for processing the detected speech input using a large language model to determine content and / or intent of the speech input) . In some embodiments, task flow, coordination, and / or orchestration component 200-24A performsoperations that enable a software object to handle coordination between one or more external components (e.g., resources) . For example, FIG. 5 illustrates examples of external components, such as external database 200-30. In some embodiments, administration component 200-24B includes functionality performed by an operating system of a device implementing software system 200-20. In some embodiments, administration component 200-24B includes functionality performed by one or more applications of a device implementing software system 200-20.

[0145] In some embodiments, administration component 200-24B performs operations that enable a software system to handle administrative tasks like managing system and / or component updates, managing user accounts, managing system settings, and / or managing component settings. In some embodiments, administration component 200-24B includes functionality performed by an operating system of a device implementing software system 200-20. In some embodiments, administration component 200-24B includes functionality performed by one or more applications of a device implementing software system 200-20.

[0146] In some embodiments, perception component 200-24C performs operations that enable a software object to perceive environmental input. For example, operations can include detecting that a context and / or environmental condition has occurred, detecting the presence of a user (e.g., subject, person, animal, and / or object in an environment) , detecting characteristics (e.g., visible and / or non-visible) of a user, detecting an input that includes speech, detecting an input that includes an air gesture, detecting facial expressions, and / or detecting verbal and / or physical cues. In some embodiments, perception component 200-24C includes functionality performed by an operating system of a deviceimplementing software system 200-20. In some embodiments, perception component 200-24C includes functionality performed by one or more applications of a device implementing software system 200-20.

[0147] In some embodiments, evaluation component 200-24D performs operations that enable a software object to process evaluate data (e.g., to determine a context such as an environmental context, a user context, and / or an operating context) . For example, operations can include evaluating data gathered from perception component 200-24C, knowledge component 200-24G, external database 200-30, and / or remote processing resource 200-32. In some embodiments, evaluation component 200-24D includes functionality performed by an operating system of a device implementing software system 200- 20. In some embodiments, evaluation component 200-24D includes functionality performed by one or more applications of a device implementing software system 200-20.

[0148] Reference is made herein to environmental context (also referred to herein as a "context of an environment" and / or "a context corresponding to an environment") . In some embodiments, an environmental context is a context based on one or more characteristics of the environment (e.g., users, time, weather, locations, and / or lighting) . For example, an environmental context can include that it is daytime, that it is raining outside, and / or that a device is currently located in a park. In some embodiments, a device (e.g., using a software object) determines an environmental context (e.g., to be currently true, applicable, and / or occurring) using one or more of detecting input (e.g., via one or more input devices) and / or receiving data (e.g., from one or more other devices and / or components in communication with the device) .

[0149] Reference is made herein to user context (also referred to herein as a "context of a user" and / or "a context corresponding to a user") (and / or a user context) . In some embodiments, a user context is a context based on one or more characteristics of the user (and / or a user) . For example, a user context can include the user's appearance and / or actions, behavior, movement, clothing, personality, location, and / or pose. In some embodiments, a device (e.g., using a software object) determines a user context (e.g., to be currently true, applicable, and / or occurring) using one or more of detecting input (e.g., via one or more input devices) and / or receiving data (e.g., from one or more other devices and / or components in communication with the device) . In some embodiments, a device determines user context based on historical context and / or learned characteristics of the user, where one or more characteristics of the user are learned and / or stored over a period of time by the device.

[0150] Reference is made herein to operational context (also referred to herein as a "context of operation" and / or an "operating context") . In some embodiments, an operational context is a context based on one or more characteristics of the operation of a device (e.g., the device determining and / or accessing the operational context and / or one or more other devices) . For example, an operational context can include the state of the device (and / or of one or more components of the device) , an internal dialogue of the device (e.g., the device's understanding of a context) , operations being performed by the device, applications and / processes that are executing (e.g., open and / or running) on the device. In some embodiments, a device (e.g., using a software object) determines an operational context (e.g., to be currently true, applicable, and / or occurring) using one or more of detecting input (e.g., via one or more input devices) and / or receivingdata (e.g., from one or more other devices and / or components in communication with the device) . In some embodiments, a device (e.g., using a software object) determines an operational context (e.g., to be currently true, applicable, and / or occurring) using one or more states (e.g., retrieved, accessed, and / or queried by a process of the device) .

[0151] In some embodiments, interaction component 200-24E performs operations that enable a software object to manage and / or perform interactions with users. For example, operations can include determining an appropriate interaction model for a particular context and / or in response to a particular input. In some embodiments, interaction component 200-24E includes functionality performed by an operating system of a device implementing software system 200-20. In some embodiments, interaction component 200-24E includes functionality performed by one or more applications of a device implementing software system 200-20.

[0152] In some embodiments, policy and decision component 200- 24F performs operations that enable a software object to take actions in view of available data. For example, operations can include determining which operations to perform and / or which functional components to utilize in response to a detected context. In some embodiments, policy and decision component 200-24F includes functionality performed by an operating system of a device implementing software system 200-20. In some embodiments, policy and decision component 200-24F includes functionality performed by one or more applications of a device implementing software system 200-20.

[0153] In some embodiments, knowledge component 200-24G performs operations that enable a software object to access and use stored knowledge. For example, operations can include indexing, storing, and / or retrieving data from a database, adata store, and / or other resource. In some embodiments, knowledge component 200-24G includes functionality performed by an operating system of a device implementing software system 200-20. In some embodiments, knowledge component 200- 24G includes functionality performed by one or more applications of a device implementing software system 200-20.

[0154] In some embodiments, learning component 200-24H performs operations that enable a software object to learn through experiences. For example, operations can include observing and / or keeping track of data that includes user characteristics, routines, preferences, and / or environmental characteristics in a manner that allows such data to be used to inform future operations by the software object and / or a component thereof (e.g., such as when performing tasks and / or interactions with users) . In some embodiments, learning component 200-24H includes functionality performed by an operating system of a device implementing software system 200- 20. In some embodiments, learning component 200-24H includes functionality performed by one or more applications of a device implementing software system 200-20.

[0155] In some embodiments, models component 200-241 performs operations that enable a software object to apply ML models (e.g., such as a large language model or "LLM") to process data. For example, operations can include executing ML models, storing ML models, training and / or re-training ML models, and / or otherwise managing aspects of implementing ML models. In some embodiments, models component 200-241 includes functionality performed by an operating system of a device implementing software system 200-20. In some embodiments, models component 200-241 includes functionality performed by one or more applications of a device implementing software system 200-20.

[0156] In some embodiments, software system 200-20 responds to natural language input. For example, software system 200-20 responds to a natural language input that is in the form of a question, a command, a statement, and / or a request. In some embodiments, software system 200-20 outputs text and / or speech output that is provided in a natural language or mimicking a natural language style. For example, software system 200-20 can process the natural language question "How hot is it outside?" with a speech response that indicates the current temperature outside at the user's location (e.g., "It is 18 degrees outside") . In some embodiments, software system 200-20 responds to natural language input by providing information (e.g., travel, weather, and / or calendar information) and / or performing a task (e.g., searching a database, opening a document, and / or opening an application) .

[0157] In some embodiments, software system 200-20 includes and / or relies on one or more data models to process input (e.g., natural language input, visual input, gesture input, and / or other data input) and / or provide output (e.g., output of information via visual output, audio output, natural language output, and / or textual output) . Such data models can include and / or be trained using user data (e.g., based on particular interactions and / or data from the user being interacted with) and / or global data (e.g., general data based on interactions and / or data from many users) . For example, user data (e.g., previous use of language and / or phrases, preferences, calendar entries, a contact list, and / or activity data) can be used to better infer user intent and / or provide responses that are more likely to address a user's request. In some embodiments, data models used by software system 200-20 include, are used by, and / or are implemented using one or more machine-learning components (e.g., hardware, software, and / or one or more neural networks) . Such machine-learning componentscan be used to process verbal input to determine words and / or phrases therein, a user intent corresponding to the words, one or more contexts that correspond to the words, one or more confidence scores, and / or a set of one or more actions to take in response to the verbal input. Analogous operations can be performed to process other types of inputs, such as data input, visual input, and / or textual input. Such data models can include machine-learning and / or data-processing models, including, but not limited to, language models, speech recognition models, natural language processing models, object recognition models, visual processing models, ontologies, task flow models, and / or intent recognition models (e.g., used to determine user intent) .

[0158] In some embodiments, Application Programming Interfaces (APIs) component 200-24J performs operations that enable a software object to interface with services, devices, and / or components. For example, operations can include relaying data (e.g., responses, requests, and / or other messages) between data interfaces (e.g., between software programs, between a system process and application process, between system processes, between application processes, between communication protocols, between a client and a server, between file systems, and / or between components on different sides of a trust boundary) . In some embodiments, the data interfaces served by APIs component 200-24J are local (e.g., to the device, such as two application processes exchanging data) and / or remote (e.g., from the device, such as interfacing with a web service via a remote server) . In some embodiments, APIs component 200-24J includes functionality performed by an operating system of a device implementing software system 200-20. In some embodiments, APIs component 200-24J includes functionality performed by one or more applications of a device implementing software system 200-20.

[0159] In some embodiments, output devices 200-26 includes components for performing output functions of software system 200-20. The exemplary output devices illustrated in FIG. 5 are described briefly below. In some embodiments, output devices 200-26 include fewer components, more, and / or different components than those illustrated in FIG. 5. In some embodiments, output devices 200-26 are implemented in hardware and / or software.

[0160] As illustrated in FIG. 5, output devices 200-26 includes one or more visual output devices 200-26A. One or more visual output devices 200-26A can include any component that functions to output (e.g., create, generate, and / or display) , and / or cause output of, a visual output (e.g., an output that is visually perceptible, such as playback of visual media content, a graphical user interface, and / or lighting) . Examples of one or more visual output devices 200- 26A include a display component, a light-emitting diode ("LED") , a projector, a head mounted display ("HMD") , and / or a component that creates visually perceptible effects (e.g., movement) . This list is not intended to be exhaustive, and one or more visual output devices 200-26A can include other visual output devices not explicitly identified herein that detect, generate, and / or otherwise provide data that can be used (e.g., stored, processed, and / or transformed) for outputting visual output.

[0161] As illustrated in FIG. 5, output devices 200-26 include one or more audio output devices 200-26B. One or more audio output devices 200-26B can include any component that functions to output (e.g., create and / or generate) , and / or cause output of, an audio output (e.g., an output that is audibly perceptible, such as a sound, speech, music, and / or audio media content) . Examples of one or more audio output devices 200-26B include a speaker, a tone generator, an audioamplifier, and / or a component that creates audibly perceptible effects (e.g., movement such as vibrations) . This list is not intended to be exhaustive, and one or more audio output devices 200-26B can include other audio output devices not explicitly identified herein that generate, detect, and / or otherwise provide data that can be used (e.g., stored, processed, and / or transformed) for outputting audio output.

[0162] As illustrated in FIG. 5, output devices 200-26 include one or more movement output devices 200-26C (also referred to herein as a "movement component") . One or more movement output devices 200-26C can include any component that functions to output (e.g., create and / or generate) , and / or cause output of, a movement output (e.g., an output that includes physical movement of the device and / or another device / component ) . Examples of one or more movement output devices 200-26C include a movement controller, an electromechanical device, an actuator, a mechanical linkage, and / or a component that creates physical movement. This list is not intended to be exhaustive, and one or more movement output devices 200-26C can include other movement output devices not explicitly identified herein that detect, generate, and / or otherwise provide data that can be used (e.g., stored, processed, and / or transformed) for outputting movement output. As illustrated in FIG. 5, output devices 200-26 include one or more haptic output devices 200-26D. One or more haptic output devices 200- 26D can include any component that functions to output (e.g., create, generate, and / or display) , and / or cause output of, a haptic output (e.g., an output that is physically perceptible using tactile sensation, such as a vibration, pressure, texture, and / or shape) . Examples of one or more haptic output devices 200-26D include a speaker, a component that generates vibrations, a component that generates pressure changes, a component that generates texture changes, and / or a componentthat creates perceivable tactile effects. This list is not intended to be exhaustive, and one or more haptic output devices 200-26D can include other haptic output devices not explicitly identified herein that detect, generate, and / or otherwise provide data that can be used (e.g., stored, processed, and / or transformed) for outputting haptic output.

[0163] As illustrated in FIG. 5, output devices 200-26 include one or more communications components 200-26E. One or more communications components 200-26E can include any component that functions to send and / or receive communications (e.g., a network interface component, an antenna, an encoder, a decoder, a modem, and / or a communication protocol stack) internal and / or external to software system 200-20. In some embodiments, the communications can be between different devices and / or between components of the same device. In some embodiments, the communications can include control signals and / or data (e.g., instructions, files, application data, messages, and / or media streams) . In some embodiments, one or more communications components 200-26E includes one or more features of one or more communications components 200-22B (e.g., as described herein) . In some embodiments, one or more communications components 200-26E are the same as one or more communications components 200-22B (e.g., one or more components that handle communication inputs and outputs and thus be considered as either and / or both an input device and an output device) .

[0164] For the purposes of this disclosure, a software object does not need to include all of the functionality mentioned herein but rather can include less functionality or more functionality. For example, a software object can be implemented on a software system that does not have movement functionality but that otherwise includes an intelligent personal assistant that can interact with a user.

[0165] Throughout this disclosure, reference can be made to movement output (e.g., referred to in various forms, such as movement, output of movement, device movement, movement output, output of motion, device motion, and / or motion output) . In some embodiments, outputting (e.g., causing output of) movement refers to movement of an electronic device (e.g., a portion or component thereof relative to another portion and / or of the whole electronic device) . For example, referring back to FIG. 2B, movement output can refer to device 200 actuating movement component 200-3 to move display portion 200-1 to the position illustrated in FIG. 2B (e.g., from the position in FIG. 2A) . In some embodiments, movement output is not (e.g., does not include and / or does not only include) haptic output (e.g., haptic movement output) . In some embodiments, movement output is not (e.g., does not include and / or does not only include) vibration output. In some embodiments, movement output is not (e.g., does not include and / or does not only include) oscillating movement (e.g., movement of an actuator that merely causes vibration by moving a component repeatedly along a path that is internal to the device) . In some embodiments, movement output includes (e.g., requires and / or results in) changing a location and / or pose of at least a portion of (and / or the entirety of) a component or the electronic device. In some embodiments, movement output includes output that moves at least a portion of (and / or the entirety of) a component or the electronic device from a first location and / or first pose to a second location and / or second pose. For example, with respect to FIGS. 2A-2C, display portion 200-1 is shown in a different location (e.g., in space) and pose (e.g., relative to base portion 200-2) in each of FIGS. 2A, 2B, and 2C. In some embodiments, movement output includes output that moves at least a portion (and / or the entirety of) a component or the electronic device to a third location and / or third pose (e.g., from the first locationand / or first pose and / or from the second location and / or the second pose) . In some embodiments, the third location and / or the third pose is the same as the first location and / or first pose and / or as the second location and / or the second pose. For example, movement output can include device 200 in FIG. 2A beginning from the first position illustrated in FIG. 2A, moving to the second position illustrated in FIG. 2B, and moving to return to the first position illustrated in FIG. 2A. For example, movement output can include device 200 in FIG. 2A beginning from the first position illustrated in FIG. 2A, moving to the second position illustrated in FIG. 2B, and continuing movement to come to rest at the third position illustrated in FIG. 2C.

[0166] Throughout this disclosure, an electronic device can be illustrated in (and / or described as being in) different locations and / or poses at different times. For example, in FIG. 2A illustrates device 200 in the first position, FIG. 2B illustrates device 200 in the second position, and FIG. 2A illustrates device 200 in the third position. In some embodiments, the electronic device moves itself between such locations and / or poses (e.g., using movement output) . For example, device 200 moves from the first position to the second position under its own power (e.g., using a power source and one or more actuators to cause movement) . In particular, any example herein that illustrates and / or describes an electronic device being at different locations and / or poses (e.g., at different times) should be understood to cover a scenario in which the device moved itself between such locations and / or poses (e.g., unless otherwise clearly indicated) .

[0167] Throughout this disclosure, reference can be made to "causing output," "performing output," and / or "outputting" (e.g., by one or more output generation devices and / or by oneor more output generation components) . In some embodiments, outputting (e.g., or the aforementioned variants) includes (and / or is) outputting movement (e.g., movement output as described herein) .

[0168] Throughout this disclosure, reference can be made to "causing display of," "displaying," and / or "outputting visual content" (e.g., by one or more display components) . In some embodiments, displaying (e.g., or the aforementioned variants) includes displaying visual content in connection with outputting movement (e.g., movement output as described herein) .

[0169] Throughout this disclosure, reference can be made to "causing output of audio," "outputting audio," and / or "providing audio output" (e.g., by one or more audio generation components and / or by one or more audio output devices) . In some embodiments, outputting audio (e.g., or the aforementioned variants) includes outputting audio content in connection with outputting movement (e.g., movement output as described herein) .

[0170] Throughout this disclosure, reference can be made to movement of an avatar (or other representation of a user, a software object, and / or a character that is displayed) (e.g., by one or more display components) . In some embodiments, moving an avatar (e.g., or the aforementioned variants) includes displaying movement of visual content in connection with outputting movement (e.g., movement output as described herein) . For example, displaying an avatar nodding in agreement can include movement of the electronic device in a similar manner as the avatar movement (e.g., mimicking nodding) . In some embodiments, moving an avatar (e.g., or the aforementioned variants) includes outputting movement (e.g., movement output as described herein) without displayingmovement of visual content. For example, a device can perform movement output that mimics nodding without moving a displayed avatar (e.g., the avatar does not move relative to the display) . As illustrated in FIG. 5, software system 200-20 can optionally interface with external components such as external database 200-30, remote processing component 200-32, and / or remote administration component 200-34. In some embodiments, external database 200-30 represents one or more functions that provide data storage resources accessible to software system 200-20. In some embodiments, access to the data of external database 200-30 is provided directly to software system 200-20 (e.g., the software system manages the database) and / or indirectly to software system 200-20 (e.g., a database is managed by a different system, but data stored therein can be provided and / or stored for use by software system 200-20) . In some embodiments, external database 200-30 is dedicated to (e.g., only for use by) software system 200-20, is not dedicated to software system 200-20 (e.g., is a database of a web service accessible to different software systems) , and / or is a combination of both dedicated and non-dedicated database resources. In some embodiments, remote processing component 200-32 represents one or more components that function as a data processing resource that is accessible to software system 200-20. In some embodiments, access to remote processing component 200-32 is provided directly to software system 200- 20 (e.g., the software system manages the processing resources) and / or indirectly to software system 200-20 (e.g., a processing resource managed by a different system, but that can provide data processing for the benefit of software system 200-20) . In some embodiments, remote processing component 200- 32 is dedicated to (e.g., only for use by) software system 200-20, is not dedicated to software system 200-20 (e.g., is a processing resource of a web service accessible to different software systems) , and / or is a combination of both dedicatedand non-dedicated processing resources. Examples of data processing include processing image data (e.g., for feature extraction and / or object detection) , processing audio data (e.g., for processing natural language speech input via a large language model) , and / or training a machine-learning algorithm and / or model. In some embodiments, remote administration component 200-34 represents functions that include and / or are related to administrative functions. For example, such administrative functions can include providing component updates to software system 200-20 (e.g., software and / or firmware updates) , managing accounts (e.g., permissions, access control, and / or preferences associated therewith) , synchronizing between different software systems and / or components thereof (e.g., such that a software object accessible via multiple devices of a user can provide a consistent user experience between such devices) , managing cooperation with other services and / or software systems, error reporting, managing backup resources to maintain software system reliability and / or software object availability, and / or other functions required by software system 200-20 to perform operations, such as those described herein.

[0171] The various components of software system 200-20 described above with respect to FIG. 5 represent functional blocks that represent functionality. This functionality can be implemented on the same and / or different hardware (e.g., physical components) and / or by the same and / or different software. For example, the functional blocks can be implemented using one or more physical components, devices (e.g., computer system 100, device 168, and / or device 200) , and / or software programs. In other words, each functional block does not necessarily represent a single, discrete physical component, device, and / or software program, but can be implemented using one or more of these. Further, softwaresystem 200-20 can include multiple implementations of functionality represented by a respective functional block. For example, software system 200-20 can include multiple different model components representing ML models that are used in different contexts, can include multiple different API components representing different APIs that are used for different services, and / or can include multiple different visual output devices that are used for outputting different types of visual output.

[0172] Attention is now turned to discussion of concepts that can arise with respect to operation of a software object.

[0173] As discussed throughout, a software object can be capable of interacting with a user. In some embodiments, this capability includes the ability to process explicit requests, commands, and / or statements. In some embodiments, explicit requests, commands, and / or statements include and / or are interpreted as instructions directed to accomplishing a task (e.g., display X, complete task Y, and / or perform operation Z) . In some embodiments, a software object includes the ability to process implicit requests, commands, and / or statements. In some embodiments, an implicit command, request, and / or statement does not include an explicit command, request, and / or statement. For example, "I like going to Africa," can be interpreted as an implicit command, request, and / or statement which, in response to detecting, device 200 displays an itinerary in response to the statement. As another example, "This picture is for my grandmother," can be interpreted as an implicit command, request, and / or statement which, in response to detecting, device 200 displays suggestions for modifying the picture. As another example, "I'm so tired," can be interpreted as an implicit command, request, and / or statement which, in response to detecting, device 200 causes a sleep meditation application to begin ameditation session. As yet another example, "I miss my grandad" can be interpreted as an implicit command, request, and / or statement when, in response to detecting, device 200 can initiate a live communication session (e.g., video call, telephone call, and / or text messaging session) with grandad. In some embodiments, an implicit request is more likely to be processed according to one or more current environmental context, operational context, and / or user context, while an explicit request is less likely to be processed according to one or more current environmental context, operational context, and / or user context. For example, the phrase, "call my grandad," can be an explicit request, and in response to detecting the request, device 200 will initiate a live communication session with grandad, irrespective of one or more current environmental context, operational context, and / or user context. However, the phrase, "I miss my grandad," can be an implicit request, and in response to detecting the request, device 200 can display a list of gifts to buy for grandad if a user has been recently talking about buying gifts or could call grandad in another context that does not include the user recently discussing buying gifts. In some embodiments, a request can include one or more explicit requests and one or more implicit requests. In some embodiments, an implicit request is responded to independently from an explicit request, and in other embodiments, a response to an implicit request is dependent on an explicit request.

[0174] Reference can be made herein to a response by a software object that is output by a device. In some embodiments, a response includes an audio portion (e.g., audio output, sound, acoustic output, and / or speech) (also referred to herein as a "verbal response," an "audio response," and / or an "acoustic response) and / or a visual portion (e.g., display and / or movement of a representation and / or avatar) . In someembodiments, a response includes a movement portion (e.g., movement of the device) . In some embodiments, a response includes a haptic portion (e.g., touch and / or vibration) .

[0175] Reference can be made herein to an internal context, internal dialogue, and / or an operational context, which can refer to a dynamic context or dynamic decision-making process of the device, a state of device 200, and / or internal data on which the device is partially basing its decision. In some embodiments, an internal dialogue includes a set of one or more rules, detections, characteristics, and / or observations that the computer system uses to generate a response to one or more commands, questions, and / or statements) . In some embodiments, the set of one or more rules, detections, characteristics, and / or observations are learned and / or generated via deep learning and / or one or more machinelearning algorithms, and / or using one or more machine-learning and / or system software objects. In some embodiments, an internal dialogue is generated in real-time. In some embodiments, an internal dialogue is locally stored and / or stored via the cloud. In some embodiments, an internal dialogue can be modified, updated, and / or deleted. In some embodiments, an internal dialogue is generated based on other internal dialogues.

[0176] Reference can be made herein to personality and / or behavior (or a representation of personality / behavior ) (e.g., of a software object, user, and / or character) . In some embodiments, personality and / or behavior refers to a set of one or more characteristics that the device detects, applies, has knowledge of, conforms to, and / or tracks. In some embodiments, the personality or behavior is used as basis to perform operations. For example, a software object can detect a user' s personality and respond in a manner based on the personality (e.g., output different responses in response todifferent user personalities) . As another example, the software object can output a response having characteristics that correspond to one or more characteristics that correspond to the personality and / or behavior (e.g., output a response in different ways that depend on personality of the software object) . In some embodiments, such characteristics represent and / or mimic personality of a user, such as how the user acts and / or speaks. In some embodiments, such characteristics approximate a user's personality.

[0177] In some embodiments, a software object is a system software object. In some embodiments, a system software object is a software object that corresponds to a process that originates from and / or is controlled by an operating system of the device (e.g., the device implementing the software object) . In some embodiments, a software object is an application software object. In some embodiments, an application software object is a software object that corresponds to a process that originates from and / or is controlled by an application of (e.g., installed on and / or executed by) the device (e.g., the device implementing the software object) .

[0178] Reference can be made herein to a representation (e.g., an avatar and / or avatar representation) of a software object (and / or of a user, subject, person, animal, and / or object) and / or a user interface object (e.g., an animated character) . In some embodiments, a representation of a software object refers to a set of output characteristics (e.g., visual and / or audio) of the software object (and / or the user and / or the user interface object) . For example, a representation of a software object can include (and / or correspond to) a set of one or more visual characteristics (e.g., facial features of an animated face) and / or one or more audio characteristics (e.g., language and voice characteristics of audio output) . In someembodiments, a representation (e.g., of a software object) is used to represent output by the software object. For example, a device implementing an interactive software object outputs audio in a voice of the software object and displays an animated face of the software object moving in a manner to simulate the software object speaking the audio output. In this way, a user can feel like they are having a normal conversation with the software object. In some embodiments, a representation of a software object is (or is not) inclusive of personality and / or behavior characteristics (e.g., as described herein) . For example, a representation of a software object can include (and / or correspond to) a set of visual characteristics (e.g., facial features of an animated face) and also a set of personality characteristics. In some embodiments, a representation of a software object includes a set of user characteristics that correspond to visual representation of a user (e.g., representations of a user's appearance, voice, and / or personality are used as an avatar that appears to move and / or speak) . In some embodiments, a representation is a representation of a face (e.g., a user interface object that is output having features that simulate a face and / or facial expressions of a person (e.g., for conveying information to a viewer) ) .

[0179] In some embodiments, a character (e.g., of a software object and / or avatar) refers to a particular set of characteristics of a representation. For example, an avatar can take on (e.g., use, interact with, apply, and / or output according to) characteristics of a fictional and / or non- fictional character (e.g., from a book, a show, a movie, a series, and / or popular culture) .

[0180] In some embodiments, a voice (e.g., of a software object and / or avatar) refers to a set of one or more characteristics corresponding to sound output that resembles(e.g., represents, mimics, and / or recreates) vocal utterance (e.g., attributable and / or simulated as being output by a software object and / or avatar) . For example, device 200 can output a sentence that sounds different depending on a voice used. In some embodiments, a particular character and / or avatar can be configured to use a particular voice (e.g., have a corresponding voice) . In some embodiments, the particular voice can mimic a user's voice.

[0181] In some embodiments, an appearance (e.g., of a software object and / or avatar) refers to a set of one or more characteristics corresponding to visual output that represents an avatar (and / or a software object) . For example, device 200 can output an avatar that has a set of facial features forming an appearance that resembles a particular character from a movie .

[0182] In some embodiments, an expression of an avatar refers to a set of one or more characteristics corresponding to a particular visual appearance of a user, an avatar, and / or a software object. For example, device 200 can output an avatar that has a set of facial features arranged in a particular way to give the appearance of a facial expression (e.g., which can be used as a form of non-verbal communication to a user)(e.g., a frown is an expression of sadness, a smile is an expression of happiness, and / or wide open eyes is an expression of surprise) . As another example, device 200 can output an avatar that has a set of body features (e.g., arms and / or legs) arranged in a particular way to give the appearance of a body expression (e.g., which can be used as a form of non-verbal communication to a user) (e.g., a hand gesture is an expression of approval, covering eyes is an expression of fear, and / or shrugging shoulders is an expression of lack of knowledge) . In some embodiments, an expression includes movement (e.g., a head nod is anexpression of agreement and / or disagreement) of the avatar. In some embodiments, device 200 can move, via the movement component, to indicate an expression with or without the avatar moving. In some embodiments, a software object performs one or more operations that depend on a user' s expression (e.g., detects if a person is sad and responds with a kind statement or question) . In some embodiments, expressions (e.g., whether and / or how they are used and / or how they are output) depends on personality. For example, a first personality can use a particular expression more than a second personality. As another example, an expression (e.g., smile, frown, and / or how wide eyes are opened) for the first personality can appear different from the expression (and / or a similar and / or equivalent expression) for a second personality (e.g., the first personality smiles in a manner that reveals teeth, but the second personality smiles without revealing teeth) .

[0183] In some embodiments, a software object (e.g., an avatar of the software object and / or a software system (e.g., hardware and / or software) implementing the software object) mimics characteristics of another user, software object, and / or character (e.g., in personality, behavior, expressions, and / or voice) . In some embodiments, mimicking includes mirroring a user (e.g., copying use of a phrase and / or movement detected from a user interacting with the software object) . In some embodiments, mimicking characteristics of a user includes attempting to reproduce the characteristics of the user (e.g., in the exact same manner and / or in manner that resembles the characteristics but is not an exact reproduction of the characteristics) . For example, a software object mimicking voice and / or expressions does not require the software object have the exact same voice and / or expressionsas the user being mimicked (e.g., but rather simply resembles the user's voice and / or expressions) .

[0184] In some embodiments, a component and / or device uses (e.g., performs operations, makes decisions, and / or determines context based on) learned characteristics (e.g., characteristics of a user, context, and / or environment that the device has learned over time, such as via detection, prior experience, and / or feedback from one or more users) . For example, characteristics learned over time can include a user's routine. In such example, if a particular user asks a software object for a summary of any new messages for the user at the same time every day, the software object can learn to perform operations automatically based on the learned characteristics of the routine (e.g., what data is needed, when the data is needed, and / or for which user) . In some embodiments, use of learned characteristics enables a software object (and / or device) to improve understanding of (and / or responses to) a user, context, and / or environment, and / or to understand a user, context, and / or environment that otherwise was not (and / or would not be) understood (e.g., not responded to or responded to incorrectly) . In some embodiments, learned characteristics are formed (e.g., by and / or for a software object) using reinforcement learning. In some embodiments, learned characteristics correspond to one or more levels of confidence, certainty, and / or reward (e.g., that are shaped by one or more reward functions) . In some embodiments, learned characteristics (and / or how they are used to affect output of a software object and / or device) can change over time (e.g., levels confidence, certainty, and / or reward change over time) . For example, output of a device before learning a set of learned characteristics can be different from output of the device after learning the set of learned characteristics. In some embodiments, a component and / or device uses learnedknowledge. For example, similar to described above with respect to learned characteristics, learned knowledge can refer to information used to update (e.g., enhance, add to, and / or augment) a knowledge base of a device (e.g., for use by a software object implemented thereon) . In some embodiments, multiple sets of learned characteristics for a user can be stored and / or used. In some embodiments, different sets of learned characteristics for different users can be stored and / or used.

[0185] Reference can be made herein to interaction with a software object (and / or a device) . In some embodiments, an interaction refers to a set of one or more inputs and / or outputs of a device implementing the software object and one or more users. For example, an interaction can be an input by a user (e.g., "Please turn on the lights") and a corresponding output (e.g., causing the lights to turn on and / or a response by the device of "Okay") . In some embodiments, interaction can include multiple inputs / outputs by one or more of the parties to the interaction (e.g., device and / or users) . For example, an interaction can include a first input by a user (e.g., "Please turn on the lights") and a corresponding first output (e.g., "Which lights?") , and also include a second input by the user (e.g., "Hallway lights") and a second output from the device (e.g., "Okay") . In some embodiments, which inputs and / or outputs are considered together as an interaction is based on a logical and / or contextual grouping (e.g., interactions within the previous thirty (30) seconds and / or interactions relating to turning on the lights) . As one of skill will appreciate, an interaction can be considered in a manner that depends on the implementation (e.g., determining when an interaction is complete can involve determining if the user still present (e.g., speaking at all) and / or if the user still talking about the lights or has moved onto a differenttopic) . In some embodiments, an interaction is a current interaction (e.g., ongoing, presently occurring, and / or active) . In some embodiments, an interaction is a previous interaction. The examples above describe a device having a conversation with a user. In some embodiments, a conversation is between two or more users (e.g., users in an environment) . For example, a device can detect a conversation between to users (e.g., the users are directing speech and responses to each other, rather than to the device) .

[0186] In some embodiments, a software object (and / or device) determines and / or performs an operation based on an intent corresponding to a user. For example, a device detects user input and outputs a response that depends on an intent of the user input. For example, a device detects user input that includes a pointing gesture detected together with verbal instruction to "turn on that light," and in response, the device turns on the light that is determined to correspond to the intent of the input (e.g., the light toward which the pointing gesture directed) . In some embodiments, intent is determined (e.g., by the device that detects input and / or by one or more other devices) using one or more of one or more inputs, knowledge (e.g., learned knowledge about a user based on a history of observed behavior, personality, and interactions) , learned characteristics, and / or context. In some embodiments, intent is determined from one or more types of input (e.g., visual input via a camera, verbal input, and / or contextual input) .

[0187] Attention is now directed towards embodiments of user interfaces ("UI") and associated processes that are implemented on an electronic device, such as computer system100, device 168, and / or device 200.

[0188] FIGS. 6A-6D illustrate exemplary user interfaces for providing expressive responses in accordance with some embodiments. The user interfaces in these figures are used to illustrate the processes described below, including the processes in FIG. 7.

[0189] FIGS. 6A-6D illustrate computer system 600 as a smart phone. It should be recognized that computer system 600 can be other types of computer systems, such as a smart watch, a smart display, a television, a tablet, a smart watch, a laptop, a communal device, a smart speaker, a personal gaming system, a desktop computer, a fitness tracking device, and / or a head-mounted display (HMD) device. In some embodiments, computer system 600 includes and / or is in communication with one or more output devices (e.g., a display component (e.g., a display screen, a projector, and / or a touch-sensitive display) , an audio component (e.g., smart speaker, home theater system, soundbar, headphone, earphone, earbud, speaker, television speaker, augmented reality headset speaker, audio jack, optical audio output, Bluetooth audio output, and / or HDMI audio output) , and / or a haptic output device) ) . In some embodiments, computer system 600 includes and / or is in communication with one or more input devices (e.g., a camera, a lidar detector, a motion sensor, an infrared sensor, a touch-sensitive surface, a physical input mechanism (such as a button or a slider) , and / or a microphone) . Such input devices can be used to detect presence of, attention of, statements from, inputs corresponding to, requests from, and / or instructions from a user in an environment. In some embodiments, computer system 600 includes and / or is in communication with one or more movement components (e.g., an actuator, a moveable base, a rotatable component, and / or a rotatable base) . Such movement components, as discussed above, can be used to change a position (e.g.,location and / or orientation) of computer system 600 and / or a portion (e.g., including one or more sensors, input components, and / or output components) of computer system 600. In some embodiments, such movement is movement such as performed by center stage using an ultrawide camera and a neural engine to automatically pan and zoom to change a frame, such as when someone moves around. In some embodiments, computer system 600 is a personal device of a user and / or associated with an account of the user.

[0190] In some embodiments, computer system 600 is in communication with a software object (e.g., as discussed above with respect to FIG. 5) . In such embodiments, computer system 600 can receive a response to an input (e.g., a user input, such as verbal input 605a and / or verbal input 605c) from the software object. The response can include a visual, an auditory, and / or a haptic portion. In some embodiments, computer system 600 receives a manner for outputting the response from the software object. For example, the software object can specify how computer system 600 should output the visual, auditory, and / or haptic portion and / or how computer system 600 should move, via the one or more movement components, a portion (e.g., including one or more input devices and / or one or more output devices) while outputting the response. In some embodiments, computer system 600 only receives what to output without receiving a manner for outputting. In such embodiments, computer system 600 can determine the manner based on a current context as further discussed below. In some embodiments, computer system 600 includes the software object to perform one or more operations discussed herein. Accordingly, it should be recognized that, while the discussion below refers to operations performed by computer system 600, such operations can be performed by the software object, a system process in communication with theIllsoftware object, and / or a user process in communication with the software object.

[0191] FIGS. 6A-6D illustrate computer system 600 displaying user interface 602. In some embodiments, user interface 602 is a user interface corresponding to the software object for interacting with the software object. In such embodiments, user interface 602 can be displayed in response to detecting an input corresponding to a request to display user interface 602. For example, computer system 600 can detect a verbal request to display user interface 602. For another example, computer system 600 can display an icon corresponding to the software object that, when selected, causes display of user interface 602.

[0192] As illustrated in FIGS. 6A-6D, user interface 602 includes representation 604 of the software object. In some embodiments, representation 604 is a box that indicates to a user that the software object is currently active (e.g., that an input detected by computer system 600 would be sent to the software object and / or that the software object is providing and / or causing computer system 600 to output content) . In other embodiments, representation 604 is an animated face that has eyes and / or a mouth. In such embodiments, the animated face can change appearance as content is output to provide additional information to a user in addition to the content. For example, a facial expression of the animated face can indicate an interpretation of the content to the user, such as that the content is information that will be interpreted by the user as bad news. It should be recognized that representation 604 can have other appearances and that such appearances are used to provide additional context to output of content.

[0193] At FIG. 6A, computer system 600 is in an initial state.In some embodiments, the initial state corresponds to a lower power mode and / or inactive state for computer system 600. For example, computer system 600 can maintain a lower screen brightness, not display any user interface, maintain a decreased number of controls displayed in a user interface, output particular content to signify that computer system 600 is in the initial state, and / or be in a particular physical orientation to signify that computer system 600 is in the initial state (e.g., a portion of computer system 600 pitched forward, displaying a tired and / or asleep animation, and / or not displaying content) . In some embodiments, representation 604 is displayed with a particular appearance to represent to a user that computer system 600 is in the initial state. For example, representation 604 can be displayed in an initial size with an initial expression (e.g., a box, a smiling face, and / or an appearance that is static without animation) at an initial position. It should be recognized that user interface 602 can include more, fewer, and / or different content and / or representation 604 can have a difference appearance while in the initial state than illustrated in FIG. 6A.

[0194] In some embodiments, when computer system 600 is in the initial state, computer system 600 is waiting for an input and / or an event to occur. The input and / or the event can include a notification (e.g., directly and / or from another computer system different from computer system 600) , an alert (e.g., a timer, alarm, and / or upcoming meeting) , output of content (e.g., end of a song, next song starting, end of a video, and / or recommended video) , and / or an input (e.g., a request and / or a statement) corresponding to a user.

[0195] At FIG. 6A, while waiting for an input and / or an event to occur while in the initial state, computer system 600 detects verbal input 605a from a user (e.g., "Can you callJohn?") . It should be recognized that verbal input 605a is an example of a type of input used by techniques described herein and that other types of inputs can be used, such as an air gesture, a typed input, a mouse click, and / or a tap input.

[0196] In some embodiments, computer system 600 reacts to verbal input 605a differently based a current context. For example, the current context can include a pitch, a tone, and / or a body language of the user. For another example, the current context can include one or more characteristics of the environment (e.g., a physical location, a number of individuals in the environment, a volume level in the environment, and / or a time of day) . For another example, the current context can include a current activity being performed by the user, a current position of the user in the environment, and / or one or more previous interactions by the user (e.g., or another user different from the user) with computer system 600 and / or one or more other computer systems (e.g., a personal device of the user and / or a communal device) different from computer system 600. For another example, the current context can include a state of computer system 600, such as a power mode (e.g., inactive, active, low power, and / or regular operating power) , an activity level (e.g., amount of time since last output, currently outputting, and / or preparing an output) , current output type (e.g., displayed user interface and / or representation, audio output, and / or movement) , and / or a position (e.g., location and / or orientation) of computer system 600.

[0197] In some embodiments, the current context is determined in response to, before (e.g., such as in a continuous manner) , and / or while detecting verbal input 605a. In some embodiments, the current context is determined based on sensor data captured via the one or more input devices. For example, the current context can be determined based on images captured viaone or more cameras while detecting verbal input 605a. For another example, the current context can be determined based on detecting a reduction in tone, pitch, and / or intensity of a voice of the user with respect to verbal input 605a compared to a previous verbal input captured via one or more microphones. In some embodiments, the current context is determined based on communication from another process of computer system 600 and / or another computer system different from computer system 600. For example, the current context can be determined based on details of an upcoming event received from a calendar application of computer system 600. For another example, the current context can be determined based on content of a text message received from the other computer system.

[0198] As illustrated in FIG. 6B, in response to detecting verbal input 605a, computer system 600 displays representation 604 with a different appearance (e.g., a circle) as compared to representation 604 as illustrated in FIG. 6A while outputting verbal output 605b (e.g., "Of course! Calling now") . In some embodiments, the difference appearance includes a different expression and / or a different visual characteristic. For example, if computer system 600 is in a lower power mode and / or a sleep mode (e.g., representation 604 has a sleeping expression and / or computer system 600 is causing the portion to lean forward) while detecting verbal input 605a, computer system 600 can lean back to an upright position and display representation 604 as waking up. For another example, if computer system 600 is in an environment that is busy and / or loud while detecting verbal input 605a, computer system 600 can output a response to verbal input 605a at a higher volume than if the environment is not busy and / or loud. For another example, if verbal input 605a is in a happy and / or friendly tone of voice and / or the user is exhibitingpositive body language, such as a smile, while detecting verbal input 605a, computer system 600 can output verbal output 605b in a friendly and / or high-pitched tone to match one or more characteristics of verbal input 605a from the user. For another example, if verbal input 605a is in a happy and / or friendly tone of voice but it is currently late at night, computer system 600 can output verbal output 605b in a manner different from one or more characteristics of verbal input 605a, such as in a neutral and / or quiet manner.

[0199] FIG. 6C illustrates computer system 600 displaying user interface 602 with representation 604 in the same appearance as illustrated in FIG. 6A. In some embodiments, at FIG. 6C, computer system 600 has responded to an input and subsequently returned to the initial state described above. At FIG. 6C, computer system 600 detects verbal input 605c from a user (e.g., "Can you call John?") . Accordingly, computer system 600 detects the same request as described above with respect to FIG. 6A. However, contrary to as described above with respect to FIGS. 6A-6B, computer system 600 detects a different context surrounding verbal input 605c as compared to verbal input 605a. For example, computer system 600 can detect that the user provided verbal input 605c with a worried and / or nervous tone of voice and / or body language (e.g., frown, furrowed eyebrows, and / or hand over mouth) .

[0200] As illustrated in FIG. 6D, in response to detecting verbal input 605c, computer system 600 alters the appearance of representation 604 based on a current context (e.g., surrounding verbal input 605c) . For example, computer system 600 can display representation 604 with a triangle appearance and / or downturned eyebrows, wider eyes, and a frown based on the current context (e.g., to mimic the voice and / or body language of the user) .

[0201] In some embodiments, while computer system 600 outputs a verbal output (e.g., verbal output 605b and / or verbal output 605d) , computer system 600 moves the portion of computer system 600. For example, if computer system 600 is outputting a verbal output in a surprised manner (e.g., shocked face, wide eyes, open mouth, and / or gasping voice) , computer system 600 can lean the portion of computer system 600 back to imitate a body language of being surprised. In some embodiments, when computer system 600 outputs a verbal output (e.g., verbal output 605b and / or verbal output 605d) , computer system 600 moves the portion of computer system 600 in the same manner while outputting a first portion of both verbal output 605b and verbal output 605d while moving in a different manner while outputting a second portion of verbal output 605b and verbal output 605d. For example, computer system 600 can lean the portion backwards for the first portion of verbal output 605b and verbal output 605d (e.g., "Of course!") . In such an example, computer system 600 can turn the portion side to side for the remainder of verbal output 605b and lean the portion forward for the remainder of verbal output 605d. In some embodiments, the same process applies to computer system 600 changing an appearance of representation 604. That is, computer system 600 can display representation 604 in the same manner (e.g., smiling) while outputting the first portion of verbal output 605b and verbal output 605d and display representation 604 in a different manner (e.g., smiling during the second portion of verbal output 605b and a worried expression during the second portion of verbal output 605d) while outputting the second portion of verbal output 605b and verbal output 605d.

[0202] In some embodiments, computer system 600 outputs different content in response to the same input. For example, if computer system 600 detects a user making a statement(e.g., "I can't wait to visit Stonehenge") , computer system 600 can output a response based on the statement, such as "Stonehenge was constructed roughly 5,000 years ago." To the contrary, if computer system 600 detects the same statement by the same user at a time when the user has an upcoming flight to England, computer system 600 can output information about the user's upcoming flight along with a happy and / or excited expression, such as increased eye size and / or a large smile.

[0203] While the above description focuses on inputs from a user, it should be recognized that such techniques described herein can be used with inputs from applications or other computer systems different from computer system 600. For example, if computer system 600 detects that a meeting begins soon (e.g., within 10 minutes) while a user is determined to not be ready for the meeting, computer system 600 can display representation 604 with an urgent expression, such as increased eye size and / or blinking, while outputting a reminder that the meeting begins soon. Alternatively, if computer system 600 detects that the meeting begins soon while the user is determined to be ready for the meeting, computer system 600 can display representation 604 with a pleasant expression, such as a smile, while outputting the reminder that the meeting begins soon. For another example, in response to detecting a notification from a sports application that a certain team won a game, computer system 600 can output the notification and display representation 604 with an excited expression, such as displaying representation 604 with an open smile and / or raised eyebrows, when the certain team is liked by the user (e.g., based on a previous interaction by the user with computer system 600 and / or another person in the presence of computer system 600) . Alternatively, in response to detecting the notification from the sports application that the certain team won the game, computer system 600 can outputthe notification and display representation 604 with a sad expression, such as displaying representation 604 with a frown, when the certain team is not liked by the user (e.g., based on a previous interaction by the user with computer system 600 and / or another person in the presence of computer system 600) . Examples of such previous interactions include the user cheering for the certain team, talking to another person about wanting that team to win, using computer system 600 to bet for the certain team, and sending text messages stating the user's desire for the certain team to win.

[0204] FIG. 7 is a flow diagram illustrating a process (e.g., process 700) for outputting content in accordance with some embodiments. Some operations in process 700 are, optionally, combined, the orders of some operations are, optionally, changed, and some operations are, optionally, omitted.

[0205] As described below, process 700 provides an intuitive way for outputting content. Process 700 reduces the cognitive burden on a user, thereby creating a more efficient humanmachine interface. For battery-operated computing devices, enabling a user to interact with such devices faster and more efficiently conserves power and increases the time between battery charges.

[0206] In some embodiments, process 700 is performed at a computer system (e.g., a phone, a tablet, a processor, a headmounted display (HMD) device, a communal device, a media device, a speaker, a television, and / or a personal computing device) (e.g., 600) that is in communication with one or more display components (e.g., a display screen, a projector, and / or a touch-sensitive display) , one or more input components (e.g., a camera, a depth sensor, a microphone, a hardware input mechanism, a rotatable input mechanism, a heart monitor, a temperature sensor, and / or a touch-sensitivesurface) , and one or more output components (e.g., a display component, an audio component, a speaker, and / or a haptic output device) . In some embodiments, the one or more output components is and / or includes the one or more display components. In some embodiments, the one or more output components is different from the one or more display components. In some embodiments, the audio component is a smart speaker, a home theater system, a soundbar, a headphone, an earphone, an earbud, a speaker, a television speaker, an augmented reality headset speaker, an audio jack, an optical audio output, a Bluetooth audio output, and / or a HDMI audio output .

[0207] While displaying, via the one or more display components, a representation (e.g., a graphical representation and / or a textual representation) (e.g., 604) of a software object (e.g., as described above with respect to FIG. 5) with a first set of one or more visual characteristics (e.g., as illustrated in and described above with respect to FIGS. 6A and / or 6C) , the computer system detects (702) , via the one or more input components, an input (e.g., an interaction, such as a verbal input and / or a non-verbal input) (e.g., 605a and / or 605c) . In some embodiments, the representation is an avatar (e.g., a stylized humanoid and / or nonhumanoid representation) , a computer system selected representation, a generated representation, an emoji, a video, and / or an image. In some embodiments, the input corresponds to (and / or of, from, with, based on, and / or involving) a user, a meeting invite, an output of an application, a message received from another computer system different from the computer system, and / or an output of the software object. In some embodiments, the input is a request, question, and / or statement from a user directed to the software object. In some embodiments, the first set of one or more visual characteristics include size, position,clarity, color, and / or expression. In some embodiments, the expression includes visual depiction of one or more facial expressions (e.g., mood facial expressions, such as happy, sad, angry, asleep, and / or tired, and / or action facial expressions, such as speaking, moving eyes, smiling, frowning, and / or listening) .

[0208] In response to (704) detecting the input and in accordance with (706) a determination that a first set of one or more criteria is satisfied, wherein the first set of one or more criteria includes a criterion that is satisfied when a current context (e.g., of the input, the computer system, and / or the interaction) is a first type of context (e.g., as described above with respect to FIGS. 6A-6D) , the computer system outputs (708) , via the one or more output components, a first response (e.g., that is based on the input) (e.g., 605b and / or 605d) . In some embodiments, outputting the first response includes displaying, via the one or more display components, visual content. In some embodiments, outputting the first response includes displaying, via one or more audio components of the one or more output components, audio content. In some embodiments, the first response includes first content. In some embodiments, the current context includes pitch, tone, and / or body language of the user during, before, and / or after detecting the input. In some embodiments, the current context includes one or more external factors not corresponding to the user (e.g., location, weather, time, activity of one or more other users, activity of one or more other computer systems, and / or one or more other interactions (e.g., previous interactions with the user, previous interactions with one or more other users, and / or other relevant interactions) ) . In some embodiments, the first type of context includes a set of one or more predefined values and / or threshold values corresponding to the pitch of theuser, the tone of the user, the body language of the user, and / or the one or more external factors not corresponding to the user. In some embodiments, in conjunction with (e.g., before, while, in response to, and / or after) detecting the input, the computer system detects, via the one or more input components, the current context.

[0209] In response to (704) detecting the input and in accordance with (706) the determination that the first set of one or more criteria is satisfied, wherein the first set of one or more criteria includes the criterion that is satisfied when the current context is the first type of context, while (and / or in conjunction with, before, and / or after) outputting the first response, the computer system displays (710) , via the one or more display components, the representation of the software object with a second set of one or more visual characteristics (e.g., based on the input) (e.g., as illustrated in and described above with respect to FIG. 6B and / or 6D) different from the first set of one or more visual characteristics .

[0210] In response to (704) detecting the input and in accordance with (712) a determination that a second set of one or more criteria, different from the first set of one or more criteria, is satisfied, wherein the second set of one or more criteria includes a criterion that is satisfied when the current context (e.g., of the input, the computer system, and / or the interaction) is a second type of context (e.g., as described above with respect to FIGS. 6A-6D) different from the first type of context, the computer system outputs (714) , via the one or more output components, a second response (e.g., based on the input corresponding to the user) (e.g., 605b and / or 605d) . In some embodiments, the second response is the first response. In some embodiments, the second response includes the first response. In some embodiments, the secondresponse is different from the first response. In some embodiments, the second response is related to the first response. In some embodiments, the first response includes first content. In some embodiments, the computer system displays, via the one or more display components, visual content as part of outputting the second response. In some embodiments, the computer system outputs audio content as part of outputting the second response. In some embodiments, the first set of one or more criteria and the second set of one or more criteria include one or more similar criterion. In some embodiments, the first set of one or more criteria is a subset of criteria of the second set of one or more criteria. In some embodiments, the second set of one or more criteria is a subset of criteria of the first set of one or more criteria. In some embodiments, the first set of one or more criteria and the second set of one or more criteria do not share any criterion .

[0211] In response to (704) detecting the input and in accordance with (712) the determination that the second set of one or more criteria, different from the first set of one or more criteria, is satisfied, wherein the second set of one or more criteria includes the criterion that is satisfied when the current context is the second type of context different from the first type of context, while (and / or in conjunction with, before, and / or after) outputting the second response, the computer system displays (716) , via the one or more display components, the representation of the software object with a third set of one or more visual characteristics (and / or based on the input corresponding to the user) (e.g., without displaying the representation of the software object with the first set of one or more visual characteristics and / or the second set of one or more visual characteristics) (e.g., as illustrated in and described above with respect to FIG. 6Band / or 6D) different from the first set of one or more visual characteristics and the second set of one or more visual characteristics. Displaying a representation of a software object with varying visual characteristics depending on different sets of criteria that include a criterion based on a current context allows (1) the computer system to respond with the same content but automatically alter the representation of the software object upon one of the sets of criteria being satisfied without requiring user input and / or (2) the computer system to respond with different content and automatically alter the representation of the software object based on the current context, thereby performing an operation when a set of conditions has been met without requiring additional input.

[0212] In some embodiments, the computer system is in communication with one or more movement components (e.g., an actuator, a movable base, a rotatable component, a motor, a lift, a level, and / or a rotatable base) . In some embodiments, the actuator is a pneumatic actuator, a hydraulic actuator and / or an electric actuator. In some embodiments, in response to detecting the input and in accordance with the determination that the first set of one or more criteria is satisfied (and / or in conjunction with outputting the first response) , the computer system moves, via the one or more movement components, a portion (e.g., a physical portion, such as a portion that includes an input component of the one or more input components and / or an output component of the one or more output components) of the computer system by a first physical amount (e.g., degree of rotation, distance from a starting location, and / or difference in pose, such as pitch, yaw, roll, and / or position) (e.g., as described above with respect to FIGS. 6A-6D) . In some embodiments, moving the portion of the computer system by the first physical amount is in synchronization with outputting the first response, suchthat movement of the portion of the computer system matches output of the first response. In some embodiments, in response to detecting the input and in accordance with the determination that the second set of one or more criteria is satisfied, the computer system moves, via the one or more movement components, the portion of the computer system by a second physical amount different from the first physical amount (e.g., degree of rotation, distance from a starting location, and / or difference in pose, such as pitch, yaw, roll, and / or position) . In some embodiments, moving the portion of the computer system by the second physical amount is in synchronization with outputting the second response, such that movement of the portion of the computer system matches output of the second response. In some embodiments, the first physical amount corresponds to the first response (e.g., the movement of the portion of the computer system is based on content, context, and / or one or more visual characteristics of the first response) . In some embodiments, the second physical amount corresponds to the second response (e.g., the movement of the portion of the computer system is based on content, context, and / or one or more visual characteristics of the second response) . In some embodiments, after outputting the first response (and / or in accordance with a determination that the first response is finished outputting) , the computer system ceases movement of the portion of the computer system. In some embodiments, in response to detecting the input and in accordance with the determination that the first set of one or more criteria is satisfied (and / or in conjunction with outputting the first response) , the computer system moves, via the one or more movement components, the portion of the computer system in a first movement pattern. In some embodiments, in response to detecting the input and in accordance with the determination that the second set of one or more criteria is satisfied (and / or in conjunction withoutputting the second response) , the computer system moves, via the one or more movement components, the portion of the computer system in a second movement pattern (e.g., without moving the portion of the computer system in the first movement pattern) different from the first movement pattern. Selectively moving a portion of a computer system by a physical amount based on one of the different sets of criteria being satisfied allows (1) the computer system to automatically move the portion of the computer system without requiring user input and / or (2) the computer system to have another modality to represent the computer system' s response to a user's input, thereby performing an operation when a set of conditions has been met without requiring additional input and / or providing improved visual feedback to the user.

[0213] In some embodiments, the first response consists of first content, wherein the second response consists of second content. In some embodiments, the second content is the same as the first content (e.g., the second response includes the same content as the first response) . In some embodiments, the computer system is in communication with one or more movement components (e.g., an actuator, a movable base, a rotatable component, a motor, a lift, a level, and / or a rotatable base) . In some embodiments, the actuator is a pneumatic actuator, a hydraulic actuator and / or an electric actuator. In some embodiments, in response to detecting the input, while outputting, via the one or more output components, a first portion (e.g., a portion that has a predefined movement amount and / or a predefined movement pattern) of the first response (and / or in accordance with the determination that the first set of one or more criteria is satisfied) , the computer system moves, via the one or more movement components, a portion (e.g., a physical portion, such as a portion that includes an input component of the one or more input components and / or anoutput component of the one or more output components) of the computer system by a third physical amount (e.g., degree of rotation, distance from a starting location, and / or difference in pose, such as pitch, yaw, roll, and / or position) (e.g., as described above with respect to FIGS. 6A-6D) . In some embodiments, moving the portion of the computer system by the third physical amount is in synchronization with outputting the first portion of the first response, such that movement of the portion of the computer system matches output of the first portion of the first response. In some embodiments, the third physical amount is the first physical amount or the second physical amount. In some embodiments, the third physical amount is less than the first physical amount and / or the second physical amount. In some embodiments, the third physical amount includes the first physical amount and / or the second physical amount. In some embodiments, the third physical amount is different from the first physical amount and / or the second physical amount (e.g., different in pitch, yaw, roll, and / or position) . In some embodiments, in response to detecting the input and while outputting, via the one or more output components, the first portion of the first response (and / or in accordance with the determination that the first set of one or more criteria is satisfied) , the computer system moves, via the one or more movement components, the portion of the computer system in a third movement pattern. In some embodiments, the third physical amount and / or the third movement pattern is not based on the current context (e.g., the third physical amount and / or the third movement pattern is predefined and occurs any time that a particular response is output no matter the current context) . In some embodiments, in response to detecting the input and while outputting, via the one or more output components, a second portion of the first response different from the first portion (e.g., a portion that does not have a predefined movement amount and / or apredefined movement pattern) of the first response (and / or in accordance with the determination that the first set of one or more criteria is satisfied) , the computer system moves, via the movement component, the portion of the computer system by a fourth physical amount (e.g., without moving the portion of the computer system by the third physical amount) (e.g., as described above with respect to FIGS. 6A-6D) different from the third physical amount (e.g., different in pitch, yaw, roll, and / or position) . In some embodiments, moving the portion of the computer system by the fourth physical amount is in synchronization with outputting the second portion of the first response, such that movement of the portion of the computer system matches output of the second portion of the first response. In some embodiments, the fourth physical amount is the first physical amount or the second physical amount. In some embodiments, the fourth physical amount is less than the first physical amount and / or the second physical amount. In some embodiments, the fourth physical amount includes the first physical amount and / or the second physical amount. In some embodiments, the fourth physical amount is different from the first physical amount and / or the second physical amount (e.g., different in pitch, yaw, roll, and / or position) . In some embodiments, in response to detecting the input and while outputting, via the one or more output components, the second portion of the first response (and / or in accordance with the determination that the first set of one or more criteria is satisfied) , the computer system moves, via the movement component, the portion of the computer system in a fourth movement pattern (e.g., without moving the portion of the computer system in the third movement pattern) different from the third movement pattern. In some embodiments, the fourth physical amount and / or the fourth movement pattern is based on the current context (e.g., movement is different depending on the current context) . In some embodiments, inresponse to detecting the input and while outputting, via the one or more output components, a first portion (e.g., a portion that has a predefined movement amount and / or a predefined movement pattern) of the second response (and / or in accordance with the determination that the second set of one or more criteria is satisfied) , the computer system moves, via the movement component, the portion of the computer system by the third physical amount (e.g., as described above with respect to FIGS. 6A-6D) . In some embodiments, moving the portion of the computer system by the third physical amount is in synchronization with outputting the first portion of the second response, such that movement of the portion of the computer system matches output of the first portion of the second response. In some embodiments, in response to detecting the input and while outputting, via the one or more output components, the first portion of the second response (and / or in accordance with the determination that the second set of one or more criteria is satisfied) , the computer system moves, via the one or more movement components, the portion of the computer system in the third movement pattern. In some embodiments, in response to detecting the input, while outputting, via the one or more output components, a second portion (e.g., a portion that does not have a predefined movement amount and / or a predefined movement pattern) of the second response different from the first portion of the second response, the computer system moves, via the movement component, the portion of the computer system by a fifth physical amount (e.g., without moving the portion of the computer system by the third physical amount and / or the fourth physical amount) (e.g., as described above with respect to FIGS. 6A-6D) different from the fourth physical amount and the third physical amount (e.g., different in pitch, yaw, roll, and / or position) . In some embodiments, the fifth physical amount is the first physical amount and / or the second physicalamount. In some embodiments, the fifth physical amount is less than the first physical amount, the second physical amount, the third physical amount, and / or the fourth physical amount. In some embodiments, the fifth physical amount includes the first physical amount, the second physical amount, the third physical amount, and / or the fourth physical amount. In some embodiments, the fifth physical amount is different from the first physical amount and / or the second physical amount (e.g., different in pitch, yaw, roll, and / or position) . In some embodiments, in response to detecting the input and while outputting, via the one or more output components, the second portion of the second response (and / or in accordance with the determination that the second set of one or more criteria is satisfied) , the computer system moves, via the movement component, the portion of the computer system in a fifth movement pattern (e.g., without moving the portion of the computer system in the fourth movement pattern) different from the third movement pattern and the fourth movement pattern. In some embodiments, the first portion of the second response is the same as the first portion of the first response. In some embodiments, the first portion of the second response includes the same content as the first portion of the first response. In some embodiments, the first portion of the first response consists of third content. In some embodiments, the second portion of the first response consists of fourth content different from the third content. In some embodiments, the first portion of the second response consists of the third content. In some embodiments, the second portion of the second response consists of the fourth content. Moving a portion of the computer system differently during different portions of responses allows the computer system to have predefined movement for a portion of a response while having dynamic movement for another portion of the response that is based ona current context, thereby performing an operation when a set of conditions has been met without requiring additional input.

[0214] In some embodiments, outputting the first portion of the first response includes displaying, via the one or more display components, the representation of the software object with a fourth set of one or more visual characteristics (e.g., as described above with respect to FIGS. 6A-6D) . In some embodiments, outputting the first portion of the second response includes displaying, via the one or more display components, the representation of the software object with the fourth set of one or more visual characteristics (e.g., as described above with respect to FIGS. 6A-6D) . In some embodiments, the fourth set of one or more visual characteristics include size, position, clarity, color, and / or expression (e.g., visual depiction of one or more facial expressions, such as mood facial expressions including happy, sad, angry, asleep, and / or tired and / or action facial expressions including speaking, moving eyes, smiling, frowning, and / or listening) . In some embodiments, the fourth set of one or more visual characteristics is the first set of one or more visual characteristics, the second set of one or more visual characteristics, and / or the third set of one or more visual characteristics. In some embodiments, the fourth set of one or more visual characteristics is different from the first set of one or more visual characteristics, the second set of one or more visual characteristics, and / or the third set of one or more visual characteristics. In some embodiments, the fourth set of one or more visual characteristics includes the first set of one or more visual characteristics, the second set of one or more visual characteristics, and / or the third set of one or more visual characteristics. Displaying a representation of a software object with particular visual characteristics during a portionof a response allows the computer system to have predefined appearances for certain outputs, thereby performing an operation when a set of conditions has been met without requiring additional input and / or providing improved visual feedback to the user.

[0215] In some embodiments, outputting the second portion of the first response includes displaying, via the one or more display components, the representation of the software object with a fifth set of one or more visual characteristics (e.g., as described above with respect to FIGS. 6A-6D) . In some embodiments, outputting the second portion of the second response includes displaying, via the one or more display components, the representation of the software object with a sixth set of one or more visual characteristics (e.g., as described above with respect to FIGS. 6A-6D) different from the fifth set of one or more visual characteristics (e.g., difference in size, position, clarity, color, and / or expression) . In some embodiments, the fifth set of one or more visual characteristics or the sixth set of one or more visual characteristics is the first set of one or more visual characteristics, the second set of one or more visual characteristics, and / or the third set of one or more visual characteristics. In some embodiments, the fifth set of one or more visual characteristics or the sixth set of one or more visual characteristics is different than the first set of one or more visual characteristics, the second set of one or more visual characteristics, and / or the third set of one or more visual characteristics. In some embodiments, the fifth set of one or more visual characteristics or the sixth set of one or more visual characteristics includes the first set of one or more visual characteristics, the second set of one or more visual characteristics, and / or the third set of one or more visual characteristics. Displaying a representation of asoftware object with different visual characteristics for a portion of a response allows the computer system to have dynamic appearances that is based on a current context for the portion of the response, thereby performing an operation when a set of conditions has been met without requiring additional input .

[0216] In some embodiments, the first response is output, via the one or more output components, at a first pitch (and / or a first audio pitch) (e.g., a first audio characteristic) (e.g., as described above with respect to FIGS. 6A-6D) . In some embodiments, the second response is output, via the one or more output components, at a second pitch (and / or a second audio pitch) (e.g., a second audio characteristic) (e.g., as described above with respect to FIGS. 6A-6D) different from the first pitch. In some embodiments, the first pitch and / or the second pitch is based on (and / or correspond to) the current context, input, and / or visual characteristics of the representation of the software object. In some embodiments, the first pitch is higher than the second pitch. In some embodiments, the second pitch is higher than the first pitch. In some embodiments, the first pitch and / or the second pitch is a predefined pitch. In some embodiments, a large language model formats the first response and / or the second response to include pitch, tone, intensity, and / or content. Outputting different responses with different pitches based on different sets of criteria allows (1) the computer system to automatically output the different responses with different audio characteristics without requiring user input and / or (2) the computer system automatically emphasize responses through pitch based on the set of one or more criteria is satisfied, thereby performing an operation when a set of conditions has been met without requiring additional input and / or providing improved visual feedback to the user.

[0217] In some embodiments, the second response is the first response (e.g., as described above with respect to FIGS. 6A- 6D) . In some embodiments, the second response contains the same content as the first response. In some embodiments, the input is the same, but the current context differs for the first response and / or the second response. In some embodiments, the format of the first response and the second response are different (e.g., pitch, tone, and / or intensity) . In some embodiments, the format of the first response and / or the second response is received from a large language model. Displaying different sets of visual characteristics of a representation of a software object while outputting the same response allows the computer system to provide additional context by an appearance of the representation of the software object while outputting the same response, thereby performing an operation when a set of conditions has been met without requiring additional input.

[0218] In some embodiments, the computer system is in communication with (and / or includes, has stored, is able to access, obtains information from, and / or is associated with) a large language model (LLM) (e.g., a software object and / or machine learning model capable of generating outputs based on a data base and / or data set) (e.g., as described above with respect to FIGS. 6A-6D) . In some embodiments, the first response (and / or the second response) is received from the LLM. In some embodiments, before the computer system outputs the first response, the computer system receives, from the large language model, the first response. In some embodiments, receiving the first response (and / or the second response) from the large language model includes receiving a format for the response (e.g., text, audio, image, and / or emoji) . Receiving a response from a large language model that the computer system is in communication with allows (1) the computer system toalter a set of visual characteristics of a representation of a software object without generating the response and / or (2) the computer system to automatically use the response from the large language model when a set of one or more criteria is satisfied, thereby providing improved visual feedback to the user and / or improving power consumption of the computer system.

[0219] In some embodiments, the current context corresponds to a state of (and / or an instance of, one or more actions of, information concerning, and / or context surrounding) a user (e.g., a user associated with an input) (e.g., as described above with respect to FIGS. 6A-6D) . In some embodiments, the state of the user includes the user's pitch, tone, and / or body language while the computer system detects the input (and / or corresponding to the user) . In some embodiments, the state of the user corresponds to the position of the user within an environment. In some embodiments, the state of the user includes context related to the user (e.g., events and / or meetings associated with the user, messages, calls, and / or emails connected to the user, and / or notifications and / or alerts for the user) . Satisfying different sets of criteria based on a state of a user allows the computer system to automatically alter a set of visual characteristics of a software object based on the state of the user without requiring user input, thereby performing an operation when a set of conditions has been met without requiring additional input .

[0220] In some embodiments, the state of the user corresponds to pitch of (e.g., corresponding to, associated with, and / or from) the user (e.g., pitch of the input) , tone of (e.g., corresponding to, associated with, and / or from) the user (e.g., tone of the input) , body language of (e.g., corresponding to, associated with, and / or from) the user, orany combinations thereof (and / or detected during, before, and / or after detecting the input) (e.g., as described above with respect to FIGS. 6A-6D) . In some embodiments, pitch and / or tone of the user correspond to a request and / or statement made by the user. In some embodiments, body language of the user includes position of one or more body parts of the user and / or a comparison of the one or more body parts of the user (e.g., head tilted forwards, arms shrugged, and / or arms crossed) . In some embodiments, the body language of the user includes an expression of the user (e.g., happy, sad, angry, shocked, and / or tired) . Satisfying different sets of criteria based on pitch, tone, and / or body language of a user allows the computer system to automatically alter a set of visual characteristics of a software object based on the user without requiring user input, thereby performing an operation when a set of conditions has been met without requiring additional input .

[0221] In some embodiments, the current context corresponds to (e.g., associated with, based on, and / or retrieved from) a state (and / or power state, operation state, and / or action state) of the computer system (e.g., as described above with respect to FIGS. 6A-6D) . In some embodiments, the state of the computer system corresponds to a current action by the computer system (e.g., waiting for an input, listening for an input, processing a response, outputting a response, and / or returning to waiting for an input) . In some embodiments, the state of the computer system corresponds to a power state of the computer system (e.g., lower power mode, high power mode, outputting mode, idle mode, inactive mode, and / or asleep mode) . In some embodiments, the state of the computer system includes context associated with the computer system (e.g., location of the computer system, notifications received by the computer system, input on the computer system, alert and / orevent on the computer system, and / or system level activities on the computer system (e.g., updates, connectivity, and / or interrupts) ) . Satisfying different sets of criteria based on a state of a computer system allows the computer system to indicate the state of the computer system while outputting responses to inputs, thereby performing an operation when a set of conditions has been met without requiring additional input .

[0222] In some embodiments, the computer system is in communication with a sensor (e.g., a thermometer, a heart rate sensor, a breathing monitor, a camera, and / or microphone) (e.g., the one or more input components) . In some embodiments, the current context is based on sensor data detected via the sensor (e.g., as described above with respect to FIGS. 6A-6D) . In some embodiments, the computer system uses the sensor along with one or more other input devices to determine the current context. Detecting the current context through a sensor allows the computer system to automatically determine a set of one or more criteria is satisfied based on data from the sensor without requiring user input, thereby performing an operation when a set of conditions has been met without requiring additional input.

[0223] In some embodiments, the input corresponds to (and / or is) a request (and / or from a user) (e.g., to perform an operation) (e.g., as described above with respect to FIGS. 6A- 6D) . In some embodiments, the request corresponds to a question and / or query from a user and / or individual within an environment (e.g., a question detected by the computer system within a location within a house) . In some embodiments, the request corresponds to content displayed via the computer system. In some embodiments, the request does not correspond to the computer system. In some embodiments, after the computer system detects the request, the computer systemretrieves (e.g., from a database, from another computer system, from a software object, and / or from a large language model) content, information, and / or a response to the request, and the computer system outputs the content, information, and / or response. Allowing detection of a request to be an input allows the computer system to respond to different requests while providing additional information about a current context, thereby performing an operation when a set of conditions has been met without requiring additional input and / or providing additional control options without cluttering the user interface with additional displayed controls.

[0224] In some embodiments, the input corresponds to (and / or is) a statement (and / or made by a user) (e.g., as described above with respect to FIGS. 6A-6D) . In some embodiments, the statement corresponds to a user and / or individual within an environment (e.g., a statement detected by the computer system within a location within a house) . In some embodiments, the statement corresponds to content displayed on the computer system. In some embodiments, the statement does not correspond to the computer system. In some embodiments, after the computer system detects the statement, the computer system retrieves (e.g., from a database, from another computer system, from a software object, and / or from a large language model) content, information, and / or response to the statement, and the computer system outputs the content, information, and / or response. Allowing detection of a statement to be an input allows the computer system to respond to statements with information determined to be relevant, thereby performing an operation when a set of conditions has been met without requiring additional input and / or providing additional control options without cluttering the user interface with additional displayed controls.

[0225] FIGS. 8A-8F illustrate an exemplary user interface for responding to inputs for different user interfaces in accordance with some embodiments. The user interface in these figures are used to illustrate the processes described below, including the processes in FIG. 9 and FIG. 10.

[0226] The left sides of FIGS. 8A-8F illustrate computer system 600 as a tablet. It should be recognized that computer system 600 can be other types of computer systems such as a smart phone, a smart watch, a laptop, an accessory, a personal gaming system, a desktop computer, a fitness tracking device, and / or a head-mounted display (HMD) device. In some embodiments, computer system 600 includes and / or is in communication with one or more input devices (e.g., a sensor, a camera, a lidar detector, a motion sensor, an infrared sensor, a touch-sensitive surface, a physical input mechanism, and / or a microphone) . Such input devices can be used to detect presence of, attention of, statements from, inputs corresponding to, requests from, and / or instructions from a subject (e.g., a person, an animal, a device, and / or a user) in an environment. In some embodiments, computer system 600 includes and / or is in communication with one or more output devices (e.g., a display screen, a projector, a touch- sensitive display, and / or a speaker) . Such output devices can be used to present information and / or cause different visual changes of computer system 600. In some embodiments, computer system 600 includes and / or is in communication with one or more movement components (e.g., an actuator, a moveable base, a rotatable component, and / or a rotatable base) . Such movement components, as discussed above, can be used to change a position (e.g., location and / or orientation) of computer system 600 and / or a portion (e.g., including one or more sensors, input components, and / or output components) of computer system 600. In some embodiments, computer system 600includes one or more components and / or features described above in relation to computer system 100 and / or electronic device 200. In some embodiments, computer system 600 is, includes, implements, and / or is in communication with one or more software systems, as described above with respect to FIG. 5, for performing (and / or causing performance of) one or more operations of a software object.

[0227] The right sides of FIGS. 8A-8F illustrate environment 800. In some embodiments, environment 800 is a physical environment and / or location, such as a home, an office space, and / or a school. Environment 800 includes subject 802 and computer system 600. In some embodiments, computer system 600 includes one or more cameras that provide computer system 600 a field of view of environment 800.

[0228] In some embodiments, computer system 600 is in communication with a software object (e.g., as discussed above with respect to FIG. 5) . In such embodiments, computer system 600 can receive a response to an input from the software object. The response can include a visual, an auditory, and / or a haptic portion. In some embodiments, computer system 600 receives a manner for outputting the response from the software object. For example, the software object can specify how computer system 600 should output the visual, auditory, and / or haptic portion and / or how computer system 600 should move, via the one or more movement components, a portion(e.g., including one or more input devices and / or one or more output devices) while outputting the response. In some embodiments, computer system 600 only receives what to output without receiving a manner for outputting. In such embodiments, computer system 600 can determine the manner based on a current context as further discussed below. In some embodiments, computer system 600 includes the software object to perform one or more operations discussed herein.Accordingly, it should be recognized that, while the discussion below refers to operations performed by computer system 600, such operations can be performed by the software object, a system process in communication with the software object, and / or a user process in communication with the software object.

[0229] As illustrated in FIG. 8A, computer system 600 displays user interface 602. In some embodiments, user interface 602 is a user interface corresponding to the software object for interacting with the software object. At FIG. 8A, computer system 600 displays software object representation 604 within user interface 602 to provide a visual cue that computer system 600 is ready for input and / or that interacting with computer system 600 includes interacting with the software object. At FIG. 8A, computer system 600 displays software object representation 604 with an appearance of waiting for an input. In some embodiments, computer system 600 displays software object representation 604 as having different appearances (e.g., different colors (e.g., sets of colors, flesh tones, reds, oranges, yellows, greens, blues, and / or purples) , textures (e.g., skin, hair, fur, scales, plastic, glass, feathers, and / or wood) , accessories (e.g., hat, glasses, monocle, wand, book, collar, bow, wings, halo, and / or crown) , and / or face types (e.g., human, animal, anthropomorphized object, alien, non-descript face, fantasy creature, and / or a collection of objects that resemble a face) ) .

[0230] While displaying software object representation 604, computer system 600 detects that subject 802 is directing attention to computer system 600. In some embodiments, computer system 600 detects that subject 802 is directing attention to computer system 600 through analysis of images captured by a camera included in, connected to, and / or incommunication with computer system 600. In response to detecting that subject 802 is directing attention to computer system 600, computer system 600 reciprocates the attention back towards subject 802. In some embodiments, computer system 600 reciprocates attention back towards subject 802 by moving (e.g., via a movement component) to face subject 802. For example, computer system 600 can move the portion such that the camera and / or a display component is facing subject 802. In some embodiments, such movement is movement such as performed by center stage using an ultrawide camera and a neural engine to automatically pan and zoom to change a frame, such as when someone moves around. In some embodiments, computer system 600 reciprocates attention back towards subject 802 by displaying software object representation 604 with an appearance of directing attention towards subject 802. For example, to reciprocate attention, computer system 600 can change software object representation 604 to be a triangle with one corner facing subject 802. For another example, to reciprocate attention, software object representation 604 can include one or more eyes and computer system 600 can change a direction that the one or more eyes are facing and / or focused on to be in direction of subject 802. For another example, as part of displaying software object representation 604 with an appearance of directing attention to subject 802, computer system 600 can display software object representation 604 as listening, such as having an ear turned towards subject 802 while cupping a hand around the ear.

[0231] At FIG. 8A, computer system 600 detects input 805a, "What's the weather like?" directed to software object representation 604. It should be recognized that input 805a is an example of a verbal input but can be other types of inputs, such as tap inputs directed to keyboard to enter text and / or a person navigating to a weather application.

[0232] As illustrated in FIG. 8B, in response to detecting input 805a, computer system 600 displays weather content 806. Weather content 806 is a user interface object that includes information about the weather at the location of computer system 600 and subject 802, "70° and sunny".

[0233] Additionally, while displaying weather content 806, computer system 600 alters the appearance of software object representation 604 by reducing the size of software object representation 604. In some embodiments, computer system 600 displays software object representation 604 at the reduced size to direct the attention of subject 802 towards weather content 806. In some embodiments, computer system 600 alters the appearance of software object representation 604 in a way other than a change in size. For example, computer system 600 can alter a color, opacity, position, expression, orientation, and / or emphasis of software object representation 604. Also illustrated in FIG. 8B, while displaying software object representation 604 at a reduced size, computer system 600 displays software object representation 604 with an appearance of directing attention to subject 802 (e.g., as described above) .

[0234] While directing attention to computer system 600, subject 802 picks up object 804 (e.g., an apple) . In some embodiments, object 804 is a different type of item, such as a pencil, a book, a tomato, a toothbrush, and / or a bottle of water. At FIG. 8B, computer system 600 detects input 805b, "Can you add two of these to my shopping list?" directed to software object representation 604. It should be recognized that input 805b is an example of a verbal input but can be other inputs, such as a point air gesture, a tap input directed to object 804, and / or a combination of inputs, such as a verbal input, "Add this," and a point air gesture. It should also be recognized that input 805b is ambiguous anddoes not explicitly disclose what object 804 is to computer system 600.

[0235] In some embodiments, in addition to detecting input 805b, computer system 600 detects another input (e.g., part of and / or separate from input 805b) directed to object 804. For example, a point input, a gaze input, and / or a tap input. For another example, subject 802 holds object 804 directly in front of a camera included in, connected to, and / or in communication with computer system 600. It should be recognized that, in some embodiments, detecting the other input helps computer system 600 be certain about what item the subject is referring to. In other embodiments, computer system 600 identifies object 804 without requiring the other input.

[0236] As illustrated in FIG. 8C, in response to detecting input 805b, computer system 600 turns (e.g., via a movement component) to direct attention towards object 804 to attempt to identify object 804 (e.g., the object that subject 802 is holding and input 805b is in reference to) . In some embodiments, computer system 600 turns to face (e.g., physically moving the portion of computer system 600) and directs attention to object 804 (e.g., through software object representation 604) in response to detecting subject 802 direct attention to object 804. For example, in response to detecting subject 802 direct attention to object 804 by looking at object 804, computer system 600 turns to face and directs attention to object 804. In some embodiments, in response to detecting input 805b and with a determination that computer system 600 is unable to turn to direct attention towards object 804, computer system 600 can request subject 802 to move closer and / or within the field of view of computer system 600. For example, in a scenario where a water bottle is blocking computer system 600 from movement to the right,computer system 600 output a request to move the water bottle or move object 804 to the left side of computer system 600.

[0237] It should be recognized that computer system 600 determines that object 804 is subject 802 of input 805b because of the connection between input 805b and the action of subject 802 holding the item. At FIG. 8C, in response to the ambiguous nature of input 805b, computer system 600 attempts to identify object 804 through images captured by a camera, included in, connected to (e.g., part of the portion of computer system 600 moved to face object 804) , and / or in communication with computer system 600. It should be recognized that computer system 600 attempts to identify object 804 through analysis of the object and draws additional reference information from environment 800 (e.g., computer system 600 can use information from environment 800 to help with identifying object 804) .

[0238] Additionally, in response to detecting input 805b, computer system 600 outputs audible output 808, "Let me see...". It should be recognized that audible output 808 is one example of an output and that other outputs can be used, including audible outputs with different content. In some embodiments, in response to detecting an input directed to computer system 600 while detecting that subject 802 is directing attention to computer system 600, computer system 600 does not move via a movement component and / or display software object representation 604 with an appearance of directing attention anywhere since the input is directed to computer system 600 (e.g., computer system 600 does not need to move to gather information from environment 800 to respond to the input as it does when turning to attempt to identify object 804) .

[0239] As illustrated in FIG. 8C, in response to detecting input 805b, computer system 600 alters the appearance ofsoftware object representation 604 by increasing the size of software object representation 604 (e.g., to the size illustrated in FIG. 8A or a size between the size illustrated in FIG. 8A and the size illustrated in FIG. 8B) . In some embodiments, computer system 600 displays software object representation 604 at the increased size to indicate that computer system 600 is performing an operation (e.g., directing attention to and / or attempting to identify) directed to object 804. In some embodiments, computer system 600 displays software object representation 604 as directing attention to object 804 in a different manner. For example, computer system 600 displays software object representation 604 with a different color to indicate that computer system 600 is directing attention to and attempting to identify object 804. For another example, computer system 600 displays software object representation 604 with a different expression (e.g., a focused expression with narrow eyes to indicate that computer system 600 is directing attention to and attempting to identify object 804.

[0240] As illustrated in FIG. 8C, computer system 600 displays software object representation 604 as overlapping weather content 806. It should be recognized that computer system 600 displays software object representation 604 as overlapping weather content 806 to direct the attention of subject 802 away from weather content 806 to indicate to subject 802 that computer system 600 is attempting to identify object 804. It should be recognized that, in some embodiments, software object representation 604 can overlap weather content 806 more or less than illustrated. At FIG. 8C, computer system 600 determines the identity of object 804.

[0241] As illustrated in FIG. 8D, in response to determining the identity of object 804, computer system 600 displays shopping list 812. Shopping list 812 includes (1) "2 apples"in response to computer system 600 successfully determining the identity of object 804 and in response to detecting input 805b and (2) "A gallon of milk" (e.g., shopping list 812 existed before computer system 600 detected input 805b and has an item from a past input already included) .

[0242] In some embodiments, computer system 600 is more specific when recognizing an object. For example, in response to recognizing a branded water bottle, computer system 600 can add the branded water bottle to a shopping list rather than a generic water bottle.

[0243] Additionally, while displaying shopping list 812, computer system 600 alters the appearance of software object representation 604 by reducing the size of software object representation 604 (e.g., to the size illustrated in FIG. 8B) . In some embodiments, computer system 600 displays software object representation 604 at the reduced size to direct the attention of subject 802 towards shopping list 812. While displaying shopping list 812 and software object representation 604 at a reduced size, computer system 600 outputs audible output 810, "I added apples to your shopping list.". It should be recognized that audible output 810 includes an identification of what was added and an identification of where it was added. It should also be recognized that audible output 810 is one example of an output and that other outputs can be used, including audible outputs with different content

[0244] In some embodiments, while displaying shopping list 812, computer system 600 maintains the appearance of software object representation 604 at a reduced size when displaying another type of content. For example, in response to detecting an input, "What's the weather like again?" while displaying shopping list 812, computer system 600 displays weathercontent 806 with shopping list 812 and maintains the appearance of software object representation 604 at a reduced size (e.g., computer system 600 does not need to change the size of software object representation 604 since computer system 600 is capable of performing the operation of displaying weather content 806 without using additional reference information from environment 800) .

[0245] In some embodiments, computer system 600 maintains the appearance of software object representation 604 at a reduced size when responding to an input that does not require computer system 600 to use additional reference information from environment 800. For example, in response to detecting an input, "Show me my investment portfolio.", computer system 600 displays investment portfolio content and maintains the appearance of software object representation 604 at a reduced size due to not using additional reference information from environment 800 to display the investment portfolio content.

[0246] In some embodiments, computer system 600 maintains the appearance of software object representation 604 at a reduced size when responding to an explicit input. For example, in response to detecting an input, "Text Bob.", computer system 600 displays a messaging user interface and maintains the appearance of software object representation 604 at a reduced size since computer system 600 is capable of performing the operation of displaying a messaging user interface without using additional reference information from environment 800. In other embodiments, when displaying a user interface of an application, computer system 600 ceases display of software object representation 604 and instead displays an indication of the software object in another manner, such as a glow at the bottom of the screen so that, for example, the user interface of the application can take up more of a displayarea, reducing an amount occluded by a representation of the software object

[0247] At FIG. 8D, computer system 600 detects that subject 802 is directing their attention to point of interest 814. In some embodiments, point of interest 814 is an object, a part of environment 800, a person, another computer system, or other type of subject. In some embodiments, computer system 600 detects that subject 802 is directing attention to point of interest 814 based on detecting the gaze of subject 802. In other embodiments, computer system 600 detects that subject 802 is directing attention to point of interest 814 based on analysis of images captured by a camera included in, connected to, and / or in communication with computer system 600. In some embodiments, computer system 600 detects that subject 802 is directing attention to point of interest 814 based on detecting subject 802 direct an input to point of interest 814. For example, a gaze input, an air gesture input, and / or a verbal input (e.g., "Oh, there it is.") .

[0248] At FIG. 8E, in response to detecting that subject 802 is directing attention to point of interest 814, computer system 600 determines that point of interest 814 is nearby and is within the field of view of computer system 600. At FIG. 8E, in response to the determination that point of interest 814 is nearby and is within the field of view of computer system 600, computer system 600 turns (e.g., via a movement component) to direct attention to point of interest 814 as well .

[0249] In some embodiments, in response to detecting that subject 802 is directing attention to point of interest 814, computer system 600 displays software object representation 604 with an appearance of directing attention to point of interest 814. In some embodiments, computer system 600displays software object representation 604 with an appearance of directing attention to point of interest 814 and then turns via a movement component to direct attention to point of interest 814. In some embodiments, in response to detecting that subject 802 is directing attention to point of interest 814 (e.g., and is no longer directing attention to computer system 600) , computer system 600 alters the appearance of software object representation 604 by increasing the size of software object representation 604 (e.g., to a size similar to the size illustrated in FIG. 8C) .

[0250] In some embodiments, computer system 600 displays software object representation 604 with an appearance of directing attention to point of interest 814 based on a determination that point of interest 814 is within a certain proximity (e.g., five to ten feet away from computer system 600) .

[0251] In some embodiments, computer system 600 displays software object representation 604 with an appearance of directing attention to point of interest 814 to compensate for a physical movement of computer system 600. For example, if computer system 600 turns a small amount to direct attention to point of interest 814, computer system 600 can display software object representation 604 with an appearance of moving dramatically to direct attention to point of interest 814 to compensate the small amount of turn. For another example, if computer system 600 turns a large amount and directs attention to point of interest 814, computer system 600 can display software object representation 604 with an appearance of moving less dramatically to direct attention to point of interest 814 to not need to compensate for the large amount of turn.

[0252] In some embodiments , computer system 600 moves to direct attention to point of interest 814 based on detecting subj ect 802 direct an input to point of interest 814 . For example , computer system 600 detects a verbal input of "Oh, I was looking for this ! " For another example , computer system 600 detects subj ect 802 direct a point gesture towards point of interest 814 .

[0253] In some embodiments , computer system 600 directs attention to point of interest 814 through physical movement without using a display component . In such embodiments , computer system 600 does not direct attention to point of interest 814 by displaying software obj ect representation 604 with an appearance of directing attention to point of interest 814 as it moves . In other embodiments , computer system 600 directs attention to point of interest 814 through displaying software obj ect representation 604 with an appearance of directing attention to point of interest 814 without moving computer system 600 . In such embodiments , computer system 600 does not direct attention to point of interest 814 though a physical movement while displaying software obj ect representation 604 with an appearance of directing attention to point of interest 814 . In some embodiments , computer system 600 directs attention to point of interest 814 through both a physical movement and displaying software obj ect representation 604 with an appearance of directing attention to point of interest 814 . In such embodiments , computer system 600 can make a physical movement before displaying software obj ect representation 604 with an appearance of directing attention to point of interest 814 or vice versa . In other embodiments , computer system directs attention to point of interest 814 though both physical movement and displaying software obj ect representation 604 with an appearance of directing attention to point of interest 814 at the same time .

[0254] In some embodiments, in a scenario where subject 802 has directed attention to point of interest 814 (e.g., and away from computer system 600) and computer system 600 also directed attention to point of interest 814, in response to detecting subject 802 direct attention back to computer system 600, computer system 600 directs attention back to subject 802. In some embodiments, computer system 600 directs attention back to subject 802 by turning towards subject 802 via a movement component. In some embodiments, computer system 600 directs attention back to subject 802 by displaying software object representation 604 with an appearance of directing attention towards subject 802. In some embodiments, computer system 600 directs attention back to subject 802 by turning towards subject 802 via a movement component and displaying software object representation 604 with an appearance of directing attention towards subject 802.

[0255] In some embodiments, in the scenario that point of interest 814 is a person, in response to detecting subject 802 direct attention to that person, computer system 600 displays software object representation 604 with an appearance of directing attention towards that person. For example, in response to detecting subject 802 direct attention to another person entering into environment 800, computer system 600 displays software object representation 604 with an appearance of directing attention to the other person as well. In some embodiments, computer system 600 directs attention to the other person by turning towards the other person via a movement component .

[0256] In some embodiments, in the scenario that point of interest 814 is a person, in response to detecting subject 802 direct an input to that person, computer system 600 can display software object representation 604 with an appearance of directing attention towards that person. For example, inresponse to detecting subject 802 direct an input (e.g., a wave, a verbal input, "Hello!", a point gesture, and / or a gaze input) to the other person, computer system 600 displays software object representation 604 with an appearance of directing attention towards the other person. It should be recognized that computer system 600 displays software object representation 604 with an appearance of directing attention towards that person in response to detecting subject 802 direct an input to the other person as a method of reactionary attention to detect the other person's response.

[0257] In some embodiments, in the scenario that point of interest 814 is a person, computer system 600 displays software object representation 604 with an appearance of directing attention towards that person in response to detecting that subject 802 is talking with the other person. In other embodiments, computer system 600 displays software object representation 604 with an appearance of directing attention towards that person in response to detecting that subject 802 is talking with the other person and determining that the other person is the topic of conversation. For example, in response to detecting subject 802 say, "Did you get a haircut?", computer system 600 displays software object representation 604 with an appearance of directing attention to the other person's hair.

[0258] At FIG. 8F, computer system 600 detects that subject 802 is directing their attention to point of interest 816. In some embodiments, point of interest 816 is an object, a part of environment 800, a person, another computer system, or other type of subject. At FIG. 8F, computer system 600 determines that point of interest 816 is far away and is beyond the field of view of computer system 600

[0259] As illustrated in FIG. 8F, in response to the determination that point of interest 816 is far away (e.g., farther than ten feet away from computer system 600) , computer system 600 displays software object representation 604 with an appearance of waiting for an input (e.g., with a similar size and appearance as illustrated in FIG. 8A) . In some embodiments, computer system 600 displays software object representation 604 with an appearance of directing attention to point of interest 816. Additionally at FIG. 8F, in response to the determination that point of interest 816 is far away, computer system 600 moves via a movement component to face subject 802.

[0260] As illustrated in FIG. 8F, as part of displaying software object representation 604 with an appearance of waiting for an input, computer system 600 ceases display of shopping list 812. In some embodiments, computer system 600 maintains display of shopping list 812 while displaying software object representation 604 with an appearance of waiting for an input.

[0261] In some embodiments, in response to detecting subject 802 direct attention to point of interest 816, computer system 600 displays software object representation 604 with an appearance of directing attention to point of interest 816. In some embodiments, computer system 600 directs attention to point of interest 816 based on detecting subject 802 direct an input to point of interest 816. For example, computer system 600 detects a verbal input of "Oh, I was looking for this!" For another example, computer system 600 detects subject 802 direct a point gesture towards point of interest 816.

[0262] FIG. 9 is a flow diagram illustrating a process (e.g., process 900) for displaying representation of a software object based on presence of an object in accordance with someembodiments. Some operations in process 900 are, optionally, combined, the orders of some operations are, optionally, changed, and some operations are, optionally, omitted.

[0263] As described below, process 900 provides an intuitive way for displaying representation of a software object based on presence of an object in accordance with some embodiments. Process 900 reduces the cognitive burden on a user, thereby creating a more efficient human-machine interface. For battery-operated computing devices, enabling a user to interact with such devices faster and more efficiently conserves power and increases the time between battery charges .

[0264] The devices, methods, and / or computer-readable storage mediums described below enhance the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating / interacting with the device) which, additionally, reduces power usage and / or improves battery life of the device by enabling the user to use the device more quickly and efficiently. Displaying user interface elements with different appearances at different times (such as by changing the manner in which a representation of a software object is displayed) helps to avoid image persistence or burn in effects that can occur with some display technologies when the same object is displayed with the same appearance at the same location repeatedly or for a long period of time. Providing improved feedback (such as by maintaining or changing the manner of which a representation of a software object is displayed based on different sets of one or more criteria) enhances the operability of the device by reducing accidental and mistaken inputs, reducing energy usage by the device. Reducing the number of inputs needed to perform an operation (such as by changing the manner of which arepresentation of a software object is displayed based on a set of one or more criteria) enhances the operability of the device by reducing the number of inputs and time required to perform a particular operation, reducing energy usage by the device. Performing an operation when a set of conditions has been met without requiring further user input (such as by maintaining or changing the manner of which a representation of a software object is displayed based on context of an input) enhances the operability of the device by reducing unnecessary inputs and / or steps to navigate through different user interfaces or sets of controls, reducing energy usage by the device.

[0265] In some embodiments, process 900 is performed at a computer system (e.g., 600) that is in communication (e.g., wired communication and / or wireless communication) with (and / or includes) one or more display components (e.g., a display screen, a projector, a head mounted display, and / or a touch-sensitive display) and one or more input devices (e.g., a camera, a depth sensor, a microphone, a light sensor, a flicker sensor, a hardware input mechanism, a rotatable input mechanism, a physical input mechanism, a mechanical button, a touch-sensitive button, a button, a crown, a knob, a dial, a physical slider, an accelerometer, a mouse, a keyboard, a touchpad, and / or a touch-sensitive surface) . In some embodiments, the computer system is a watch, a phone, a tablet, a fitness tracking device, a processor, a head-mounted display (HMD) device, a communal device, a media device, a speaker, a television, an electronic device, and / or a personal computing device.

[0266] The computer system displays (902) , via the one or more display components, a representation (e.g., a character and / or a system avatar) of a software object (e.g., 604) (e.g., as described above with respect to FIG. 5) in a first manner(e.g., as described above with respect to FIG. 8A-8B) (e.g., a first set of visual characteristics such as color, size, opacity, position, expression, orientation, and / or emphasis) . In some embodiments, the representation of the software object is a system avatar and / or visual representation to depict that a subject is interacting with the computer system and / or the software object (e.g., providing a visual cue that the subject is talking with and / or detected by the computer system and / or the software object by providing an avatar that is listening to the subject) . In some embodiments, while displaying the representation of the software object in the first manner, the computer system animates the representation such as to depict a status of the computer system (e.g., waking up, ready to perform an activity, and / or outputting a reply to the input) . In some embodiments, the computer system displays the representation of the software object in the first manner based on other content (e.g., the representation of the software object is displayed alongside and / or with the other content and has an appearance that is influenced by the other content) . In some embodiments, displaying the representation of the software object in the first manner includes displaying the representation of the software object at a reduced size (e.g., as compared to another manner and / or a default manner) . In some embodiments, the computer system displays the representation of the software object in the first manner in response to outputting content (e.g., audibly and / or visually outputting content in response to a previous request from a user) . In some embodiments, the computer system displays the representation of the software object in the first manner while performing an operation (e.g., searching and / or reviewing locally stored information and / or a remote information source for information corresponding to a request from a user) .

[0267] While displaying the representation of the software object in the first manner, the computer system detects (904) , via the one or more input devices, an input (e.g., 805a, 805b) (e.g., a tap input and / or a voice input) from a subject (e.g., 802) (e.g., an individual, a person, and / or a personal device of a person) (e.g., as described above with respect to FIGS. 8A-8B and 8D) . In some embodiments, detecting the input from the subject includes detecting, via the one or more input dev...

Claims

CLAIMSWhat is claimed is:

1. A method, comprising: at a computer system that is in communication with one or more display components, one or more input components, and one or more output components: while displaying, via the one or more display components, a representation of a software object with a first set of one or more visual characteristics, detecting, via the one or more input components, an input; and in response to detecting the input: in accordance with a determination that a first set of one or more criteria is satisfied, wherein the first set of one or more criteria includes a criterion that is satisfied when a current context is a first type of context: outputting, via the one or more output components, a first response; and while outputting the first response, displaying, via the one or more display components, the representation of the software object with a second set of one or more visual characteristics different from the first set of one or more visual characteristics; and in accordance with a determination that a second set of one or more criteria, different from the first set of one or more criteria, is satisfied, wherein the second set of one or more criteria includes a criterion that is satisfied when the current context is a second type of context different from the first type of context: outputting, via the one or more output components, a second response; and while outputting the second response, displaying, via the one or more display components, the representation of the software object with a third set of oneor more visual characteristics di f ferent from the first set of one or more visual characteristics and the second set of one or more visual characteristics .2 . The method of claim 1 , wherein the computer system is in communication with one or more movement components , the method further comprising : in response to detecting the input and in accordance with the determination that the first set of one or more criteria is satis fied, moving, via the one or more movement components , a portion of the computer system by a first physical amount .3 . The method of claim 2 , further comprising : in response to detecting the input and in accordance with the determination that the second set of one or more criteria is satis fied, the computer system moves , via the one or more movement components , the portion of the computer system by a second physical amount di f ferent from the first physical amount .4 . The method of any one of claims 1-3 , wherein the first response consists of first content , wherein the second response consists of second content , wherein the second content is the same as the first content , wherein the computer system is in communication with one or more movement components , the method further comprising : in response to detecting the input : while outputting, via the one or more output components , a first portion of the first response , moving, via the one or more movement components , a portion of the computer system by a third physical amount ; while outputting, via the one or more output components , a second portion of the first response di f ferent from the first portion of the first response , moving, via themovement component , the portion of the computer system by a fourth physical amount di f ferent from the third physical amount ; while outputting, via the one or more output components , a first portion of the second response , moving, via the movement component , the portion of the computer system by the third physical amount ; and while outputting, via the one or more output components , a second portion of the second response di f ferent from the first portion of the second response , moving, via the movement component , the portion of the computer system by a fi fth physical amount di f ferent from the fourth physical amount and the third physical amount .5 . The method of claim 4 , wherein outputting the first portion of the first response includes displaying, via the one or more display components , the representation of the software obj ect with a fourth set of one or more visual characteristics , and wherein outputting the first portion of the second response includes displaying, via the one or more display components , the representation of the software obj ect with the fourth set of one or more visual characteristics .6 . The method of any one of claims 4-5 , wherein outputting the second portion of the first response includes displaying, via the one or more display components , the representation of the software obj ect with a fi fth set of one or more visual characteristics , and wherein outputting the second portion of the second response includes displaying, via the one or more display components , the representation of the software obj ect with a sixth set of one or more visual characteristics di f ferent from the fi fth set of one or more visual characteristics .

7. The method of any one of claims 1-6, wherein the first response is output, via the one or more output components, at a first pitch, and wherein the second response is output, via the one or more output components, at a second pitch different from the first pitch.

8. The method of any one of claims 1-7, wherein the second response is the first response.

9. The method of any one of claims 1-8, wherein the computer system is in communication with a large language model (LLM) , and wherein the first response is received from the LLM.

10. The method of any one of claims 1-9, wherein the current context corresponds to a state of a user.

11. The method of claim 10, wherein the state of the user corresponds to pitch of the user, tone of the user, body language of the user, or any combinations thereof.

12. The method of any one of claims 1-11, wherein the current context corresponds to a state of the computer system.

13. The method of any one of claims 1-12, wherein the computer system is in communication with a sensor, and wherein the current context is based on sensor data detected via the sensor .

14. The method of any one of claims 1-13, wherein the input corresponds to a request.

15. The method of any one of claims 1-14, wherein the input corresponds to a statement.16 . A non-transitory computer-readable medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more display components , one or more input components , and one or more output components , the one or more programs including instructions for performing the method of any one of claims 1- 15 .17 . A computer system that is configured to communicate with one or more display components , one or more input components , and one or more output components , the computer system comprising : one or more processors ; and memory storing one or more programs configured to be executed by the one or more processors , the one or more programs including instructions for performing the method of any one of claims 1- 15 .18 . A computer system that is configured to communicate with one or more display components , one or more input components , and one or more output components , the computer system comprising : means for performing the method of any one of claims 1- 15 .19 . A computer program product , comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more display components , one or more input components , and one or more output components , the one or more programs including instructions for performing the method of any one of claims 1- 15 .20 . A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more display components , one or more input components , and one or more output components , the one or more programs including instructions for : while displaying, via the one or more display components , a representation of a software obj ect with a first set of one or more visual characteristics , detecting, via the one or more input components , an input ; and in response to detecting the input : in accordance with a determination that a first set of one or more criteria is satis fied, wherein the first set of one or more criteria includes a criterion that is satis fied when a current context is a first type of context : outputting, via the one or more output components , a first response ; and while outputting the first response , displaying, via the one or more display components , the representation of the software obj ect with a second set of one or more visual characteristics di f ferent from the first set of one or more visual characteristics ; and in accordance with a determination that a second set of one or more criteria, di f ferent from the first set of one or more criteria, is satis fied, wherein the second set of one or more criteria includes a criterion that is satis fied when the current context is a second type of context di f ferent from the first type of context : outputting, via the one or more output components , a second response ; and while outputting the second response , displaying, via the one or more display components , the representation of the software obj ect with a third set of one or more visual characteristics di f ferent from the first set ofone or more visual characteristics and the second set of one or more visual characteristics.

21. A computer system configured to communicate with one or more display components, one or more input components, and one or more output components, comprising: one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: while displaying, via the one or more display components, a representation of a software object with a first set of one or more visual characteristics, detecting, via the one or more input components, an input; and in response to detecting the input: in accordance with a determination that a first set of one or more criteria is satisfied, wherein the first set of one or more criteria includes a criterion that is satisfied when a current context is a first type of context: outputting, via the one or more output components, a first response; and while outputting the first response, displaying, via the one or more display components, the representation of the software object with a second set of one or more visual characteristics different from the first set of one or more visual characteristics; and in accordance with a determination that a second set of one or more criteria, different from the first set of one or more criteria, is satisfied, wherein the second set of one or more criteria includes a criterion that is satisfied when the current context is a second type of context different from the first type of context: outputting, via the one or more output components, a second response; andwhile outputting the second response displaying, via the one or more display components, the representation of the software object with a third set of one or more visual characteristics different from the first set of one or more visual characteristics and the second set of one or more visual characteristics.

22. A computer system configured to communicate with one or more display components, one or more input components, and one or more output components, comprising: means for, while displaying, via the one or more display components, a representation of a software object with a first set of one or more visual characteristics, detecting, via the one or more input components, an input; and in response to detecting the input: in accordance with a determination that a first set of one or more criteria is satisfied, wherein the first set of one or more criteria includes a criterion that is satisfied when a current context is a first type of context: means for outputting, via the one or more output components, a first response; and means for, while outputting the first response, displaying, via the one or more display components, the representation of the software object with a second set of one or more visual characteristics different from the first set of one or more visual characteristics; and in accordance with a determination that a second set of one or more criteria, different from the first set of one or more criteria, is satisfied, wherein the second set of one or more criteria includes a criterion that is satisfied when the current context is a second type of context different from the first type of context: means for outputting, via the one or more output components, a second response; andmeans for, while outputting the second response , displaying, via the one or more display components , the representation of the software obj ect with a third set of one or more visual characteristics di f ferent from the first set of one or more visual characteristics and the second set of one or more visual characteristics .23 . A computer program product , comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more display components , one or more input components , and one or more output components , the one or more programs including instructions for : while displaying, via the one or more display components , a representation of a software obj ect with a first set of one or more visual characteristics , detecting, via the one or more input components , an input ; and in response to detecting the input : in accordance with a determination that a first set of one or more criteria is satis fied, wherein the first set of one or more criteria includes a criterion that is satis fied when a current context is a first type of context : outputting, via the one or more output components , a first response ; and while outputting the first response , displaying, via the one or more display components , the representation of the software obj ect with a second set of one or more visual characteristics di f ferent from the first set of one or more visual characteristics ; and in accordance with a determination that a second set of one or more criteria, di f ferent from the first set of one or more criteria, is satis fied, wherein the second set of one or more criteria includes a criterion that is satis fied whenthe current context is a second type of context different from the first type of context: outputting, via the one or more output components, a second response; and while outputting the second response, displaying, via the one or more display components, the representation of the software object with a third set of one or more visual characteristics different from the first set of one or more visual characteristics and the second set of one or more visual characteristics.

24. A method, comprising: at a computer system that is in communication with one or more display components and one or more input devices: displaying, via the one or more display components, a representation of a software object in a first manner; while displaying the representation of the software object in the first manner, detecting, via the one or more input devices, an input from a subject; in response to detecting the input from the subject: in accordance with a determination that a first set of one or more criteria is satisfied, wherein the first set of one or more criteria includes a criterion that is satisfied when the input from the subject corresponds to an object in an environment including the computer system, displaying, via the one or more display components, the representation of the software object in a second manner different from the first manner, wherein the object is different from the subject; and in accordance with a determination that a second set of one or more criteria is satisfied, maintaining display of, via the one or more display components, the representation of the software object in the first manner,wherein the second set of one or more criteria is different from the first set of one or more criteria.

25. The method of claim 24, wherein the computer system is a communal device.

26. The method of any one of claims 24-25, wherein the representation of the software object is displayed in the first manner while displaying, via the one or more display components, content.

27. The method of claim 26, wherein displaying the representation of the software object in the second manner includes displaying, via the one or more display components, the representation of the software object overlapping a portion of the content.

28. The method of any one of claims 24-27, wherein detecting the input includes detecting, via the one or more input devices, a voice input.

29. The method of any one of claims 24-28, wherein detecting the input includes detecting, via the one or more input devices, an air gesture.

30. The method of any one of claims 24-29, wherein the first set of one or more criteria includes a criterion that is satisfied when the input is a request to perform an operation with respect to the object.

31. The method of any one of claims 24-30, wherein the second set of one or more criteria includes a criterion that is satisfied when the input is a request to perform an operation irrespective of the environment.

32. The method of any one of claims 24-31, wherein the first set of one or more criteria includes a criterion that is satisfied when the input is ambiguous.

33. The method of any one of claims 24-32, wherein the second set of one or more criteria includes a criterion that is satisfied when the input is explicit.

34. The method of any one of claims 24-33, wherein the first set of one or more criteria includes a criterion that is satisfied when the input includes a reference to the object without including an identification of the object.

35. The method of any one of claims 24-34, wherein the first set of one or more criteria includes a criterion that is satisfied when the input includes a gesture directed to the ob j ect .

36. The method of any one of claims 24-35, wherein displaying the representation of the software object in the second manner includes displaying, via the one or more display components, the representation of the software object directed to the ob j ect .

37. The method of any one of claims 24-36, wherein the computer system is in communication with one or more movement components, the method further comprising: in response to detecting the input from the subject and in accordance with the determination that the first set of one or more criteria is satisfied, moving, via the one or more movement components, a portion of the computer system to be directed to the object.

38. The method of any one of claims 24-37, wherein the computer system is in communication with one or more output devices, the method further comprising: in response to detecting the input from the subject and in accordance with the determination that the first set of one or more criteria is satisfied, outputting, via the one or more output devices, an identification of the object.

39. The method of claim 38, wherein outputting the identification of the object includes displaying, via the one or more display components, the identification of the object.

40. The method of any one of claims 38-39, wherein the computer system is in communication with one or more audio components, and wherein outputting the identification of the object includes audibly outputting, via the one or more audio components, the identification of the object.

41. The method of any one of claims 24-40, wherein the computer system is in communication with one or more output devices, the method further comprising: after displaying the software object in the second manner, outputting, via the one or more output devices, a response to the input based on the object.

42. The method of claim 41, further comprising: in conjunction with outputting the response, displaying, via the one or more display components, the representation of the software object in the first manner.

43. The method of any one of claim 24-42, further comprising: in conjunction with maintaining display of the representation of the software object in the first manner,displaying, via the one or more display components , content corresponding to the input .44 . A non-transitory computer-readable medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more display components and one or more input devices , the one or more programs including instructions for performing the method of any one of claims 24-43 .45 . A computer system that is configured to communicate with one or more display components and one or more input devices , the computer system comprising : one or more processors ; and memory storing one or more programs configured to be executed by the one or more processors , the one or more programs including instructions for performing the method of any one of claims 24-43 .46 . A computer system that is configured to communicate with one or more display components and one or more input devices , the computer system comprising : means for performing the method of any one of claims 24- 43 .47 . A computer program product , comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more display components and one or more input devices , the one or more programs including instructions for performing the method of any one of claims 24-43 .48 . A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or moreprocessors of a computer system that is in communication with one or more display components and one or more input devices, the one or more programs including instructions for: displaying, via the one or more display components, a representation of a software object in a first manner; while displaying the representation of the software object in the first manner, detecting, via the one or more input devices, an input from a subject; in response to detecting the input from the subject: in accordance with a determination that a first set of one or more criteria is satisfied, wherein the first set of one or more criteria includes a criterion that is satisfied when the input from the subject corresponds to an object in an environment including the computer system, displaying, via the one or more display components, the representation of the software object in a second manner different from the first manner, wherein the object is different from the subject; and in accordance with a determination that a second set of one or more criteria is satisfied, maintaining display of, via the one or more display components, the representation of the software object in the first manner, wherein the second set of one or more criteria is different from the first set of one or more criteria.

49. A computer system configured to communicate with one or more display components and one or more input devices, the computer system comprising: one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: displaying, via the one or more display components, a representation of a software object in a first manner;while displaying the representation of the software object in the first manner, detecting, via the one or more input devices, an input from a subject; in response to detecting the input from the subject: in accordance with a determination that a first set of one or more criteria is satisfied, wherein the first set of one or more criteria includes a criterion that is satisfied when the input from the subject corresponds to an object in an environment including the computer system, displaying, via the one or more display components, the representation of the software object in a second manner different from the first manner, wherein the object is different from the subject; and in accordance with a determination that a second set of one or more criteria is satisfied, maintaining display of, via the one or more display components, the representation of the software object in the first manner, wherein the second set of one or more criteria is different from the first set of one or more criteria.

50. A computer system configured to communicate with one or more display components and one or more input devices, the computer system comprising: means for displaying, via the one or more display components, a representation of a software object in a first manner; means for, while displaying the representation of the software object in the first manner, detecting, via the one or more input devices, an input from a subject; in response to detecting the input from the subject: means for, in accordance with a determination that a first set of one or more criteria is satisfied, wherein the first set of one or more criteria includes a criterion that is satisfied when the input from the subject corresponds to anobject in an environment including the computer system, displaying, via the one or more display components, the representation of the software object in a second manner different from the first manner, wherein the object is different from the subject; and means for, in accordance with a determination that a second set of one or more criteria is satisfied, maintaining display of, via the one or more display components, the representation of the software object in the first manner, wherein the second set of one or more criteria is different from the first set of one or more criteria.

51. A computer program product, comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more display components and one or more input devices, the one or more programs including instructions for: displaying, via the one or more display components, a representation of a software object in a first manner; while displaying the representation of the software object in the first manner, detecting, via the one or more input devices, an input from a subject; in response to detecting the input from the subject: in accordance with a determination that a first set of one or more criteria is satisfied, wherein the first set of one or more criteria includes a criterion that is satisfied when the input from the subject corresponds to an object in an environment including the computer system, displaying, via the one or more display components, the representation of the software object in a second manner different from the first manner, wherein the object is different from the subject; and in accordance with a determination that a second set of one or more criteria is satisfied, maintaining display of, via the one or more display components, the representation ofthe software object in the first manner, wherein the second set of one or more criteria is different from the first set of one or more criteria.

52. A method, comprising: at a computer system that is in communication with one or more display components, one or more input devices, and one or more output devices: while the computer system is directed at a subject, detecting, via the one or more input devices, attention of the sub j ect ; in response to detecting the attention of the sub j ect : in accordance with a determination that the attention of the subject satisfies a set of one or more criteria, wherein the set of one or more criteria includes a criterion that is satisfied when the attention of the subject is not directed to the computer system, directing the computer system away from being directed to the subject; and in accordance with a determination that the attention of the subject does not satisfy the set of one or more criteria, maintaining direction of the computer system to the subject.

53. The method of claim 52, further comprising: in response to detecting the attention of the subject and in accordance with a determination that the attention of the subject corresponds to an object within an environment, directing the computer system towards the object within the environment .

54. The method of any one of claims 52-53, further comprising :detecting, via the one or more input devices, an input, wherein the determination that the attention of the subject corresponds to the object within the environment includes a determination that the input corresponds to the object.

55. The method of any one of claims 52-54, further comprising : before directing the computer system towards the subject, detecting, via the one or more input devices, an input corresponding to the subject; and in response to detecting the input corresponding to the subject, directing the computer system towards the subject.

56. The method of claim 55, further comprising: in response to detecting the input corresponding to the sub j ect : displaying, via the one or more display components, a representation of a software object in a first manner; and displaying, via the one or more display components, content corresponding to the input.

57. The method of claim 56, further comprising: in response to detecting the attention of the subject and in accordance with the determination that the attention of the subject satisfies the set of one or more criteria, displaying, via the one or more display components, the representation of the software object in a second manner different from the first manner.

58. The method of any one of claims 52-57, wherein the attention of the subject is first attention of the subject, the method further comprising: after directing the computer system away from the subject, detecting, via the one or more input devices, secondattention of the subject, wherein the second attention of the subject is different from the first attention of the subject; and in response to detecting the second attention of the subject and in accordance with a determination that the second attention of the subject is directed to the computer system, directing the computer system towards the subject.

59. The method of any one of claim 52-58, wherein directing the computer system away from the subject includes directing the computer system towards another subject different from the subject, wherein the set of one or more criteria includes a criterion that is satisfied when the attention of the subject is directed to the other subject.

60. The method of claim 59, wherein the set of one or more criteria includes a criterion that is satisfied when the other subject is a topic of a conversation corresponding to the sub ect .

61. The method of any one of claims 52-60, further comprising : in conjunction with detecting the attention of the subject, detecting, via the one or more input devices, another subject different from the subject, wherein the set of one or more criteria includes a criterion that is satisfied when the subject is speaking to the other subject.

62. The method of any one of claims 52-61, wherein directing the computer system away from the subject includes physically moving, via the one or more output devices, a portion of the computer system away from the subject.

63. The method of any one of claims 52-62, wherein directing the computer system away from the subject includes visually directing, via the one or more display components, a representation of a software object away from the subject.

64. The method of any one of claims 52-63, wherein directing the computer system away from the subject includes: physically moving, via the one or more output devices, a portion of the computer system away from the subject; and visually directing, via the one or more display components, a representation of a software object away from the subject.

65. The method of any one of claims 52-64, wherein the set of one or more criteria is a first set of one or more criteria, the method further comprising: in response to detecting the attention of the subject and in accordance with a determination that the attention of the subject satisfies a second set of one or more criteria, wherein the second set of criteria includes a criterion that is satisfied when the attention of the subject corresponds to the computer system, directing the computer system towards the subject, wherein the second set of one or more criteria is different from the first set of one or more criteria.

66. A non-transitory computer-readable medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more display components, one or more input devices, and one or more output devices, the one or more programs including instructions for performing the method of any one of claims 52-65.

67. A computer system that is configured to communicate with one or more display components, one or more input devices, and one or more output devices, the computer system comprising: one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method of any one of claims 52-65.

68. A computer system that is configured to communicate with one or more display components, one or more input devices, and one or more output devices, the computer system comprising: means for performing the method of any one of claims 52- 65.

69. A computer program product, comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more display components, one or more input devices, and one or more output devices, the one or more programs including instructions for performing the method of any one of claims 52-65.

70. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more display components, one or more input devices, and one or more output devices, the one or more programs including instructions for: while the computer system is directed at a subject, detecting, via the one or more input devices, attention of the sub ect ; in response to detecting the attention of the subject:in accordance with a determination that the attention of the subj ect satis fies a set of one or more criteria, wherein the set of one or more criteria includes a criterion that is satis fied when the attention of the subj ect is not directed to the computer system, directing the computer system away from being directed to the subj ect ; and in accordance with a determination that the attention of the subj ect does not satis fy the set of one or more criteria, maintaining direction of the computer system to the subj ect .71 . A computer system configured to communicate with one or more display components , one or more input devices , and one or more output devices , the computer system comprising : one or more processors ; and memory storing one or more programs configured to be executed by the one or more processors , the one or more programs including instructions for : while the computer system is directed at a subj ect , detecting, via the one or more input devices , attention of the sub j ect ; in response to detecting the attention of the sub j ect : in accordance with a determination that the attention of the subj ect satis fies a set of one or more criteria, wherein the set of one or more criteria includes a criterion that is satis fied when the attention of the subj ect is not directed to the computer system, directing the computer system away from being directed to the subj ect ; and in accordance with a determination that the attention of the subj ect does not satis fy the set of one or more criteria, maintaining direction of the computer system to the subj ect .

72. A computer system configured to communicate with one or more display components, one or more input devices, and one or more output devices, the computer system comprising: means for, while the computer system is directed at a subject, detecting, via the one or more input devices, attention of the subject; in response to detecting the attention of the subject: means for, in accordance with a determination that the attention of the subject satisfies a set of one or more criteria, wherein the set of one or more criteria includes a criterion that is satisfied when the attention of the subject is not directed to the computer system, directing the computer system away from being directed to the subject; and means for, in accordance with a determination that the attention of the subject does not satisfy the set of one or more criteria, maintaining direction of the computer system to the subject.

73. A computer program product, comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more display components, one or more input devices, and one or more output devices, the one or more programs including instructions for: while the computer system is directed at a subject, detecting, via the one or more input devices, attention of the sub j ect ; in response to detecting the attention of the subject: in accordance with a determination that the attention of the subject satisfies a set of one or more criteria, wherein the set of one or more criteria includes a criterion that is satisfied when the attention of the subject is not directed to the computer system, directing the computer system away from being directed to the subject; andin accordance with a determination that the attention of the subject does not satisfy the set of one or more criteria, maintaining direction of the computer system to the subject.

74. A method, comprising: at a computer system that is in communication with one or more input devices and one or more display components: while displaying, via the one or more display components, a representation of a software object, detecting, via the one or more input devices, movement of a subject; and in response to detecting the movement of the sub j ect : in accordance with a determination that the subject satisfies a first set of one or more criteria, directing the representation of the software object in a first manner; and in accordance with a determination that the subject satisfies a second set of one or more criteria, directing the representation of the software object in a second manner, wherein the second set of one or more criteria is different from the first set of one or more criteria, wherein the second manner is different from the first manner.

75. The method of claim 74, wherein the first set of one or more criteria includes a criterion that is satisfied when the subject is directing attention towards the computer system, and wherein the second set of criteria includes a criterion that is satisfied when the subject is directing attention away from the computer system.

76. The method of any one of claims 74-75, wherein the first set of one or more criteria includes a criterion that is satisfied when the subject is within a predetermined distancefrom the computer system, and wherein the second set of criteria includes a criterion that is satisfied when the subject is outside of the predetermined distance from the computer system.

77. The method of any one of claims 74-76, wherein the first set of one or more criteria includes a criterion that is satisfied when the subject is a recognized subject, and wherein the second set of criteria includes a criterion that is satisfied when the subject is not a recognized subject.

78. The method of any one of claims 74-77, wherein: the subject is a respective subject; the first set of one or more criteria includes a criterion that is satisfied when the respective subject is a first subject; and the second set of criteria includes a criterion that is satisfied when the respective subject is a second subject different from the first subject.

79. The method of any one of claims 74-78, wherein directing the representation of the software object in the first manner includes directing the representation of the software object in a direction towards the subject, and wherein directing the representation of the software object in the second manner includes directing the representation of the software object in a direction away from the subject.

80. The method of any one of claims 74-79, wherein: the computer system is in communication with one or more movement components; directing the representation of the software object in the first manner includes directing, via the one or moremovement components, a portion of the computer system in a direction towards the subject; and directing the representation of the software object in the second manner includes directing, via the one or more movement components, the portion of the computer system in a direction away from the subject.

81. The method of any one of claims 74-80, wherein: the computer system is in communication with one or more movement components; directing the representation of the software object in the first manner includes directing, via the one or more movement components, a portion of the computer system such that the subject is at a first position with respect to the portion of the computer system; and directing the representation of the software object in the second manner includes directing, via the one or more movement components, the portion of the computer system such that the subject is at a second position with respect to the portion of the computer system different from the first position with respect to the portion of the computer system.

82. The method of claim 81, wherein the second position with respect to the portion of the computer system is within a field of view of the one or more input devices.

83. The method of any one of claims 74-82, further comprising : before displaying the representation of the software object, detecting, via the one or more input devices, a respective expression of the subject, wherein: in accordance with a determination that the respective expression of the subject is a first expression,the representation of the software obj ect is displayed with a first set of visual characteristics ; in accordance with a determination that the respective expression of the subj ect is a second expression, the representation of the software obj ect is displayed with a second set of visual characteristics ; the second expression is di f ferent from the first expression; and the second set of visual characteristics is di f ferent from the first set of visual characteristics .84 . The method of any one of claims 74- 83 , further comprising : while displaying the representation of the software ob j ect : in accordance with the determination that the subj ect satis fies the first set of one or more criteria, forgoing display of respective content ; and in accordance with the determination that the subj ect satis fies the second set of one or more criteria, displaying, via the one or more display components , the respective content .85 . The method of claim 84 , further comprising : detecting, via the one or more input devices , a state of an environment including the subj ect , wherein, in response to detecting the state of the environment : in accordance with a determination that the environment satis fies a third set of one or more criteria, the respective content is first content ; in accordance with a determination that the environment satis fies a fourth set of one or more criteria, the respective content is second content corresponding to the sub j ect ;the fourth set of one or more criteria is different from the third set of one or more criteria; and the second content corresponding to the subject is different from the first content.

86. The method of any one of claims 84-85, wherein directing the representation of the software object in the second manner includes directing the representation of the software object towards the respective content.

87. The method of any one of claims 74-86, wherein directing the representation of the software object in the first manner includes directing one or more features of the representation of the software object in a first direction, and wherein directing the representation of the software object in the second manner includes directing the one or more features of the representation of the software object in a second direction different from the first direction.

88. The method of any one of claims 74-87, wherein: in response to detecting the movement of the subject: in accordance with the determination that the subject satisfies the first set of one or more criteria, the representation of the software object is displayed at a first size; and in accordance with the determination that the subject satisfies the second set of one or more criteria, the representation of the software object is displayed at a second size different from the first size.

89. A non-transitory computer-readable medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more input devices and one or more display components,the one or more programs including instructions for performing the method of any one of claims 74- 88 .90 . A computer system that is configured to communicate with one or more input devices and one or more display components , the computer system comprising : one or more processors ; and memory storing one or more programs configured to be executed by the one or more processors , the one or more programs including instructions for performing the method of any one of claims 74- 88 .91 . A computer system that is configured to communicate with one or more input devices and one or more display components , the computer system comprising : means for performing the method of any one of claims 74- 88 .92 . A computer program product , comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more input devices and one or more display components , the one or more programs including instructions for performing the method of any one of claims 74- 88 .93 . A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more input devices and one or more display components , the one or more programs including instructions for : while displaying, via the one or more display components , a representation of a software obj ect , detecting, via the one or more input devices , movement of a subj ect ; and in response to detecting the movement of the subj ect :in accordance with a determination that the subject satisfies a first set of one or more criteria, directing the representation of the software object in a first manner; and in accordance with a determination that the subject satisfies a second set of one or more criteria, directing the representation of the software object in a second manner, wherein the second set of one or more criteria is different from the first set of one or more criteria, wherein the second manner is different from the first manner.

94. A computer system configured to communicate with one or more input devices and one or more display components, the computer system comprising: one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: while displaying, via the one or more display components, a representation of a software object, detecting, via the one or more input devices, movement of a subject; and in response to detecting the movement of the sub j ect : in accordance with a determination that the subject satisfies a first set of one or more criteria, directing the representation of the software object in a first manner; and in accordance with a determination that the subject satisfies a second set of one or more criteria, directing the representation of the software object in a second manner, wherein the second set of one or more criteria is different from the first set of one or more criteria, wherein the second manner is different from the first manner.

95. A computer system configured to communicate with one or more input devices and one or more display components, the computer system comprising: means for, while displaying, via the one or more display components, a representation of a software object, detecting, via the one or more input devices, movement of a subject; and in response to detecting the movement of the subject: means for, in accordance with a determination that the subject satisfies a first set of one or more criteria, directing the representation of the software object in a first manner; and means for, in accordance with a determination that the subject satisfies a second set of one or more criteria, directing the representation of the software object in a second manner, wherein the second set of one or more criteria is different from the first set of one or more criteria, wherein the second manner is different from the first manner.

96. A computer program product, comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more input devices and one or more display components, the one or more programs including instructions for: while displaying, via the one or more display components, a representation of a software object, detecting, via the one or more input devices, movement of a subject; and in response to detecting the movement of the subject: in accordance with a determination that the subject satisfies a first set of one or more criteria, directing the representation of the software object in a first manner; and in accordance with a determination that the subject satisfies a second set of one or more criteria, directing the representation of the software object in a second manner, wherein the second set of one or more criteria is differentfrom the first set of one or more criteria, wherein the second manner is di f ferent from the first manner .97 . A method, comprising : at a computer system that is in communication with one or more input devices and one or more movement components : while a portion of the computer system is in a first position in an environment , detecting, via the one or more inputs devices , a set of one or more inputs ; and in response to detecting the set of one or more inputs : in accordance with a determination that the attention of a user does not satis fy a first attention threshold, moving, via the one or more movement components , the portion of the computer system to a second position with a first level of intensity; and in accordance with a determination that the attention of the user satis fies the first attention threshold, forgoing moving, via the one or more movement components , the portion of the computer system to the second position .98 . The method of claim 97 , wherein the computer system is in communication with a first display component , the method further comprising : before detecting the set of one or more inputs , displaying, via the first display component , a first user interface in a first state ; and in response to detecting the set of one or more inputs and in accordance with a determination that the attention of the user satis fies a second attention threshold di f ferent from the first attention threshold, changing, via the first display component , the first user interface to a second state di f ferent from the first state .99 . The method of any one of claims 97- 98 , wherein the computer system is in communication with a second display component , the method further comprising : before detecting the set of one or more inputs , displaying, via the second display component , a second user interface in a fourth state ; and in response to detecting the set of one or more inputs and in accordance with a determination that the attention of the user satis fies a third attention threshold, forgoing changing, via the second display component , the second user interface from the fourth state .100 . The method of any one of claims 97- 99 , further comprising : in response to detecting the set of one or more inputs : in accordance with a determination that the attention of the user satis fies a fourth attention threshold di f ferent from the first attention threshold, moving, via the one or more movement components , the portion of the computer system to the second position with a second level of intensity di f ferent from the first level of intensity .101 . The method of any one of claims 97- 100 , further comprising : in response to detecting the set of one or more inputs : in accordance with a determination that an input of the set of one or more inputs satis fies a first intensity threshold, moving, via the one or more movement components , the portion of the computer system in a first manner ; and in accordance with a determination that an input of the set of one or more inputs does not satis fy the first intensity threshold, forgoing moving, via the one or more movement components , the portion of the computer system to the second position .102 . The method of any one of any one of claims 97- 101 , wherein moving, via the one or more movement components , the portion of the computer system to the second position with the first level of intensity includes rotating, via the one or more movement components , the portion of the computer system to the second position .103 . The method of any one of claims 97- 102 , wherein moving, via the one or more movement components , the portion of the computer system to the second position with the first level of intensity includes laterally moving, via the one or more movement components , the portion of the computer system to the second position .104 . The method of any one of claims 97- 103 , wherein moving, via the one or more movement components , the portion of the computer system to the second position with the first level of intensity includes moving, via the one or more movement components , the portion of the computer system to the second position with a first speed, the method further comprising : in response to detecting the set of one or more inputs and in accordance with a determination that the attention of the user satis fies a fi fth attention threshold di f ferent from the first attention threshold, moving, via the one or more movement components , the portion of the computer system to the second position with a fourth level of intensity di f ferent from the first level of intensity, wherein moving the portion of the computer system to the second position with the fourth level of intensity includes moving, via the one or more movement components , the portion of the computer system to the second position with a second speed di f ferent from the first speed .105 . The method of any one of claims 97- 104 , further comprising : in response to detecting the set of one or more inputs : in accordance with a determination that the set of one or more inputs satis fy a first set of one or more criteria, moving, via the one or more movement components , the portion of the computer system to a third position; and in accordance with a determination that the set of one or more inputs satis fy a second set of one or more criteria di f ferent from the first set of one or more criteria, moving, via the one or more movement components , the portion of the computer system to a fourth position di f ferent from the third position .106 . The method of any one of claims 97- 105 , wherein moving, via the one or more movement components , the portion of the computer system to the second position with the first level of intensity includes moving, via the one or more movement components , the portion of the computer system to the second position in a first amount of time , the method further comprising : in response to detecting the set of one or more inputs and in accordance with a determination that the attention of the user satis fies a sixth attention threshold di f ferent from the first attention threshold, moving, via the one or more movement components , the portion of the computer system to the second position with a fi fth level of intensity di f ferent from the first level of intensity, wherein moving the portion of the computer system to the second position with the fi fth level of intensity includes moving, via the one or more movement components , the portion of the computer system to the second position in a second amount of time di f ferent from the first amount of time .107 . The method of any one of claims 97- 106 , further comprising : after moving, via the one or more movement components , the portion of the computer system to the second position, moving, via the one or more movement components , the portion of the computer system to the first position without detecting an input corresponding to a request to move the portion of the computer system to the first position .108 . The method of claim 107 , wherein the computer system is in communication with a third display component , the method further comprising : before moving, via the one or more movement components , the portion of the computer system to the second position, displaying, via the third display component , first content ; and after detecting the set of one or more inputs , displaying, via the third display component , second content di f ferent from the first content ; and after moving, via the one or more movement components , the portion of the computer system to the first position, displaying, via the third display component , the first content without detecting an input corresponding to a request to display the first content .109 . The method of any one of claims 97- 108 , wherein the determination that the attention of the user satis fies the first attention threshold includes a determination that a gaze of the user satis fies the first attention threshold .110 . The method of any one of claims 97- 109 , wherein the determination that the attention of the user satis fies the first attention threshold includes a determination that a body language of the user satis fies the first attention threshold .

111. The method of any one of claims 97-110, wherein the determination that the attention of the user satisfies the first attention threshold includes a determination that an expression of the user satisfies the first attention threshold .

112. The method of any one of claims 97-111, wherein the determination that the attention of the user satisfies the first attention threshold includes a determination that a touch input satisfies the first attention threshold.

113. The method of any one of claims 97-112, wherein the determination that the attention of the user satisfies the first attention threshold includes a determination that a sound input satisfies the first attention threshold.

114. The method of any one of claims 97-113, wherein the attention of the user satisfies the first attention threshold when the computer system is outputting a response to an input from the user.

115. The method of any one of claims 97-114, wherein the attention of the user satisfies the first attention threshold when the attention of the user is directed to a location corresponding to the set of one or more inputs.

116. The method of any one of claims 97-115, wherein the second position in the environment corresponds to the set of one or more inputs.

117. A non-transitory computer-readable medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication withone or more input devices and one or more movement components , the one or more programs including instructions for performing the method of any one of claims 97- 116 .118 . A computer system that is configured to communicate with one or more input devices and one or more movement components , the computer system comprising : one or more processors ; and memory storing one or more programs configured to be executed by the one or more processors , the one or more programs including instructions for performing the method of any one of claims 97- 116 .119 . A computer system that is configured to communicate with one or more input devices and one or more movement components , the computer system comprising : means for performing the method of any one of claims 97- 116 .120 . A computer program product , comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more input devices and one or more movement components , the one or more programs including instructions for performing the method of any one of claims 97- 116 .121 . A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more input devices and one or more movement components , the one or more programs including instructions for : while a portion of the computer system is in a first position in an environment , detecting, via the one or more inputs devices , a set of one or more inputs ; andin response to detecting the set of one or more inputs : in accordance with a determination that the attention of a user does not satis fy a first attention threshold, moving, via the one or more movement components , the portion of the computer system to a second position with a first level of intensity; and in accordance with a determination that the attention of the user satis fies the first attention threshold, forgoing moving, via the one or more movement components , the portion of the computer system to the second position .122 . A computer system configured to communicate with one or more input devices and one or more movement components , comprising : one or more processors ; and memory storing one or more programs configured to be executed by the one or more processors , the one or more programs including instructions for : while a portion of the computer system is in a first position in an environment , detecting, via the one or more inputs devices , a set of one or more inputs ; and in response to detecting the set of one or more inputs : in accordance with a determination that the attention of a user does not satis fy a first attention threshold, moving, via the one or more movement components , the portion of the computer system to a second position with a first level of intensity; and in accordance with a determination that the attention of the user satis fies the first attention threshold, forgoing moving, via the one or more movement components , the portion of the computer system to the second position .123 . A computer system configured to communicate with one or more input devices and one or more movement components , comprising : means for, while a portion of the computer system is in a first position in an environment , detecting, via the one or more inputs devices , a set of one or more inputs ; and in response to detecting the set of one or more inputs : means for, in accordance with a determination that the attention of a user does not satis fy a first attention threshold, moving, via the one or more movement components , the portion of the computer system to a second position with a first level of intensity; and means for, in accordance with a determination that the attention of the user satis fies the first attention threshold, forgoing moving, via the one or more movement components , the portion of the computer system to the second position .124 . A computer program product , comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more input devices and one or more movement components , the one or more programs including instructions for : while a portion of the computer system is in a first position in an environment , detecting, via the one or more inputs devices , a set of one or more inputs ; and in response to detecting the set of one or more inputs : in accordance with a determination that the attention of a user does not satis fy a first attention threshold, moving, via the one or more movement components , the portion of the computer system to a second position with a first level of intensity; and in accordance with a determination that the attention of the user satis fies the first attention threshold,forgoing moving, via the one or more movement components , the portion of the computer system to the second position .125 . A method, comprising : at a computer system that is in communication with one or more input devices : while a portion of the computer system is directed to a first user in an environment , detecting, via the one or more input devices , an attention of a second user in the environment , wherein the second user is di f ferent from the first user ; and after detecting the attention of the second user in the environment : in accordance with a determination that the attention of the second user with respect to the computer system satis fies a first attention threshold, performing a first operation corresponding to the second user ; and in accordance with a determination that the attention of the second user with respect to the computer system satis fies a second attention threshold di f ferent from the first attention threshold, performing a second operation corresponding to the second user, wherein the second operation is di f ferent from the first operation .126 . The method of claim 125 , wherein the computer system is in communication with a first set of one or more output devices , wherein performing the first operation corresponding to the second user includes mirroring, via the first set of one or more output devices , the second user .127 . The method of any one of claims 125- 126 , further comprising : after detecting the attention of the second user in the environment and in accordance with a determination that theattention of the second user with respect to the computer system satis fies a third attention threshold di f ferent from the first attention threshold and the second attention threshold, forgoing performing an operation corresponding to the second user .128 . The method of any one of claims 125- 127 , further comprising : after detecting the attention of the second user in the environment : in accordance with a determination that a current task being performed is a first type of task, performing a fourth operation corresponding to the second user ; and in accordance with a determination that the current task being performed is a second type of task di f ferent from the first type of task, forgoing performing an operation corresponding to the second user .129 . The method of any one of claims 125- 128 , wherein the computer system is in communication with a first set of one or more movement components , wherein performing the first operation corresponding to the second user includes moving, via the first set of one or more movement components , the portion of the computer system to follow motion of the second user .130 . The method of claim 129 , further comprising : after moving, via the first set of one or more movement components , the portion of the computer system to follow the motion of the second user, moving, via the first set of one or more movement components , the portion of the computer system toward the first user .

131. The method of any one of claims 125-130, wherein the computer system is in communication with a first set of one or more display components, wherein performing the second operation corresponding to the second user includes displaying, via the first set of one or more display components, a first indication corresponding to the second user .

132. The method of any one of claims 125-131, wherein the computer system is in communication with a second set of one or more display components, and wherein performing the first operation corresponding to the second user includes displaying, via the second set of one or more display components, a second indication.

133. The method of claim 132, wherein performing the second operation corresponding to the second user includes displaying, via the second set of one or more display components, a third indication corresponding to the second user, and wherein the third indication is different from the second indication.

134. The method of any one of claims 132-133, wherein the second indication corresponds to another user in the environment, and wherein the other user is different from the second user.

135. The method of any one of claims 132-134, wherein the second indication corresponds to the first user.

136. The method of any one of claims 125-135, further comprising : while the computer system is directed to the first user in the environment, detecting, via the one or more inputdevices , an attention of a respective user in the environment , wherein the respective user is di f ferent from the first user ; and in response to detecting the attention of the respective user in the environment : in accordance with a determination that the attention of the respective user with respect to the computer system satis fies a fourth attention threshold and that the respective user is a third user, performing a first operation corresponding to the respective user ; in accordance with a determination that the attention of the respective user with respect to the computer system satis fies the fourth attention threshold and that the respective user is a fourth user di f ferent from the third user, forgoing performing an operation; and in accordance with a determination that the attention of the respective user with respect to the computer system satis fies a fi fth attention threshold di f ferent from the fourth threshold and that the respective user is the fourth user, performing a second operation corresponding to the respective user .137 . The method of any one of claims 125- 136 , wherein : the computer system is in communication with a third set of one or more display components ; the computer system is in communication with a third set of one or more movement components ; performing the first operation corresponding to the second user includes displaying, via the third set of one or more display components , a third indication moving from a first position to a second position di f ferent from the first position; performing the first operation corresponding to the second user includes moving, via the third set of one or moremovement components , the portion of the computer system from a third position to a fourth position di f ferent from the third position; and performing the second operation corresponding to the second user includes displaying, via the third set of one or more display components , a fourth indication moving from a fi fth position to a sixth position, di f ferent from the fi fth position, without moving, via the third set of one or more movement components , the portion of the computer system .138 . The method of any one of claims 125- 137 , wherein the determination that the attention of the second user with respect to the computer system satis fies the first attention threshold includes a determination that the second user is a first distance from the computer system .139 . The method of any one of claims 125- 138 , wherein detecting the attention of the second user in the environment includes detecting, via the one or more input devices , a gesture .140 . The method of any one of claims 125- 139 , wherein detecting the attention of the second user in the environment includes detecting, via the one or more input devices , a gaze .141 . The method of any one of claims 125- 140 , further comprising : after detecting the attention of the second user in the environment : in accordance with a determination that the attention of the second user with respect to the computer system satis fies a sixth attention threshold, performing, for a first period of time , a third operation corresponding the second user ; andin accordance with a determination that the attention of the second user with respect to the computer system satis fies a seventh attention threshold di f ferent from the sixth attention threshold, performing, for a second period of time di f ferent from the first period of time , a fourth operation corresponding the second user .142 . A non-transitory computer-readable medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more input devices , the one or more programs including instructions for performing the method of any one of claims 125- 141 .143 . A computer system that is configured to communicate with one or more input devices , the computer system comprising : one or more processors ; and memory storing one or more programs configured to be executed by the one or more processors , the one or more programs including instructions for performing the method of any one of claims 125- 141 .144 . A computer system that is configured to communicate with one or more input devices , the computer system comprising : means for performing the method of any one of claims 125- 141 .145 . A computer program product , comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more input devices , the one or more programs including instructions for performing the method of any one of claims 125- 141 .146 . A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more input devices , the one or more programs including instructions for : while a portion of the computer system is directed to a first user in an environment , detecting, via the one or more input devices , an attention of a second user in the environment , wherein the second user is di f ferent from the first user ; and after detecting the attention of the second user in the environment : in accordance with a determination that the attention of the second user with respect to the computer system satis fies a first attention threshold, performing a first operation corresponding to the second user ; and in accordance with a determination that the attention of the second user with respect to the computer system satis fies a second attention threshold di f ferent from the first attention threshold, performing a second operation corresponding to the second user, wherein the second operation is di f ferent from the first operation .147 . A computer system configured to communicate with one or more input devices , comprising : one or more processors ; and memory storing one or more programs configured to be executed by the one or more processors , the one or more programs including instructions for : while a portion of the computer system is directed to a first user in an environment , detecting, via the one or more input devices , an attention of a second user in the environment , wherein the second user is di f ferent from the first user ; andafter detecting the attention of the second user in the environment : in accordance with a determination that the attention of the second user with respect to the computer system satis fies a first attention threshold, performing a first operation corresponding to the second user ; and in accordance with a determination that the attention of the second user with respect to the computer system satis fies a second attention threshold di f ferent from the first attention threshold, performing a second operation corresponding to the second user, wherein the second operation is di f ferent from the first operation .148 . A computer system configured to communicate with one or more input devices , comprising : means for, while a portion of the computer system is directed to a first user in an environment , detecting, via the one or more input devices , an attention of a second user in the environment , wherein the second user is di f ferent from the first user ; and after detecting the attention of the second user in the environment : means for, in accordance with a determination that the attention of the second user with respect to the computer system satis fies a first attention threshold, performing a first operation corresponding to the second user ; and means for, in accordance with a determination that the attention of the second user with respect to the computer system satis fies a second attention threshold di f ferent from the first attention threshold, performing a second operation corresponding to the second user, wherein the second operation is di f ferent from the first operation .149 . A computer program product , comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more input devices , the one or more programs including instructions for : while a portion of the computer system is directed to a first user in an environment , detecting, via the one or more input devices , an attention of a second user in the environment , wherein the second user is di f ferent from the first user ; and after detecting the attention of the second user in the environment : in accordance with a determination that the attention of the second user with respect to the computer system satis fies a first attention threshold, performing a first operation corresponding to the second user ; and in accordance with a determination that the attention of the second user with respect to the computer system satis fies a second attention threshold di f ferent from the first attention threshold, performing a second operation corresponding to the second user, wherein the second operation is di f ferent from the first operation .150 . A method, comprising : at a computer system that is in communication with one or more input devices : while a portion of the computer system is in a first position in an environment , detecting, via the one or more inputs devices , an attention of one or more users in the environment ; and in response to detecting the attention of the one or more users in the environment : in accordance with a determination that a first set of one or more criteria is satis fied, wherein the firstset of one or more criteria includes a first criterion that is satis fied when the attention corresponds to a first obj ect at a second position in the environment , wherein the first set of one or more criteria includes a second criterion that is satis fied when a number of the one or more users exceeds a non- zero threshold, changing the computer system from a first state to a second state di f ferent from the first state ; and in accordance with a determination that a second set of one or more criteria is satis fied, wherein the second set of one or more criteria includes a third criterion that is satis fied when the attention corresponds to the first obj ect at the second position in the environment , wherein the second set of one or more criteria includes a fourth criterion that is satis fied when the number of the one or more users does not exceed the non- zero threshold, forgoing changing the computer system from the first state to the second state .151 . The method of claim 150 , further comprising : in response to detecting the attention of the one or more users in the environment and in accordance with a determination that the second set of one or more criteria is satis fied, changing the computer system from the first state to a third state di f ferent from the first state and the second state .152 . The method of claim 151 , wherein the computer system is in communication with a first set of one or more display components , wherein changing the computer system from the first state to the third state includes displaying, via the one or more display components , a first UI element moving from a first position to a second position di f ferent from the first position .153 . The method of any one of claims 150- 152 , further comprising : in response to detecting the attention of the one or more users in the environment and in accordance with the determination that the second set of one or more criteria is satis fied, maintaining the computer system in the first state .154 . The method of any one of claims 150- 153 , wherein the computer system is in communication with a second set of one or more display components , wherein changing the computer system from the first state to the second state includes displaying, via the second set of one or more display components , a first user interface changing from a third state to a fourth state di f ferent from the third state .155 . The method of claim 154 , wherein displaying the first user interface changing from the third state to the fourth state includes animating, via the second set of one or more display components , a first user interface element to acknowledge the first obj ect .156 . The method of any one of claims 153- 154 , further comprising : in response to detecting the attention of the one or more users in the environment and in accordance with a determination that a second set of one or more criteria is satis fied, forgoing animating, via the second set of one or more display components , a second user interface element of the first user interface to acknowledge the first obj ect .157 . The method of any one of claims 150- 156 , wherein the computer system is in communication with a first set of one or more movement components , wherein changing the computer system from the first state to the second state includes moving, viathe first set of one or more movement components, the portion of the computer system to a third position in the environment, wherein the third position is different from the first position .

158. The method of any one of claims 150-157, wherein changing the computer system from the first state to the second state occurs without detecting an explicit request from the one or more users to move the portion of the computer system.

159. The method of any one of claims 150-158, wherein the first set of one or more criteria includes a fifth criterion that is satisfied when the first object is within a predetermined distance of a particular position, wherein the second set of one or more criteria includes a sixth criterion that is satisfied when the first object is not within the predetermined distance of the particular position.

160. The method of any one of claims 150-159, wherein the first set of one or more criteria includes a seventh criterion that is satisfied when the first object is determined to be relevant to an operation being performed, and wherein the second set of one or more criteria includes an eight criterion that is satisfied when the first object is determined not to be relevant to the operation being performed.

161. The method of any one of claims 150-160, wherein detecting the attention of the one or more users includes detecting, via the one or more input devices, a gaze of a first user of the one or more users, and wherein the first set of one or more criteria includes a fifth criterion that is satisfied when the gaze of the first user looks at the first object for a second predetermined period of time.

162. The method of any one of claims 150-161, wherein detecting the attention of the one or more users includes detecting, via the one or more input devices, body language of a second user of the one or more users, and wherein the first set of one or more criteria includes a sixth criterion that is satisfied when the body language of the second user is determined to correspond to the first object.

163. The method of any one of claims 150-162, wherein detecting the attention of the one or more users includes detecting, via the one or more input devices, a facial expression of a third user of the one or more users, and wherein the first set of one or more criteria includes a seventh criterion that is satisfied when the facial expression of the third user satisfies a set of one or more expression criteria .

164. The method of any one of claims 150-163, wherein detecting the attention of the one or more users includes detecting, via the one or more input devices, a touch input of a fourth user of the one or more users, and wherein the second set of one or more criteria includes an eighth criterion that is satisfied when the touch input is detected.

165. The method of any one of claims 150-164, wherein detecting the attention of the one or more users includes detecting, via a microphone of the one or more input devices, a verbal input of a fifth user of the one or more users, and wherein the first set of one or more criteria includes a ninth criterion that is satisfied when the verbal input corresponds to the first object.

166. The method of any one of claims 150-165, wherein detecting the attention of the one or more users includesdetecting, via a camera of the one or more input devices , an air gesture from a sixth user of the one or more users , wherein the first set of one or more criteria includes a tenth criterion that is satis fied when the air gesture is in the direction of the first obj ect .167 . The method of any one of claims 150- 166 , further comprising : after a third predetermined period of time has lapsed since changing the computer system from the first state to the second state , changing the computer system to the first state from the second state .168 . The method of claim 167 , wherein changing the computer system to the first state from the second state occurs while continuing to detect that the attention of the one or more users in the environment corresponds to the first obj ect .169 . The method of any one of claims 150- 166 , further comprising : after a fourth predetermined period of time has lapsed since changing the computer system from the first state to the second state , detecting, via the one or more input devices , an attention of a seventh user of the one or more users in the environment ; and in response to detecting the attention of the seventh user and in accordance with a determination that the attention of the seventh user does not correspond to the first obj ect , changing the computer system to the first state from the second state .170 . The method of claim 169 , further comprising : in response to detecting the attention of the seventh user and in accordance with a determination that the attentionof the seventh user corresponds to the first obj ect , forgoing changing the computer system from the second state to the first state .171 . A non-transitory computer-readable medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more input devices , the one or more programs including instructions for performing the method of any one of claims 150- 170 .172 . A computer system that is configured to communicate with one or more input devices , the computer system comprising : one or more processors ; and memory storing one or more programs configured to be executed by the one or more processors , the one or more programs including instructions for performing the method of any one of claims 150- 170 .173 . A computer system that is configured to communicate with one or more input devices , the computer system comprising : means for performing the method of any one of claims 150- 170 .174 . A computer program product , comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more input devices , the one or more programs including instructions for performing the method of any one of claims 150- 170 .175 . A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication withone or more input devices , the one or more programs including instructions for : while a portion of the computer system is in a first position in an environment , detecting, via the one or more inputs devices , an attention of one or more users in the environment ; and in response to detecting the attention of the one or more users in the environment : in accordance with a determination that a first set of one or more criteria is satis fied, wherein the first set of one or more criteria includes a first criterion that is satis fied when the attention corresponds to a first obj ect at a second position in the environment , wherein the first set of one or more criteria includes a second criterion that is satis fied when a number of the one or more users exceeds a non- zero threshold, changing the computer system from a first state to a second state di f ferent from the first state ; and in accordance with a determination that a second set of one or more criteria is satis fied, wherein the second set of one or more criteria includes a third criterion that is satis fied when the attention corresponds to the first obj ect at the second position in the environment , wherein the second set of one or more criteria includes a fourth criterion that is satis fied when the number of the one or more users does not exceed the non- zero threshold, forgoing changing the computer system from the first state to the second state .176 . A computer system configured to communicate with one or more input devices , comprising : one or more processors ; and memory storing one or more programs configured to be executed by the one or more processors , the one or more programs including instructions for :while a portion of the computer system is in a first position in an environment , detecting, via the one or more inputs devices , an attention of one or more users in the environment ; and in response to detecting the attention of the one or more users in the environment : in accordance with a determination that a first set of one or more criteria is satis fied, wherein the first set of one or more criteria includes a first criterion that is satis fied when the attention corresponds to a first obj ect at a second position in the environment , wherein the first set of one or more criteria includes a second criterion that is satis fied when a number of the one or more users exceeds a non- zero threshold, changing the computer system from a first state to a second state di f ferent from the first state ; and in accordance with a determination that a second set of one or more criteria is satis fied, wherein the second set of one or more criteria includes a third criterion that is satis fied when the attention corresponds to the first obj ect at the second position in the environment , wherein the second set of one or more criteria includes a fourth criterion that is satis fied when the number of the one or more users does not exceed the non- zero threshold, forgoing changing the computer system from the first state to the second state .177 . A computer system configured to communicate with one or more input devices , comprising : means for, while a portion of the computer system is in a first position in an environment , detecting, via the one or more inputs devices , an attention of one or more users in the environment ; and in response to detecting the attention of the one or more users in the environment :means for, in accordance with a determination that a first set of one or more criteria is satis fied, wherein the first set of one or more criteria includes a first criterion that is satis fied when the attention corresponds to a first obj ect at a second position in the environment , wherein the first set of one or more criteria includes a second criterion that is satis fied when a number of the one or more users exceeds a non- zero threshold, changing the computer system from a first state to a second state di f ferent from the first state ; and means for, in accordance with a determination that a second set of one or more criteria is satis fied, wherein the second set of one or more criteria includes a third criterion that is satis fied when the attention corresponds to the first obj ect at the second position in the environment , wherein the second set of one or more criteria includes a fourth criterion that is satis fied when the number of the one or more users does not exceed the non- zero threshold, forgoing changing the computer system from the first state to the second state .178 . A computer program product , comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more input devices , the one or more programs including instructions for : while a portion of the computer system is in a first position in an environment , detecting, via the one or more inputs devices , an attention of one or more users in the environment ; and in response to detecting the attention of the one or more users in the environment : in accordance with a determination that a first set of one or more criteria is satis fied, wherein the first set of one or more criteria includes a first criterion that issatis fied when the attention corresponds to a first obj ect at a second position in the environment , wherein the first set of one or more criteria includes a second criterion that is satis fied when a number of the one or more users exceeds a non- zero threshold, changing the computer system from a first state to a second state di f ferent from the first state ; and in accordance with a determination that a second set of one or more criteria is satis fied, wherein the second set of one or more criteria includes a third criterion that is satis fied when the attention corresponds to the first obj ect at the second position in the environment , wherein the second set of one or more criteria includes a fourth criterion that is satis fied when the number of the one or more users does not exceed the non- zero threshold, forgoing changing the computer system from the first state to the second state .179 . A method, comprising : at a computer system that is in communication with one or more input devices and one or more output devices including a display component : detecting, via the one or more input devices , an input ; and in response to detecting the input , outputting, via the one or more output devices , a response to the input , including : in accordance with a determination that the input corresponds to a first context , displaying, via the display component , a first avatar representation that moves in a first manner based on the response and according to a first set of one or more learned characteristics ; and in accordance with a determination that the input corresponds to a second context , di f ferent from the first context , displaying, via the display component , a second avatar representation that moves in a second manner, di f ferentfrom the first manner, based on the response and according to a second set of one or more learned characteristics , di f ferent from the first set of one or more learned characteristics .180 . The method of claim 179 , wherein the first avatar representation includes a first set of one or more visual attributes , and wherein the second avatar representation includes a second set of one or more visual attributes di f ferent from the first set of one or more visual attributes .181 . The method of any one of claims 179- 180 , wherein the one or more input devices includes an audio input device , and wherein the input includes a verbal input detected via the audio input device .182 . The method of any one of claims 179- 181 , wherein moving in the first manner includes moving a first portion of the first avatar representation, and wherein moving in the second manner includes moving a second portion of the second avatar representation .183 . The method of any one of claims 179- 182 , wherein moving in the first manner includes displaying the first avatar representation with a first facial expression, and wherein moving in the second manner includes displaying the second avatar with a second facial expression di f ferent from the first facial expression .184 . The method of any one of claims 179- 183 , wherein the first avatar representation corresponds to a first set of one or more personality characteristics , and wherein the second avatar representation corresponds to a second set of one or more personality characteristics di f ferent from the first set of one or more personality characteristics .

185. The method of any one of claims 179-184, wherein the first set of one or more learned characteristics are based on a first user, and wherein the second set of one or more learned characteristics are based on the first user.

186. The method of any one of claims 179-184, wherein the first set of one or more learned characteristics are based on a second user, and wherein the second set of one or more learned characteristics are based on a third user different from the second user.

187. The method of any one of claims 179-186, wherein: in accordance with a determination that the input corresponds to a first set of one or more characteristics, the input corresponds to the first context; and in accordance with a determination that the input corresponds to a second set of one or more characteristics that is different from the first set of one or more characteristics, the input corresponds to the second context.

188. The method of any one of claims 179-187, wherein: in accordance with a determination that the input is detected at a first time, the input corresponds to the first context; and in accordance with a determination that the input is detected at a second time that is different from the first time, the input corresponds to the second context.

189. The method of any one of claims 179-188, wherein: in accordance with a determination that the computer system is operating in a first mode when the input is detected, the input corresponds to the first context; andin accordance with a determination that the computer system is operating in a second mode that is di f ferent from the first mode , the input corresponds to the second context .190 . The method of any one of claims 179- 189 , wherein : in accordance with a determination that the computer system is configured to output a first type of content when the input is detected, the input corresponds to the first context ; and in accordance with a determination that the computer system is configured to output a second type of content when the input is detected, the input corresponds to the second context , wherein the first type of content is di f ferent from the second type of content .191 . The method of any one of claims 179- 190 , wherein : in accordance with the determination that the input corresponds to the first context and in accordance with a determination that the input corresponds to a first set of one or more users , the first set of one or more learned characteristics is a third set of one or more learned characteristics ; and in accordance with the determination that the input corresponds to the first context and in accordance with a determination that the input corresponds to a second set of one or more users di f ferent from the first set of users , the first set of one or more learned characteristics is a fourth set of one or more learned characteristics di f ferent from the third set of one or more learned characteristics .192 . The method of any one of claims 179- 190 , wherein : in accordance with the determination that the input corresponds to the first context and in accordance with a determination that the input corresponds to a third set of oneor more users , the first set of one or more learned characteristics is a fi fth set of one or more learned characteristics ; and in accordance with the determination that the input corresponds to the first context and in accordance with a determination that the input corresponds to a fourth set of one or more users di f ferent from the third set of one or more users , the first set of one or more learned characteristics is the fi fth set of one or more learned characteristics .193 . The method of any one of claims 179- 192 , wherein the input is a first input detected at a third time , and wherein the response is a first response , the method further comprising : after outputting the first response , obtaining a first set of information with respect to the user ; after obtaining the first set of information with respect to the user, detecting, via the one or more input devices , a second input at a fourth time that is after the third time ; and in response to detecting the second input , outputting, via the one or more output devices , a second response to the second input , including : in accordance with a determination that the second input corresponds to the first context , displaying, via the display component , the first avatar representation that moves in a third manner based on the response and according to an updated first set of one or more learned characteristics , wherein the updated first set of one or more learned characteristics represents one or more updates to the first set of one or more learned characteristics corresponding to a period between the third time and the fourth time .194 . The method of any one of claims 179- 193 , wherein the input is a third input , the method further comprising : after detecting the third input , detecting, via the one or more input devices , a fourth input ; and in response to detecting the fourth input , outputting, via the one or more output devices , a third response to the third input di f ferent from the response , including : in accordance with a determination that the fourth input corresponds to the first context , displaying, via the display component , the first avatar representation that moves in a fourth manner, di f ferent from the first manner and the second manner, based on the third response and according to the first set of one or more learned characteristics ; and in accordance with a determination that the fourth input corresponds to the second context , displaying, via the display component , the second avatar representation that moves in a fi fth manner based on the third response and according to the second set of one or more learned characteristics , wherein the fi fth manner is di f ferent from the fourth manner, the first manner, and the second manner .195 . A non-transitory computer-readable medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more input devices and one or more output devices including a display component , the one or more programs including instructions for performing the method of any one of claims 179- 194 .196 . A computer system that is configured to communicate with one or more input devices and one or more output devices including a display component , the computer system comprising : one or more processors ; andmemory storing one or more programs configured to be executed by the one or more processors , the one or more programs including instructions for performing the method of any one of claims 179- 194 .197 . A computer system that is configured to communicate with one or more input devices and one or more output devices including a display component , the computer system comprising : means for performing the method of any one of claims 179- 194 .198 . A computer program product , comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more input devices and one or more output devices including a display component , the one or more programs including instructions for performing the method of any one of claims 179- 194 .199 . A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more input devices and one or more output devices including a display component , the one or more programs including instructions for : detecting, via the one or more input devices , an input ; and in response to detecting the input , outputting, via the one or more output devices , a response to the input , including : in accordance with a determination that the input corresponds to a first context , displaying, via the display component , a first avatar representation that moves in a firstmanner based on the response and according to a first set of one or more learned characteristics; and in accordance with a determination that the input corresponds to a second context, different from the first context, displaying, via the display component, a second avatar representation that moves in a second manner, different from the first manner, based on the response and according to a second set of one or more learned characteristics, different from the first set of one or more learned characteristics.

200. A computer system configured to communicate with one or more input devices and one or more output devices including a display component, comprising: one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: detecting, via the one or more input devices, an input; and in response to detecting the input, outputting, via the one or more output devices, a response to the input, including : in accordance with a determination that the input corresponds to a first context, displaying, via the display component, a first avatar representation that moves in a first manner based on the response and according to a first set of one or more learned characteristics; and in accordance with a determination that the input corresponds to a second context, different from the first context, displaying, via the display component, a second avatar representation that moves in a second manner, different from the first manner, based on the response and according to a second set of one or more learned characteristics, different from the first set of one or more learned characteristics.201 . A computer system configured to communicate with one or more input devices and one or more output devices including a display component , comprising : means for, detecting, via the one or more input devices , an input ; and in response to detecting the input , means for outputting, via the one or more output devices , a response to the input , including : means for, in accordance with a determination that the input corresponds to a first context , displaying, via the display component , a first avatar representation that moves in a first manner based on the response and according to a first set of one or more learned characteristics ; and means for, in accordance with a determination that the input corresponds to a second context , di f ferent from the first context , displaying, via the display component , a second avatar representation that moves in a second manner, di f ferent from the first manner, based on the response and according to a second set of one or more learned characteristics , di f ferent from the first set of one or more learned characteristics .202 . A computer program product , comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more input devices and one or more output devices including a display component , the one or more programs including instructions for : detecting, via the one or more input devices , an input ; and in response to detecting the input , outputting, via the one or more output devices , a response to the input , including :in accordance with a determination that the input corresponds to a first context, displaying, via the display component, a first avatar representation that moves in a first manner based on the response and according to a first set of one or more learned characteristics; and in accordance with a determination that the input corresponds to a second context, different from the first context, displaying, via the display component, a second avatar representation that moves in a second manner, different from the first manner, based on the response and according to a second set of one or more learned characteristics, different from the first set of one or more learned characteristics.

203. A method, comprising: at a computer system that is in communication with one or more output devices, one or more input devices, and a movement component : detecting, via the one or more input devices, an input; and in response to detecting the input: in accordance with a determination that the computer system was operating with respect to a first profile for a user before detecting the input, moving, via the movement component, in a first manner; and in accordance with a determination that the computer system was operating with respect to a second profile, different from the first profile, for the user before detecting the input, moving, via the movement component, in a second manner different from the first manner.

204. The method of claim 203, further comprising: before detecting the input, detecting, via the one or more input devices, a set of one or more inputs, wherein:in accordance with a determination that the set of one or more inputs corresponds to a first set of characteristics , the computer system operates with respect to the first profile for the user before detecting the input ; and in accordance with a determination that the set of one or more inputs corresponds to a second set of characteristics di f ferent from the first set of characteristics , the computer system operates with respect to the second profile before detecting the input .205 . The method of any one of claim 203-204 , further comprising : before detecting the input , detecting, via the one or more input devices , a verbal input , wherein : in accordance with a determination that the verbal input is detected at a first time , the computer system, operates with respect to the first profile for the user ; and in accordance with a determination that the verbal input is detected at a second time that is di f ferent than the first time , the computer system operates with respect to the second profile for the user .206 . The method of any one of claim 203-205 , further comprising : before detecting the input , activating a mode of the computer system, wherein : in accordance with a determination that the mode is a first mode of the computer system, activating the first mode of the computer system causes the computer system to operate with respect to the first profile for the user ; and in accordance with a determination that the mode is a second mode of the computer system di f ferent from the first mode , activating the second mode of the computer system causesthe computer system to operate with respect to the second profile for the user.

207. The method of any one of claims 203-206, further comprising : before detecting the input, configuring the computer system to output a respective type of content, wherein: in accordance with a determination that the respective type of content is a first type of content, the computer system operates with respect to the first profile for the user; and in accordance with a determination that the respective type of content is a second type of content, different than the first type of content, the computer system operates with respect to the second profile for the user.

208. The method of any one of claims 203-207, wherein: moving in the first manner includes moving with respect to three dimensions; and wherein moving in the second manner includes moving with respect to the three dimensions.

209. The method of claim 208, wherein moving in the first manner includes moving with respect to the three dimensions differently in each dimension, of the three dimensions, than moving in the second manner.

210. The method of claim 208, wherein moving in the first manner includes moving with respect to the three dimensions differently in at least one dimension, of the three dimensions, than moving in the second manner.

211. The method of claim 208, wherein moving in the first manner includes moving with respect to the three dimensions asame amount in at least one dimension, of the three dimensions , as moving in the second manner .212 . The method of any one of claims 203-211 , wherein moving, via the movement component in the first manner, corresponds to a first type of body movement of the user, and wherein moving, via the movement component , in the second manner corresponds to a second type of body movement of the user .213 . The method of claim 212 , wherein the first type of body movement of the user corresponds to at least one movement type corresponding to the group comprising : head movement of the user, torso movement of the user, and appendage movement of the user .214 . The methods of any one of claims 203-213 , further comprising : in response to detecting the input and in accordance with a determination that the computer system was operating with respect to a third profile for the user di f ferent from the first profile for the user and the second profile for the user, forgoing moving, via the movement component , in a respective manner .215 . The methods of any one of claims 203-214 , wherein the computer system includes an audio output component , the method further comprising : in response to detecting the input : in accordance with a determination that the computer system was operating with respect to the first profile for the user before detecting the input , outputting, via the audio output component , a first audio output ; and in accordance with a determination that the computer system was operating with respect to the second profile forthe user before detecting the input , outputting, via the audio output component , a second audio output that is di f ferent from the first audio output .216 . The method of any one of claims 203-215 , wherein the computer system includes a first display component , the method further comprising : in response to detecting the input : in accordance with a determination that the computer system was operating with respect to the first profile for the user before detecting the input , displaying, via the first display component , a first set of content ; and in accordance with a determination that the computer system was operating with respect to the second profile for the user before detecting the input , displaying, via the first display component , a second set of content that is di f ferent from the first set of content .217 . The method of any one of claims 203-216 , wherein the computer system includes a second display component , the method further comprising : in response to detecting the input : in accordance with a determination that the computer system was operating with respect to the first profile for the user before detecting the input , displaying, via the second display component , a first graphical representation; and in accordance with a determination that the computer system was operating with respect to the second profile for the user before detecting the input , displaying, via the second display component , a second graphical representation that is di f ferent from the first graphical representation .218 . The method of any one of claims 203-217 , wherein the computer system includes a third display component , the method further comprising : in response to detecting the input , displaying, via the third display component , a third graphical representation, wherein displaying the third graphical representation includes : in accordance with a determination that the computer system was operating with respect to the first profile for the user before detecting the input , animating the third graphical representation moving in a third manner ; and in accordance with a determination that the computer system was operating with respect to the second profile for the user before detecting the input , animating the third graphical representation moving in a fourth manner di f ferent from the third manner .219 . The method of any one of claims 203-218 , wherein the input corresponds to the user .220 . The method of any one of claims 203-219 , wherein the input corresponds to a request for the computer system to perform an operation .221 . The method of any one of claims 203-220 , further comprising : in response to detecting the input and in accordance with a determination that the computer system was operating with respect to a fourth profile for the user, di f ferent from the first profile and the second profile , before detecting the input , moving, via the movement component , in a fi fth manner di f ferent from the first manner and from the second manner .222 . The method of any one of claims 203-221 , further comprising : before detecting the input , detecting, via the one or more input devices , the user, wherein : in accordance with a determination that the user is a first user, causing the computer system to operate with respect to the first profile ; and in accordance with a determination that the user is a second user di f ferent from the first user, causing the computer system to operate with respect to the second profile .223 . The methods of any one of claims 203-222 , further comprising : before detecting the input , detecting a request to activate a first account of the computer system; and in response to detecting the request to activate the first account on the computer system : in accordance with a determination that the first account corresponds to the first profile , causing the computer system to operate with respect to the first profile ; and in accordance with a determination that the first account corresponds to the second profile , causing the computer system to operate with respect to the second profile a .224 . The methods of any one of claims 203-223 , wherein a second account corresponds to the first profile and a third account corresponds to the second profile , and wherein, the second account and the third account are inactive while the computer system detects the input .225 . A non-transitory computer-readable medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication withone or more output devices , one or more input devices , and a movement component , the one or more programs including instructions for performing the method of any one of claims 203-224 .226 . A computer system that is configured to communicate with one or more output devices , one or more input devices , and a movement component , the computer system comprising : one or more processors ; and memory storing one or more programs configured to be executed by the one or more processors , the one or more programs including instructions for performing the method of any one of claims 203-224 .227 . A computer system that is configured to communicate with one or more output devices , one or more input devices , and a movement component , the computer system comprising : means for performing the method of any one of claims 203- 224 .228 . A computer program product , comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more output devices , one or more input devices , and a movement component , the one or more programs including instructions for performing the method of any one of claims 203-224 .229 . A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more output devices , one or more input devices , and a movement component , the one or more programs including instructions for :detecting, via the one or more input devices, an input; and in response to detecting the input: in accordance with a determination that the computer system was operating with respect to a first profile for a user before detecting the input, moving, via the movement component, in a first manner; and in accordance with a determination that the computer system was operating with respect to a second profile, different from the first profile, for the user before detecting the input, moving, via the movement component, in a second manner different from the first manner.

230. A computer system configured to communicate with one or more output devices, one or more input devices, and a movement component, comprising: one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: detecting, via the one or more input devices, an input; and in response to detecting the input: in accordance with a determination that the computer system was operating with respect to a first profile for a user before detecting the input, moving, via the movement component, in a first manner; and in accordance with a determination that the computer system was operating with respect to a second profile, different from the first profile, for the user before detecting the input, moving, via the movement component, in a second manner different from the first manner.

231. A computer system configured to communicate with one or more output devices, one or more input devices, and a movement component, comprising: means for, detecting, via the one or more input devices, an input; and in response to detecting the input: means for, in accordance with a determination that the computer system was operating with respect to a first profile for a user before detecting the input, moving, via the movement component, in a first manner; and means for, in accordance with a determination that the computer system was operating with respect to a second profile, different from the first profile, for the user before detecting the input, moving, via the movement component, in a second manner different from the first manner.

232. A computer program product, comprising one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more output devices, one or more input devices, and a movement component, the one or more programs including instructions for : detecting, via the one or more input devices, an input; and in response to detecting the input: in accordance with a determination that the computer system was operating with respect to a first profile for a user before detecting the input, moving, via the movement component, in a first manner; and in accordance with a determination that the computer system was operating with respect to a second profile, different from the first profile, for the user before detecting the input, moving, via the movement component, in a second manner different from the first manner.

Citation Information

Patent Citations

  • Adaptive visualisation system and visualization method

    EP3165995A1

  • Movable audio / video communication interface system

    US20060119572A1