User interfaces and technologies for performing actions based on learned characteristics

Abstract

Provides a user interface. [Solution] This disclosure relates in general to user interfaces.

Description

[Technical Field]

[0001] (Cross-Reference to Related Applications) This application claims priority to U.S. Provisional Patent Application No. 63 / 541,826 filed on September 30, 2023, U.S. Provisional Patent Application No. 63 / 541,822 filed on September 30, 2023, U.S. Provisional Patent Application No. 63 / 541,825 filed on September 30, 2023, and U.S. Provisional Patent Application No. 63 / 541,830 filed on September 30, 2023, all of which are incorporated herein by reference in their entireties for all purposes. [Background Art]

[0002] Users often interact with user interfaces of computer systems and provide commands via the user interfaces to initiate various operations performed by the computer systems. Computer systems often output content based on specific inputs. Computer systems are frequently used to perform operations for users. Such operations may be executed in response to inputs provided by the user. Electronic devices often issue acknowledgment responses from the user. Such acknowledgment responses can indicate that the user has been detected. [Summary of the Invention]

[0003] Existing technologies for performing operations based on characteristics learned using electronic devices are generally cumbersome and inefficient. For example, some existing technologies use complex and time-consuming user interfaces that may include multiple key presses or keystrokes. Some existing technologies require more time than necessary, wasting user time and device energy. This latter consideration is particularly important for battery-operated devices.

[0004] Therefore, this technology provides electronic devices having faster and more efficient methods and interfaces for performing actions. Such methods and interfaces optionally complement or replace other methods for performing actions. Such methods and interfaces reduce the cognitive burden on the user and create a more efficient human-machine interface. In the case of battery-operated computing devices, such methods and interfaces conserve power and increase the interval between battery charges. Such methods and interfaces can complement or replace other methods for performing actions based on learned characteristics.

[0005] In some embodiments, a method is described that is performed in a computer system that communicates with one or more input devices. In some embodiments, the method includes detecting a first user's movement to a first context via one or more input devices; deactivating a representation of the first user's movement in response to the detection of the first user's movement to the first context; detecting a transition to a second context after detecting the first user's movement to the first context; and performing a representation of the first user's movement in response to the detection of the transition to the second context and in accordance with the determination that the second context corresponds to the first context.

[0006] In some embodiments, a non-temporary computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system communicating with one or more input devices. In some embodiments, one or more programs include instructions that, via one or more input devices, detect a movement of a first user to a first context, and, in response to the detection of the first user's movement to the first context, deactivate the execution of a representation of the first user's movement, and, after detecting the first user's movement to the first context, detect a transition to a second context, and, in response to the detection of the transition to the second context and in accordance with the determination that the second context corresponds to the first context, execute a representation of the first user's movement.

[0007] In some embodiments, a temporary computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system communicating with one or more input devices. In some embodiments, one or more programs include instructions that, via one or more input devices, detect a movement of a first user to a first context, and, in response to the detection of the first user's movement to the first context, deactivate the execution of the representation of the first user's movement, and, after detecting the first user's movement to the first context, detect a transition to a second context, and, in response to the detection of the transition to the second context and in accordance with the determination that the second context corresponds to the first context, execute the representation of the first user's movement.

[0008] In some embodiments, a computer system that communicates with one or more input devices is described. In some embodiments, the computer system comprises one or more processors and a memory that stores one or more programs configured to be executed by one or more processors. In some embodiments, one or more programs include instructions that, via one or more input devices, detect a movement of a first user to a first context, and, in response to the detection of the first user's movement to the first context, cancel the execution of a representation of the first user's movement, and, after detecting the first user's movement to the first context, detect a transition to a second context, and, in response to the detection of the transition to the second context and in accordance with the determination that the second context corresponds to the first context, execute a representation of the first user's movement.

[0009] In some embodiments, a computer system that communicates with one or more input devices is described. In some embodiments, the computer system includes means for performing each of the following steps via one or more input devices: detecting the movement of a first user to a first context; deactivating the representation of the first user's movement in response to the detection of the first user's movement to the first context; detecting a transition to a second context after detecting the first user's movement to the first context; and performing the representation of the first user's movement in response to the detection of the transition to the second context and in accordance with the determination that the second context corresponds to the first context.

[0010] In some embodiments, a computer program product is described. In some embodiments, the computer program product includes one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more input devices. In some embodiments, one or more programs include instructions that, via one or more input devices, detect a movement of a first user to a first context, and, in response to the detection of the first user's movement to the first context, deactivate the execution of the representation of the first user's movement, and, after detecting the first user's movement to the first context, detect a transition to a second context, and, in response to the detection of the transition to the second context and in accordance with the determination that the second context corresponds to the first context, execute the representation of the first user's movement.

[0011] In some embodiments, a method is described that is performed in a computer system that communicates with one or more input devices. In some embodiments, the method includes detecting a first attitude in conjunction with detecting a first input via one or more input devices; performing a first action in response to detecting a first attitude in conjunction with detecting a first input; configuring the system to perform the first action without detecting a first input; and after performing the first action and configuring the system to perform the first action without detecting a first input, detecting a first attitude in conjunction with detecting a first input via one or more input devices; and performing a first action in response to detecting a first attitude without detecting a first input.

[0012] In some embodiments, a non-temporary computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system communicating with one or more input devices. In some embodiments, one or more programs include instructions that, via one or more input devices, detect a first attitude in conjunction with detecting a first input, perform a first action in response to the detection of the first attitude in conjunction with the detection of the first input, configure the instructions to perform a first action without detecting a first input, and after performing a first action and configured the instructions to perform a first action without detecting a first input, detect a first attitude via one or more input devices without detecting a first input, and perform a first action in response to the detection of the first attitude without detecting a first input.

[0013] In some embodiments, a temporary computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system communicating with one or more input devices. In some embodiments, one or more programs include instructions that, after detecting a first input and a first attitude via one or more input devices, in conjunction with detecting a first input and a first attitude, perform a first action in response to detecting a first attitude and a first input, and after performing a first action and after being configured to perform a first action without detecting a first input, detect a first attitude via one or more input devices without detecting a first input, and perform a first action in response to detecting a first attitude without detecting a first input.

[0014] In some embodiments, a computer system that communicates with one or more input devices is described. In some embodiments, the computer system comprises one or more processors and a memory that stores one or more programs configured to be executed by one or more processors. In some embodiments, one or more programs include instructions that, via one or more input devices, detect a first attitude in conjunction with detecting a first input, perform a first action in response to the detection of the first attitude in conjunction with the detection of the first input, configure the first action to be performed without detecting the first input, and after the first action has been performed and configured the first action to be performed without detecting the first input, detect a first attitude via one or more input devices without detecting the first input, and perform a first action in response to the detection of the first attitude without detecting the first input.

[0015] In some embodiments, a computer system that communicates with one or more input devices is described. In some embodiments, the computer system includes means for performing each of the following steps: detecting a first attitude in conjunction with detecting a first input via one or more input devices; performing a first action in response to detecting a first attitude in conjunction with detecting a first input; configuring the system to perform a first action without detecting a first input; and, after performing a first action and having configured the system to perform a first action without detecting a first input, detecting a first attitude via one or more input devices without detecting a first input; and performing a first action in response to detecting a first attitude without detecting a first input.

[0016] In some embodiments, a computer program product is described. In some embodiments, the computer program product includes one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more input devices. In some embodiments, one or more programs include instructions that detect a first attitude in conjunction with detecting a first input via one or more input devices, perform a first action in response to the detection of the first attitude in conjunction with the detection of the first input, configure the program to perform the first action without detecting the first input, and after performing the first action and configured the program to perform the first action without detecting the first input, detect a first attitude in conjunction with the detection of the first attitude via one or more input devices, and perform a first action in response to the detection of the first attitude without detecting the first input.

[0017] In some embodiments, a method is described that is performed in a computer system communicating with one or more input devices and one or more output devices. In some embodiments, the method includes detecting an input corresponding to a user request via one or more input devices; outputting audio content having one or more audio characteristics via one or more output devices, in response to detecting an input corresponding to a user request, according to a determination that the computer system is operating in a first context and that the first context corresponds to a first set of one or more learned characteristics corresponding to a user; and outputting audio content having one or more second sets of audio characteristics having one or more different

[0018] In some embodiments, a non-temporary computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system communicating with one or more input devices and one or more output devices. In some embodiments, one or more programs include instructions that, in response to detecting input corresponding to a user request via one or more input devices, output audio content having one or more audio characteristics via one or more output devices according to a determination that the computer system is operating in a first context and the first context corresponds to a first set of one or more learned characteristics corresponding to the user, and output audio content having one or more audio characteristics having one or more second sets of audio characteristics having one or more different

[0019] In some embodiments, a temporary computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system communicating with one or more input devices and one or more output devices. In some embodiments, one or more programs include instructions that, upon detecting input corresponding to a user request via one or more input devices, output audio content having one or more audio characteristics via one or more output devices, according to a determination that the computer system is operating in a first context and the first context corresponds to a first set of one or more learned characteristics corresponding to the user, and output audio content having a second set of one or more audio characteristics different from the first set of one or more audio characteristics via one or more output devices, according to a determination that the computer system is operating in a second context different from the first context and the second context corresponds to a second set of one or more learned characteristics different from the first set of one or more learned characteristics corresponding to the user.

[0020] In some embodiments, a computer system is described that communicates with one or more input devices and one or more output devices. In some embodiments, the computer system comprises one or more processors and a memory that stores one or more programs configured to be executed by one or more processors. In some embodiments, one or more programs include instructions that detect input corresponding to a user request via one or more input devices, and, in response to detecting input corresponding to a user request, output audio content having one or more audio characteristics via one or more output devices according to a determination that the computer system is operating in a first context and the first context corresponds to a first set of one or more learned characteristics corresponding to a user, and output audio content having one or more audio characteristics

[0021] In some embodiments, a computer system communicating with one or more input devices and one or more output devices is described. In some embodiments, the computer system includes means for performing each of the following steps: detecting an input corresponding to a user request via one or more input devices; outputting audio content having a first set of one or more audio characteristics via one or more output devices, in response to detecting an input corresponding to a user request, according to a determination that the computer system is operating in a first context and that the first context corresponds to a first set of one or more learned characteristics corresponding to a user; and outputting audio content having a second set of one or more audio characteristics different from the first set of one or more audio characteristics via one or more output devices, according to a determination that the computer system is operating in a second context different from the first context and that the second context corresponds to a second set of one or more learned characteristics different from the first set of one or more learned characteristics corresponding to a user.

[0022] In some embodiments, a computer program product is described. In some embodiments, the computer program product includes one or more programs configured to be executed by one or more processors of a computer system communicating with one or more input devices and one or more output devices. In some embodiments, one or more programs include instructions to detect input corresponding to a user request via one or more input devices, and, in response to detecting input corresponding to a user request, output audio content having one or more audio characteristics via one or more output devices according to a determination that the computer system is operating in a first context and the first context corresponds to a first set of one or more learned characteristics corresponding to a user, and output audio content having one or more audio characteristics

[0023] In some embodiments, a method is described that is performed in a computer system that communicates with one or more input devices and an audio generation component. In some embodiments, the method includes detecting a first input via one or more input devices; outputting a first audio content having a second set of one or more audio characteristics via an audio generation component, after detecting the first input, according to a determination that the first input corresponds to a first set of one or more audio characteristics; and outputting a second audio content having a fourth set of one or more audio characteristics having a second set of one or more audio characteristics having a second set of one or more audio characteristics having a third set of one or more audio characteristics having a different second set of one or more audio characteristics having a different set of one or more audio characteristics having a first input via one or more input devices

[0024] In some embodiments, a non-temporary computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more input devices and audio generation components. In some embodiments, one or more programs include instructions that detect a first input via one or more input devices, and, after detecting the first input, output first audio content having a second set of one or more audio characteristics via an audio generation component according to a determination that the first input corresponds to a first set of one or more audio characteristics, and output second audio content having a fourth set of one or more audio characteristics having a second set of one or more audio characteristics having a second set of one or more audio characteristics having a second set of one or more audio characteristics having a third set of one or more audio characteristics having a different

[0025] In some embodiments, a temporary computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more input devices and audio generation components. In some embodiments, one or more programs include instructions that detect a first input via one or more input devices, and, after detecting the first input, output first audio content having a second set of one or more audio characteristics via an audio generation component according to a determination that the first input corresponds to a first set of one or more audio characteristics, and output second audio content having a fourth set of one or more audio characteristics having a second set of one or more audio characteristics having a second set of one or more audio characteristics having a second set of one or more audio characteristics having a third set of one or more audio characteristics having a different

[0026] In some embodiments, a computer system in communication with one or more input devices and an audio generation component is described. In some embodiments, the computer system comprises one or more processors, and a memory that stores one or more programs configured to be executed by the one or more processors. In some embodiments, the one or more programs include instructions for: detecting a first input via one or more input devices; after detecting the first input, in accordance with a determination that the first input corresponds to a first set of one or more audio characteristics, outputting first audio content having a second set of one or more audio characteristics via the audio generation component; and in accordance with a determination that the first input corresponds to a third set of one or more audio characteristics that is different from the first set of one or more audio characteristics, outputting second audio content having a fourth set of one or more audio characteristics that is different from the second set of one or more audio characteristics via the audio generation component.

[0027] In some embodiments, a computer system in communication with one or more input devices and an audio generation component is described. In some embodiments, the computer system comprises means for performing each of the following steps: detecting a first input via one or more input devices; after detecting the first input, in accordance with a determination that the first input corresponds to a first set of one or more audio characteristics, outputting first audio content having a second set of one or more audio characteristics via the audio generation component; and in accordance with a determination that the first input corresponds to a third set of one or more audio characteristics that is different from the first set of one or more audio characteristics, outputting second audio content having a fourth set of one or more audio characteristics that is different from the second set of one or more audio characteristics via the audio generation component.

[0028] In some embodiments, a computer program product is described. In some embodiments, the computer program product includes one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more input devices and audio generation components. In some embodiments, one or more programs include instructions for detecting a first input via one or more input devices, and, after detecting the first input, outputting first audio content having a second set of one or more audio characteristics via an audio generation component according to a determination that the first input corresponds to a first set of one or more audio characteristics, and outputting second audio content having a fourth set of one or more audio characteristics having a second set of one or more audio characteristics having a second set of one or more audio characteristics having a third set of one or more audio characteristics having a different

[0029] In some embodiments, a method is described that is performed in a computer system having one or more input devices and a moving component. In some embodiments, the method includes detecting a request to perform an action via one or more input devices;, in response to detecting a request to perform an action, moving via the moving component in a first manner before the action is performed, according to a determination that a user in the environment should perform a first action in the environment before the action is performed; and ceasing to move via the moving component in the first manner before the action is performed, according to a determination that a user in the environment should perform a second action different from the first action in the environment before the action is performed.

[0030] In some embodiments, a non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system having one or more input devices and a moving component is described. In some embodiments, the one or more programs include instructions for: detecting, via one or more input devices, a request to perform an operation; in response to detecting the request to perform the operation, moving the moving component in a first manner before performing the operation via the moving component in accordance with a determination that a user in the environment should perform a first action in the environment before the operation is performed; and canceling the moving of the moving component in the first manner via the moving component in accordance with a determination that the user in the environment should perform a second action different from the first action in the environment before the operation is performed.

[0031] In some embodiments, a transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system having one or more input devices and a moving component is described. In some embodiments, the one or more programs include instructions for: detecting, via one or more input devices, a request to perform an operation; in response to detecting the request to perform the operation, moving the moving component in a first manner before performing the operation via the moving component in accordance with a determination that a user in the environment should perform a first action in the environment before the operation is performed; and canceling the moving of the moving component in the first manner via the moving component in accordance with a determination that the user in the environment should perform a second action different from the first action in the environment before the operation is performed.

[0032] In some embodiments, a computer system having one or more input devices and a moving component is described. In some embodiments, the computer system having one or more input devices and a moving component comprises one or more processors and a memory that stores one or more programs configured to be executed by one or more processors. In some embodiments, one or more programs include instructions that, upon detecting a request to perform an action via one or more input devices, move via the moving component in a first manner before the action is performed, according to a determination that a user in the environment should perform a first action in the environment, and that cancel the movement via the moving component in the first manner before the action is performed, according to a determination that a user in the environment should perform a second action different from the first action in the environment before the action is performed.

[0033] In some embodiments, a computer system having one or more input devices and a moving component is described. In some embodiments, the computer system having one or more input devices and a moving component includes means for performing each of the following steps: detecting a request to perform an action via one or more input devices; moving via the moving component in a first manner before performing the action, in response to detecting a request to perform an action, according to a determination that a user in the environment should perform a first action in the environment before the action is performed; and canceling moving via the moving component in the first manner, according to a determination that a user in the environment should perform a second action different from the first action in the environment before the action is performed.

[0034] In some embodiments, a computer program product is described. In some embodiments, the computer program product includes one or more programs configured to be executed by one or more processors of a computer system having one or more input devices and a moving component. In some embodiments, one or more programs include instructions that, upon detecting a request to perform an action via one or more input devices, and, in response to detecting a request to perform an action, move via the moving component in a first manner before the action is performed, according to a determination that a user in the environment should perform a first action in the environment, and that cancel the first manner of movement via the moving component, according to a determination that a user in the environment should perform a second action different from the first action in the environment before the action is performed.

[0035] In some embodiments, a method is described that is performed on a computer system having one or more input devices and one or more output devices. In some embodiments, the method includes detecting a user intent via one or more input devices without detecting an explicit instruction to perform an action determined to be the user's intent; in response to detecting a user intent without detecting an explicit instruction to perform an action determined to be the detected intent, outputting a first set of one or more proposed actions to perform an action via one or more output devices according to a determination that the context corresponding to the intent is a first type of context; and ceasing to output a first set of one or more proposed actions to perform an action according to a determination that the context corresponding to the intent is a second type of context different from the first type of context.

[0036] In some embodiments, a non-temporary computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system having one or more input devices and one or more output devices. In some embodiments, one or more programs include instructions that, via one or more input devices, detect a user intent without detecting an explicit instruction to perform an action determined to be the user intent, and, in response to the detection of the user intent without detecting an explicit instruction to perform an action determined to be the detected intent, output a first set of one or more proposed actions to perform an action via one or more output devices according to a determination that the context corresponding to the intent is a first type of context, and refrain from outputting the first set of one or more proposed actions to perform an action according to a determination that the context corresponding to the intent is a second type of context different from the first type of context.

[0037] In some embodiments, a temporary computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system having one or more input devices and one or more output devices. In some embodiments, one or more programs include instructions that, via one or more input devices, detect a user intent without detecting an explicit instruction to perform an action determined to be the user intent, and, in response to the detection of the user intent without detecting an explicit instruction to perform an action determined to be the detected intent, output a first set of one or more proposed actions to perform an action via one or more output devices according to a determination that the context corresponding to the intent is a first type of context, and refrain from outputting the first set of one or more proposed actions to perform an action according to a determination that the context corresponding to the intent is a second type of context different from the first type of context.

[0038] In some embodiments, a computer system having one or more input devices and one or more output devices is described. In some embodiments, the computer system having one or more input devices and one or more output devices comprises one or more processors and a memory storing one or more programs configured to be executed by one or more processors. In some embodiments, one or more programs include instructions that, via one or more input devices, detect a user intent without detecting an explicit instruction to perform an action determined to be the user intent, and, in response to the detection of the user intent without detecting an explicit instruction to perform an action determined to be the detected intent, output a first set of one or more proposed actions to perform an action via one or more output devices according to a determination that the context corresponding to the intent is a first type of context, and refrain from outputting the first set of one or more proposed actions to perform an action according to a determination that the context corresponding to the intent is a second type of context different from the first type of context.

[0039] In some embodiments, a computer system having one or more input devices and one or more output devices is described. In some embodiments, the computer system having one or more input devices and one or more output devices includes means for performing each of the following steps: detecting a user intent via one or more input devices without detecting an explicit instruction to perform an action determined to be the user's intent; in response to detecting a user intent without detecting an explicit instruction to perform an action determined to be the detected intent, outputting a first set of one or more proposed actions to perform an action via one or more output devices according to a determination that the context corresponding to the intent is a first type of context; and ceasing to output a first set of one or more proposed actions to perform an action according to a determination that the context corresponding to the intent is a second type of context different from the first type of context.

[0040] In some embodiments, a computer program product is described. In some embodiments, the computer program product includes one or more programs configured to be executed by one or more processors of a computer system having one or more input devices and one or more output devices. In some embodiments, one or more programs include instructions that, via one or more input devices, detect a user intent without detecting an explicit instruction to perform an action determined to be the user intent, and, in response to detecting a user intent without detecting an explicit instruction to perform an action determined to be the detected intent, output a first set of one or more proposed actions to perform an action via one or more output devices according to a determination that the context corresponding to the intent is a first type of context, and refrain from outputting the first set of one or more proposed actions to perform an action according to a determination that the context corresponding to the intent is a second type of context different from the first type of context.

[0041] In some embodiments, a method is described that is performed in a computer system communicating with one or more input devices and one or more output devices. In some embodiments, the method includes detecting input from a first user via one or more input devices, the input comprising identification information of one or more users; detecting a second user different from the first user via one or more input devices after detecting the input; outputting a first acknowledgment directed to the second user via one or more output devices in accordance with the determination that the second user corresponds to the identification information of one or more users, in response to the detection of the second user; and outputting a second acknowledgment directed to the second user via one or more output devices in accordance with the determination that the second user does not correspond to the identification information corresponding to one or more users, wherein the second acknowledgment is different from the first acknowledgment.

[0042] In some embodiments, a non-temporary computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system communicating with one or more input devices and one or more output devices is described. In some embodiments, the one or more programs include instructions that detect input from a first user via one or more input devices, the input including identification information of one or more users; after detecting the input, detect a second user different from the first user via one or more input devices; and, in response to detecting the second user, output a first acknowledgment directed to the second user via one or more output devices according to a determination that the second user corresponds to the identification information of one or more users; and output a second acknowledgment directed to the second user via one or more output devices according to a determination that the second user does not correspond to the identification information of one or more users, wherein the second acknowledgment is different from the first acknowledgment.

[0043] In some embodiments, a temporary computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system communicating with one or more input devices and one or more output devices. In some embodiments, the one or more programs include instructions that detect input from a first user via one or more input devices, the input including identification information of one or more users; after detecting the input, detect a second user different from the first user via one or more input devices; and, in response to detecting the second user, output a first acknowledgment directed to the second user via one or more output devices according to a determination that the second user corresponds to the identification information of one or more users; and output a second acknowledgment directed to the second user via one or more output devices according to a determination that the second user does not correspond to the identification information of one or more users, wherein the second acknowledgment is different from the first acknowledgment.

[0044] In some embodiments, a computer system communicating with one or more input devices and one or more output devices is described. In some embodiments, the computer system communicating with one or more input devices and one or more output devices comprises one or more processors and a memory storing one or more programs configured to be executed by one or more processors. In some embodiments, one or more programs include instructions that detect input from a first user via one or more input devices, the input including identification information of one or more users; after detecting the input, detect a second user different from the first user via one or more input devices; and, in response to detecting the second user, output a first acknowledgment directed to the second user via one or more output devices according to a determination that the second user corresponds to the identification information of one or more users; and output a second acknowledgment directed to the second user via one or more output devices according to a determination that the second user does not correspond to the identification information of one or more users, wherein the second acknowledgment is different from the first acknowledgment.

[0045] In some embodiments, a computer system communicating with one or more input devices and one or more output devices is described. In some embodiments, the computer system communicating with one or more input devices and one or more output devices includes means for performing each of the following steps: detecting an input from a first user via one or more input devices, the input comprising identification information of one or more users; detecting a second user different from the first user via one or more input devices after detecting the input; outputting a first acknowledgment directed to the second user via one or more output devices according to a determination that the second user corresponds to the identification information of one or more users, in response to the detection of the second user; and outputting a second acknowledgment directed to the second user via one or more output devices according to a determination that the second user does not correspond to the identification information corresponding to one or more users, wherein the second acknowledgment is different from the first acknowledgment.

[0046] In some embodiments, a computer program product is described. In some embodiments, the computer program product includes one or more programs configured to be executed by one or more processors of a computer system communicating with one or more input devices and one or more output devices. In some embodiments, one or more programs include instructions to detect input from a first user via one or more input devices, the input including identification information of one or more users; after detecting the input, to detect a second user different from the first user via one or more input devices; in response to detecting the second user, to output a first acknowledgment directed to the second user via one or more output devices according to a determination that the second user corresponds to the identification information of one or more users; and to output a second acknowledgment directed to the second user via one or more output devices according to a determination that the second user does not correspond to the identification information of one or more users, wherein the second acknowledgment is different from the first acknowledgment.

[0047] In some embodiments, a method is described that is performed in a computer system communicating with one or more input devices and one or more output devices. In some embodiments, the method includes detecting a first set of one or more inputs via one or more input devices, which includes an indication of a first context and an indication of a first set of one or more moves; detecting the occurrence of an individual context via one or more input devices after detecting the first set of one or more inputs; outputting a representation of a first set of one or more moves via one or more output devices in response to detecting the occurrence of an individual context, according to a determination that the individual context is a first context; and ceasing to output a representation of a first set of one or more moves via one or more output devices in accordance with a determination that the individual context is a second context different from the first context.

[0048] In some embodiments, a non-temporary computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system communicating with one or more input devices and one or more output devices. In some embodiments, one or more programs include instructions that, via one or more input devices, detect a first set of one or more inputs including an indication of a first context and an indication of a first set of one or more moves; after detecting the first set of one or more inputs, detect the occurrence of an individual context via one or more input devices; and, in response to detecting the occurrence of an individual context, output a representation of the first set of one or more moves via one or more output devices according to a determination that the individual context is a first context; and, according to a determination that the individual context is a second context different from the first context, refrain from outputting a representation of the first set of moves via one or more output devices.

[0049] In some embodiments, a temporary computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system communicating with one or more input devices and one or more output devices. In some embodiments, one or more programs include instructions that, via one or more input devices, detect a first set of one or more inputs including an indication of a first context and an indication of a first set of one or more moves; after detecting the first set of one or more inputs, detect the occurrence of an individual context via one or more input devices; and, in response to detecting the occurrence of an individual context, output a representation of the first set of one or more moves via one or more output devices according to a determination that the individual context is a first context; and refrain from outputting a representation of the first set of one or more moves via one or more output devices according to a determination that the individual context is a second context different from the first context.

[0050] In some embodiments, a computer system communicating with one or more input devices and one or more output devices is described. In some embodiments, the computer system communicating with one or more input devices and one or more output devices comprises one or more processors and a memory storing one or more programs configured to be executed by the one or more processors. In some embodiments, one or more programs include instructions for detecting a first set of one or more inputs via one or more input devices, including an indication of a first context and an indication of a first set of one or more moves; detecting the occurrence of an individual context via one or more input devices after detecting the first set of one or more inputs; outputting a representation of a first set of one or more moves via one or more output devices according to a determination that the individual context is a first context, in response to the detection of the occurrence of an individual context; and ceasing to output a representation of a first set of one or more moves via one or more output devices according to a determination that the individual context is a second context different from the first context.

[0051] In some embodiments, a computer system communicating with one or more input devices and one or more output devices is described. In some embodiments, the computer system communicating with one or more input devices and one or more output devices includes means for performing each of the following steps: detecting a first set of one or more inputs via one or more input devices, which includes an indication of a first context and an indication of a first set of one or more moves; detecting the occurrence of an individual context via one or more input devices after detecting the first set of one or more inputs; outputting a representation of a first set of one or more moves via one or more output devices in accordance with the determination that the individual context is a first context in response to the detection of the occurrence of an individual context; and ceasing to output a representation of a first set of one or more moves via one or more output devices in accordance with the determination that the individual context is a second context different from the first context.

[0052] In some embodiments, a computer program product is described. In some embodiments, the computer program product includes one or more programs configured to be executed by one or more processors of a computer system communicating with one or more input devices and one or more output devices. In some embodiments, one or more programs include instructions for detecting one or more first sets of inputs via one or more input devices, including an indication of a first context and an indication of a first set of one or more moves; detecting the occurrence of an individual context via one or more input devices after detecting the first set of one or more inputs; outputting a representation of the first set of one or more moves via one or more output devices according to a determination that the individual context is a first context, in response to the detection of the occurrence of an individual context; and ceasing to output a representation of the first set of one or more moves via one or more output devices according to a determination that the individual context is a second context different from the first context.

[0053] In some embodiments, a method is described that is performed in a computer system communicating with one or more input devices and one or more output devices. In some embodiments, the method includes detecting user input via one or more input devices, and, after detecting user input, outputting a first proposal, which is based on user input, via one or more output devices, in accordance with a determination that the current context is a first context, without detecting a request to provide a proposal, and, in accordance with a determination that the current context is not a first context, ceasing to output the first proposal via one or more output devices.

[0054] In some embodiments, a non-temporary computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system communicating with one or more input devices and one or more output devices. In some embodiments, one or more programs include instructions that, after detecting user input, and without detecting a request to provide a suggestion, output a first suggestion via one or more output devices according to a determination that the current context is a first context, the first suggestion being based on user input, and that, according to a determination that the current context is not a first context, refrain from outputting the first suggestion via one or more output devices.

[0055] In some embodiments, a temporary computer-readable storage medium is described that stores one or more programs configured to be executed by one or more processors of a computer system communicating with one or more input devices and one or more output devices. In some embodiments, one or more programs include instructions that, after detecting user input, and without detecting a request to provide a suggestion, output a first suggestion via one or more output devices according to a determination that the current context is a first context, the first suggestion being based on user input, and that, according to a determination that the current context is not a first context, refrain from outputting the first suggestion via one or more output devices.

[0056] In some embodiments, a computer system is described that communicates with one or more input devices and one or more output devices. In some embodiments, the computer system comprises one or more processors and a memory that stores one or more programs configured to be executed by one or more processors. In some embodiments, one or more programs include instructions that, after detecting input from a user, and without detecting a request to provide a suggestion, output a first suggestion via one or more output devices according to a determination that the current context is a first context, the first suggestion being based on input from a user, and that, according to a determination that the current context is not a first context, refrain from outputting the first suggestion via one or more output devices.

[0057] In some embodiments, a computer system communicating with one or more input devices and one or more output devices is described. In some embodiments, the computer system includes means for performing each of the following steps: detecting input from a user via one or more input devices; and, after detecting input from a user, without detecting a request to provide a suggestion, outputting a first suggestion, which is based on user input, via one or more output devices according to a determination that the current context is a first context; and ceasing to output the first suggestion via one or more output devices according to a determination that the current context is not a first context.

[0058] In some embodiments, a computer program product is described. In some embodiments, the computer program product includes one or more programs configured to run by one or more processors of a computer system communicating with one or more input devices and one or more output devices. In some embodiments, one or more programs include instructions that, after detecting input from a user, and without detecting a request to provide a suggestion, output a first suggestion via one or more output devices in accordance with a determination that the current context is a first context, the first suggestion being based on input from a user, and that, in accordance with a determination that the current context is not a first context, refrain from outputting the first suggestion via one or more output devices.

[0059] The executable instructions that perform these functions are optionally contained within a non-temporary computer-readable storage medium or other computer program product configured to be executed by one or more processors.

[0060] For a better understanding of the various embodiments described, please refer to the following “Modes for Carrying Out the Invention” in conjunction with the drawings. Similar reference numbers refer to corresponding parts throughout those drawings. [Brief explanation of the drawing]

[0061] [Figure 1] This is a block diagram showing a computer system in several embodiments.

[0062] [Figure 2A] This figure shows exemplary components and user interfaces of an electronic device according to several embodiments. [Figure 2B] This figure shows exemplary components and user interfaces of an electronic device according to several embodiments. [Figure 2C] This figure shows exemplary components and user interfaces of an electronic device according to several embodiments.

[0063] [Figure 3] This is a block diagram showing exemplary components of a device according to several embodiments.

[0064] [Figure 4] This is a functional diagram of an exemplary actuator device according to several embodiments.

[0065] [Figure 5] This is a functional diagram of an exemplary agent system according to several embodiments.

[0066] [Figure 6A] This document presents exemplary user interfaces for performing movement representations based on learned characteristics, according to several embodiments. [Figure 6B] This document presents exemplary user interfaces for performing movement representations based on learned characteristics, according to several embodiments. [Figure 6C] This document presents exemplary user interfaces for performing movement representations based on learned characteristics, according to several embodiments. [Figure 6D] This document presents exemplary user interfaces for performing movement representations based on learned characteristics, according to several embodiments. [Figure 6E] This document presents exemplary user interfaces for performing movement representations based on learned characteristics, according to several embodiments.

[0067] [Figure 7] This flowchart illustrates a method for performing a movement representation based on learned characteristics, according to several embodiments.

[0068] [Figure 8A] This document presents exemplary user interfaces for configuring actions performed based on learned characteristics, according to several embodiments. [Figure 8B] This document presents exemplary user interfaces for configuring actions performed based on learned characteristics, according to several embodiments. [Figure 8C] This document presents exemplary user interfaces for configuring actions performed based on learned characteristics, according to several embodiments. [Figure 8D] This document presents exemplary user interfaces for configuring actions performed based on learned characteristics, according to several embodiments. [Figure 8E] This document presents exemplary user interfaces for configuring actions performed based on learned characteristics, according to several embodiments.

[0069] [Figure 9] This flowchart illustrates a method for configuring actions to be performed based on learned characteristics, according to several embodiments.

[0070] [Figure 10A] This document presents exemplary user interfaces for automatically outputting content based on context and / or input characteristics, according to several embodiments. [Figure 10B] This document presents exemplary user interfaces for automatically outputting content based on context and / or input characteristics, according to several embodiments. [Figure 10C] This document presents exemplary user interfaces for automatically outputting content based on context and / or input characteristics, according to several embodiments.

[0071] [Figure 11]This flowchart illustrates several embodiments of methods for automatically outputting audio content based on context.

[0072] [Figure 12] This flowchart illustrates a method for automatically outputting audio with specific characteristics, according to several embodiments.

[0073] [Figure 13A] This figure shows an exemplary user interface for performing an operation, according to several embodiments. [Figure 13B] This figure shows an exemplary user interface for performing an operation, according to several embodiments. [Figure 13C] This figure shows an exemplary user interface for performing an operation, according to several embodiments. [Figure 13D] This figure shows an exemplary user interface for performing an operation, according to several embodiments.

[0074] [Figure 14] This is a flowchart illustrating a method for performing an operation according to several embodiments.

[0075] [Figure 15A] This document presents exemplary user interfaces for anticipating needs, based on several embodiments. [Figure 15B] This document presents exemplary user interfaces for anticipating needs, based on several embodiments. [Figure 15C] This document presents exemplary user interfaces for anticipating needs, based on several embodiments.

[0076] [Figure 16] This flowchart illustrates a method for predicting needs through several embodiments.

[0077] [Figure 17A] This figure shows an exemplary user interface for performing a custom greeting, according to several embodiments. [Figure 17B] This figure shows an exemplary user interface for performing a custom greeting, according to several embodiments. [Figure 17C] This figure shows an exemplary user interface for performing a custom greeting, according to several embodiments. [Figure 17D] This figure shows an exemplary user interface for performing a custom greeting, according to several embodiments.

[0078] [Figure 18] This is a flowchart illustrating methods for performing custom greetings through several embodiments.

[0079] [Figure 19] This is a flowchart illustrating methods for performing custom greetings through several embodiments. [Modes for carrying out the invention]

[0080] The following description provides illustrative methods, components, parameters, etc. While specific examples are given below, it should be understood that such examples are not intended to limit the scope of this disclosure to the express descriptions of the examples provided herein, but rather to provide illustrative examples.

[0081] Each of the identified modules and applications herein corresponds to an executable instruction set for performing one or more of the functions described above and the methods of this application (e.g., the computer implementation methods and other information processing methods described herein). These modules (e.g., instruction sets) do not necessarily have to be implemented as separate software programs (e.g., computer programs (containing instructions)), procedures, or modules, and therefore, various subsets of these modules may, in various embodiments, be, optionally combined or otherwise reconfigured. For example, a video player module may, optionally, be combined with a music player module to form a single module. In some embodiments, memory may optionally store a subset of the modules and data structures identified above. Furthermore, memory may optionally store additional modules and data structures not described above.

[0082] One or more steps of the methods described herein may depend on (be conditional on) the satisfaction of one or more conditions. In some embodiments, the method is performed by repeating the process multiple times. In some embodiments, the conditional steps may be satisfied in different iterations of the same process and still be within the scope of the methods described herein. For example, with respect to a given method comprising two steps conditional on different conditions, a person skilled in the art will understand that the given method is deemed to have been performed even if the process is repeated multiple times until the conditional steps are satisfied. In some embodiments, multiple iterations of the process are not required to carry out the claims presented herein. For example, claims for electronic devices, systems, or computer-readable media can be performed without iteratively repeating the process. In some embodiments, claims for electronic devices, systems, or computer-readable media include instructions for performing one or more steps conditional on the satisfaction of one or more conditions. Since such instructions are stored in one or more processors and / or one or more memory locations, claims for electronic devices, systems, or computer-readable media can include logic for determining whether one or more conditions have been satisfied without requiring the repetition of steps in the process.

[0083] The elements are described below using numerical descriptors such as “first” and / or “second,” but these elements do not correspond to order or distinct expressions and should not be limited to the numerical terms described. In some embodiments, these terms are used simply as prefixes to distinguish a reference to one element from a reference to another. For example, “first” device and “second” device may be two distinct references to the same device. In contrast, for example, “first” device and “second” device may be references to two different devices (e.g., not the same device and / or not devices of the same type). For example, “first computer system” and “second computer system” do not correspond to first and second in time and are simply used to distinguish two computer systems. Thus, without departing from the scope of the various embodiments described, a first computer system may be referred to as a second computer system, and a second computer system may be referred to as a first computer system.

[0084] For the purpose of describing various elements and examples, the use of certain terms is used to provide a productive description of the subject matter below and should not be interpreted as limiting. As used to describe various examples herein, the singular forms of “a,” “an,” and “the” should not be interpreted as excluding or excluding the plural forms unless the context explicitly indicates otherwise. Similarly, “and / or” is used to encompass any and all possible combinations of one or more related enumerated items. For example, “x and / or y” should be interpreted as including “x” or “y,” as well as “x and y” as possible permutations. Furthermore, the use of the terms “includes,” “including,” “comprises,” and / or “comprising,” as used herein, specifies the presence of the described features, integers, steps, actions, elements, and / or components, but does not exclude the presence or addition of one or more other features, integers, steps, actions, elements, components, and / or groups thereof.

[0085] When describing options and / or logical possibilities, the term “if” is optionally interpreted, depending on the context, to mean “when,” “upon,” “in response to determining,” “in response to detecting,” or “in a determination that.” Similarly, the phrases “if determined” or “if [the stated condition or event] is detected” are optionally interpreted, depending on the context, to mean “when determined,” “in response to determining,” “when [the stated condition or event] is detected,” “in response to having detected [the stated condition or event],” or “in a determination that [the stated condition or event] is detected.”

[0086] The processes described below improve the usability of the device and make the user device more efficient (for example, by helping the user provide appropriate input when operating / interacting with the device and reducing user errors) through a variety of techniques, including providing the user with improved feedback (e.g., visual, tactile, audible, and / or haptic feedback), reducing the number of inputs required to perform an action, providing additional control options without cluttering the user interface with additional displayed controls, performing an action when a set of conditions is met without requiring further input (e.g., user input), and / or improving the security and / or privacy of the computer system and reducing burn-in of one or more parts of the user interface of the display. These techniques also reduce power consumption and improve the battery life of the device by enabling the user to use the device more quickly and efficiently.

[0087] Figures 1, 2A-2C, and 3-5 below provide a description of exemplary devices for performing the techniques described herein. Figures 6A-6E show exemplary user interfaces for performing motion representations based on learned characteristics, according to several embodiments. Figure 7 is a flowchart showing a method for performing motion representations based on learned characteristics, according to several embodiments. The user interfaces in Figures 6A-6E are used to illustrate processes described later, including the process in Figure 7. Figures 8A-8E show exemplary user interfaces for configuring actions performed based on learned characteristics, according to several embodiments. Figure 9 is a flowchart showing a method for configuring actions performed based on learned characteristics, according to several embodiments. The user interfaces in Figures 8A-8E are used to illustrate processes described later, including the process in Figure 9. Figures 10A-10C show exemplary user interfaces for automatically outputting content based on context and / or input characteristics, according to several embodiments. Figure 11 is a flowchart showing a method for automatically outputting audio content based on context, according to several embodiments. Figure 12 is a flowchart illustrating a method for automatically outputting audio with specific characteristics according to several embodiments. The user interfaces in Figures 10A to 10C are used to illustrate a process described later, including the process in Figures 11 and 12. Figures 13A to 13D are diagrams illustrating exemplary user interfaces for performing an operation according to several embodiments. Figure 14 is a flowchart illustrating a method for performing an operation according to several embodiments. The user interfaces in Figures 13A to 13D are used to illustrate a process described later, including the process in Figure 14. Figures 15A to 15C show exemplary user interfaces for anticipating needs according to several embodiments. Figure 16 is a flowchart illustrating a method for anticipating needs according to several embodiments. The user interfaces in Figures 15A to 15C are used to illustrate a process described later, including the process in Figure 16.Figures 17A to 17D show exemplary user interfaces for performing custom acknowledgments according to several embodiments. Figure 18 is a flowchart showing a method for performing custom acknowledgments according to several embodiments. Figure 19 is a flowchart showing a method for performing custom acknowledgments according to several embodiments. The user interfaces in Figures 17A to 17D are used to illustrate a process described later, including the processes in Figures 18 and 19.

[0088] Figure 1 depicts a block diagram of a computer system 100 (e.g., electronic devices and / or electronic systems) that includes a set of electronic components communicating with each other (e.g., connected) (e.g., wired or wirelessly). It should be understood that computer system 100 is merely an example of a computer system that can be used to perform the functions described below, and that one or more other computer systems can be used to perform the functions described below. Additionally, while Figure 1 depicts the computer architecture of computer system 100, other computer architectures of computer systems (e.g., including more components, similar components, and / or fewer components) can be used to perform the functions described herein.

[0089] In some embodiments, the computer system 100 may correspond to (e.g., being and / or including) a system-on-a-chip, server system, personal computer system, smartphone, smartwatch, wearable device, tablet, laptop computer, fitness tracking device, head-mounted display (HMD) device, desktop computer, shared device (e.g., smart speaker, connected thermostat, and / or additional home computer system), accessory (e.g., switch, light, speaker, air conditioner, heater, window cover, fan, lock, media playback device, television, etc.), controller, hub, and / or sensor.

[0090] In some embodiments, the sensor includes one or more hardware components capable of detecting (e.g., sensing, generating, and / or processing) information about the physical environment adjacent to the sensor. For example, the sensor may be configured to detect information around the sensor, detect information in one or more directions away from the sensor, and / or detect information based on contact between the sensor and elements of the physical environment. In some embodiments, the hardware components of the sensor include sensing components (e.g., temperature and / or image sensors), transmission components (e.g., wireless and / or laser transmitters), and / or receiving components (e.g., laser and / or wireless receivers). In some embodiments, the sensors include angle sensors, break sensors, flow sensors, force sensors, gas sensors, humidity or moisture sensors, glass break sensors, chemical sensors, contact sensors, non-contact sensors, image sensors (e.g., RGB cameras and / or infrared sensors), particle sensors, photoelectric sensors (e.g., ambient light and / or solar), position sensors (e.g., Global Positioning Systems), precipitation sensors, pressure sensors, proximity sensors, radiation sensors, inertial measurement units, leak sensors, level sensors, metal sensors, microphones, motion sensors, range or depth sensors (e.g., RADAR, LiDAR), speed sensors, temperature sensors, time-of-flight sensors, torque sensors, and ultrasonic sensors, empty sensors, presence sensors, voltage and / or current sensors, conductivity sensors, resistivity sensors, capacitance sensors, and / or water sensors. Although only a single computer system is depicted in Figure 1, the functions described below can be performed by two or more computer systems working together. Additionally, in some embodiments, the computer system 100 includes one or more sensors as described above, and information about the physical environment is captured by combining data from one sensor with data from one or more additional sensors (e.g., part of a computer and / or one or more additional computer systems).

[0091] As shown in Figure 1, the computer system 100 consists of a processor subsystem 110, memory 120, and an I / O interface 130. Memory 120 corresponds to system memory communicating with the processor subsystem 110. The electronic components constituting the computer system 100 are electrically connected via an interconnect 150 that enables communication between the components of the computer system 100. For example, the interconnect 150 may be a system bus for connecting multiple components of the computer system 100, one or more memory locations, and / or additional electrical channels. The I / O interface 130 is connected to an I / O device 140 via wired and / or wireless connections. In some embodiments, the computer system 100 includes components consisting of the I / O interface 130 and the I / O device 140, such that the functionality of the individual components is included in the component. Additionally, it should be understood that the computer system 100 may include one or more I / O interfaces that communicate with one or more I / O devices. In some embodiments, the computer system 100 consists of multiple processor subsystems 100s, each electrically connected via the interconnect 150.

[0092] In some embodiments, the processor subsystem 110 includes one or more processors or individual processing units capable of executing instructions (e.g., programs, systems, and / or interrupts) that perform the functions described herein. For example, operating system level and / or application level instructions are executed by the processor subsystem 110. In some embodiments, the processor subsystem 110 includes one or more components (e.g., implemented as hardware, software, and / or a combination thereof) capable of supporting, interpreting, and / or executing machine learning instructions and / or operations. For example, computer system 100 can perform operations locally according to a machine learning model. Alternatively, or additionally, computer system 100 can communicate with a remote interactive knowledge base (e.g., processing resources that implement machine learning models, artificial intelligence models, and / or large-scale language models) (e.g., by performing calculations and / or executing corresponding instructions) to perform operations that may otherwise be outside the set of capabilities of computer system 100. For example, computer system 100 can determine a set of inputs (e.g., instructions, data, and / or parameters) to an interactive knowledge base for performing a desired machine learning operation.

[0093] The memory 120 communicating with the processor subsystem 110 can be implemented using a variety of different physical non-temporary memory media. In some embodiments, the computer system 100 includes a plurality of memory components and / or a plurality of types of memory components, each connected to the processor subsystem 110 directly and / or via an interconnect 150. For example, the memory 120 may be implemented using removable flash drives, storage arrays, storage area networks (e.g., SANs), flash memory, hard disk storage, optical drive storage, floppy disk storage, removable disk storage, random access memory (e.g., SDRAM, DDR SDRAM, RAM-SRAM, EDO RAM, and / or RAMBUS RAM), and / or read-only memory (e.g., PROM and / or EEPROM). Additionally, in some embodiments, the processor subsystem 110 and / or the interconnect 150 are connected to a memory controller electrically connected to the memory 120.

[0094] In some embodiments, instructions can be executed by the processor subsystem 110. In this example, memory 120 may include computer-readable media (e.g., non-temporary or temporary computer-readable media) that can be used to store instructions executable by the processor subsystem 110 (e.g., configured to store, allocated to store, and / or store). In some embodiments, each instruction stored in memory 120 and executed by the processor subsystem 110 corresponds to an operation for completing a function described herein. For example, memory 120 may store program instructions for performing functions related to the methods described below, including 700, 900, 1100, 1200, 1400, 1600, 1800, and / or 1900 (Figures 7, 9, 11, 12, 14, 16, 18, and / or 19).

[0095] As described above, the I / O interface 130 may be one or more types of interfaces that enable the computer system 100 to communicate with other devices. In some embodiments, the I / O interface 130 includes a bridge chip (e.g., a southbridge) from a front bus to one or more rear buses. In some embodiments, the I / O interface 130 enables communication with one or more I / O devices, indicated as I / O devices 140, via one or more corresponding buses or other interfaces. For example, the I / O devices may include one or more of the following: physical user interface devices (e.g., physical keyboards, mice, and / or joysticks), storage devices (e.g., as described above with respect to memory 120), network interface devices (e.g., to a local or wide area network), sensor devices (e.g., as described above with respect to sensors), and / or auditory and / or visual output devices (e.g., screens, speakers, lighting, and / or projectors). In some embodiments, visual output devices are referred to as display components. For example, a display component may be configured to provide a visual output, such as displaying an image on a physically visible medium via an LED display or image projection. As used herein, “displaying” content includes displaying content (e.g., video data rendered and / or decoded by a display controller) by transmitting data (e.g., image data and / or video data) to an integrated or external display component via a wired or wireless connection in order to visually generate the content.

[0096] In some embodiments, the computer system 100 includes a component that integrates the I / O device 140 with other components (e.g., a component including an I / O interface 130 and the I / O device 140). In some embodiments, the I / O device 140 is separate from the other components of the computer system 100 (e.g., a separate component). In some embodiments, the I / O device 140 includes a network interface device that enables the computer system 100 to connect to a network or other computer systems (e.g., communicate) via a wired or wireless method. In some embodiments, the network interface device may include Wi-Fi, Bluetooth, NFC, USB, Thunderbolt, Ethernet, etc. For example, the computer system 100 can use an NFC connection to facilitate banking, credit, finance, tokens (e.g., fungible or nonfungible tokens), and / or cryptocurrency transactions between the computer system 100 and another computer system in proximity.

[0097] In some embodiments, the I / O device 140 includes components for detecting users (e.g., objects, people, animals, other computer systems different from the computer system, and / or objects) and / or input from detected users (e.g., tap input and / or non-tap input (e.g., verbal input, audible requests, audible commands, audible statements, swipe input, hold-and-drag input, gaze input, air gestures, and / or mouse clicks)). In some embodiments, the I / O device 140 enables the computer system 100 to identify users associated with and / or without accounts in the environment. For example, the computer system 100 can detect known users (e.g., users corresponding to accounts) and access information about users using the accounts of known users. In some embodiments, as part of the computer system 100's detection of users, the computer system 100 detects that a user's account is associated with (e.g., included in and / or identified with) a group of users. For example, the computer system 100 can access information associated with a family of accounts, depending on whether it has detected members of a family defined as a group of accounts. In some embodiments, the account corresponding to a user may be connected to additional accounts and / or additional computer systems. For example, computer system 100 may detect such additional computer systems and / or such computer systems for detecting users. In some embodiments, computer system 100 may detect an unknown user and allow a guest account of the unknown user to use computer system 100.

[0098] In some embodiments, the I / O device 140 includes one or more cameras. In some embodiments, the cameras include image sensors (e.g., one or more light sensors and / or one or more depth camera sensors) that provide the computer system 100 with the ability to detect user and / or user gestures (e.g., hand gestures and / or air gestures) as input. In some embodiments, an air gesture is a gesture detected without the user touching (or independently of) an input element that is part of the device, and is based on detected movement of a part of the user's body in the air, including movement of the user's body relative to an absolute reference (e.g., the angle of the user's arm relative to the ground, or the distance of the user's hand relative to the ground), movement of the user's body relative to another part of the user's body (e.g., movement of the user's hand relative to the user's shoulder, movement of the user's other hand relative to one hand, and / or movement of the user's fingers relative to another finger or part of the user's hand), and / or absolute movement of a part of the user's body (e.g., a tap gesture involving movement of the hand in a predetermined pose by a predetermined amount and / or speed, or a shake gesture involving rotation of a part of the user's body by a predetermined speed or amount). In some embodiments, one or more cameras enable the computer system 100 to transmit picture and / or video information to an application. For example, image data captured by a camera can enable the computer system 100 to complete a video call by transmitting video data to an application for performing a video call.

[0099] In some embodiments, the I / O device 140 includes one or more microphones. For example, the microphones can be used by 100 to obtain data and / or information from a user without contact input. In some embodiments, the microphones enable the computer system 100 to detect verbal input and / or voice input from a user. In some embodiments, the computer system 100 utilizes voice input to enable personal assistant functions. For example, a user elicits a request to the computer system 100 to perform an action and / or obtain information for the user. In some embodiments, the computer system 100 utilizes voice input (e.g., together with one or more other input and / or output technologies) to request and / or detect information from a user without requiring the user to have physical contact with the computer system 100.

[0100] In some embodiments, the I / O device 140 includes a physical input medium for a user to directly interact with the computer system 100. In some embodiments, the physical input medium includes one or more physical buttons on and / or connected to the computer system 100 (e.g., tactile pressable buttons and / or touch-sensitive non-pressable components), mouse and keyboard input methods (e.g., connected to the computer system 100 together with and / or separately with one or more I / O interfaces), and / or touch-sensitive display components.

[0101] In some embodiments, the I / O device 140 includes one or more components for outputting information (e.g., display components, audio generation components, speakers, haptic output devices, display screens, projectors, and / or touch-sensitive displays). In some embodiments, the computer system 100 uses the I / O device 140 to communicate information and / or states of the computer system 100. In some embodiments, the I / O device 140 includes haptic output components. For example, a haptic output component may be a haptic generation component that enables the computer system 100 to communicate information to a user who is in contact with (e.g., holding, touching, and / or near) the computer system 100. In some embodiments, the I / O device 140 includes one or more components for outputting visual output (e.g., video, images, animations, 3D renderings, augmented reality overlays, motion graphics, data visualizations, digital art, etc.). For example, displaying content from one or more applications and / or system applications, and / or displaying widgets corresponding to one or more applications (e.g., controls that display real-time information and / or data).

[0102] In some embodiments, the I / O device 140 includes one or more components for outputting audio (e.g., smart speakers, home theater systems, soundbars, headphones, earphones, earbuds, speakers, TV speakers, augmented reality headset speakers, audio jacks, optical audio outputs, Bluetooth audio outputs, HDMI audio outputs, audio sensors, etc.). In some embodiments, the computer system 100 can output audio through one or more speakers. For example, the computer system 100 outputs audio-based content and / or information to the user. In some embodiments, one or more speakers enable spatial audio (e.g., audio output that responds to the environment (e.g., the computer system 100 that detects materials and / or objects in the environment, and / or the computer system 100 that modifies audio patterns, intensities, and / or waveforms to compensate for various characteristics of the environment)).

[0103] Figures 2 to 5 show exemplary components and user interfaces of the electronic device 200 according to several embodiments. The electronic device 200 (sometimes referred to herein as device 200) may include one or more features of the computer system 100. In the examples described with respect to Figures 2 to 5, device 200 is a laptop computer. In some embodiments, device 200 is not limited to a laptop computer, and those skilled in the art should recognize that device 200 may be one or more other devices (including, for example, one or more of the components and / or functions described herein with respect to device 200, as described herein). For example, device 200 may be a shared device (such as a smart display, smart speaker, and / or television) and / or a personal device (such as a smartphone, smartwatch, tablet, desktop computer, fitness tracking device, and / or head-mounted display device). In some embodiments, the shared device is configured to provide functionality to multiple users (e.g., simultaneously and / or at different times). In such embodiments, the shared device may be managed and / or set up by a single user. In some embodiments, the personal device is configured to provide functionality to a single user (for example, when a single user logs into the personal device).

[0104] Figures 2A and 2C show the device 200 in three different physical positions. As shown in Figure 2A, the device 200 is a laptop computer (also referred to herein as a “laptop”) comprising a base portion 200-2 (for example, placed horizontally on a surface such as a desk, as shown in Figure 2A) and a display portion 200-1 connected to the base portion 200-2 by a connector 200-3 (for example, one or more connection points, motorized arms, hinges, and / or joints) that allows the display portion 200-1 to pivot and / or change orientation relative to the base portion 200-2. For example, the device 200 can pivot at the connector 200-3 to rotate the display portion 200-1 and / or the device 200 to one or more positions corresponding to an “off” internal state (for example, as further described below in relation to Figure 2C). In some embodiments, the position corresponding to an “off” internal state is a position in which the device 200 is in a predetermined orientation. For example, a predetermined orientation may include a display portion 200-1 positioned parallel to the base portion 200-2, or a display portion 200-1 forming a predetermined angle (e.g., a 60-degree angle) with respect to the base portion 200-2. In some embodiments, in the "off" internal state, the area where content is displayed by the device 200 is positioned in a manner corresponding to the "off" internal state (e.g., configured to represent, associate with, and / or be associated with it) (e.g., downward-facing, invisible, and / or obscuring the area where content is displayed). In some embodiments, in the "off" internal state, the area where content is displayed by the device 200 is not positioned in a manner corresponding to the "off" internal state (e.g., configured to represent, associate with, and / or be associated with it) (e.g., instead, it is positioned in a manner corresponding to the "on" internal state).For example, when not in the "off" internal state, the device 200 can be positioned within a range of different open positions (e.g., the display portion 200-1 is not parallel to the base portion 200-2, and the area where content is displayed by the device 200 is visible and / or not obscured). It should be noted that the display portion 200-1 being parallel to the base portion 200-2 is an example of a position corresponding to the "off" internal state of the device 200 (e.g., the closed position). In some embodiments, a different configuration may set a different orientation of the display portion 200-1 relative to the base portion 200-2 as the closed position of the device 200, as shown in Figure 2C.

[0105] Figure 2A shows the display screen 200-4 (representing the area where content is displayed by device 200) on the left and the device 200 in the corresponding orientation on the right. As shown in Figure 2A, device 200 is in a first position (for example, display portion 200-1 is perpendicular to base portion 200-2, forming a 90-degree angle). In Figure 2A, display screen 200-4 represents what is currently displayed by device 200 (for example, via display components) while open in the first position. In Figure 2A, display screen 200-4 indicates an internal state in which device 200 is "on" (for example, operating, powered on, awake, a more power-and- / resource-intensive state than the "off" state, and / or activated). In some embodiments, device 200 displays one or more user interfaces (for example, user interface objects, windows, application user interfaces, system user interfaces, controls, and / or other visual content) (for example, via display screen 200-4). In some embodiments, the device 200 displays one or more user interfaces (e.g., via the display screen 200-4) while in an "on" internal state. For example, in Figure 2A, the device 200 is in an "on" internal state, and the display screen 200-4 displays a desktop user interface 200-5, which includes an application window. In some embodiments, the user interface includes (and / or is) one or more user interface objects (e.g., windows, icons, and / or other graphical objects). For example, the user interface (e.g., 200-5) may include one or more graphical objects that are different from and / or the same as the application window.

[0106] Figure 2B shows the display screen 200-4 on the left and the device 200 in the corresponding orientation on the right. As shown in Figure 2B, the device 200 is in a second position (for example, the display portion 200-1 is angled (e.g., via the connector 200-3) relative to the base portion 200-2, which forms an angle of 120 degrees (e.g., a larger angle than in Figure 2A)). In Figure 2B, the display screen 200-4 represents what the device 200 is displaying while in the second position. The display screen 200-4 shows the internal state in which the device 200 is "on" (e.g., the same internal state as shown in the upper part of Figure 2A). In Figure 2B, the device 200 displays the desktop user interface 200-5 (e.g., the same as shown in Figure 2A) (e.g., via the display screen 200-4). In some embodiments, the device 200 displays a different user interface (e.g., something other than the desktop user interface 200-5). For example, Figure 2B shows a device 200 displaying the same desktop user interface 200-5 as Figure 2A, but while in a different position than Figure 2A, the device 200 can display a different user interface. In some embodiments, the device 200 displays a user interface that corresponds to a physical state (e.g., position, location, and / or orientation) and includes content that is specific to a particular angle or specific to the current context (e.g., configured to be based on, caused by, triggered by, related to, and / or associated with).

[0107] Figure 2C shows the display screen 200-4 on the left and the device 200 in the corresponding orientation on the right. As shown in Figure 2C, the device 200 is in a third position (for example, the display portion 200-1 is angled relative to the base portion 200-2 (for example, via the connector portion 200-3) to form a 60-degree angle (for example, a smaller angle than in Figures 2A and 2B)). In Figure 2C, the display screen 200-4 represents what the device 200 is displaying while in the third position. In Figure 2C, the display screen 200-4 indicates an internal state where the device 200 is "off" (for example, not operating, not powered on, not awakened, not activated, powered off, sleeping, hibernating, inactive, and / or deactivated). In some embodiments, while the device 200 is in an "off" internal state, it does not display (e.g., it stops displaying) one or more user interfaces (e.g., it does not display any visual content) (e.g., it does not display any visual content). In some embodiments, while the device 200 is in an "off" internal state, it displays (e.g., via the display screen 200-4) one or more user interfaces (e.g., a scheme to display user interfaces specific to the "off" state and / or user interfaces not specific to the "off" internal state) (e.g., a scheme to display user interfaces specific to the "off" state and / or user interfaces not specific to the "off" internal state). In Figure 2C, the display screen 200-4 is blank because nothing is displayed on the display of the device 200 (e.g., the display screen 200-4 is off and / or does not display a user interface) (e.g., the desktop user interface 200-5 is not displayed on the display screen 200-4).

[0108] In some embodiments, device 200 includes one or more components (also referred to herein as “moving components”) that enable device 200 to perform (e.g., trigger and / or control) (and / or be moved). For example, performing a move may include moving a part of device 200 (e.g., some or all of the components of the device move), moving all of device 200 (e.g., the entire device (including all of its components) moves, such as by changing its location), and / or moving one or more other devices and / or components (e.g., communicating with device 200 and / or the moving components of device 200). For example, device 200 may automatically move (e.g., pivot) the display portion 200-1 relative to the base portion 200-2 to one of the positions shown in Figures 2A to 2C, trigger and / or control that move. In some embodiments, device 200 performs a move based on the internal state of device 200. By performing movements based on internal states, new (e.g., alternative and unavailable) interactions can be enabled by device 200. For example, such new interactions of device 200 may be configured using special features, functions, modes, and / or programs that take advantage of device 200's ability to perform movements. Examples of such interactions include using movements to communicate the device's internal state (e.g., on, off, sleep, and / or hibernate) (e.g., to the user), to assist user input (e.g., to reduce the distance to the user), and / or to enhance the device's interaction behavior (e.g., moving in a specific way that conveys information such as importance and / or direction of attention during interaction with the user). In some embodiments, the movements performed correspond to one or more of the detected input, detected context (e.g., environment context and / or user context), and / or internal states of device 200 (e.g., internal states and / or sets of internal states) (e.g., triggered by, responding to, and / or determined and / or performed based on).For example, device 200 can perform a move of the display portion so that device 200 moves from a first position shown in Figure 2A to a second position shown in Figure 2B. In this example, device 200 can detect that the user has repositioned relative to device 200 (e.g., the user has stood up), and accordingly, device 200 can perform a move to the second position so that the display is at an optimized viewing angle based on the repositioned height and / or angle of the user's eyes relative to the display of device 200. In another example, device 200 can perform a move so that device 200 moves from a state in the first position shown in Figure 2A to a state in the third position shown in Figure 2C. In this example, device 200 can perform a move to the third position in response to detecting an internal state of reduced activity (e.g., the "off" internal state described above). In this way, the movement of device 200 to one or more positions can indicate the internal state of device 200.

[0109] Figures 2A to 2C show a device 200 having a display portion that can move with one degree of freedom via a connector 200-3 (e.g., a hinge) connecting the display portion 200-1 to the base portion 200-2. In some embodiments, the device 200 includes one or more components having one or more degrees of freedom. For example, a moving component of the device 200 (e.g., an output component that causes and / or enables movement) (e.g., 200-26C in Figure 5) may include multiple degrees of freedom (e.g., six degrees of freedom including three translational components and three rotational components). For example, the device 200 can be implemented so that the display portions can be moved forward or backward in a nested manner (e.g., the display portion 200-1 moves forward, while the base portion 200-2 remains spatially stationary relative to the base portion (e.g., to shorten and / or extend the user's viewing distance)). As yet another example, device 200 may be implemented so that the display portion can move to rotate around an axis perpendicular to the hinge, so that the display portion can rotate to position the display so that it follows the user as the user walks around device 200. The example shown in Figures 2A-2C shows a hinge, but other moving components such as actuators (e.g., pneumatic actuators, hydraulic actuators and / or electric actuators), a movable base, a rotatable component and / or a rotatable base may be included in device 200. In some embodiments, one or more moving components may move device 200 in different ways, such as rotating (e.g., 0 to 360 degrees), moving laterally (e.g., right, left, down, up, and / or any combination thereof), and / or tilting (e.g., 0 to 360 degrees).

[0110] Figure 3 shows an exemplary block diagram of device 200. In some embodiments, device 200 includes some or all of the components described with respect to Figures 1A, 1B, 3, and 5B. As shown in Figure 3, device 200 has a bus 200-13 that operably connects an I / O section 200-12 (also referred to as an I / O subsection and / or I / O interface) to a processor 200-11 and memory 200-10. As shown in Figure 3, the I / O section 200-12 is connected to an output device 200-16 (also referred to herein as an “output component”). In some embodiments, the output device 200-16 includes one or more visual output devices (e.g., display components such as displays, display screens, projectors, and / or touch-sensitive displays), one or more tactile output devices (e.g., devices that produce vibration and / or other tactile outputs), one or more audio output devices (e.g., speakers), and / or one or more motion components (e.g., actuators, motors, mechanical linkages, devices that produce and / or enable motion, and / or the above-mentioned one or more motion components). As shown in Figure 3, the output device 200-16 includes two illustrative motion components (e.g., motion controller 200-17 and actuator 200-18). Actuator 200-18 can be any component that performs the physical movement (e.g., part and / or whole) of a device (e.g., device 200 and / or a device coupled to and / or in contact with device 200). Motion controller 200-17 may be any component (e.g., a control device) that controls (e.g., supplies control signals to) actuator 200-18. For example, the movement controller 200-17 can provide a control signal to actuate the actuator 200-18 (e.g., to cause physical movement). In some embodiments, the movement controller 200-17 includes one or more logic components (e.g., a processor), one or more feedback components (e.g., sensors), and / or one or more control components (e.g., relays, switches, and / or control lines for applying control signals).In some embodiments, the movement controller 200-17 and the actuator 200-18 are embodied in the same device and / or components (e.g., a dedicated onboard movement controller 200-17 mounted on the actuator 200-18). In some embodiments, the movement controller 200-17 and the actuator 200-18 are embodied in different devices and / or components (e.g., one or more processors 200-11 can function as the movement controller 200-17 of the actuator 200-18). In some embodiments, the movement controller 200-17 and / or the actuator 200-18 are embodied in a device other than device 200 (or one or more devices) (e.g., device 200 is coupled to another device (e.g., temporarily and / or detachably) and can command the movement controller 200-17 and / or control actuator 200-18 of the other device). Actuator 200-18 can function to cause one or more types of mechanical movement (e.g., linear and / or rotation) in one or more ways (e.g., using electricity, magnetism, hydraulics, and / or pneumatics). Examples of actuator 200-18 may include electromechanical actuators, linear actuators, and / or rotary actuators.

[0111] As shown in Figure 3, the I / O section 200-12 is connected to an input device 200-14. In some embodiments, the input device 200-14 includes one or more visual input devices (e.g., a camera and / or a light sensor), one or more physical input devices (e.g., a button, a slider, a switch, a touch-sensitive surface, and / or a rotatable input mechanism), one or more audio input devices (e.g., a microphone), and / or other input devices (e.g., an accelerometer, a pressure sensor (e.g., a contact strength sensor), a distance sensor, a temperature sensor, a GPS sensor, an accelerometer, a direction sensor (e.g., a compass), a gyroscope, a motion sensor, and / or a biosensor). Furthermore, the I / O section 200-12 may be connected to a communication unit 200-15 to receive application and operating system data using Wi-Fi, Bluetooth, near-field communication (NFC), cellular, and / or other wireless (and / or wired) communication technologies.

[0112] The memory 200-10 of the personal electronic device 200 may include one or more non-temporary computer-readable storage media for storing computer-executable instructions, which, when executed by one or more computer processors 200-11, cause the computer processors to execute techniques described below, including processes 700 and 900 (Figures 7 and 9). The computer-readable storage media may be any medium that can tangibly contain or store computer-executable instructions used by or in connection with an instruction execution system, apparatus, or device. In some embodiments, the storage medium is a temporary computer-readable storage medium. In some embodiments, the storage medium is a non-temporary computer-readable storage medium. The non-temporary computer-readable storage medium may include, but is not limited to, magnetic storage devices, optical storage devices, and / or semiconductor storage devices. Examples of such storage include magnetic disks, CDs, DVDs, and optical disks based on Blu-ray technology, as well as persistent solid-state memories such as flash and solid-state drives. The electronic device 200 is not limited to the components and configurations shown in Figure 3, and may include other and / or additional components in a number of possible configurations, all of which are intended to be within the scope of this disclosure.

[0113] Figure 4 shows a functional diagram of actuator 200-18B according to several embodiments. As described above, actuator 200-18B may be any component that performs physical movement. In some embodiments, actuator 200-18B operates using inputs including control signals 200-18A and / or energy source 200-18B. For example, actuator 200-18 may be a rotary actuator that converts electrical energy into rotational movement. This rotational movement can cause movement of the display portion of device 200 as described with respect to Figures 2A-2C (for example, counterclockwise rotation of the actuator moves device 200 to a position with a larger angle (e.g., the second position shown in Figure 2B), and clockwise rotation of the actuator moves device 200 to a position with a smaller angle (e.g., the third position shown in Figure 2C)). The control signal 200-18A can indicate one or more start and / or stop commands, direction of movement and / or operation, speed of movement and / or operation, amount of time to move and / or actuate, target position of movement and / or operation (e.g., attitude and / or location), and / or one or more other characteristics of movement and / or operation. In some embodiments, the control signal and energy source are the same signal and / or input. In some embodiments, one or more additional components (e.g., mechanical and / or electrical) are coupled (e.g., detachably or permanently) to the actuator 200-18B (e.g., a mechanical linkage mechanism such as a lead screw, gears, and / or other components for changing (e.g., converting) the characteristics of movement and / or operation). In some embodiments, the actuator 200-18B includes one or more feedback components (e.g., a position sensor, an encoder, an overcurrent sensor, and / or a force sensor) that form part of a feedback loop for correcting and / or stopping movement and / or operation (e.g., slowing down operation when a target position is reached and / or stopping operation when physical resistance to operation is detected via a sensor).In some embodiments, one or more feedback components are included (e.g., partially and / or entirely) in a motion controller (e.g., motion controller 200-13) operably coupled to the actuator.

[0114] Next, we consider the functions (e.g., features and / or capabilities) of one or more electronic devices (e.g., computer system 100 and / or device 200). One such function is to implement an “agent” which may be alternatively referred to as a software agent, intelligent agent, interactive agent, virtual assistant, intelligent virtual assistant, interactive virtual assistant, personal assistant, intelligent personal assistant, interactive personal assistant, intelligent interactive personal assistant, and / or artificial intelligence (AI) assistant. In some embodiments, an agent refers to a set of one or more functions implemented in hardware and / or software (e.g., locally and / or remotely) on an agent system (e.g., a single device and / or multiple devices). In some embodiments, an agent perceives the environment, acquires knowledge, retrieves knowledge, learns skills, interacts with a user, and / or performs actions to perform tasks. The agent may perform these (and / or other) actions, for example, in response to user input and / or automatically (e.g., at an appropriate time determined based on the perceived context).A non-exhaustive list of exemplary actions that the agent may use for and / or in conjunction with it includes: tracking the user's eyes, face, and / or body (e.g., to move with the user and / or to identify the user's intentions and / or activities); detecting, recognizing, and / or classifying users in the environment; detecting and / or responding to input (e.g., verbal input, air gestures, and / or physical input such as touch input and / or force input to physical hardware components (e.g., buttons, knobs, and / or sliders)); and detecting context (e.g., user context, behavioral context, and / or environmental context). This includes moving (e.g., changes in posture, position, orientation, and / or location), performing one or more actions in response to input, context, and / or stimuli (e.g., objects or events (e.g., external and / or internal to the device) that cause one or more response actions by the device), providing intelligent interaction capabilities to respond and / or perform actions (e.g., partly attributable to one or more machine learning ("ML") models, such as Large Language Models ("LLM")), and / or performing tasks (e.g., a set of actions to achieve a particular goal) (e.g., automatically and / or intelligently). In some embodiments, the agent performs actions in response to non-contact input (e.g., air gestures and / or natural language commands). The above list is intended to illustrate, but not exhaustive, actions that can be performed using the agent. Other actions are within the intended scope of the agent's capabilities. Additionally, for the purposes of this disclosure, an agent does not need to include all of the functions referred to herein, but may include fewer or more functions (for example, an agent may be implemented on an agent system that includes an intelligent personal assistant that does not have mobility but can interact with the user in a different way).

[0115] In some embodiments, a user is one or more of the following: an object, person, and / or animal within the environment (e.g., the device's) (e.g., the physical environment and / or the virtual environment). In some embodiments, a user is a perceived entity (e.g., detected by the device, one or more other devices, and / or one or more of their components). In some embodiments, an entity is one that is distinguishable from surrounding entities (e.g., parts of the environment and / or other users) and / or is considered a discrete logical structure through one or more components (e.g., perceptual components and / or other components). In some embodiments, a user is physical and / or virtual. For example, a physical user may represent a user standing in front of the device and perceived by the device. As another example, a virtual user may represent an avatar in a virtual scene perceived by the device (e.g., the avatar is detected in a media stream received by the device and / or captured by the device's camera). While presented above as examples of “user,” the terms and / or concepts referred to as “subject,” “person,” “object,” and / or “animal” may be used interchangeably with “user” throughout this disclosure unless otherwise explicitly stated. For example, the use of the term “subject” may also be understood to refer to “user” unless otherwise explicitly indicated.

[0116] As an example, referring back to Figures 2A and 2C, an agent at least partially implemented on device 200 can perform an action to move the display portion 200-1 of device 200 relative to the base portion 200-2. For example, the agent can detect context including the fact that a user is standing (e.g., based on face detection and tracking), and in response, the agent can cause device 200 to open and / or device 200 to open the display portion 200-1 to a greater angle. As another example, the agent can detect verbal input (e.g., interpreted as an action including and / or referring to) a request to move the display (e.g., "Please move my display," or "Please enter sleep mode"), and in response, the agent can move device 200 and / or device 200 to move the display portion 200-1.

[0117] Figure 5 shows a functional diagram of an exemplary agent system 200-20A. As shown in Figure 5, the agent system 200-20A has dotted box boundaries surrounding the input component 200-22, the agent component 200-24, and the output component 200-26. In some embodiments, the agent system 200-20A includes fewer, more, and / or different components than those shown in Figure 5. In some embodiments, the agent system 200-20 is implemented on a single device (e.g., computer system 100 and / or electronic device 200). In some embodiments, the agent system 200-20 is implemented on multiple devices. In some embodiments, one or more components of the agent system 200-20 shown in and / or described with respect to Figure 5 are external to the agent system 200-20 (e.g., accessories, external devices, external sensors, external actuators, external display components, external speakers, and / or external databases) but are operably coupled to it. In some embodiments, one or more components of agent system 200-20 are local to one or more other components of agent system 200-20. In some embodiments, one or more components of agent system 200-20 are remote from one or more other components of agent system 200-20.

[0118] In some embodiments, the input component 200-22 includes components for performing sensing and / or communication functions of the agent system 200-20. As shown in Figure 5, the input component 200-22 includes one or more sensors 200-22A. One or more sensors 200-22A may include any components that function to detect data corresponding to the physical environment. Examples of one or more sensors 200-22A may include cameras, light sensors, microphones, accelerometers, position sensors, pressure sensors, temperature sensors, olfactory sensors, and / or contact sensors. This list is not intended to be exhaustive, and one or more sensors 200-22A may include other sensors not expressly specified herein that detect, generate, and / or otherwise provide data that can be used (e.g., processed, stored, and / or transformed) to detect data corresponding to the physical environment. As shown in Figure 5, the input component 200-22 includes one or more communication components 200-22B. One or more communication components 200-22B may include any components (e.g., antennas, modems, network interface components, encoders, decoders, and / or communication protocol stacks) that function to transmit and / or receive communications within and / or outside the agent system 200-20. Communication components 200-22B may be between different devices and / or between components of the same device. Communications may include control signals and / or data (e.g., messages, instructions, files, application data, and / or media streams). In some embodiments, the input components 200-22 include fewer, more, and / or different components than those shown in Figure 5. In some embodiments, the input components 200-22 are implemented in hardware and / or software.

[0119] In some embodiments, the agent component 200-24 includes components that manage and / or perform the functions of the agent in the agent system 200-20. As shown in Figure 5, the agent component 200-24 includes functional components such as the task flow, coordination, and / or orchestration component 200-24A, the management component 200-24B, the perception component 200-24C, the evaluation component 200-24D, the interaction component 200-24E, the policy and decision component 200-24F, the knowledge component 200-24G, the learning component 200-24H, the model component 200-24I, and the API component 200-24J. Each of these components is briefly described below. In particular, this list of agent components 200-24 is not intended to be exhaustive, and the agent component 200-24 may include other functional components not expressly specified herein that can be used to perform any of the functions of the agent as described herein (e.g., processing, storing, and / or transforming). In some embodiments, the agent components 200-24 include fewer, more, and / or different components than those shown in Figure 5. In some embodiments, the agent components 200-24 are implemented in hardware and / or software.

[0120] In some embodiments, the task flow, coordination, and / or orchestration component 200-24A performs actions that enable the agent to handle coordination between various components. For example, the actions may include processing a data processing task flow to move from the perceptual component 200-24C (e.g., detecting speech input) to the model component 200-24I (e.g., processing the detected speech input using a large language model to determine the content and / or intent of the speech input). In some embodiments, the task flow, coordination, and / or orchestration component 200-24A performs actions that enable the agent to handle coordination between one or more external components (e.g., resources). For example, Figure 5 shows an example of an external component such as an external database 200-30. In some embodiments, the management component 200-24B includes functions performed by the operating system of the device that implements the agent system 200-20. In some embodiments, the management component 200-24B includes functions performed by one or more applications of the device that implements the agent system 200-20.

[0121] In some embodiments, the management component 200-24B performs operations that enable the agent system to handle administrative tasks such as managing system and / or component updates, managing user accounts, managing system settings, and / or managing component settings. In some embodiments, the management component 200-24B includes functions performed by the operating system of the device that implements the agent system 200-20. In some embodiments, the management component 200-24B includes functions performed by one or more applications of the device that implements the agent system 200-20.

[0122] In some embodiments, the perceptual component 200-24C performs actions that enable the agent to perceive environmental input. For example, actions may include detecting the occurrence of context and / or environmental conditions, detecting the presence of a user (e.g., an object, person, or animal in the environment), detecting input including utterances, detecting input including air gestures, detecting facial expressions, detecting user characteristics (e.g., visible and / or invisible), and / or detecting language cues and / or physical cues. In some embodiments, the perceptual component 200-24C includes functions performed by the operating system of the device that realizes the agent system 200-20. In some embodiments, the perceptual component 200-24C includes functions performed by one or more applications of the device that realizes the agent system 200-20.

[0123] In some embodiments, the evaluation component 200-24D performs actions that enable the agent to process evaluation data (e.g., determining contexts such as user context, environment context, and / or behavioral context). For example, the actions may include evaluating data collected from the perception component 200-24C, the knowledge component 200-24G, the external database 200-30, and / or the remote processing resource 200-32. In some embodiments, the evaluation component 200-24D includes functions performed by the operating system of the device implementing the agent system 200-20. In some embodiments, the evaluation component 200-24D includes functions performed by one or more applications of the device implementing the agent system 200-20.

[0124] In this specification, an environmental context (also referred to herein as “environmental context” and / or “context corresponding to the environment”) is used. In some embodiments, the environmental context is a context based on one or more characteristics of the environment (e.g., user, location, time, weather, and / or lighting). For example, the environmental context may include that it is raining outdoors, that it is daytime, and / or that the device is currently located in a park. In some embodiments, a device (e.g., using an agent) determines the environmental context (e.g., that is currently true, occurring, and / or applicable) by one or more of the following: detecting input (e.g., via one or more input components) and / or receiving data (e.g., from one or more other devices and / or components communicating with the device).

[0125] In this specification, user context (also referred to herein as “user context” and / or “context corresponding to user”) (and / or user context). In some embodiments, user context is a context based on one or more characteristics of the user (and / or user). For example, user context may include the user’s appearance and / or clothing, personality, actions, behavior, movement, location, and / or posture. In some embodiments, a device (e.g., using an agent) determines user context (e.g., currently true, occurring, and / or applicable) by one or more of the following: detecting input (e.g., via one or more input components) and / or receiving data (e.g., from one or more other devices and / or components communicating with the device). In some embodiments, the device determines user context based on the user’s historical context and / or learned characteristics, and one or more characteristics of the user are learned and / or stored by the device over a period of time.

[0126] In this specification, an operational context (also referred to herein as “operational context” and / or “operational context”) is used. In some embodiments, an operational context is a context based on one or more characteristics of the operation of a device (e.g., a device that determines and / or accesses an operational context and / or one or more other devices). For example, an operational context may include the internal state of the device (and / or one or more components of the device), the internal dialogs of the device (e.g., the device’s understanding of the context), the operations being performed by the device, and applications and / or processes running on the device (e.g., running and / or open). In some embodiments, a device (e.g., using an agent) determines an operational context (e.g., currently true, occurring and / or applicable) by one or more of the following: detecting input (e.g., via one or more input components) and / or receiving data (e.g., from one or more other devices and / or components communicating with the device). In some embodiments, a device (e.g., using an agent) uses one or more internal states (e.g., accessed, retrieved, and / or queried by the device's process) to determine the operational context (e.g., currently true, occurring, and / or applicable).

[0127] In some embodiments, interaction components 200-24E perform actions that enable the agent to manage and / or perform interactions with the user. For example, actions may include determining an appropriate interaction model for a particular context and / or in response to a particular input. In some embodiments, interaction components 200-24E include functions performed by the operating system of the device realizing the agent system 200-20. In some embodiments, interaction components 200-24E include functions performed by one or more applications of the device realizing the agent system 200-20.

[0128] In some embodiments, the policy and decision components 200-24F perform actions that enable the agent to take action considering the available data. For example, the actions may include determining which actions to perform and / or which functional components to utilize depending on the detected context. In some embodiments, the policy and decision components 200-24F include functions performed by the operating system of the device that implements the agent system 200-20. In some embodiments, the policy and decision components 200-24F include functions performed by one or more applications of the device that implements the agent system 200-20.

[0129] In some embodiments, the knowledge component 200-24G performs operations that enable the agent to access and use the stored knowledge. For example, operations may include indexing, storing, and / or retrieving data from data stores, databases, and / or other resources. In some embodiments, the knowledge component 200-24G includes functions performed by the operating system of the device that implements the agent system 200-20. In some embodiments, the knowledge component 200-24G includes functions performed by one or more applications of the device that implements the agent system 200-20.

[0130] In some embodiments, the learning component 200-24H performs actions that enable the agent to learn through experience. For example, actions may include observing and / or tracking data including preferences, routines, user characteristics, and / or environmental characteristics, in a manner that such data may be used to inform future actions by the agent and / or its components (for example, when performing tasks and / or interactions with a user). In some embodiments, the learning component 200-24H includes functions performed by the operating system of the device that implements the agent system 200-20. In some embodiments, the learning component 200-24H includes functions performed by one or more applications of the device that implements the agent system 200-20.

[0131] In some embodiments, the model component 200-24I performs operations that enable the agent to process data by applying an ML model (e.g., a Large Language Model LLM). For example, operations may include storing the ML model, running the ML model, training and / or retraining the ML model, and / or managing the manner in which the ML model is implemented. In some embodiments, the model component 200-24I includes functions performed by the operating system of the device implementing the agent system 200-20. In some embodiments, the model component 200-24I includes functions performed by one or more applications of the device implementing the agent system 200-20.

[0132] In some embodiments, the agent system 200 responds to natural language input. For example, the agent system 200 responds to natural language input in the form of statements, questions, commands, and / or requests. In some embodiments, the agent system 200 outputs text and / or utterance output provided in natural language or a natural language style. For example, the agent system 200 can process the natural language question "How hot is it outside?" with an utterance response indicating the current external temperature at the user's location (e.g., "It's 18 degrees outside"). In some embodiments, the agent system 200 responds to natural language input by providing information (e.g., weather, travel, and / or calendar information) and / or performing tasks (e.g., opening a document, searching a database, and / or opening an application).

[0133] In some embodiments, the agent system 200 includes and / or relies on one or more data models to process inputs (e.g., natural language input, gesture input, visual input, and / or other data inputs) and / or provide outputs (e.g., output of information via natural language output, visual output, audio output, and / or text output). Such data models may include and / or be trained using user data (e.g., based on data from specific interactions and / or users being interacted with) and / or global data (e.g., general data based on interactions and / or data from many users). For example, user data (e.g., preferences, previous use of language and / or phrases, calendar entries, contact lists, and / or activity data) can be used to better infer user intent and / or provide responses that are more likely to address user requests. In some embodiments, the data models used by the agent system 200 include, are used by and / or are implemented using one or more machine learning components (e.g., hardware and / or software) (e.g., one or more neural networks). Such machine learning components may be used to process oral input to determine the words and / or phrases within it, one or more contexts corresponding to the words, the user intent corresponding to the words, one or more confidence scores, and / or a set of one or more actions to take in response to the oral input. Similar operations can be performed to process other types of input, such as visual input, data input, and / or text input. Such data models may include, but are not limited to, natural language processing models, language models, speech recognition models, object recognition models, visual processing models, ontologs, task flow models, and / or intent recognition models (e.g., used to determine user intent), machine learning and / or data processing models.

[0134] In some embodiments, the Application Programming Interface (API) component 200-24J performs operations that enable the agent to interface with services, devices, and / or components. For example, operations may include relaying data (e.g., requests, responses, and / or other messages) between data interfaces (e.g., between software programs, between system processes and application processes, between system processes, between application processes, between communication protocols, between clients and servers, between file systems, and / or between components on different sides of a trust boundary). In some embodiments, the data interfaces serviced by the API component 200-24J are local (e.g., to a device, such as two application processes exchanging data) and / or remote (e.g., from a device, such as interfaced with a web service via a remote server). In some embodiments, the API component 200-24J includes functions performed by the operating system of the device that implements the agent system 200-20. In some embodiments, the API component 200-24J includes functions performed by one or more applications of the device that implement the agent system 200-20.

[0135] In some embodiments, the output component 200-26 includes components for performing the output functions of the agent system 200-20. An exemplary output component shown in Figure 5 is briefly described below. In some embodiments, the output component 200-26 includes fewer, more, and / or different components than those shown in Figure 5. In some embodiments, the output component 200-26 is implemented in hardware and / or software.

[0136] As shown in Figure 5, output component 200-26 includes one or more visual output components 200-26A. One or more visual output components 200-26A may include any components that output (e.g., generate, create, and / or display) and / or function to cause visual output (e.g., a graphical user interface, playback of visual media content, and / or visually perceptible output such as lighting). Examples of one or more visual output components 200-26A may include display components, projectors, head-mounted display (HMD) devices, light-emitting diodes ("LEDs"), and / or components that create visually perceptible effects (e.g., motion). This list is not intended to be exhaustive, and one or more visual output components 200-26A may include other visual output components not expressly identified herein that detect, generate, and / or otherwise provide data that can be used (e.g., processed, stored, and / or transformed) to output visual output.

[0137] As shown in Figure 5, output component 200-26 includes one or more audio output components 200-26B. One or more audio output components 200-26B include components that output (e.g., generate and / or produce) and / or produce an audio output (e.g., an audibly perceptible output such as sound, music, speech, and / or audio media content). Examples of one or more audio output components 200-26B may include speakers, audio amplifiers, tone generators, and / or components that produce an audibly perceptible effect (e.g., movement such as vibration). This list is not intended to be exhaustive, and one or more audio output components 200-26B may include other audio output components not expressly identified herein that detect, generate, and / or otherwise provide data that can be used (e.g., processed, stored, and / or transformed) to output an audio output.

[0138] As shown in Figure 5, the output component 200-26 includes one or more motion output components 200-26C (also referred to herein as “motion components”). One or more motion output components 200-26C may include any components that output (e.g., generate and / or create) and / or cause motion outputs (e.g., outputs including the physical movement of a device and / or another device / component). Examples of one or more motion output components 200-26C may include motion controllers, actuators, mechanical linkage mechanisms, electromechanical devices, and / or components that generate physical movement. This list is not intended to be exhaustive, and one or more motion output components 200-26C may include other motion output components not expressly identified herein that detect, generate and / or otherwise provide data that can be used (e.g., processed, stored, and / or converted) to output motion outputs. As shown in Figure 5, the output component 200-26 includes one or more tactile output components 200-26D. One or more haptic output components 200-26D may include any components that output (e.g., generate, create, and / or display) and / or function to cause haptic output (e.g., output that is physically perceptible using touch, such as vibration, pressure, texture, and / or shape). Examples of one or more haptic output components 200-26D may include a speaker, a component that generates vibration, a component that generates a texture change, a component that generates a pressure change, and / or a component that creates a perceptible haptic effect. This list is not intended to be exhaustive, and one or more haptic output components 200-26D may include other haptic output components not expressly specified herein that detect, generate, and / or otherwise provide data that can be used (e.g., processed, stored, and / or transformed) to output haptic output.

[0139] As shown in Figure 5, the output component 200-26 includes one or more communication components 200-26E. One or more communication components 200-26E may include any components (e.g., antennas, modems, network interface components, encoders, decoders, and / or communication protocol stacks) that function to transmit and / or receive communications within and / or outside the agent system 200-20. In some embodiments, communications may be between different devices and / or between components of the same device. In some embodiments, communications may include control signals and / or data (e.g., messages, instructions, files, application data, and / or media streams). In some embodiments, one or more communication components 200-26E include one or more features of one or more communication components 200-22B (e.g., as described above). In some embodiments, one or more communication components 200-26E are the same as one or more communication components 200-22B (e.g., one or more components that handle communication inputs and outputs and are therefore considered either and / or both input components and output components).

[0140] Throughout this disclosure, the term "movement output" can be used to refer to various forms such as, for example, movement, device movement, movement output, device motion, motion output, and / or motion output. In some embodiments, producing a movement output (e.g., causing a movement output) refers to the movement of an electronic device (e.g., another part and / or that part or component relative to the entire electronic device). For example, referring back to Figure 2B, the movement output could refer to the device 200 acting on a moving component 200-3 to move the display portion 200-1 to the position shown in Figure 2B (e.g., from the position in Figure 2A). In some embodiments, the movement output is not a tactile output (e.g., a tactile movement output) (e.g., does not include one, and / or does not include one). In some embodiments, the movement output is not a vibration output (e.g., does not include a vibration output, and / or does not include a vibration output). In some embodiments, the movement output is not an oscillating movement (e.g., the movement of an actuator that simply causes vibration by repeatedly moving a component along a path inside the device) (e.g., does not include one, and / or does not include one). In some embodiments, the movement output includes changing the location and / or orientation of at least part (and / or all) of a component or electronic device (e.g., as required and / or brought about). In some embodiments, the movement output includes an output that moves at least part (and / or all) of a component or electronic device from a first location and / or first orientation to a second location and / or second orientation. For example, with respect to Figures 2A to 2C, the display portion 200-1 is shown in different locations (e.g., in space) and orientations (e.g., relative to the base portion 200-2) in each of Figures 2A, 2B, and 2C. In some embodiments, the movement output includes an output that moves at least part (and / or all) of a component or electronic device to a third location and / or third orientation (e.g., from the first location and / or first orientation and / or from the second location and / or second orientation).In some embodiments, the third location and / or third orientation is identical to the first location and / or first orientation, and / or the second location and / or second orientation. For example, the moving output may include the device 200 in Figure 2A, which moves starting from a first position shown in Figure 2A, moving to a second position shown in Figure 2B, and returning to the first position shown in Figure 2A. For example, the moving output may include the device 200 in Figure 2A, which moves starting from a first position shown in Figure 2A, moving to a second position shown in Figure 2B, and continuing to move to a resting position in a third position shown in Figure 2C.

[0141] Throughout this disclosure, electronic devices may be shown (and / or described as being in different locations and / or orientations) at different times. For example, Figure 2A shows device 200 in a first position, Figure 2B shows device 200 in a second position, and Figure 2A shows device 200 in a third position. In some embodiments, electronic devices move themselves between such locations and / or orientations (e.g., using a moving output). For example, device 200 moves from a first position to a second position under its own power (e.g., using a power supply and one or more actuators to cause the movement). In particular, any example of this specification illustrating and / or describing an electronic device in different locations and / or orientations (e.g., at different times) should be understood to encompass scenarios in which the device itself moves between such locations and / or orientations (unless, e.g., it is explicitly indicated otherwise).

[0142] Throughout this disclosure, the terms “performing an output,” “causing an output,” and / or “outputting” (and / or similar phrases) may be used (for example, by one or more output generating devices and / or by one or more output generating components). In some embodiments, outputting (e.g., or the variations described above) includes (and / or is outputting) a move (e.g., the move output described above).

[0143] Throughout this disclosure, the terms “display,” “to make display,” and / or “to output visual content” (and / or similar phrases) may be used. In some embodiments, displaying (e.g., or the variations described above) includes displaying visual content in relation to outputting movement (e.g., movement output as described above).

[0144] Throughout this disclosure, you may refer to “outputting audio,” “causing audio output,” and / or “providing audio output” (and / or similar phrases) (for example, by one or more audio generating components and / or by one or more audio output devices). In some embodiments, outputting audio (e.g., or the variations described above) includes outputting audio content in relation to outputting motion (e.g., motion output as described above).

[0145] Throughout this disclosure, the movement of an avatar (and / or similar phrases) may be referred to (for example, by one or more display components) (for example, other representations of a user, agent, and / or character that are displayed). In some embodiments, moving an avatar (e.g., or the variations described above) includes displaying movement of visual content in connection with outputting movement (e.g., movement output as described above). For example, displaying an avatar nodding in agreement may include movement of an electronic device in a similar manner to the movement of the avatar (e.g., mimicking a nod). In some embodiments, moving an avatar (e.g., or the variations described above) includes outputting movement (e.g., movement output as described above) without displaying movement of visual content. For example, a device may perform a movement output that mimics a nod without moving a displayed avatar (e.g., the avatar does not move relative to the display). As shown in Figure 5, the agent system 200-20 can optionally interface with external components such as an external database 200-30, a remote processing component 200-32, and / or a remote management component 200-34. In some embodiments, the external database 200-30 represents one or more functions that provide data storage resources accessible to the agent system 200-20. In some embodiments, access to the data in the external database 200-30 is provided directly to the agent system 200-20 (e.g., the agent system manages the database) and / or indirectly to the agent system 200-20 (e.g., the database is managed by a different system, but the data stored therein may be provided and / or stored for use by the agent system 200-20).In some embodiments, the external database 200-30 is dedicated to the agent system 200-20 (e.g., for use only by the agent system 200-20), not dedicated to the agent system 200-20 (e.g., a database of web services accessible to different agent systems), and / or a combination of both dedicated and non-dedicated database resources. In some embodiments, the remote processing component 200-32 represents one or more components that function as data processing resources accessible to the agent system 200-20. In some embodiments, access to the remote processing component 200-32 is provided directly to the agent system 200-20 (e.g., the agent system manages the processing resources), and / or indirectly to the agent system 200-20 (e.g., processing resources managed by different systems but capable of providing data processing for the benefit of the agent system 200-20). In some embodiments, the remote processing component 200-32 is dedicated to the agent system 200-20 (e.g., for use only by the agent system 200-20), not dedicated to the agent system 200-20 (e.g., a processing resource for a web service accessible to different agent systems), and / or a combination of both dedicated and non-dedicated processing resources. Examples of data processing include processing image data (e.g., for feature extraction and / or object detection), processing audio data (e.g., for processing natural language speech input via a large-scale language model), and / or training machine learning algorithms and / or models. In some embodiments, the remote management component 200-34 includes and / or represents functions related to management functions.For example, such management functions may include providing component updates (e.g., software and / or firmware updates) to agent system 200-30, managing accounts (e.g., permissions, access control, and / or associated preferences), synchronizing between different agent systems and / or their components (e.g., so that agents accessible through a user's multiple devices can provide a consistent user experience across such devices), managing coordination with other services and / or agent systems, error reporting, managing backup resources to maintain the reliability of the agent system and / or the availability of agents, and / or other functions required by agent system 200-20 to perform the operations described herein.

[0146] With respect to Figure 5, the various components of the agent system 200-20 described above represent function blocks that represent functions. These functions can be implemented on the same and / or different hardware (e.g., physical components) and / or by the same and / or different software. For example, a function block can be implemented using one or more physical components, devices (e.g., computer system 100 and / or electronic device 200), and / or software programs. In other words, each function block does not necessarily represent a single discrete physical component, device, and / or software program, but can be implemented using one or more of these. Furthermore, the agent system 200-20 can include multiple implementations of functions represented by individual function blocks. For example, the agent system 200-20 can include multiple different model components that represent ML models used in different contexts, multiple different API components that represent different APIs used for different services, and / or multiple different visual output components used to output different types of visual output.

[0147] Next, we will focus on explaining the concepts that may arise regarding the agent's behavior.

[0148] As will be discussed throughout, an agent may be capable of interacting with a user. In some embodiments, this capability includes the ability to process explicit requests, commands, and / or statements. In some embodiments, explicit requests, commands, and / or statements include and / or are interpreted as instructions that concern accomplishing a task (e.g., displaying X, completing task Y, and / or performing action Z). In some embodiments, the agent includes the ability to process implicit requests, commands, and / or statements. In some embodiments, implicit requests, commands, and / or statements do not include explicit requests, commands, and / or statements. For example, "I like to go to Europe" may be interpreted as an implicit request, command, and / or statement in which, upon detection, device 200 displays an itinerary in response to the statement. As another example, "This photo is of my grandmother" may be interpreted as an implicit request, command, and / or statement in which, upon detection, device 200 displays suggestions for modifying the photo. As another example, "I am very tired" may be interpreted as an implicit request, command, and / or statement that, upon detection, would cause device 200 to initiate a meditation session in the sleep meditation application. As yet another example, "I miss my grandpa" may be interpreted as an implicit request, command, and / or statement that, upon detection, would allow device 200 to initiate a live communication session with the grandpa (e.g., a phone call, a video call, and / or a text messaging session). In some embodiments, implicit requests are more likely to be processed according to one or more current environment contexts, behavioral contexts, and / or user contexts, while explicit requests are less likely to be processed according to one or more current environment contexts, behavioral contexts, and / or user contexts.For example, the phrase "Call Grandpa" may be an explicit request, and upon detecting the request, device 200 may initiate a live communication session with Grandpa, regardless of one or more current environment contexts, behavioral contexts, and / or user contexts. However, the phrase "I miss Grandpa" may also be an implicit request, and upon detecting the request, device 200 may display a list of gifts to purchase for Grandpa if the user has recently spoken about purchasing gifts, or it may call Grandpa in a different context that does not include the user recently discussing purchasing gifts. In some embodiments, a request may include one or more explicit requests and one or more implicit requests. In some embodiments, the implicit requests are responded to independently of the explicit requests, and in other embodiments, the response to the implicit requests depends on the explicit requests.

[0149] In this specification, responses from agents output by a device can be referred to. In some embodiments, the response includes an audio portion (e.g., audio output, audible output, sound, and / or speech) (also referred to herein as “oral response,” “audio response,” and / or “audible response”) and / or a visual portion (e.g., representation and / or display and / or movement of an avatar). In some embodiments, the response includes a movement portion (e.g., movement of the device). In some embodiments, the response includes a tactile portion (e.g., touch and / or vibration). In this specification, internal dialogues, internal contexts, and / or operational contexts may refer to the dynamic context or dynamic decision-making process of a device, the internal state of device 200, and / or internal data on which the device partially relies on its decisions. In some embodiments, an internal dialogue includes one or more sets of rules, characteristics, detections, and / or observations that a computer system uses to generate responses to one or more commands, questions, and / or statements. In some embodiments, the set of one or more rules, characteristics, detections, and / or observations is learned and / or generated via deep learning and / or one or more machine learning algorithms and / or using one or more machine learning and / or system agents. In some embodiments, internal dialogues are generated in real time. In some embodiments, internal dialogues are stored locally and / or via the cloud. In some embodiments, internal dialogues can be modified, updated, and / or deleted. In some embodiments, internal dialogues are generated based on other internal dialogues.

[0150] In this specification, personality and / or behavior (or representations of personality / behavior) (e.g., of agents, users, and / or characters) may be referred to. In some embodiments, personality and / or behavior refers to a set of one or more characteristics that a device detects, knows, adapts to, applies to, and / or tracks. In some embodiments, personality or behavior is used as a basis for performing actions. For example, an agent may detect a user's personality and respond in a personality-based manner (e.g., output different responses depending on different user personalities). As another example, an agent may output responses having characteristics corresponding to one or more characteristics corresponding to personality and / or behavior (e.g., outputting responses in different ways depending on the agent's personality). In some embodiments, such characteristics represent and / or mimic the user's personality, such as how the user behaves and / or speaks. In some embodiments, such characteristics approximate the user's personality.

[0151] In some embodiments, the agent is a system agent. In some embodiments, the system agent is an agent corresponding to a process arising from and / or controlled by the operating system of a device (e.g., the device implementing the agent). In some embodiments, the agent is a coating agent. In some embodiments, the application agent is an agent corresponding to a process arising from and / or controlled by the application of a device (e.g., installed on and / or executed by the device).

[0152] This specification may refer to representations (e.g., avatars and / or avatar representations) and / or user interface objects (e.g., animated characters) of agents (e.g., and / or users (e.g., people, objects, and / or animals)). In some embodiments, an agent representation refers to a set of output characteristics (e.g., visual and / or audio) of the agent (and / or user and / or user interface objects). For example, an agent representation may include (and / or correspond to) a set of one or more visual characteristics (e.g., facial features of an animated face) and / or one or more audio characteristics (e.g., linguistic and voice characteristics of an audio output). In some embodiments, a representation (e.g., of an agent) is used to represent output by the agent. For example, a device that implements an interactive agent outputs audio in the agent's voice and displays an animated face of the agent moving in a manner that simulates the agent speaking the audio output. This allows the user to feel as if they are having a normal conversation with the agent. In some embodiments, an agent representation includes (or does not include) personality and / or behavioral characteristics (e.g., as described above). For example, an agent's representation may include (and / or correspond to) a set of visual characteristics (e.g., facial features of an animated face) and a set of personality characteristics. In some embodiments, an agent's representation may include a set of user characteristics corresponding to a visual representation of a user (e.g., representations of the user's appearance, voice, and / or personality are used as an avatar that appears to move and / or speak). In some embodiments, the representation is a facial expression (e.g., a user interface object that is an output having features that simulate a human face and / or expression (e.g., to convey information to an audience)).

[0153] In some embodiments, a character (e.g., an agent and / or avatar) refers to a specific set of characteristics of representation. For example, an avatar can embody (e.g., use, apply, interact with, and / or output accordingly) the characteristics of fictional and / or non-fictional characters (e.g., from movies, shows, books, series, and / or popular culture).

[0154] In some embodiments, the voice (e.g., of an agent and / or avatar) refers to a set of one or more characteristics corresponding to a sound output that is similar to (e.g., represents, imitates, and / or reproduces) a speech utterance (e.g., resulting from and / or simulated as being output by an agent and / or avatar). For example, device 200 may output a sentence that sounds different depending on the voice used. In some embodiments, a particular character and / or avatar may be configured to use a particular voice (e.g., have a corresponding voice). In some embodiments, a particular voice may imitate the user's voice.

[0155] In some embodiments, the appearance (e.g., of an agent and / or avatar) refers to a set of one or more characteristics corresponding to a visual output representing the avatar (and / or agent). For example, device 200 may output an avatar having a set of facial features that form an appearance similar to a particular character in a movie.

[0156] In some embodiments, an avatar's facial expression refers to a set of one or more characteristics that correspond to a particular appearance of the user, avatar, and / or agent. For example, device 200 may output an avatar having a set of facial features arranged in a particular way to give the appearance of a facial expression (e.g., a frown is a sad expression, a smile is a happy expression, and / or wide-open eyes are a surprised expression). As another example, device 200 may output an avatar having a set of physical features (e.g., arms and / or legs) arranged in a particular way to give the appearance of a bodily expression (e.g., a hand gesture is an approval expression, covering the eyes is a fear expression, and / or shrugging the shoulders is a lack of knowledge expression). In some embodiments, the expression includes movement of the avatar (e.g., a nod of the head is an agreement and / or disagreement expression). In some embodiments, device 200 may move via a moving component to display an expression with or without movement of the avatar. In some embodiments, the agent performs one or more actions that depend on the user's facial expressions (e.g., detecting whether the person is sad and responding with a kind statement or question). In some embodiments, facial expressions (e.g., whether they are used and / or how they are used, and / or how they are output) depend on the personality. For example, a first personality may be able to use certain facial expressions more than a second personality. As another example, the facial expressions of a first personality (e.g., a grumpy face, a smile, and / or the degree of eye opening) may appear different from the facial expressions (and / or similar and / or equivalent facial expressions) of a second personality (e.g., a first personality smiles showing their teeth, while a second personality smiles without showing their teeth).

[0157] In some embodiments, an agent (e.g., an agent avatar and / or an agent system that implements the agent (e.g., hardware and / or software)) mimics the characteristics (e.g., personality, behavior, facial expressions, and / or voice) of another user, agent, and / or character. In some embodiments, mimicking includes mirroring the user (e.g., copying the use of phrases and / or movements detected from the user interacting with the agent). In some embodiments, mimicking user characteristics includes attempting to reproduce the user's characteristics (e.g., in exactly the same manner and / or in a manner similar to the characteristics but not an exact reproduction of the characteristics). For example, an agent mimicking voice and / or facial expressions does not need to have the exact same voice and / or facial expressions as the user being mimicked (e.g., it simply needs to be similar to the user's voice and / or facial expressions).

[0158] In some embodiments, components and / or devices use learned characteristics (e.g., characteristics of context, user, and / or environment that the device has learned over time (e.g., through detection, previous experience, and / or feedback (e.g., from one or more users)) to perform actions, make decisions, and / or determine the context based on them). For example, characteristics learned over time may include user routines. In such an example, if a particular user asks the agent for a summary of any new messages for the user at the same time each day, the agent can learn to automatically perform actions based on the learned characteristics of the routine (e.g., what data is needed, when the data is needed, and / or for which user). In some embodiments, the use of learned characteristics enables the agent (and / or device) to improve its understanding of (and / or response to) context, user, and / or environment, and / or to understand context, user, and / or environment that was otherwise not understood (and / or would not be understood) (e.g., not responded to, or responded to incorrectly). In some embodiments, learned traits are formed using reinforcement learning (e.g., by and / or for the agent). In some embodiments, learned traits correspond to one or more levels of reliability, certainty, and / or reward (e.g., shaped by one or more reward functions). In some embodiments, learned traits (and / or how they are used to influence the output of the agent and / or device) can change over time (e.g., levels of reliability, certainty, and / or reward change over time). For example, the output of a device before learning a set of learned traits may be different from the output of a device after learning a set of learned traits. In some embodiments, components and / or devices use the learned knowledge.For example, as described above with respect to learned traits, learned knowledge can refer to information used to update (e.g., enhance, add to, and / or extend) the device's knowledge base (e.g., for use by an agent implemented on it). In some embodiments, multiple sets of learned traits for a user can be stored and / or used. In some embodiments, different sets of learned traits for different users can be stored and / or used.

[0159] In this specification, interactions with an agent (and / or device) may be referred to. In some embodiments, an interaction refers to a set of one or more inputs and / or outputs of a device that realizes an agent and one or more users. For example, an interaction may be an input by the user (e.g., "Please turn on the lights") and a corresponding output (e.g., turning on the lights and / or an "OK" response by the device). In some embodiments, an interaction may include multiple inputs / outputs by one or more of the parties to the interaction (e.g., the device and / or the user). For example, an interaction may include a first input by the user (e.g., "Please turn on the lights") and a corresponding first output (e.g., "Which light?"), and may also include a second input by the user (e.g., "Kitchen light") and a second output from the device (e.g., "OK"). In some embodiments, which inputs and / or outputs are considered together as an interaction is based on logical and / or contextual grouping (e.g., interactions within the last 30 seconds and / or interactions related to turning on the lights). As those skilled in the art will understand, interactions can be considered in a manner dependent on the implementation (for example, determining when an interaction is complete may involve determining whether the user is still present (e.g., still speaking) and / or whether the user is still talking about lighting or has moved on to a different topic). In some embodiments, the interaction is a current interaction (e.g., in progress, currently occurring, and / or active). In some embodiments, the interaction is a previous interaction. The above examples describe a device having a conversation with a user. In some embodiments, the conversation is between two or more users (e.g., users in an environment). For example, the device may detect a conversation between users (e.g., users directing their voice and responses at each other, rather than at the device).

[0160] In some embodiments, an agent (and / or device) determines and / or performs an action based on the user's intent. For example, a device detects user input and outputs a response that depends on the intent of the user input. For example, a device detects user input including a pointing gesture detected along with the verbal instruction "turn on that light," and accordingly turns on a light (e.g., the light the pointing gesture is directed at) that it determines corresponds to the intent of the input. In some embodiments, intent is determined using one or more inputs, knowledge (e.g., knowledge learned about the user based on observed behavior, personality, and interaction history), learned traits, and / or context (e.g., by the device detecting the input and / or by one or more other devices). In some embodiments, intent is determined from one or more types of input (e.g., verbal input, visual input via a camera, and / or contextual input).

[0161] Next, we will focus on embodiments of user interfaces ("UI") and related processes that run on electronic devices such as computer systems 100 and / or electronic devices 200.

[0162] Figures 6A to 6E show exemplary user interfaces for performing movement representations based on learned characteristics, according to several embodiments. These user interfaces are used to illustrate processes described later, including the process in Figure 7.

[0163] Figures 6A to 6E show a computer system 600 displaying different user interfaces as a tablet. It should be recognized that the computer system 600 may be other types of computer systems such as a smartphone, smartwatch, laptop, shared device, smart speaker, accessory, personal gaming system, desktop computer, fitness tracking device, and / or head-mounted display (HMD) device. In some embodiments, the computer system 600 includes and / or communicates with one or more sensors (e.g., one or more cameras, one or more LiDAR detectors, one or more motion sensors, one or more infrared sensors, and / or one or more microphones). In some embodiments, the computer system 600 includes and / or communicates with one or more output devices (e.g., a display screen, projector, touch-sensitive display, and / or speaker). In some embodiments, the computer system 600 includes and / or communicates with one or more moving components (e.g., actuators, movable bases, rotatable components, and / or rotatable bases). In some embodiments, the computer system 600 includes one or more of the above-described components and / or features in relation to the device 100 and / or 200.

[0164] Figures 6A to 6E illustrate scenarios in which the computer system 600 learns the user's behavior (e.g., movement (e.g., face and / or body) and / or set of sounds) as well as characteristics within a context. When in the same or similar context, the computer system 600 outputs a representation of the learned behavior (e.g., movement and / or sound). The movement included in the representation is the learned movement of the user with similar speed, facial expressions and / or direction and / or set of directions.

[0165] In the examples described below, the computer system 600 that outputs a representation of user movement includes the computer system 600 that moves UI elements (e.g., avatars) via a display. In some embodiments, the computer system 600 that outputs a representation of user movement includes the computer system 600 that moves a portion of the computer system 600 via one or more movement components. In some embodiments, the computer system 600 that outputs a representation of user movement includes the computer system 600 moving UI elements and a portion of the computer system 600 (e.g., a display portion, and / or hardware components such as buttons and / or rotatable input mechanisms) in coordinated movement (e.g., moving at the same speed, moving in the same direction, and / or moving at the same cadence). In some embodiments, reference to moving at the same speed, direction, cadence, beat, and / or tempo includes movement at similar speed, direction, cadence, beat, and / or tempo, and / or movement generated using a common speed, direction, cadence, beat, and / or tempo.

[0166] As shown in Figure 6A, the computer system 600 displays a virtual assistant user interface 602. The virtual assistant user interface 602 includes a virtual assistant avatar 604 that the computer system 600 displays in a central location within the virtual assistant user interface 602 in Figure 6A. In this example, the computer system 600 displays the virtual assistant avatar 604, which occupies most of the virtual assistant user interface 602. In some embodiments, the computer system 600 displays the virtual assistant avatar 604 in different sizes and / or different locations within the virtual assistant user interface 602. In some embodiments, the virtual assistant avatar 604 is an anthropomorphic visual representation of a virtual assistant application and / or artificial intelligence application that visually changes based on content output and / or input, and reacts to and / or responds to input. In some embodiments, the virtual assistant avatar 604 corresponds to a system process of the computer system 600 (e.g., managed, controlled, output, created, and / or requested by the system process). In this example, the virtual assistant avatar 604 is a visual representation of a human and / or animal face. In some embodiments, the virtual assistant avatar 604 has different appearances (e.g., different colors (e.g., sets of colors, skin tone, red, orange, yellow, green, blue, and / or purple), textures (e.g., skin, hair, fur, scales, plastic, glass, feathers, and / or wood), accessories (e.g., hats, glasses, monoculars, canes, books, collars, bows, wings, halos, and / or crowns), and / or face types (e.g., humans, animals, anthropomorphic objects, aliens, featureless faces, imaginary creatures, and / or collections of face-like objects)). Figure 6A also shows a time indicator 608 for showing the passage of time in the figures described below.

[0167] Figure 6A shows a computer system 600 and a user 610 (e.g., a user responding to something, a user performing an action, and / or outputting something) in a first context. In this example, the first context includes the computer system 600 detecting a user (e.g., 610) in the environment and outputting a greeting in response to detecting the user. In some embodiments, the first context includes the computer system 600 outputting a notification. For example, the first context could include the computer system 600 outputting the current score of a game being played by the user's favorite team. In some embodiments, the first context includes the computer system 600 detecting a user responding to a detectable situation. For example, the first context could include the computer system 600 detecting that a user is dancing when a particular piece of music is being played. In some embodiments, the first context includes the computer system 600 detecting that a user is performing an action. For example, the first action could include the computer system 600 detecting that a user is motivating someone before a meeting.

[0168] In Figure 6A, the computer system 600 detects a user 610 in the environment. As shown in Figure 6A, in response to detecting a user 610 in the environment, the computer system 600 outputs a first behavior. In Figure 6A, in response to detecting that user 610 and the computer system 600 output a first behavior (e.g., a first set of movement and / or sound), it is determined that the computer system 600 is operating within a first context. In some embodiments, the first behavior is a default behavior corresponding to the first context. In some embodiments, the default behavior is a behavior pre-configured (e.g., previously configured) by the publisher of the virtual assistant user interface 602 (e.g., selected by default, rather than based on user input and / or output content). In some embodiments, the default behavior is a behavior pre-configured by the user. In some embodiments, the first behavior is a previously learned characteristic corresponding to the first context. In this example, the first behavior corresponds to a greeting directed at the detected user. In this example, the first behavior includes the computer system 600 outputting first audio, including audio output 606 (e.g., "hello"). In some embodiments, the first audio is a default audio corresponding to a first context. In some embodiments, the first audio is a previously learned audio corresponding to a first context. In some embodiments, the first behavior includes the computer system 600 outputting a first movement (e.g., a user interface element moving across the display, and / or a part of the computer system 600 moving across one or more movement components). For example, the first movement could include the computer system 600 moving a part of the computer system 600 in an up-and-down motion similar to a bow. In some embodiments, the first movement is a default movement corresponding to a first context. In some embodiments, the first movement is a previously learned movement corresponding to a first context.In some embodiments, the first behavior includes first audio and first movement. In some embodiments, the first behavior includes the computer system 600 moving the virtual assistant avatar 604 in sync with the first audio to give the appearance that the virtual assistant avatar 604 has said hello.

[0169] In Figure 6B, the computer system 600 detects a second behavior from user 610 (e.g., a second set of movement and / or sound) in response to a first behavior. In this example, the second behavior includes a second audio and a second movement. As shown in Figure 6B, the second audio includes an audio input 605B1 (e.g., "What's wrong?"). Also, as shown in Figure 6B, the second movement includes a movement input 605B2 in which user 610 greets (e.g., raises their head and nods), lifts their chin, and then drops it. In some embodiments, the computer system 600 detects the second audio before detecting the second movement. In some embodiments, the computer system 600 detects the second audio after detecting the second movement. In some embodiments, the computer system 600 detects the second audio and the second movement simultaneously. In some embodiments, the second behavior includes only the second movement. In some embodiments, the second behavior includes only the second audio. In this example, the second movement is the user's head movement. In some embodiments, the second movement is a movement of the user's face. For example, the second movement may be a smile and a wink. In some embodiments, the second movement is a movement of the user's body. For example, the second movement may be the user tilting their shoulders to a certain angle. In Figure 6B, the computer system 600 is operating in the first context and, in response to the determination that it has detected a second behavior from the user 610, the computer system 600 learns the second behavior but does not perform a representation of the second behavior.

[0170] In Figure 6C, as indicated by the time indicator 608 in Figure 6C, which shows a different time than the time indicator 608 in Figure 6B, the computer system 600 detects users 610 and 616 at a time after the detection of the second behavior. In Figure 6C, in response to the detection of users 610 and / or user 616, the computer system 600 determines that it is operating in the second context. In Figure 6C, it is determined that the second context corresponds to the first context. As shown in Figure 6C, in response to the determination that the computer system 600 is operating in the second context and that the second context corresponds to the first context, the computer system 600 outputs a third behavior (e.g., a third set of movement and / or sound) which is the computer system 600's representation of the second behavior detected by user 610 in Figure 6B.

[0171] In some embodiments, the first and second contexts are the same, which leads to the determination that the second context corresponds to the first context. For example, if computer system 600 detects and greets user 610 in both the first and second contexts, this may lead to the determination that the second context corresponds to the first context. In some embodiments, the first and second contexts are different, which may lead to the determination that the second context does not correspond to the first context. For example, if the first context includes computer system 600 outputting a calendar notification, and the second context includes computer system 600 outputting a social media feed, this may lead to the determination that the second context does not correspond to the first context. In some embodiments, the first and second contexts are different, but are sufficiently similar in one or more respects to lead to the determination that the second context corresponds to the first context. For example, a first context in which the computer system 600 outputs a phone call from the user's parent, and a second context in which the computer system 600 outputs a text notification from the user's parent, may lead to a determination that the second context corresponds to the first context. In some embodiments, the first and second contexts include the same input. For example, the computer system 600 can detect that the user performs the same air gesture in the first and second contexts. In some embodiments, the first and second contexts include similar types of input. For example, the computer system 600 can detect an audio input corresponding to a question about an upcoming birthday in the first context and an audio input corresponding to a question about an upcoming anniversary in the second context.

[0172] In some embodiments, in response to a determination that a second context does not correspond to a first context, the computer system 600 outputs a fourth behavior (e.g., a fourth set of movement and / or sound). For example, in response to a determination that a second context does not correspond to a first context, the computer system 600 may output a fourth behavior that is a representation of the user when the user is confused. In some embodiments, the fourth behavior corresponds to a second context. For example, in response to outputting a notification of the winning score of the user's preferred team (e.g., a second context (e.g., the first context) that does not correspond to detecting and greeting the user), the computer system 600 may output audio that is a representation of the user saying "yes" while moving a part of the computer system 600 with movement that is a representation of the user doing a celebratory dance. In some embodiments, in response to a determination that a second context does not correspond to a first context, the computer system 600 does not output a set of movement and / or sound.

[0173] In some embodiments, a user in the first context is different from a user in the second context. In some embodiments, the difference between the user in the first context and the user in the second context leads to the determination that the second context does not correspond to the first context. For example, depending on whether user 616 is detected while in the second context (e.g., instead of user 610), it may be determined that the second context corresponds to the third context, which may lead the computer system 600 to output a fifth behavior (e.g., a fifth set of movement and / or sound) (e.g., a representation of user 616's learned behavior) corresponding to user 616. In some embodiments, even if the user in the first context is different from the user in the second context, it may be determined that the second context corresponds to the first context. For example, depending on whether user 616 is detected while in the second context (e.g., instead of user 610), it may be determined that the second context corresponds to the first context because both contexts involve detecting and greeting a user, which may lead the computer system 600 to output a third behavior.

[0174] In this example, the third behavior includes the computer system 600 outputting a third audio and a third movement. As shown in Figure 6C, the third audio includes an audio output 614 which is a representation of the audio input 605B1 (e.g., "What's wrong?"). As shown in Figure 6C, the computer system 600 outputs a different audio (e.g., the third audio) in the second context than the audio (e.g., the first audio) that the computer system 600 outputs in the first context (e.g., shown in Figure 6A).

[0175] Figures 6D to 6E illustrate a scenario in which the computer system 600 outputs a third movement. In this example, the computer system 600 outputting the third movement includes animating a virtual assistant avatar 604 via a display to represent movement input 605B2. In some embodiments, the computer system 600 outputting the third movement includes moving a portion of the computer system 600. For example, the computer system 600 outputting the third movement may include the computer system 600 moving a portion of the computer system 600 up and then down with a movement representing movement input 605b.

[0176] As shown in Figure 6D, after the computer system 600 outputs audio output 614, the computer system 600 moves the virtual assistant avatar 604 upward in the virtual assistant user interface 602 in the representation of user 610 raising their chin in the movement input 605B2 (for example, as shown in Figure 6B). In some embodiments, the computer system 600 outputs audio output 614 while moving the virtual assistant avatar 604 upward in the virtual assistant user interface 602. In some embodiments, the computer system 600 outputs audio output 614 after moving the virtual assistant avatar 604 upward in the virtual assistant user interface 602.

[0177] As shown in Figure 6E, after the computer system 600 has moved the virtual assistant avatar 604 upward within the virtual assistant user interface 602, the computer system 600 moves the virtual assistant avatar 604 downward within the virtual assistant user interface 602 to the location where the virtual assistant avatar 604 was in the virtual assistant user interface 602 in Figure 6C, which is an expression of the user 610 lowering their chin in the movement input 605B2 (as shown in Figure 6B). In some embodiments, the computer system 600 outputs an audio output 614 while moving the virtual assistant avatar 604 downward within the virtual assistant user interface 602. In some embodiments, the computer system 600 outputs an audio output 614 after moving the virtual assistant avatar 604 downward within the virtual assistant user interface 602.

[0178] In some embodiments, upon receiving communication from another user (e.g., voice call, video call, and / or text), the computer system 600 performs a sixth behavior (e.g., a sixth set of movement and / or sound) corresponding to the other user (e.g., a learned representation of the other user's behavior). In some embodiments, the sixth behavior is included in the user profile of the other user in the other computer system. In some embodiments, the sixth behavior is memorized by the computer system 600 from previous interactions with the other user. In some embodiments, the sixth behavior is a setting configured by the primary user of the computer system 600 (e.g., the user with the most permissions) to correspond to the other user.

[0179] Figure 7 is a flowchart illustrating a method for performing a representation of movement based on learned characteristics using a computer system, according to several embodiments. Method 700 is performed on a computer system (e.g., 100, 200, and / or 600). Some operations of Method 700 are arbitrarily combined, the order of some operations is arbitrarily changed, and some operations are arbitrarily omitted.

[0180] As will be described later, Method 700 provides an intuitive way to perform a representation of movement based on learned characteristics. The method reduces the cognitive burden on the user to interact with the computer system, thereby creating a more efficient human-machine interface. In the case of battery-powered computing devices, power is saved and the intervals between battery charges are extended by enabling the user to interact with the computer system faster and more efficiently.

[0181] In some embodiments, Method 700 is performed in a computer system (e.g., 600) that communicates with one or more input devices (e.g., touch-sensitive displays, rotatable input mechanisms, cameras (e.g., telephoto, wide-angle, and / or ultra-wide-angle cameras), and / or sensors (e.g., gyroscopes and / or heart rate sensors)) (for example, as described above with respect to Figures 6A to 6B). In some embodiments, the computer system communicates with display components (e.g., display screens, projectors, and / or touch-sensitive displays) and / or one or more output devices (e.g., speakers, haptic output devices, display screens, projectors, and / or touch-sensitive displays). In some embodiments, the computer system is a wristwatch, telephone, tablet, fitness tracking device, processor, head-mounted display (HMD) device, sharing device, media device, speaker, television, and / or personal computing device. In some embodiments, the computer system communicates with moving components (e.g., actuators, motors, electronic arms, lifts, and / or levers). In some embodiments, the computer system communicates with one or more cameras (e.g., telephoto, wide-angle, and / or ultra-wide-angle cameras).

[0182] The computer system detects, via one or more input devices, the movement of a first user (e.g., 610) (e.g., body movement (e.g., head, shoulders, arms, and / or fingers) and / or facial movement (e.g., lips, eyes, eyelids, mouth, and / or eyebrows)) (e.g., the user responds to a stimulus, the user's location (e.g., outdoors, indoors, home, school, car, concert, museum, theater, place of worship, and / or gym), the computer system outputs content, the user talks about a topic (e.g., sports, travel, current events, school, work, and / or hobbies), and / or the user performs an action) (702) in relation to a first context (e.g., during, in operation, and / or detection) (e.g., as shown in Figures 6A to 6B).

[0183] In response to detecting the movement of a first user (e.g., 610) into a first context, the computer system ceases to perform (e.g., projection, display, animation, rasterization, and / or rendering) a representation of the first user's movement (e.g., an approximation of the first user's actual movement and / or one or more of the same properties of the first user's movement) (e.g., as described above with respect to Figures 6A and 6B) (704).

[0184] After detecting the first user's movement to the first context, the computer system detects a transition to the second context (e.g., the user responding to a stimulus, the user's location (e.g., outdoors, indoors, home, school, car, concert, museum, theater, place of worship, and / or gym), the computer system outputting content, the user talking about a topic (e.g., sports, travel, current events, school, work, and / or hobbies), and / or the user performing an action) (706).

[0185] In response to detecting a transition to a second context, and in accordance with the determination that the second context corresponds to the first context (and / or satisfies a predetermined threshold of confidence in semantic meaning, syntactic meaning, similarity, relation, connection, and / or correlation), the computer system executes a representation of the first user's movement (e.g., an approximation of the first user's actual movement and / or one or more of the same properties of the first user's movement) (708). In some embodiments, in accordance with the determination that the second context does not correspond to the first content (and / or does not satisfy a predetermined threshold of confidence in semantic meaning, syntactic meaning, similarity, relation, connection, and / or correlation), the computer system does not execute a presentation of the first user's movement. By executing a representation of the first user's movement based on the satisfaction of predetermined conditions, the computer system can reproduce the user's movement according to the current situation and / or context, thereby providing the user with improved visual feedback and executing the action without requiring further user input when the set of conditions is met.

[0186] In some embodiments, upon detecting a transition to a second context and determining that the second context does not correspond to the first context (and / or does not meet a predetermined threshold of confidence in semantic meaning, syntactic meaning, similarity, relation, association, connection, and / or correlation), the computer system refrains from performing the representation of the first user's movement (for example, as described above with respect to Figures 6A to 6E). Refraining from performing the representation of the first user's movement based on the fulfillment of predetermined conditions allows the computer system to refrain from reproducing the user's movement according to the current situation and / or context, thereby providing the user with improved visual feedback and performing the action without requiring further user input when the set of conditions is met.

[0187] In some embodiments, the second context is the same as the first context (for example, as described above with respect to Figures 6A to 6E). By making the second context the same as the first context, the computer system can learn and replicate the user's movements for the same situation and / or context, thereby providing the user with improved visual feedback and / or performing actions without requiring further user input when a set of conditions is met.

[0188] In some embodiments, the second context is different from the first context (for example, as described above with respect to Figures 6A to 6E). By making the second context different from the first context, the computer system can learn and replicate the user's movements for different situations and / or contexts, thereby providing the user with improved visual feedback and / or performing actions without requiring further user input when a set of conditions is met.

[0189] In some embodiments, the computer system (e.g., 600) communicates with a microphone. In some embodiments, detecting the movement of a first user (e.g., 610) to a first context includes receiving verbal input (e.g., 605B1) from the first user via the microphone. In some embodiments, detecting a transition to a second context includes receiving verbal input (e.g., 616) from a second user different from the first user via the microphone (e.g., as described above with respect to Figures 6A-6E). In some embodiments, the verbal input from the second user is different from the verbal input from the first user. In some embodiments, detecting a transition to a second context does not include detecting the movement of the second user and / or detecting the movement of the first user. By performing a representation of the first user's movement based on the fulfillment of predetermined conditions, the computer system can reproduce the user's movement while responding to different users, thereby providing the user with improved visual feedback and performing actions without requiring further user input when a set of conditions is met.

[0190] In some embodiments, detecting a first user's (e.g., 610) movement to a first context includes receiving a first input (e.g., 605B1) via at least one of one or more input devices. In some embodiments, detecting a transition to a second context includes receiving a second input (e.g., 605B1) different from the first input (e.g., as described above with respect to Figures 6A to 6E) via at least one of one or more input devices. In some embodiments, the second input and the first input are of the same type (e.g., air gestures (single or multiple), mouse clicks (single or multiple), taps (single or multiple), verbal input (single or multiple), swipes (single or multiple), keyboard input (single or multiple), and / or rotations of a rotatable input mechanism (single or multiple)) (e.g., as described above with respect to Figures 6A to 6E). By executing a representation of a first user's movement based on the fulfillment of predetermined conditions, the computer system can reproduce the user's movement while responding to the same input, thereby providing the user with improved visual feedback and executing the action without requiring further user input when the set of conditions is met.

[0191] In some embodiments, detecting the movement of a first user (e.g., 610) to a first context includes detecting a third input (e.g., 605B1) via one or more input devices (e.g., as described above with respect to Figures 6A to 6E). In some embodiments, detecting a transition to a second context includes detecting a fourth input (e.g., 605B2) via one or more input devices (e.g., as described above with respect to Figures 6A to 6E), which is different from the third input. In some embodiments, the third and fourth inputs are different types of inputs corresponding to actions (and / or the same actions) (e.g., air gestures (single or multiple), mouse clicks (single or multiple), taps (single or multiple), verbal input (single or multiple), swipes (single or multiple), keyboard input (single or multiple), and / or rotations of a rotatable input mechanism (single or multiple)). In some embodiments, the third input is an input that causes a computer system to perform an action. In some embodiments, the fourth input is another type of input that causes the computer system to perform the same action. By performing a representation of the first user movement based on the fulfillment of predetermined conditions, the computer system is enabled to reproduce the user's movement in accordance with the detection of different types of input, thereby providing the user with improved visual feedback and performing the action without requiring further user input when a set of conditions is met.

[0192] In some embodiments, according to the determination that the movement of a first user (e.g., 610) to a first context has a first set of one or more movement characteristics, the representation of the movement of the first user is a representation of a second set of one or more movement characteristics (as described above, for example, with respect to Figures 6A to 6E). In some embodiments, according to the determination that the movement of a first user (e.g., 610) to a first context has a third set of one or more movement characteristics that is different from the first set of one or more movement characteristics, the representation of the movement of the first user is a representation of a fourth set of one or more movement characteristics (as described above, for example, with respect to Figures 6A to 6E). In some embodiments, the second set of one or more movement characteristics is the same as and / or generated based on the first set of one or more movement characteristics. In some embodiments, the second set of one or more movement characteristics is not the same as and / or generated based on the third set of one or more movement characteristics. In some embodiments, the second set of one or more movement characteristics is not the same as and / or generated based on the fourth set of one or more movement characteristics. In some embodiments, a fourth set of one or more movement characteristics is not the same as and / or not generated based on a first set of one or more movement characteristics. In some embodiments, a fourth set of one or more movement characteristics is not the same as and / or not generated based on a second set of one or more movement characteristics. In some embodiments, a fourth set of one or more movement characteristics is the same as and / or generated based on a third set of one or more movement characteristics. In some embodiments, a computer system displays (and / or projects) a representation of a first user's movement that includes one or more characteristics of the first user's movement to a first context.By representing the movement of a first user as a representation of a second set of one or more movement characteristics or a fourth set of one or more movement characteristics, based on whether predetermined conditions are met, the computer system is enabled to reproduce the movement of a specific user, thereby providing the user with improved visual feedback and executing actions without requiring further user input when the set of conditions is met.

[0193] In some embodiments, a first set of one or more movement characteristics and a second set of one or more movement characteristics have a first acceleration (and / or deceleration) characteristic. In some embodiments, a third set of one or more movement characteristics and a fourth set of one or more movement characteristics have a second acceleration characteristic that is different from the first acceleration characteristic (for example, as described above with respect to Figures 6A to 6E). In some embodiments, the representation of the first user's movement is faster than the first user's movement to a first context and has the same constant time-scale invariance between events as the first user's movement to first content. In some embodiments, the representation of the first user's movement is slower than the first user's movement to a first context and has the same constant time-scale invariance between events as the first user's movement to first content. By assigning a first acceleration to a first set of one or more movement characteristics and a second set of one or more movement characteristics, and a second acceleration to a third set of one or more movement characteristics and a fourth set of one or more movement characteristics, the computer system can reproduce a specific speed of the user's movement, thereby providing the user with improved visual feedback and executing actions without requiring further user input when a set of conditions is met.

[0194] In some embodiments, a first set of one or more movement characteristics and a second set of one or more movement characteristics have a first directional characteristic (e.g., north, south, east, west, left, right, up, and / or down) (e.g., moving in the direction of a particular set (e.g., left, then right, then up, and / or then down)). In some embodiments, a third set of one or more movement characteristics and a fourth set of one or more movement characteristics have a second directional characteristic (e.g., north, south, east, west, left, right, up, and / or down) that is different from the first directional characteristic (e.g., as described above with respect to Figures 6A to 6E) (e.g., moving in the direction of a particular set (e.g., left, then right, then up, and / or then down)). By assigning a first directional characteristic to a first set of one or more movement characteristics and a second set of one or more movement characteristics, and a second directional characteristic to a third set of one or more movement characteristics and a fourth set of one or more movement characteristics, the computer system can reproduce a specific direction(s) of user movement, thereby providing the user with improved visual feedback and executing actions without requiring further user input when a set of conditions is met.

[0195] In some embodiments, a first set of one or more movement characteristics and a second set of one or more movement characteristics have a first facial expression characteristic (e.g., a smile, a grimace, laughter, open mouth, embarrassed expression, happy expression, sad expression, nod, expression of agreement, expression of disagreement, and / or expression of contempt). In some embodiments, a third set of one or more movement characteristics and a fourth set of one or more movement characteristics have a second facial expression characteristic different from the first facial expression characteristic (e.g., a smile, a grimace, laughter, open mouth, embarrassed expression, happy expression, sad expression, nod, expression of agreement, expression of disagreement, and / or expression of contempt). By assigning a first set of one or more movement characteristics and a second set of one or more movement characteristics to a first set of facial expression characteristics, and a third set of one or more movement characteristics and a fourth set of one or more movement characteristics to a second set of facial expression characteristics, the computer system can reproduce the user's expressions through movement, thereby providing the user with improved visual feedback and executing actions without requiring further user input when a set of conditions is met.

[0196] In some embodiments, a computer system (e.g., 600) communicates with a first movable component (e.g., actuators (e.g., pneumatic actuators, hydraulic actuators, and / or electric actuators), a movable base, a rotatable component, and / or a rotatable base). In some embodiments, performing a representation of movement by a first user (e.g., 610) includes moving a first part of the computer system (e.g., a physical part, a part of a display component, the center of the display and / or another part of the display, and / or hardware components (e.g., hardware buttons and / or rotatable input mechanisms)) via the first movable component (e.g., tilting, rotating, moving right, left, up, down, vertical, horizontal, inward, and / or outward).

[0197] In some embodiments, a computer system (e.g., 600) communicates with a display component. In some embodiments, performing a representation of movement by a first user (e.g., 610) includes displaying an animation via the display component (e.g., as described above with respect to Figures 6C-6E). In some embodiments, displaying an animation of movement of a portion of a user interface element (e.g., 602) includes, at a first time, moving a portion of the user interface element (e.g., an avatar, selectable use interface object, text, symbols, buttons, and / or content) (e.g., face, eyes(s), eyebrows(single or multiple), mouth, lips(single or multiple), torso, and / or shoulders(single or multiple)) in a first direction (e.g., as described above with respect to Figures 6C-6E), and at a second time different from the first time (e.g., as described above with respect to Figures 6C-6E), moving a portion of the user interface element in a second direction different from the first direction. Displaying animations involves moving parts of user interface elements in a first direction and parts of user interface elements in a second direction when certain conditions are met, enabling the computer system to reproduce the user's representation through movement, thereby providing the user with improved visual feedback and performing actions without requiring further user input when a set of conditions is met.

[0198] In some embodiments, a user interface element (e.g., 602) includes a representation of a face (e.g., 604) (e.g., a face having a nose, eyes (single or multiple), mouth, and / or eyebrows (single or multiple)) (as described above with respect to Figures 6A to 6E, for example). By including a facial representation in the user interface element, the computer system can reproduce the user making and changing facial expressions, thereby providing the user with improved visual feedback and performing actions without requiring further user input when a set of conditions is met.

[0199] In some embodiments, the computer system communicates with a second moving component (e.g., actuators (e.g., pneumatic actuators, hydraulic actuators, and / or electric actuators), a movable base, a rotatable component, and / or a rotatable base). In some embodiments, performing a representation of movement by a first user (e.g., 610) includes, at the same time as displaying an animation of user interface elements (e.g., as described above with respect to Figures 6A to 6E), moving a second part of the computer system (e.g., a physical part, a part of a display component, the center of the display and / or another part of the display, and / or hardware components (e.g., hardware buttons and / or rotatable input mechanisms)) via the first moving component (e.g., tilting, rotating, moving right, left, up, down, vertical, horizontal, inward, and / or outward).

[0200] In some embodiments, parts of the computer system move, and parts of the user interface elements are displayed to move at the same speed (for example, as described above with respect to Figures 6A to 6E). In some embodiments, the direction is determined based on the speed(s) of the first user's movement.

[0201] In some embodiments, parts of the computer system move, and parts of the user interface elements are displayed to move in the same direction (for example, as described above with respect to Figures 6A to 6E). In some embodiments, the direction is determined based on the direction(s) of movement of the first user.

[0202] In some embodiments, parts of the computer system move, and parts of the user interface elements are displayed to move with the same cadance (e.g., beat, sway, jerkyness, and / or pattern of movement) (as described above with respect to Figures 6A to 6E, for example). In some embodiments, the cadance is determined based on the cadance(singular or plural) of a first user's movement.

[0203] In some embodiments, after detecting the movement of a first user (e.g., 610) into a first context, the computer system detects a transition to a third context that is different from the first and second contexts. In some embodiments, upon detecting the transition to the third context, the computer system refrains from performing a representation of the first user's (e.g., 610) movement (as described above with respect to Figures 6A to 6E, for example). In some embodiments, upon detecting a transition to a second context and determining that the second context corresponds to the third context, the computer system performs a representation of the first user's movement. By refraining from performing a representation of the first user's movement upon detecting a transition to the third context, the computer system can avoid reproducing the user's movement in certain situations, thereby providing the user with improved visual feedback and performing actions without requiring further user input when a set of conditions is met.

[0204] In some embodiments, upon detecting a transition to a third context, the computer system provides an output different from that which would be performed by executing a representation of the first user's (e.g., 610) movement (as described above with respect to Figures 6A-6E, for example). By providing an output different from that which would be performed by executing a representation of the first user's movement upon detecting a transition to a third context, the computer system is able to provide other types of input while the computer system is operating in other contexts, thereby providing the user with improved visual feedback and performing actions without requiring further user input when a set of conditions is met.

[0205] In some embodiments, providing an output includes performing a representation of a second movement that is different from the movement of a first user (e.g., 610) (as described above with respect to Figures 6A to 6E, for example). Providing an output includes performing a representation of a second movement that is different from the movement of a first user, enabling the computer to replicate a different movement for the user while the computer system is operating in other contexts, thereby providing the user with improved visual feedback and performing the action without requiring further user input when a set of conditions is met.

[0206] In some embodiments, upon detecting the movement of a first user (e.g., 610) into a first context, the computer system performs a different action from the representation of the first user's movement (e.g., as described above with respect to Figures 6A to 6E).

[0207] In some embodiments, actions different from the representation of movement of the first user (e.g., 610) are not performed based on detected (e.g., previously detected and / or currently detected) movement of the first user (e.g., as described above with respect to Figures 6A to 6E).

[0208] In some embodiments, after performing a representation of the movement of a first user (e.g., 610), the computer system detects a movement of a third user, distinct from the first user, to a fourth context. In some embodiments, the movement of the third user is the same as the movement of the first user (e.g., as described above with respect to Figures 6A to 6E). In some embodiments, upon detecting the movement of the third user to the fourth context, the computer system performs a representation of the movement of the third user (e.g., 610) without performing a representation of the movement of the first user. In some embodiments, the representation of the movement of the third user is different from the representation of the movement of the first user (e.g., as described above with respect to Figures 6A to 6E). The computer system enables a computer to respond to multiple users in different ways by detecting the movement of a third user to a fourth context and, in response to detecting the movement of a third user to a fourth context, executing a representation of the movement of a third user without executing a representation of the movement of a first user, thereby providing the user with improved visual feedback and executing an action without requiring further user input when a set of conditions is met.

[0209] In some embodiments, after performing a representation of a movement by a first user (e.g., 610), the computer system detects a movement by a fourth user, distinct from that of the first user, to a fifth context. In some embodiments, the movement of the fourth user is the same as that of the first user (as described above, for example, with respect to Figures 6A to 6E). In some embodiments, upon detecting the movement of the fourth user to the fifth context, the computer system performs a representation of the movement of the first user (as described above, for example, with respect to Figures 6A to 6E). By detecting a movement by the fourth user that is the same as that of the first user to the fifth context, and upon detecting the movement of the fourth user to the fifth context, the computer system enables multiple users to be provided with the same output, thereby providing users with improved visual feedback and performing actions without requiring further user input when a set of conditions is met.

[0210] In some embodiments, after performing a representation of the movement of a first user (e.g., 610), the computer system detects incoming communications (e.g., telephone calls, text messages, and / or video calls) from a fifth user different from the first user (e.g., from a second computer system different from the computer system) (e.g., as described above with respect to Figures 6A to 6E). In some embodiments, upon detection (and / or reception) of the incoming communications, the computer system performs a representation of the movement of the fifth user (e.g., as described above with respect to Figures 6A to 6E) (e.g., mimicking the behavior of the caller of the incoming communications). In some embodiments, the representation of the movement of the fifth user is the same as the representation of the movement of the first user. In some embodiments, the representation of the movement of the fifth user is different from the representation of the movement of the first user. By detecting incoming communications from the fifth user and, upon detection, performing a representation of the movement of the fifth user, the computer system is able to provide customized outputs for various communications, thereby providing the user with improved visual feedback and / or reducing the number of inputs required to perform actions.

[0211] In some embodiments, before executing a representation of a movement by a first user (e.g., 610), the computer system detects a transition to a sixth context (e.g., another context such as the first context and / or the second context or a context different from the second context) (e.g., as described above with respect to Figures 6A to 6E). In some embodiments, upon detection of the sixth context, the computer system executes a representation of the first user's movement (e.g., as described above with respect to Figures 6A to 6E) based on the determination that the movement of the first user (e.g., 610) has been detected more than a threshold number of times (e.g., 1 to 1000) before transitioning to the sixth context. In some embodiments, upon detection of the sixth context, the computer system refrains from executing a representation of the first user's movement (e.g., as described above with respect to Figures 6A to 6E) based on the determination that the movement of the first user (e.g., 610) has been detected less than a threshold number of times before transitioning to the sixth context. Executing or not executing a representation of a first user's movement based on whether predetermined conditions are met allows the computer system to reproduce the user's movement only after detecting the movement execution multiple times, thereby providing the user with improved visual feedback and executing the action without requiring further user input when the set of conditions is met.

[0212] It should be noted that the details of the process described above with respect to Method 700 (e.g., Figure 7) are also applicable in a similar manner to the methods described below / above. For example, Method 900 optionally includes one or more characteristics of the various methods described above with reference to Method 700. For example, a computer system may, in response to detecting a posture that causes an action along with a representation of movement using the techniques described in relation to Method 900, execute a representation of movement using the techniques described in relation to Method 700. For brevity, these details will not be repeated below.

[0213] Figures 8A to 8E show exemplary user interfaces for configuring actions performed based on learned characteristics, according to several embodiments. The user interfaces in these figures are used to illustrate processes described later, including the process in Figure 9.

[0214] Figures 8A to 8E show a computer system 800 displaying different user interfaces as a tablet. It should be recognized that the computer system 800 may be other types of computer systems such as a smartphone, smartwatch, laptop, shared device, smart speaker, accessory, personal gaming system, desktop computer, fitness tracking device, and / or head-mounted display (HMD) device. In some embodiments, the computer system 800 includes and / or communicates with one or more sensors (e.g., one or more cameras, one or more LiDAR detectors, one or more motion sensors, one or more infrared sensors, and / or one or more microphones). In some embodiments, the computer system 800 includes and / or communicates with one or more output devices (e.g., a display screen, projector, touch-sensitive display, and / or speaker). In some embodiments, the computer system 800 includes and / or communicates with one or more movable components (e.g., actuators, movable bases, rotatable components, and / or rotatable bases). In some embodiments, the computer system 800 includes one or more of the above-described components and / or features in relation to the electronic devices 100, 200, and / or 600.

[0215] Figures 8A to 8E illustrate a scenario in which the computer system 800 learns air gestures from a user and associates them with system responses and / or inputs. The computer system 800 detects inputs and also detects air gestures from the user via one or more sensors, and in response, the computer system 800 performs actions. In this scenario, the computer system 800 configures actions to be performed by the inputs so that they are executed when the computer system 800 detects air gestures without detecting inputs.

[0216] As shown in Figure 8A, the computer system 800 displays the text input user interface 802, including displaying the first text 804 within a central location of the text input user interface 802, such that the first text 804 occupies most of the text input user interface 802. In some embodiments, the computer system 800 displays the first text 804 as some other size and / or in some other location within the text input user interface 802. As shown in Figure 8A, the first text 804 corresponds to a request to send a text (e.g., "Should I send a text?"). In Figure 8A, the computer system 800 detects a first gesture from user 806. In this example, the first gesture is an air gesture 805a, which is a fist. In some embodiments, the air gesture 805a is one of several other air gestures (e.g., palm up, palm down, thumb up, high five, flick, pointing, pinch, wiggle, wave, and / or finger circle). In some embodiments, the first gesture is some other form of input (e.g., gaze input and / or body movement). In this example, the air gesture 805a is not the default gesture (e.g., it is not pre-configured to correspond to an action). In some embodiments, the air gesture 805a is the default gesture (discussed in more detail below). In Figure 8A, the computer system 800 determines that it does not recognize the air gesture 805a as an input corresponding to an action.

[0217] As shown in Figure 8B, in response to the determination that the computer system 800 does not recognize the air gesture 805a as an input corresponding to an action, the computer system 800 continues to display the first text 804. In some embodiments, in response to the determination that the computer system 800 does not recognize the air gesture 805a as an input corresponding to an action, the computer system 800 temporarily stops displaying the first text 804 before displaying it again. In some embodiments, in response to the determination that the computer system 800 does not recognize the air gesture 805a as an input corresponding to an action, the computer system 800 modifies the display of the first text 804 to improve its visibility.

[0218] In Figure 8B, the computer system 800 detects a first input corresponding to the computer system 800 performing a first action. In this example, the first input is an audio input 805b corresponding to an affirmative response (e.g., yes) to the first text 804. In Figure 8B, the computer system 800 continues to detect an air gesture 805a (e.g., the first gesture). In some embodiments, the computer system 800 detects the first input before detecting the first gesture. In some embodiments, the computer system 800 detects the first input after detecting the first gesture. In some embodiments, the computer system 800 detects the first input simultaneously with the first gesture.

[0219] As shown in Figure 8C, in response to detecting audio input 805b, the computer system 800 performs a first action. In this example, the computer system 800 performing the first action includes ceasing to display the first text 804 and displaying a second text 808 in response to confirmation that the text has been sent. In some embodiments, the computer system 800 performing the first action includes transmitting text in response to a question in the first text 804. In Figure 8C, in response to detecting air gesture 805a along with audio input 805b, the computer system 800 configures air gesture 805a (e.g., the first gesture) to correspond to the computer system 800 performing the first action without detecting audio input 805b (e.g., the first input). In Figure 8C, the computer system 800 no longer detects air gesture 805a from user 806.

[0220] In some embodiments, the computer system 800 requires detecting a first gesture with a first input at least twice (e.g., a threshold number of times) before configuring the first gesture to correspond to the computer system 800 performing a first action (e.g., the same action that the first input corresponds to the computer system 800 performing) without detecting a first input. In some embodiments, the computer system 800 requires different gestures to be detected with their corresponding inputs a different number of times before configuring gestures to be used without corresponding inputs. For example, the computer system 800 may require common gestures (e.g., clapping, pinching, swiping, and / or raising a thumb) to be detected with their corresponding gestures more often than less common gestures (e.g., moving the back of the hand forward, raising the little finger, and / or scooping).

[0221] In some embodiments, the first action includes launching a new application (for example, computer system 800 displays the application). In some embodiments, the first action includes closing the application (for example, computer system 800 stops displaying the application). In some embodiments, the first action is media control (e.g., play, pause, forward skip, backward skip, next play, and / or mark as favorite). For example, computer system 800 performing the first action may include computer system 800 pausing the media currently being output by computer system 800. In some embodiments, the first action is communication control (e.g., starting, answering, and / or ending a telephone and / or video call). For example, computer system 800 performing the first action may include computer system 800 starting a video call.

[0222] In some embodiments, the computer system 800 recognizes a first gesture as an input corresponding to a second action (for example, not a first action). In some embodiments, upon detection of the first gesture without detecting an audio input 805b, the computer system 800 performs the second action. In some embodiments, the air gesture 805a is a default gesture. For example, the first gesture may be a default gesture corresponding to "no," and upon detection of the first gesture, the computer system 800 may stop displaying text 804 and display text stating "No text will be sent." In some embodiments, the second gesture is a default gesture corresponding to the computer system 800 performing the first action. For example, upon detection of a thumbs-up air gesture (for example, the second gesture), the computer system 800 may perform the first action. In some embodiments, upon detecting an air gesture 805a along with an audio input 805b, the computer system 800 recognizes the air gesture 805a as corresponding to a second operation and the audio input 805b as corresponding to a first operation, while the computer system 800 performs a first operation. In some embodiments, after performing a first operation upon detecting an audio input 805b, the computer system 800 detects and recognizes the air gesture 805a as corresponding to a second operation and the audio input 805 as corresponding to a first operation, while the computer system 800 configures the air gesture 805a to correspond to a first operation, and the scenario continues as described below in Figure 8D.

[0223] As shown in Figure 8D, after displaying the second text 808, the computer system 800 displays the text input user interface 802 containing the first text 804. In Figure 8D, the computer system 800 detects an air gesture 805d from user 806. In this example, air gesture 805d is the same as air gesture 805a. In Figure 8D, the computer system 800 recognizes air gesture 805d as input corresponding to the first action.

[0224] As shown in Figure 8E, in response to the computer system 800 detecting an air gesture 805d and recognizing the air gesture 805d as an input corresponding to a first action, the computer system 800 performs a first action, which includes the computer system 800 ceasing to display the first text 804 and displaying the second text 808. In some embodiments, the computer system 800 performing the first action includes the computer system 800 transmitting text corresponding to the quest in the first text 804.

[0225] In some embodiments, when the computer system 800 is operating in a different modality, the detection of an air gesture 805d by the computer system 800 does not lead to the computer system 800 performing an action. In some embodiments, upon detecting an air gesture 805d while the computer system 800 is displaying an online shopping interface, the computer system 800 does nothing. In some embodiments, upon detecting an air gesture 805d during some modality, the computer system 800 performs a third action. For example, if the computer system 800 is displaying an e-book application, upon detecting an air gesture 805d, the computer system 800 may add a bookmark to the currently displayed page. In some embodiments, while the computer system 800 detects an air gesture 805d, in some modalities, the computer system 800 performs an action similar to the first action. For example, if computer system 800 is displaying text in response to a request to send an email while displaying an email user interface (for example, displaying text in response to a request to send an email, as shown in Figure 8D), then upon detecting air gesture 805d, computer system 800 will stop displaying the text in response to the request and display text in response to a confirmation that the email has been sent.

[0226] In some embodiments, upon detecting a third gesture along with an audio input 805b (for example, an input corresponding to a computer system 800 performing a first action), the computer system 800 performs a first action and configures the third gesture to correspond to a computer system 800 performing a first action without detecting audio input 805b. For example, if the computer system 800 detects an air gesture input of a hand with the palm facing forward and all fingers spread, while also detecting audio input 805b, the computer system 800 can perform a first action and configure the air gesture input of a hand with the palm facing forward and all fingers spread to correspond to a computer system 800 performing a first action. In some embodiments, after configuring the third gesture to correspond to a computer system 800 performing a first action, upon detecting an air gesture 805d, the computer system 800 performs a first action and demonstrates that air gesture 805d is still configured to correspond to the first action. In some embodiments, two or more gestures may be configured to perform the same action. In some embodiments, after configuring a third gesture to correspond to a first action, the computer system 800, upon detecting air gesture 805d, does not perform the first action and demonstrates that air gesture 805d is no longer configured to correspond to the first action. In some embodiments, only one gesture can be configured to perform an action at a time, and when a new gesture is configured to perform an action, the previous gesture is no longer configured to perform its action without the original input. For example, after configuring an air gesture input of a hand with the palm facing forward and all fingers spread to correspond to the computer system 800 performing a first action, the computer system 800 may no longer perform the first action as a result of detecting air gesture 805a without also detecting an audio input 805b.

[0227] In some embodiments, computer system 800 detects a fourth gesture along with a second input corresponding to computer system 800 performing a fourth action, thereby configuring the fourth gesture to correspond to computer system 800 performing a fourth action. For example, while computer system 800 is displaying text 804, if computer system 800 detects an air gesture of two fingers sweeping down and left along with an audio input corresponding to computer system 800 opening the original text for editing, computer system 800 can open the original text for editing and configures an air gesture of two fingers moving down and left to correspond to computer system 800 opening the original text for editing. In some embodiments, computer system 800 can recognize different gestures as corresponding to computer system 800 performing different actions while in the same modality. For example, when computer system 800 is displaying text 804, computer system 800 can recognize a first gesture as corresponding to computer system 800 performing a first action, and a fourth gesture as corresponding to computer system 800 performing a fourth action.

[0228] In some embodiments, the computer system 800 does not allow a gesture to be configured to correspond to the computer system 800 performing an action without detecting a corresponding input. For example, while displaying a prompt to change security settings, the computer system 800 may ignore a gesture detected along with input to change security settings. In some embodiments, the computer system 800 does not acknowledge a gesture that has already been configured to correspond to the computer system 800 performing an action; instead, the computer system 800 requires detection of the original corresponding input. For example, the computer system 800 may ignore a gesture corresponding to the computer system 800 deleting a file when an entire drive is selected; instead, the computer system 800 may require an audio input corresponding to the computer system 800 deleting a file to perform the action.

[0229] In this example, the computer system 800 performing the first action does not involve movement (e.g., moving a UI element across a display and / or moving a part of the computer system 800). In some embodiments, the computer system 800 performing the first action includes movement (e.g., moving a UI element across a display and / or moving a part of the computer system 800). For example, the computer system 800 performing the first action may include the computer system 800 moving a volume slider across a music user interface. In this example, the air gesture 805d (e.g., and 805a) does not involve movement. In some embodiments, the air gesture 805d (e.g., and 805a) includes movement. In some embodiments, if the air gesture 805d includes movement and the first action does not include movement, the amount of movement detected by the computer system 800 in the air gesture 805d does not affect how the computer system 800 performs the first action. In some embodiments, if both the air gesture 805d and the first action involve movement, the amount of movement detected by the computer system 800 in the air gesture 805d affects how the computer system 800 performs the first action. For example, if the first action is to scroll a document upward within the user interface, and the air gesture 805d involves raising an index finger, the amount and speed at which the computer system 800 detects that the index finger has been raised affects the amount and speed at which the computer system 800 scrolls the document upward within the user interface.

[0230] Figure 9 is a flowchart illustrating a method for configuring actions to be performed based on learned characteristics using a computer system, according to several embodiments. Method 900 is performed on a computer system (e.g., 100, 200, 600). Some actions of Method 900 are combined at will, the order of some actions is changed at will, and some actions are omitted at will.

[0231] As described below, Method 900 provides an intuitive method for configuring actions to be performed based on learned characteristics. This method reduces the cognitive burden on the user to configure actions to be performed based on learned characteristics, thereby creating a more efficient human-machine interface. For battery-powered computing devices, enabling users to configure actions to be performed based on learned characteristics more quickly and efficiently saves power and increases the time between battery charges.

[0232] In some embodiments, Method 900 is performed in a computer system (e.g., 600) that communicates with one or more input devices (e.g., touch-sensitive displays, rotatable input mechanisms, cameras (e.g., telephoto, wide-angle, and / or ultra-wide-angle cameras), and / or sensors (e.g., gyroscopes and / or heart rate sensors)). In some embodiments, the computer system communicates with display components (e.g., display screens, projectors, and / or touch-sensitive displays) and / or one or more output devices (e.g., speakers, haptic output devices, display screens, projectors, and / or touch-sensitive displays). In some embodiments, the computer system is a wristwatch, telephone, tablet, fitness tracking device, processor, head-mounted display (HMD) device, sharing device, media device, speaker, television, and / or personal computing device. In some embodiments, the computer system communicates with moving components (e.g., actuators, motors, electronic arms, lifts, and / or levers). In some embodiments, the computer system communicates with one or more cameras (e.g., telephoto, wide-angle, and / or ultra-wide-angle cameras).

[0233] The computer system, in conjunction with detecting a first input (e.g., 805B) (e.g., verbal input, air gesture, touch input (e.g., tap input, swipe input, and / or long press input), and / or gaze input) (e.g., during, immediately before, and / or immediately after), detects a first posture (e.g., 805A) (e.g., body gesture, user movement, thumbs up, thumbs down, waving, and / or karate chop) via one or more input devices (902).

[0234] In response to detecting a first input (e.g., 805B) and a first attitude (e.g., 805A) (904), the computer system performs a first action (e.g., corresponding to the first input) (906) (as described above with respect to Figures 8A to 8E, for example). In some embodiments, the first input corresponds to a request to perform a specific action. In some embodiments, the first action is an action performed by the computer system (e.g., launching an application, displaying an application, and / or stopping the display of an application) and / or an action to cause an external computer system to perform the action.

[0235] In response to detecting a first input and a first posture (904), the computer system configures a first operation to be performed without detecting a first input (e.g., 805B) (and / or in response to detecting user movement) (908), as described above with respect to Figures 8B-8C.

[0236] After performing the first operation and configuring the first operation to be performed without detecting the first input (e.g., 805B), the computer system detects the first posture (e.g., 805A) (e.g., another instance of the first posture, and / or a second posture distinct from the first posture (e.g., detected at a different time and / or in a different context)) via one or more input devices (e.g., after the computer system has detected a posture that is different from and / or not of the same type as the first posture) (910).

[0237] In response to detecting a first posture (e.g., 805A) without detecting a first input (e.g., 805B), the computer system performs a first action (e.g., as described above with respect to Figures 8D-8E) (912). By configuring the first action to be performed without detecting a first input, and then performing the first action in response to detecting a posture without detecting a first input, the computer system can automatically configure actions to be performed without detecting input; the computer system can learn the user's posture and associate the posture with the system response based on the fact that the posture is associated with the input associated with the system response, thereby reducing the number of inputs required to perform the action; the computer system can automatically associate personal gestures by the user with the system response, thereby providing additional control options without cluttering the user interface with additional displayed controls, performing the action without requiring further user input, and providing the user with improved feedback.

[0238] In some embodiments, before configuring a first operation to be performed without detecting a first input (e.g., 805B), the computer system detects a third posture (e.g., the same as or different from the first posture) in conjunction with detecting a first input (e.g., as described above with respect to Figures 8A to 8E) via one or more input devices. In some embodiments, in response to detecting a third posture in conjunction with detecting a first input (e.g., 805B), and in accordance with the determination that the system is not configured to perform a first operation without detecting a first input, the computer system performs a second operation (e.g., as described above with respect to Figures 8A to 8E). In some embodiments, the second operation is different from the first operation. In some embodiments, the second operation is the same as the first operation. In some embodiments, before configuring a first operation to be performed without detecting an input, the computer system was not previously configured to perform a first operation without detecting an input. In some embodiments, the computer system performs a second operation because the second operation is not configured to perform a first operation without detecting an input. In some embodiments, the computer system performs the first action and not the second action in response to the detection of a third posture in conjunction with the detection of a first input, and according to a determination that the system is configured to perform the first action without detecting the first input. The computer system performs the second action in response to the detection of a third posture in conjunction with the detection of a first input, and according to a determination that the system is not configured to perform the first action without detecting the first input, thereby enabling the computer system to perform additional actions prompted by the user, thereby providing additional control options without cluttering the user interface with additional displayed controls, performing actions without requiring further user input, and providing the user with improved feedback.

[0239] In some embodiments, before configuring a first operation to be performed without detecting a first input (e.g., 805B), the computer system detects a fourth posture (e.g., the same as or different from the third posture) in conjunction with detecting a first input (e.g., as described above with respect to Figures 8A to 8E) via one or more input devices. In some embodiments, upon detecting the fourth posture in conjunction with detecting the first input (e.g., 805B), and in accordance with the determination that the system is not configured to perform the first operation without detecting the first input, the computer system cancels performing the first operation (and in some embodiments, additional and / or different operations) (e.g., as described above with respect to Figures 8A to 8E). In some embodiments, upon detecting the fourth posture in conjunction with detecting the first input, and in accordance with the determination that the system is configured to perform the first operation without detecting the first input, the computer system performs the first operation. In response to detecting a fourth posture in conjunction with detecting an input, and in accordance with the determination that the system is not configured to perform the first action without detecting a first input, the computer system refrains from performing the first action. This allows the computer system to automatically perform an action without detecting input when it has configured a posture detected without input to trigger an action, thereby providing additional control options without cluttering the user interface with additional displayed controls, performing the action without requiring further user input, and providing the user with improved feedback.

[0240] In some embodiments, before detecting a first attitude (e.g., 805A) in conjunction with detecting a first input (e.g., 805B), the computer system detects the first attitude without detecting the first input via one or more input devices (e.g., as described above with respect to Figures 8A to 8E). In some embodiments, in response to detecting the first attitude (e.g., 805A) without detecting the first input (e.g., 805B), the computer system refrains from performing the first action (and in some embodiments, additional and / or different actions) (e.g., as described above with respect to Figures 8A to 8E). In some embodiments, detecting the first attitude prevents the system from performing an action (e.g., the first action and / or additional and / or different actions) without detecting the first input. By not performing the first action in response to detecting the first attitude without detecting the first input, the computer system can perform an action without detecting input only if it was previously configured to do so, thereby providing additional control options without cluttering the user interface with additional displayed controls, performing an action without requiring further user input, and providing improved feedback to the user.

[0241] In some embodiments, before detecting a first poster (e.g., 805A) in conjunction with detecting a first input (e.g., 805B), the computer system detects a first posture without detecting the first input (e.g., as described above with respect to Figures 8A-8E) via one or more input devices. In some embodiments, in response to detecting a first posture (e.g., 805A) without detecting a first input (e.g., 805B), the computer system performs a third operation different from the first operation (e.g., as described above with respect to Figures 8A-8E). In some embodiments, by detecting a first posture, the computer system performs an operation without detecting a first input. By performing a third operation different from the first operation in response to detecting a first posture without detecting a first input, the computer system is enabled to perform a different operation when it is not configured to automatically perform a different operation, thereby providing additional control options without cluttering the user interface with additional displayed controls, performing an operation without requiring further user input, and providing improved feedback to the user.

[0242] In some embodiments, before configuring the first operation to be performed without detecting a first input (e.g., 805B), the first pose (e.g., 805A) is not of a previously stored pose type (e.g., not a default pose, not a system-recorded pose, and / or a system-registered pose) (e.g., not a default pose, not a system-recorded pose, and / or a system-registered pose). In some embodiments, the first pose is a second type of pose different from the first type of pose (e.g., a custom type, a user (e.g., a subject, a person, an object, and / or an animal), a specific pose, and / or a learned characteristic of the user). Executing a first action, where the first posture is not a first type posture previously stored before the first action was configured to be executed without detecting a first input, in response to detecting a posture without detecting a first input, enables the computer system to automatically configure actions to be executed in response to previously unregistered postures without prompting the user to perform the action, thereby reducing the number of inputs required to perform the action, providing additional control options without cluttering the user interface with additional displayed controls, executing the action without requiring further user input, and providing the user with improved feedback.

[0243] In some embodiments, before detecting a first posture (e.g., 805A) in conjunction with detecting a first input (e.g., 805B), the computer system detects a fifth posture (e.g., a different type and / or characteristic) different from the first posture (e.g., a distinct and / or different type of posture (e.g., both postures include a fist and thumb (e.g., the first posture has a thumb raised and / or the seventh posture has a thumb lowered)), both postures include waving (e.g., the first posture waves and / or the seventh posture waves at a different location than the first posture)), and / or both postures include head movement (e.g., the first posture is a nod (e.g., affirmation) and the seventh posture is an upward head movement)) via one or more input devices, and the fifth posture is (e.g., The first type of posture is a previously stored posture type (as described above with respect to Figures 8A to 8E). In some embodiments, upon detecting a fifth posture of a previously stored posture type, the computer system performs a first action (for example, as described above with respect to Figures 8A to 8E). By performing the first action upon detecting a fifth posture of a previously stored first type of posture, the computer system is enabled to perform actions in response to previously stored inputs on the computer system, thereby providing additional control options without cluttering the user interface with additional displayed controls, performing actions without requiring further user input, and providing the user with improved feedback.

[0244] In some embodiments, the computer system communicates with a first display component. In some embodiments, performing a first action includes displaying a representation (e.g., graphical representation, image, user interface element, button, and / or affordance) of content (e.g., application content, media content, and / or symbolic content) that has not been previously displayed on the user interface (e.g., as described above with respect to Figures 8A to 8E) via the first display component. In some embodiments, performing a first action includes moving content, changing content, removing content, and / or highlighting and / or dehighlighting content (e.g., faces, application content, media content, and / or representations of symbolic content). In some embodiments, performing a first action includes launching an application. In some embodiments, the content is displayed on a user interface (e.g., a lock screen, a home screen, a user interface displayed while the computer system is locked (e.g., a state that requires a password and / or other information to be entered before the computer system can transition to an unlocked state, and / or a state that is less secure, less functional, and / or contains less information than another state in which the computer system can operate)), a non-lock screen user interface, and / or a user interface displayed via a first display component while the computer system is unlocked and / or not locked. By performing an action that includes displaying a representation of content that has not been previously displayed on the user interface, the computer system is able to display additional information without prompting the user to perform the action, thereby reducing the number of inputs required to perform the action, providing additional control options without cluttering the user interface with additional displayed controls, performing the action without requiring further user input, and providing the user with improved visual feedback.

[0245] In some embodiments, a computer system (e.g., 600) communicates with a second display component. In some embodiments, before (and in some embodiments, during and / or after) detecting a first pose (e.g., 805A) in conjunction with detecting a first input (e.g., 805B), the computer system displays individual content (e.g., one or more user interface objects (e.g., user interface elements, software application representations, avatars, system avatars, menus, and / or buttons)) (e.g., application content, media content, and / or symbolic content) via the second display component. In some embodiments, performing a first action includes ceasing to display individual content via the second display component (e.g., as described above with respect to Figures 8A to 8E). In some embodiments, individual content is first displayed on a second user interface (e.g., a lock screen, a home screen, and / or a user interface displayed while the computer system is locked (e.g., a state that requires a password and / or other information to be entered before the computer system can transition to an unlocked state, and / or a state that is less secure, less functional, and / or contains less information than another state in which the computer system can operate)). By detecting a first input and ceasing to display the individual content, in conjunction with displaying the individual content before detecting a first posture, the computer system is enabled to automatically configure different content to be displayed, thereby reducing the number of inputs required to perform an action, providing additional control options without cluttering the user interface with additional displayed controls, performing an action without requiring further user input, and providing the user with improved visual feedback.

[0246] In some embodiments, after performing a first action (for example, in response to detecting a second posture without detecting a first input) (and, in some embodiments, in conjunction with detecting a first input or without detecting a first input), the computer system detects a first posture (e.g., 805A) via one or more input devices (and, in some embodiments, in conjunction with detecting a first input or without detecting a first input) (for example, as described above with respect to Figures 8A to 8E). In some embodiments, in response to detecting a first posture (e.g., 805A) (and, in some embodiments, in conjunction with detecting a first input or without detecting a first input), the computer system performs a fourth action different from the first action (for example, as described above with respect to Figures 8A to 8E). Performing a fourth action in response to detecting a first posture allows the computer system to perform different actions based on the same prompt from the user, thereby reducing the number of inputs required to perform the action, providing additional control options without cluttering the user interface with additional displayed controls, performing the action without requiring further user input, and providing improved feedback to the user.

[0247] In some embodiments, (for example, as described above with respect to Figures 8A to 8E) the first operation is a first type of operation (e.g., displaying, outputting, and / or playing media), and the fourth operation is a first type of operation. In some embodiments, the first type of operation is outputting content in a particular manner. In some embodiments, the first operation is outputting a first media, and the fourth operation is outputting a second media different from the first media. By performing a fourth operation of the same type as the first operation in response to detecting a first posture, the computer system enables the computer system to perform different operations of the same type based on the same posture from the user, thereby providing additional control options without cluttering the user interface with additional displayed controls, performing operations without requiring further user input, and providing the user with improved feedback.

[0248] In some embodiments, the first and fourth operations are the same operation (for example, as described above with respect to Figures 8A to 8E). In some embodiments, the first operation is to output a first medium, and the fourth operation is to output a first medium. By performing a fourth operation of the same type as the first operation in response to the detection of a first posture, the computer system enables the computer system to perform different operations of the same type based on the same posture from the user, thereby providing additional control options without cluttering the user interface with additional displayed controls, performing operations without requiring further user input, and providing the user with improved feedback.

[0249] In some embodiments, after (and / or before) performing a first action (for example, in response to detecting a first posture without detecting a first input, or in response to detecting a first posture in conjunction with detecting a first input), the computer system detects a second input via one or more input devices (for example, as described above with respect to Figures 8A to 8E) that is different from the first posture (e.g., 805A) (e.g., a separate, and / or different type of posture (e.g., both postures include a fist and a thumb (e.g., first The system detects a sixth posture (e.g., body gestures, user movement, thumbs up, thumbs down, waving, and / or karate chops), a posture in which the first is a thumbs up and the seventh is a thumbs down, a posture in which both postures include waving (e.g., the first posture is a waving hand, and the seventh posture is a waving hand at a different location than the first posture), and / or a posture in which both postures include head movement (e.g., the first posture is a nod and the seventh posture is an upward head movement). In some embodiments, the system detects a second posture (e.g., body gestures, user movement, thumbs up, thumbs down, waving, and / or karate chops). In some embodiments, the second input is different from the first input. In this case, the first input is the same as the second input. In some embodiments, upon detecting the sixth posture in conjunction with the detection of the second input, the computer system performs a fifth action (e.g., corresponding to the second input) (for example, as described above with respect to Figures 8A to 8E) according to the determination that the sixth posture has been detected more than a predetermined number of times (e.g., 1 to 50 times) in conjunction with the detection of the second input. In some embodiments, the fifth action is to perform an action performed by the computer system (e.g., launch an application, display an application, and / or stop displaying an application), and / or to have an external computer system perform the action. In some embodiments, upon detecting the sixth posture in conjunction with the detection of the second input, the computer system configures the fifth action to be performed without detecting the second input (for example, as described above with respect to Figures 8A to 8E) according to the determination that the sixth posture has been detected more than a predetermined number of times in conjunction with the detection of the second input.In some embodiments, upon detecting a sixth posture in conjunction with detecting a second input, the computer system performs a fifth operation (for example, as described above with respect to Figures 8A to 8E) according to the determination that the sixth posture has not been detected a predetermined number of times in conjunction with detecting the second input. In some embodiments, upon detecting a sixth posture in conjunction with detecting a second input, the computer system is not configured to perform the fifth operation without detecting a second input (for example, as described above with respect to Figures 8A to 8E) according to the determination that the sixth posture has not been detected a predetermined number of times in conjunction with detecting the second input.

[0250] In some embodiments, before configuring the first operation to be performed without detecting a first input (e.g., 805B), the computer system may, via one or more input devices, (e.g., as described above with respect to Figures 8A to 8E) (in conjunction with and / or without detecting a first input) configure a posture different from the first posture (e.g., 805A) (e.g., a separate and / or different type of posture (e.g., both postures include a fist and thumb (e.g., the first posture has the thumb raised, the seventh posture has the thumb lowered)), both postures include waving (e.g., the first posture waves, the seventh posture waves at a different location than the first posture)), and / or both postures include head movement (e.g., the first posture nods, the seventh posture tilts the head upward). The system detects a seventh posture, which is the movement of the system. In some embodiments, upon detection of the seventh posture (for example, in conjunction with and / or without detection of the first input), the computer system performs a first action (for example, as described above with respect to Figures 8A to 8E). By performing the first action upon detection of the seventh posture, the computer system can automatically perform the same action for multiple different postures without requiring input, thereby reducing the number of inputs required to perform the action, providing additional control options without cluttering the user interface with additional displayed controls, performing the action without requiring further user input, and providing the user with improved feedback.

[0251] In some embodiments, after configuring a first operation to be performed without detecting a first input (e.g., 805B) (and, in some embodiments, during this time), the computer system detects a seventh attitude via one or more input devices (e.g., in conjunction with and / or without detecting a first input) (for example, as described above with respect to Figures 8A to 8E). In some embodiments, in response to detecting a seventh attitude without detecting a first input (e.g., 805B), the computer system (e.g., as described above with respect to Figures 8A to 8E) discontinues performing the first operation. In some embodiments, by configuring the first operation to be performed without detecting a first input, the seventh attitude is not configured to cause the computer system to detect a first input and perform the first operation. In some embodiments, by configuring the first operation to be performed without detecting a first input, the seventh attitude is not configured to cause the computer system to detect a first input and perform the first operation. In some embodiments, by configuring the first operation to be performed without detecting a first input, the computer system does not perform the first operation when the computer system detects a seventh attitude. By not performing the first action in response to detecting the seventh posture without detecting the first input, the computer system can no longer automatically perform actions without detecting input, thereby reducing the number of inputs required to perform the action, providing additional control options without cluttering the user interface with additional displayed controls, performing the action without requiring further user input, and providing improved feedback to the user.

[0252] In some embodiments, after performing a first operation, (for example, as described above with respect to Figures 8A to 8E) the computer system detects a third input that is different from the first input (e.g., 805B) (e.g., a separate and / or different type of input (e.g., the first input is a button press and the second input is a press of a different button, and / or the first input is a tap and the second input is a tap at a different location)), and in conjunction with this, the computer system, via one or more input devices, changes the first posture (e.g., 805A) An eighth posture is detected (for example, a posture separate from and / or of a different type from the first posture (for example, both postures include a fist and thumb (for example, the first posture has the thumb raised, the seventh posture has the thumb lowered), both postures include waving (for example, the first posture waves, the seventh posture waves at a different location than the first posture), and / or both postures include head movement (for example, the first posture nods, and the seventh posture is an upward head movement)). In some embodiments, the eighth posture is detected in conjunction with the third input. Depending on the circumstances, the computer system performs a sixth operation that is different from the first operation (and, in some embodiments, without performing the first operation) (for example, a separate and / or different type of operation) (for example, the first operation is launching an application, the sixth operation is launching the application on a separate computer system, and / or the first operation is taking a photograph, the sixth operation is displaying a home screen user interface). In some embodiments, depending on the detection of an eighth posture in conjunction with a third input, the computer system configures the sixth operation to be performed without detecting the first input (for example, 805B) (for example, as described above with respect to Figures 8A to 8E). In some embodiments, after performing the sixth operation, the computer system detects a ninth posture via one or more input devices, the ninth posture being the same as the eighth posture (for example, as described above with respect to Figures 8A to 8E).In some embodiments, upon detection of a ninth posture without detecting a third input, the computer system performs a sixth action (as described above with respect to Figures 8A to 8E, for example) (and, in some embodiments, without performing a first action). In some embodiments, after performing a sixth action, the computer system detects a distinct posture different from the ninth posture via one or more input devices. In some embodiments, upon detection of a distinct posture without detecting a third input, the computer system performs a distinct action different from the sixth action. By configuring the sixth action to be performed without detecting a first input, and then performing the sixth action upon detection of the ninth posture without detecting a third input, the computer system is enabled to configure multiple different actions to detect different postures without separate inputs for each of the different actions, thereby reducing the number of inputs required to perform the actions, providing additional control options without cluttering the user interface with additional displayed controls, performing actions without requiring further user input, and providing improved feedback to the user.

[0253] In some embodiments, after performing the first operation, the computer system, in conjunction with detecting a fourth input different from the first input (e.g., 805B) (as described above with respect to Figures 8A to 8E), via one or more input devices, a posture different from the first posture (e.g., 805A) (e.g., a posture separate from the first posture and / or of a different type (e.g., both postures include a fist and thumb (e.g., the first posture has the thumb raised, the seventh posture has the thumb lowered)), both postures include waving the hand (e.g., A first posture is waving, a seventh posture is waving from a different location than the first posture), and / or a tenth posture is detected in which both postures involve head movement (for example, the first posture is nodding and the seventh posture is an upward head movement). In some embodiments, in response to detecting the tenth posture in conjunction with the fourth input, the computer system performs a seventh action different from the first action (for example, as described above with respect to Figures 8A to 8E). In some embodiments, the tenth posture is detected in conjunction with the fourth input. In response to this, the computer system ceases to configure itself to perform the seventh operation without detecting a fourth input (for example, as described above with respect to Figures 8A to 8E). In some embodiments, after performing the seventh operation, the computer system detects an eleventh posture via one or more input devices, and the eleventh posture is the same as the tenth posture (for example, as described above with respect to Figures 8A to 8E). In some embodiments, in response to detecting the eleventh posture without detecting a fourth input, the computer system ceases to perform the seventh operation (for example, as described above with respect to Figures 8A to 8E) (and, in some embodiments, ceases to configure the seventh operation to be performed without detecting a fourth input). In some embodiments, in response to detecting postures (for example, the tenth posture, the eleventh posture, and / or different postures) without detecting an input (for example, the fourth input and / or a different input), the computer system ceases to perform the seventh operation.In some embodiments, upon detecting a posture without detecting an input, the computer system refrains from performing the seventh action, and the computer system refrains from configuring the system to perform the seventh action without detecting a fourth input. In some embodiments, a particular action (e.g., the seventh action) cannot be configured to be performed in response to both posture and input. In some embodiments, the computer system is not permitted to be configured to perform an action upon detecting only posture without detecting an input. By not configuring the seventh action to be performed without detecting a fourth input, and then not performing the seventh action upon detecting an eleventh posture without detecting a fourth input, the computer system is made able to not automatically configure an action to be performed without detecting an input, thereby reducing the number of inputs required to perform the action, providing additional control options without cluttering the user interface with additional displayed controls, performing the action without requiring further user input, and providing the user with improved feedback.

[0254] In some embodiments, after configuring a first operation to be performed without detecting input, the computer system detects a first posture (e.g., 805A) (and / or a second posture and / or a posture identical to the first posture) via one or more input devices (e.g., as described above with respect to Figures 8A to 8E). In some embodiments, upon detection of the first posture (e.g., 805A), the computer system discontinues performing the first operation (e.g., as described above with respect to Figures 8A to 8E) according to the determination that the first operation has been performed without detecting the first input (e.g., 805B) more than a threshold number of times (e.g., 1 to 50) (and, in some embodiments, upon detection of a different posture that is identical to the first posture). In some embodiments, upon detection of the first posture, the computer system discontinues performing the first operation (e.g., as described above with respect to Figures 8A to 8E) according to the determination that the first operation has been performed without detecting the first input (e.g., 805B) less than a threshold number of times (e.g., 1 to 50). By automatically executing the first action based on the determination that the first action has been performed without detecting the first input fewer than a threshold number of times, the computer system can automatically execute an action without detecting input multiple times before it requires input to be detected along with posture to execute the action, thereby reducing the number of inputs required to execute the action, providing additional control options without cluttering the user interface with additional displayed controls, executing the action without requiring further user input, and providing improved feedback to the user.

[0255] In some embodiments, before detecting a first posture (e.g., 805A), the first operation is tracked (e.g., recorded, recognized, identified, and / or stated) as being performed a first number of times (e.g., 1 to 10 times) without detecting an input (e.g., as described above with respect to Figures 8A to 8E). In some embodiments, upon determination that the first posture (e.g., 805A) has been detected in conjunction with the detection of a first input (e.g., 805B), the first operation is performed a second number of times (e.g., 0 to 1 times) less than the first number of times (e.g., as described above with respect to Figures 8A to 8E) without detecting an input. In some embodiments, the second number of times is two or more less than the first number of times. In some embodiments, the second number of times is a reset value (e.g., 0 to 1). In some embodiments, following the determination that a first posture (e.g., 805A) has been detected in conjunction with the detection of a first input (e.g., 805B), the first action is performed without detecting input for a third number of times (e.g., 1 to 10 times) which is greater than the first number of times (e.g., as described above with respect to Figures 8A to 8E). In some embodiments, the third number of times is 1 greater than the first number of times. In some embodiments, the third number of times is 2 or more greater than the first number of times. In some embodiments, the first number of times is refreshed after the gesture has been detected in conjunction with the first input. By performing the first action without detecting the first input for fewer than a threshold number of times based on the detection of a posture with a gesture, and by automatically performing the first action according to the determination that the threshold number is different, the computer system is able to refresh the counter for deconfiguring the posture without input to perform the action, thereby reducing the number of inputs required to perform the action, providing additional control options without cluttering the user interface with additional displayed controls, performing the action without requiring further user input, and providing the user with improved feedback.

[0256] In some embodiments, after configuring a first operation to be performed without detecting input, the computer system detects a first posture (e.g., 805A) (and / or a second posture and / or the same posture as the first posture) via one or more input devices (e.g., as described above with respect to Figures 8A to 8E). In some embodiments, upon detection of the first posture (e.g., 805A), the computer system stops performing the first operation (e.g., as described above with respect to Figures 8A to 8E) according to the determination that a threshold time amount (e.g., 1 to 1000 seconds) has elapsed (e.g., because the first posture and the first input were detected together and / or in relation to each other at a time prior to exceeding the threshold time amount (e.g., non-activity of the threshold amount) from the current time (e.g., the time after the first operation was detected after the configuration to perform the first operation without detecting input). In some embodiments, upon detection of the first posture, the computer system performs the first operation (e.g., as described above with respect to Figures 8A to 8E) according to the determination that the threshold time amount has not elapsed. Whether or not to perform a first action based on whether a threshold time has elapsed allows the computer system to perform an action automatically without prompting the user to perform the action according to the threshold time, thereby reducing the number of inputs required to perform the action, providing additional control options without cluttering the user interface with additional displayed controls, performing the action without requiring further user input, and providing the user with improved feedback.

[0257] In some embodiments, the threshold time is (for example, as described above with respect to Figures 8A to 8E) a threshold time for inactivity (e.g., 1 to 1000 seconds) (e.g., no input detected, the computer system not interacting, and / or not being used to perform an action in response to the computer system detecting input and / or posture). Performing or not performing a first action based on whether the threshold time has elapsed allows the computer system to perform an action automatically without being prompted by the user to perform an action when the inactivity time has not elapsed, thereby reducing the number of inputs required to perform the action, providing additional control options without cluttering the user interface with additional displayed controls, performing the action without requiring further user input, and providing improved feedback to the user.

[0258] In some embodiments, the threshold time is the amount of time elapsed since the detection of a first input (e.g., 805B) (e.g., 1 to 1000 seconds), as described above with respect to Figures 8A to 8E. By performing or not performing a first action based on whether the threshold time has elapsed, the computer system can automatically perform an action only in response to detecting the pose at the time the input was most recently detected, thereby reducing the number of inputs required to perform the action, providing additional control options without cluttering the user interface with additional displayed controls, performing the action without requiring further user input, and providing the user with improved feedback.

[0259] In some embodiments, the threshold time is the amount of time (e.g., 1 to 1000 seconds) since a first posture (e.g., 805A) (and / or a posture of the same type as the first posture) was detected (e.g., regardless of whether an input was received) (e.g., without detecting an input) (e.g., as described above with respect to Figures 8A to 8E). Whether or not to perform a first action based on whether or not the threshold time has elapsed allows the computer system to automatically perform an action in response to detecting only the posture from when the posture was most recently detected, thereby reducing the number of inputs required to perform the action, providing additional control options without cluttering the user interface with additional displayed controls, performing the action without requiring further user input, and providing the user with improved feedback.

[0260] In some embodiments, the threshold time is the time elapsed since the first posture (e.g., 805A) was detected in conjunction with the detection of the first input (e.g., 805b) (e.g., as described above with respect to Figures 8A-8E) (e.g., the first posture and the first input were detected together and / or together with each other at a time prior to exceeding the threshold time from the current time (e.g., the time after the first action is configured to be performed without the first input being detected)). By performing or not performing the first action based on whether the threshold time has elapsed, the computer system can automatically perform the action in response to the detection of only the posture when the posture and input were most recently detected, thereby reducing the number of inputs required to perform the action, providing additional control options without cluttering the user interface with additional displayed controls, performing the action without requiring further user input, and providing improved feedback to the user.

[0261] In some embodiments, after performing a first operation and configuring the first operation to be performed without detecting a first input (e.g., 805B), the computer system detects a 12th posture different from the first posture (e.g., 805A) via one or more input devices (e.g., as described above with respect to Figures 8A to 8E) without detecting a first input. In some embodiments, in response to detecting a 12th posture without detecting a first input (e.g., 805B), the computer system performs a first operation (e.g., as described above with respect to Figures 8A to 8E). In some embodiments, the 12th posture is similar to the first posture but not identical to the first posture (e.g., a left-to-right head turn versus a right-to-left head turn, and / or a bottom-to-top head nod versus a top-to-bottom head nod). By detecting a twelfth posture without detecting a first input, and after executing a first action, and after configuring the first action to be executed without detecting a first input, the computer system enables the detection of different postures (e.g., similar postures) and the execution of actions without detecting input, thereby reducing the number of inputs required to execute actions, providing additional control options without cluttering the user interface with additional displayed controls, executing actions without requiring further user input, and providing improved feedback to the user.

[0262] It should be noted that the details of the process described above with respect to Method 900 (e.g., Figure 9) are also applicable in a similar manner to the methods described below / above. For example, Method 700 optionally includes one or more characteristics of the various methods described above with reference to Method 900. For example, a computer system may, in response to detecting a posture that causes an action along with a representation of movement using the techniques described in relation to Method 900, execute a representation of movement using the techniques described in relation to Method 700. For brevity, these details will not be repeated below.

[0263] Figures 10A to 10C show exemplary user interfaces for automatically outputting content based on context and / or input characteristics, according to several embodiments. The user interfaces in Figures 10A to 10C are used to illustrate processes described later, including the processes in Figures 11 and 12.

[0264] Figures 10A to 10C show a computer system 1000 displaying different user interfaces as a tablet. It should be recognized that computer system 1000 may be other types of computer systems such as a smartphone, smartwatch, laptop, shared device, smart speaker, accessory, personal gaming system, desktop computer, fitness tracking device, and / or head-mounted display (HMD) device. In some embodiments, computer system 1000 includes and / or communicates with one or more sensors (e.g., a camera, lidar detector, motion sensor, infrared sensor, and / or microphone). In some embodiments, computer system 1000 includes and / or communicates with one or more output devices (e.g., a display screen, projector, touch-sensitive display, and / or speaker). In some embodiments, computer system 1000 includes and / or communicates with one or more movable components (e.g., actuator, movable base, rotatable component, and / or rotatable base). In some embodiments, the computer system 1000 includes one or more of the above-described components and / or features in relation to the computer system 100 and / or the electronic device 200.

[0265] Figures 10A to 10C illustrate a scenario in which the computer system 1000 detects an input and adjusts the characteristics of the content output in response to the detected contextual characteristics. In Figures 10A to 10C, the computer system 1000 detects the contextual characteristics via one or more sensors connected to and / or communicating with the computer system 1000. The scenarios shown in Figures 10A to 10C cover examples in which the computer system 1000 outputs content having characteristics corresponding to a first set of one or more learned characteristics when operating in a first context, and outputs content having characteristics corresponding to a second set of one or more learned characteristics when operating in a second context. In some embodiments, the second context and the second set of one or more corresponding learned characteristics are different from the first context and the first set of one or more corresponding learned characteristics. In some embodiments, the second context and the second set of one or more corresponding learned characteristics are the same as the first context and the first set of one or more corresponding learned characteristics.

[0266] In some embodiments, contextual characteristics include the location in which the computer system 1000 is currently operating (e.g., home, car, theater, museum, park, and / or workplace). For example, the computer system 1000 may respond differently to an input when located in a park than to the same input when located in a car, where the user may not be able to give the computer system 1000 their full attention. In some embodiments, contextual characteristics include environmental characteristics of the location in which the computer system 1000 is currently located (e.g., volume, light level, and / or number of users in the environment). For example, the computer system 1000 may respond differently to the same input in a loud environment (e.g., an environment where it is difficult for the user to hear the audio output by the computer system 1000 (e.g., an environment with a large amount of audio competing with the audio output by the computer system 1000)) than in a quiet environment (e.g., an environment where it is easy for the user to hear the audio output by the computer system 1000 (e.g., an environment with a small amount of audio competing with the audio output by the computer system 1000)). In some embodiments, contextual characteristics include user characteristics. In some embodiments, user characteristics include facial expressions (e.g., smiling, crying, grumpy, laughing, and / or neutral), user clothing (e.g., earmuffs, sunglasses, goggles, face mask, and / or gloves), user activity (e.g., phone, video call, running, driving, conversation with another user, cooking, and / or relaxing), calendar events, and / or audio characteristics of the user's audio output (e.g., pitch, volume, rhythm, and / or tempo). For example, computer system 1000 may respond to the same input differently when it detects that the user is running compared to when it detects that the user is getting ready to go out. In some embodiments, user characteristics include general characteristics applicable to many users. In some embodiments, user characteristics include specific characteristics applicable to a particular user.For example, depending on the input detected, the computer system 1000 may output a response that is different when detecting a smile from a first user compared to when detecting a smile from a second user.

[0267] In some embodiments, contextual characteristics include characteristics of the detected input. For example, the computer system 1000 may respond differently to the same tap input depending on whether the tap input is detected as a hard tap input or a soft tap input. Examples described below include verbal input and touch input. In some embodiments, the input includes air gestures. In some embodiments, the input includes gaze input. In some embodiments, the input includes the user's movement within the environment. One of the examples described below includes an input that corresponds to a request and / or question (for example, the user requests information about the external temperature (e.g., "The external temperature is ~")). In some embodiments, if the input corresponds to a request and / or question, the computer system 1000 outputs content that corresponds to the request and / or question. In some embodiments, the input corresponds to a declaration statement. For example, the user may say, "It looks like it's going to rain today." In some embodiments, if the input corresponds to a declaration statement, the computer system 1000 outputs content that corresponds to the declaration statement. For example, upon detecting the audio input "It looks like it's going to rain today," the computer system 1000 can output the audio "There is a 60 percent chance of rain today." In some embodiments, the input corresponds to a command. For example, the user might say, "Tell me the weather today." In some embodiments, if the input corresponds to a command, the computer system 1000 outputs content corresponding to the command.

[0268] As shown in Figure 10A, the computer system 1000 displays a home screen user interface 1002. In this example, the home screen user interface 1002 includes a weather application control 1004, a text application control 1006a, an email application control 1006b, a telephone application control 1006c, and a calendar application control 1006d. As shown in Figure 10A, the text application control 1006a, the email application control 1006b, the telephone application control 1006c, and the calendar application control 1006d are displayed in locations along the bottom edge of the home screen user interface 1002. Also, as shown in Figure 10A, the computer system 1000 displays the weather application control 1004 in the upper left location within the home screen user interface 1002. In some embodiments, the home screen user interface 1002 includes one or more other controls and / or indications. In some embodiments of Figure 10A, the computer system 1000 detects a tap input 1005a1. In some embodiments, in Figure 10A, the computer system 1000 detects the audio input 1005a2. In some embodiments, in Figure 10A, the computer system 1000 determines that it is operating in a first context. In some embodiments, in Figure 10A, the computer system 1000 determines that it is operating in a second context.

[0269] Figure 10B shows the computer system 1000 when it is in a first context corresponding to a first set of one or more contextual characteristics detected and learned by the computer system 1000. In this example, the first context corresponds to the computer system 1000 outputting the context in a complete format (e.g., a complete sentence and / or multiple pieces of information). In some embodiments, the first set of one or more contextual characteristics includes the computer system 1000 in locations the user frequently visits (e.g., home, office, park, cafe, and / or a friend's house). For example, the computer system 1000 and the user may be located in the user's home, a location where the user is more likely to feel comfortable in the environment. In some embodiments, the first set of one or more contextual characteristics includes environmental characteristics (e.g., proximity of other users, maximum volume level, maximum light level, and / or minimum light level) that lead to the user receiving content output by the computer system 1000. For example, the computer system 1000 and the user may be located in a quiet room with a light level that is comfortable for reading. In some embodiments, the first set of one or more contextual characteristics includes user characteristics. For example, the user may be calm and not engaged in any activity that would require special attention, such as being away from computer system 1000.

[0270] In some embodiments, the first set of one or more context characteristics includes audio input 1005a2 corresponding to a first set of one or more audio characteristics (e.g., pitch, volume, rhythm, and / or tempo). For example, the first set of one or more audio characteristics can include audio input 1005a2 having normal cadence and volume characteristics for a speaking user. In some embodiments, the first set of one or more context characteristics includes tap input 1005a1 having the characteristic that it is a normal press compared to other presses by the user. In some embodiments, the tap input 1005a1 is a gaze input, and the first set of one or more context characteristics includes that the gaze input is a sustained gaze. In some embodiments, the tap input 1005a1 is an air gesture, and the first set of one or more context characteristics includes that the air gesture is a controlled air gesture.

[0271] As shown in Figure 10B, upon detecting tap input 1005a1 and / or audio input 1005a2, the computer system 1000 stops displaying the home screen user interface 1002 and displays the weather application user interface 1012. As shown in Figure 10B, upon determining that the computer system 1000 is operating in a first context and has detected tap input 1005a1 and / or audio input 1005a2, the computer system 1000 displays a weather indication 1014 corresponding to a first set of one or more learned contextual characteristics. As shown in Figure 10B, upon detecting tap input 1005a1 and / or audio input 1005a2, the computer system 1000 displays the weather indication 1014 in a central location within the weather application user interface 1012. In this example, a computer system 1000 that displays a weather indication 1014 corresponding to a first set of one or more learned contextual characteristics includes displaying the weather indication 1014 along with multi-line information (e.g., current location, current external temperature, current weather conditions, and / or expected high and / or low temperatures for the day). In some embodiments, the computer system 1000 displays the weather indication 1014 simultaneously with the output of the audio response 1016.

[0272] As shown in Figure 10B, in response to a determination that the computer system 1000 is operating in a first context and has detected a tap input 1005a1 and / or an audio input 1005a2, the computer system 1000 outputs an audio response 1016 having a second set of one or more audio characteristics corresponding to a first set of one or more learned contextual characteristics. In this example, the computer system 1000 outputting an audio response 1016 having a second set of one or more audio characteristics includes outputting a sentence that verbally indicates the temperature (e.g., "It is currently 75 degrees outside"). In some embodiments, the computer system 1000 that outputs audio having a second set of audio characteristics corresponds to the computer system 1000 that outputs audio having default audio characteristics. In some embodiments, the default audio characteristics are audio characteristics pre-configured (e.g., previously configured) by the publisher of the weather application user interface 1012 (e.g., or otherwise, selected by default rather than based on user input and / or output content). In some embodiments, the default audio characteristics are audio characteristics pre-configured by the user. In some embodiments, a computer system 1000 that outputs audio having a second set of audio characteristics corresponds to a computer system 1000 that matches the audio characteristics of the user's voice. For example, if the computer system 1000 determines, in response to a determination that it is operating in a first context and has detected a tap input 1005a1, that the computer system 1000 is speaking with a uniform rhythm, a non-abrupt tempo, and conversational volume, then the computer system 1000 can output an audio response 1016 with the same and / or similar uniform rhythm, a non-abrupt tempo, and conversational volume. In some embodiments, the audio characteristics of the user's voice are sufficiently similar to those of the default audio characteristics that the computer system 1000 outputs when it matches the audio characteristics of the user's voice and outputs audio with the default audio characteristics.

[0273] In some embodiments, the computer system 1000 matches the user's redundancy. For example, if the user provides a concise input such as "What's the weather like today?", the computer system 1000 can infer a preference for low redundancy and respond with a concise output such as "Sunny, 72". Conversely, if the user asks, "Can you give me a forecast for today, including the temperature range, chance of precipitation, and wind conditions?", the computer system 1000 can provide a more redundant and / or comprehensive weather forecast to match the user's redundancy and / or inferred desired level of engagement. For example, the computer system 1000 could respond, "It looks like it's going to be a pretty nice day today. We're expecting temperatures between 68 and 75 degrees. There's about a 20% chance of light rain in the afternoon, so you might want to bring an umbrella just in case. The wind is coming from the northwest, not too strong, about 5 to 10 mph." In some embodiments, the user's redundancy corresponds to the number of words and / or phrases used to convey content (e.g., requests, messages, statements, and / or commands). In such embodiments, the content may have mean and / or minimum redundancy so that matching user redundancy may include increasing or decreasing the redundancy of the response depending on the extent to which the user redundancy and / or user redundancy are below or above the mean and / or minimum redundancy, respectively. In some embodiments, changing the redundancy of the content does not change the meaning and / or prevents the communication of a particular part of the content. In some embodiments, increasing redundancy includes using more words to communicate the same content. In some embodiments, decreasing redundancy includes using fewer words to communicate the same content. It should be noted that redundancy matching may only take into account the most recent input from the user and / or a predetermined amount of recent input from the user (including multiple inputs, e.g., by averaging the redundancy of those inputs and / or taking the minimum, maximum, and / or mode of those inputs).It should also be recognized that redundancy matching can be performed in addition to, or instead of, the matching of audio characteristics described above.

[0274] In some embodiments, upon detecting an audio input 1005a2 corresponding to a first set of one or more audio characteristics, the computer system 1000 outputs audio having a third set of one or more audio characteristics. In some embodiments, the third set of one or more audio characteristics is the same as the first set of one or more audio characteristics. For example, upon detecting an audio input 1005a2 having audio characteristics that change the rhythm of the music and the pitch of the song being sung, the computer system 1000 can output an audio response 1016 having audio characteristics that change the rhythm of the music and the pitch of the song being sung, reflecting the audio characteristics of the user's voice and, consequently, the user's emotions. In some embodiments, the first set of one or more audio characteristics is sufficiently similar to a default set of audio characteristics, such that the third set of one or more audio characteristics is the same as the default audio characteristics. In some embodiments, the third set of one or more audio characteristics is different from the first set of one or more audio characteristics. For example, upon detecting an audio input 1005a2 having high pitch and uneven rhythmic characteristics, the computer system 1000 can output an audio response 1016 having lower pitch and more uniform rhythmic characteristics as a calm contrast to the audio characteristics of audio input 1005a2.

[0275] Figure 10C shows the computer system 1000 when it is in a second context corresponding to a second set of one or more contextual characteristics detected and learned by the computer system 1000. In this example, the second context corresponds to the computer system 1000 outputting the context in a shortened format (e.g., incomplete sentences and / or less information). In some embodiments, the second set of one or more contextual characteristics includes the computer system 1000 being in a location that the user does not visit often (e.g., a hotel, amusement park, resort, and / or airport). For example, the computer system 1000 and the user may be located in an airport, which is a location where the user is more likely to be distracted and / or distracted, and a more concise response from the computer system 1000 may be easier for the user to understand. In some embodiments, the second set of one or more contextual characteristics includes the computer system 1000 being in a location where a low volume is generally considered polite (e.g., a library, place of worship, museum, and / or theater). For example, the computer system 1000 and the user may be located in a library where shorter responses at lower volume from the computer system 1000 are beneficial in not disturbing nearby users. In some embodiments, a second set of one or more contextual characteristics includes environmental characteristics (e.g., proximity of other users, maximum volume level, maximum light level, and / or minimum light level) that do not contribute to the user receiving content output by the computer system 1000. For example, the computer system 1000 and the user may be located outdoors in a noisy and very bright environment, and responses from the computer system 1000 having a higher volume and / or higher contrast display may make it easier for the user to receive the response. In some embodiments, a second set of one or more contextual characteristics includes user characteristics. For example, the user may be ready to work and do not have time for a long response.

[0276] In some embodiments, a second set of one or more contextual characteristics includes an audio input 1005a2 corresponding to a fourth set of one or more audio characteristics (e.g., pitch, volume, rhythm, and / or tempo). For example, the fourth set of one or more audio characteristics may include an audio input 1005a2 having fast tempo and loud volume characteristics for a speaking user. In some embodiments, a second set of one or more contextual characteristics includes a tap input 1005a1 having the characteristic of being a quick press compared to other presses by the user. In some embodiments, the tap input 1005a1 is a gaze input, and a second set of one or more contextual characteristics includes the gaze input being an unstable gaze. In some embodiments, the tap input 1005a1 is an air gesture, and a second set of one or more contextual characteristics includes the air gesture being an abrupt air gesture.

[0277] As shown in Figure 10C, upon detecting tap input 1005a1 and / or audio input 1005a2, the computer system 1000 stops displaying the home screen user interface 1002 and displays the weather application user interface 1012. As shown in Figure 10C, upon detecting tap input 1005a1 and / or audio input 1005a2, the computer system 1000 displays the weather indication 1018 in the central location within the weather application user interface 1012. As shown in Figure 10C, upon determining that the computer system 1000 is operating in a second context and has detected tap input 1005a1 and / or audio input 1005a2, the computer system 1000 displays the weather indication 1018 corresponding to a second set of one or more learned contextual characteristics. In this example, a computer system 1000 displaying a weather indication 1018 corresponding to a second set of one or more learned contextual characteristics is the same as a computer system 1000 displaying a weather indication 1014 corresponding to a first set of one or more learned contextual characteristics. In some embodiments, a computer system 1000 displaying a weather indication 1018 corresponding to a second set of one or more learned contextual characteristics is different from a computer system 1000 displaying a weather indication 1014 corresponding to a first set of one or more learned contextual characteristics. In some embodiments, a computer system 1000 displaying a weather indication 1018 corresponding to a second set of one or more learned contextual characteristics includes displaying a weather indication 1018 with less information. For example, a computer system 1000 displaying a weather indication 1018 corresponding to a second set of one or more learned contextual characteristics may include displaying only the current external temperature and current weather conditions, providing the user with more concise information.In some embodiments, a computer system 1000 that displays a weat...

Claims

1. It is a method, In a computer system communicating with one or more input devices, The movement of the first user to the first context is detected via one or more input devices. In response to detecting the movement of the first user to the first context, the execution of the representation of the movement of the first user is discontinued. After detecting the first user's movement to the first context, the system detects the transition to the second context. A method comprising: detecting the transition to the second context and determining that the second context corresponds to the first context, and performing the representation of the first user's movement.

2. The method according to claim 1, further comprising detecting the transition to the second context and determining that the second context does not correspond to the first context, by ceasing to perform the representation of the first user's movement.

3. The method according to claim 1 or 2, wherein the second context is the same as the first context.

4. The method according to claim 1 or 2, wherein the second context is different from the first context.

5. The aforementioned computer system is communicating with a microphone, Detecting the movement of the first user to the first context includes receiving verbal input from the first user via the microphone, The method according to any one of claims 1 to 4, wherein detecting the transition to the second context includes receiving oral input from a second user different from the first user via the microphone.

6. Detecting the movement of the first user to the first context includes receiving a first input via at least one of the one or more input devices. Detecting the transition to the second context includes receiving a second input different from the first input via at least one of the one or more input devices. The method according to any one of claims 1 to 5, wherein the second input and the first input are inputs of the same type.

7. Detecting the movement of the first user to the first context includes detecting a third input via one or more input devices. Detecting the transition to the second context includes detecting a fourth input different from the third input via one or more input devices, The method according to any one of claims 1 to 5, wherein the third input and the fourth input are different types of inputs corresponding to an operation.

8. In accordance with the determination that the movement of the first user to the first context has a first set of one or more movement characteristics, the representation of the movement of the first user is a representation of a second set of one or more movement characteristics. The method according to any one of claims 1 to 7, wherein, according to a determination that the movement of the first user to the first context has a third set of one or more movement characteristics different from the first set of one or more movement characteristics, the representation of the movement of the first user is a representation of a fourth set of one or more movement characteristics.

9. The method according to claim 8, wherein the first set of one or more motion characteristics and the second set of one or more motion characteristics have a first acceleration characteristic, and the third set of one or more motion characteristics and the fourth set of one or more motion characteristics have a second acceleration characteristic different from the first acceleration characteristic.

10. The method according to claim 8 or 9, wherein the first set of one or more movement characteristics and the second set of one or more movement characteristics have a first directional characteristic, and the third set of one or more movement characteristics and the fourth set of one or more movement characteristics have a second directional characteristic different from the first directional characteristic.

11. The method according to any one of claims 8 to 10, wherein the first set of one or more movement characteristics and the second set of one or more movement characteristics have a first facial expression characteristic, and the third set of one or more movement characteristics and the fourth set of one or more movement characteristics have a second facial expression characteristic different from the first facial expression characteristic.

12. The method according to any one of claims 1 to 11, wherein the computer system communicates with a first mobile component, and performing the representation of the first user's movement involves moving a first part of the computer system via the first mobile component.

13. The computer system communicates with a display component, and the execution of the representation of the first user's movement includes displaying an animation via the display component, and the display of the animation in which a part of the user interface element moves, In the first time period, move the part of the user interface element in the first direction, The method according to any one of claims 1 to 11, comprising moving the portion of the user interface element in a second direction different from the first direction at a second time different from the first time.

14. The method according to claim 13, wherein the user interface element includes a facial representation.

15. The method according to claim 13 or 14, wherein the computer system communicates with a second movement component, and performing the representation of the movement of the first user includes moving a second part of the computer system via the first movement component, while simultaneously displaying the animation of the user interface elements.

16. The method according to claim 15, wherein the part of the computer system is moving, and the part of the user interface elements is displayed to move at the same speed.

17. The method according to claim 15 or 16, wherein the portion of the computer system is moving, and the portion of the user interface elements is displayed to move in the same direction.

18. The method according to any one of claims 15 to 17, wherein the portion of the computer system is moving, and the portion of the user interface elements is displayed to move in the same cadence.

19. After detecting the first user's movement to the first context, the system detects a transition to a third context that is different from the first and second contexts. The method according to any one of claims 1 to 18, further comprising detecting the transition to the third context and ceasing to perform the representation of the first user's movement.

20. The method of claim 19, further comprising providing an output different from performing the representation of the first user's movement in response to detecting the transition to the third context.

21. The method according to claim 20, wherein providing the output includes performing a representation of a second movement different from the movement of the first user.

22. The method according to any one of claims 1 to 21, further comprising detecting the movement of the first user to the first context and performing an action different from the representation of the movement of the first user.

23. The method according to claim 22, wherein the action, which differs from the representation of the movement of the first user, is not performed based on the detected movement of the first user.

24. After performing the representation of the movement of the first user, detect a movement of a third user, distinct from the first user, to a fourth context, wherein the movement of the third user is the same as the movement of the first user. The method according to any one of claims 1 to 23, further comprising detecting the movement of the third user to the fourth context, and performing the representation of the movement of the third user without performing the representation of the movement of the first user, wherein the representation of the movement of the third user is different from the representation of the movement of the first user.

25. After executing the representation of the movement of the first user, the fifth context is to detect a movement of a fourth user, which is different from the first user, and the movement of the fourth user is the same as the movement of the first user. The method according to any one of claims 1 to 24, further comprising detecting the movement of the fourth user to the fifth context and performing the representation of the movement of the first user.

26. After performing the representation of the movement of the first user, an incoming communication from a fifth user different from the first user is detected, The method according to any one of claims 1 to 25, further comprising performing a representation of the fifth user's movement in response to the detection of the incoming communication.

27. Before executing the representation of the first user's movement, a transition to the sixth context is detected, In response to detecting the sixth context, Before transitioning to the sixth context, the representation of the first user's movement is executed in accordance with the determination that the first user's movement has been detected more than a threshold number of times, The method according to any one of claims 1 to 26, further comprising: determining that the movement of the first user has been detected less than the threshold number of times before transitioning to the sixth context; and ceasing to perform the representation of the movement of the first user.

28. A non-temporary computer-readable medium storing one or more programs configured to be executed by one or more processors of a computer system communicating with one or more input devices, wherein the one or more programs include instructions for performing the method according to any one of claims 1 to 27.

29. A computer system that communicates with one or more input devices, One or more processors, A computer system comprising: a memory for storing one or more programs configured to be executed by one or more processors, wherein the one or more programs include instructions for performing the method according to any one of claims 1 to 27.

30. A computer system that communicates with one or more input devices, A computer system comprising means for performing the method described in any one of claims 1 to 27.

31. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more input devices, wherein the one or more programs comprises instructions for performing the method according to any one of claims 1 to 27.

32. A non-temporary computer-readable storage medium for storing one or more programs configured to be executed by one or more processors of a computer system communicating with one or more input devices, wherein the one or more programs are The movement of the first user to the first context is detected via one or more input devices. Upon detecting the movement of the first user to the first context, the representation of the first user's movement is discontinued. After detecting the first user's movement to the first context, the transition to the second context is detected. A non-temporary computer-readable storage medium including instructions for executing the representation of the first user's movement in response to the detection of the transition to the second context and in accordance with the determination that the second context corresponds to the first context.

33. A computer system that communicates with one or more input devices, One or more processors, The system comprises a memory that stores one or more programs configured to be executed by one or more processors, and the one or more programs are The movement of the first user to the first context is detected via one or more input devices. Upon detecting the movement of the first user to the first context, the representation of the first user's movement is discontinued. After detecting the first user's movement to the first context, the transition to the second context is detected. A computer system including an instruction to execute the representation of the first user's movement in response to detecting the transition to the second context and in accordance with the determination that the second context corresponds to the first context.

34. A computer system that communicates with one or more input devices, Means for detecting the movement of a first user to a first context via one or more input devices, Means for detecting the movement of the first user to the first context and ceasing to perform the representation of the movement of the first user, Means for detecting a transition to a second context after detecting the first user's movement to the first context, A computer system comprising: means for executing the representation of the first user's movement in response to detecting the transition to the second context and in accordance with the determination that the second context corresponds to the first context.

35. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system communicating with one or more input devices, wherein the one or more programs are The movement of the first user to the first context is detected via one or more input devices. Upon detecting the movement of the first user to the first context, the representation of the first user's movement is discontinued. After detecting the first user's movement to the first context, the transition to the second context is detected. A computer program product including an instruction to execute the representation of the first user's movement in response to the detection of the transition to the second context and in accordance with the determination that the second context corresponds to the first context.

36. It is a method, In a computer system communicating with one or more input devices, The first input is detected via one or more input devices, and the first posture is detected in conjunction with this detection. In response to detecting the first input and the first attitude, Performing the first action, The configuration is such that the first operation is performed without detecting the first input, After performing the first operation and configuring the system so that the first operation is performed without detecting the first input, the first attitude is detected via one or more input devices without detecting the first input. A method comprising: performing a first action in response to detecting a first posture without detecting the first input.

37. Before configuring the system to perform the first operation without detecting the first input, the system detects the first input and the third attitude via one or more input devices, The method according to claim 36, further comprising: detecting the third posture in conjunction with detecting the first input, and determining that the system is not configured to perform the first operation without detecting the first input; and performing a second operation.

38. Before configuring the system to perform the first operation without detecting the first input, the system detects the first input and the fourth attitude via one or more input devices, The method according to claim 36 or 37, further comprising detecting the fourth posture in conjunction with detecting the first input, and determining that the system is not configured to perform the first operation without detecting the first input, and ceasing to perform the first operation.

39. Before detecting the first attitude in conjunction with detecting the first input, the first attitude may be detected via one or more input devices without detecting the first input. The method according to any one of claims 36 to 38, further comprising: discontinuing to perform the first operation in response to detecting the first posture without detecting the first input.

40. In addition to detecting the first attitude, the first input is detected via one or more input devices without detecting the first input, The method according to any one of claims 36 to 38, further comprising performing a third operation different from the first operation in response to detecting the first posture without detecting the first input.

41. The method according to any one of claims 36 to 40, wherein the first posture is not of a previously stored type before the first operation is performed without detecting the first input.

42. Before detecting the first posture in conjunction with detecting the first input, a fifth posture different from the first posture is detected via one or more input devices, wherein the fifth posture is of the type of previously stored posture. The method according to claim 41, further comprising: detecting a fifth posture of the type of previously stored posture; performing the first action in response to that detection.

43. The method according to any one of claims 36 to 42, wherein the computer system communicates with a first display component, and performing the first operation includes displaying a representation of content that has not been previously displayed on the user interface via the first display component.

44. The computer system communicates with a second display component, and the method is The method according to any one of claims 36 to 43, further comprising displaying individual content via the second display component before detecting the first pose in conjunction with detecting the first input, wherein performing the first operation includes ceasing to display the individual content via the second display component.

45. After performing the first operation, the first posture is detected via one or more input devices, The method according to any one of claims 36 to 44, further comprising performing a fourth action different from the first action in response to the detection of the first posture.

46. The method according to claim 45, wherein the first operation is a first type of operation, and the fourth operation is a first type of operation.

47. The method according to claim 46 or 47, wherein the first operation and the fourth operation are the same operation.

48. After performing the first operation, a second input is detected via one or more input devices, and a sixth posture different from the first posture is detected. In response to detecting the second input and the sixth attitude, In addition to detecting the second input, in accordance with the determination that the sixth posture has been detected more than a predetermined number of times, Performing the fifth action, The fifth operation is configured to be performed without detecting the second input, In addition to detecting the second input, in accordance with the determination that the sixth posture has not been detected more than the predetermined number of times, Performing the fifth operation described above, The method according to any one of claims 36 to 47, further comprising: discontinuing to configure the fifth operation to be performed without detecting the second input.

49. Before configuring the system to perform the first operation without detecting the first input, one or more input devices are used to detect a seventh posture different from the first posture, The method according to any one of claims 36 to 48, further comprising performing the first action in response to detecting the seventh posture.

50. After configuring the system so that the first operation is performed without detecting the first input, the seventh posture is detected via one or more input devices, The method according to claim 49, further comprising: discontinuing the execution of the first operation in response to the detection of the seventh posture without detecting the first input.

51. After performing the first operation, an eighth posture different from the first posture is detected via one or more input devices, in conjunction with detecting a third input different from the first input. In response to detecting the eighth attitude in conjunction with the third input, Performing a sixth operation that is different from the first operation described above, The sixth operation is configured to be performed without detecting the first input, After performing the sixth operation, a ninth posture is detected via one or more input devices, wherein the ninth posture is the same as the eighth posture. The method according to any one of claims 36 to 50, further comprising performing the sixth operation in response to detecting the ninth posture without detecting the third input.

52. After performing the first operation, a tenth posture different from the first posture is detected via one or more input devices, in conjunction with detecting a fourth input different from the first input. In response to detecting the tenth posture in conjunction with the fourth input, Performing a seventh operation that is different from the first operation described above, To discontinue configuring the seventh operation to be performed without detecting the fourth input, After performing the seventh operation described above, an eleventh posture is detected via one or more input devices, wherein the eleventh posture is the same as the tenth posture described above. The method according to any one of claims 36 to 51, further comprising: discontinuing to perform the seventh operation in response to detecting the eleventh posture without detecting the fourth input.

53. After configuring the system so that the first operation is performed without detecting the input, the first posture is detected via one or more input devices. In response to detecting the first posture, In accordance with the determination that the first operation has been performed without detecting the first input more than a threshold number of times, the execution of the first operation is stopped. The method according to any one of claims 36 to 52, further comprising: performing the first operation in accordance with the determination that the first operation has been performed without detecting the first input a number of times less than the threshold number of times;

54. Before detecting the first posture, the first operation is tracked as having been performed without detecting the input a first number of times. In accordance with the determination that the first posture is detected along with the detection of the first input, the first operation is performed for a second number of times, which is fewer than the first number of times, without detecting the input. The method according to claim 53, wherein, in accordance with the determination that the first posture has been detected in conjunction with the detection of the first input, the first operation is performed for a third number of times greater than the first number of times without detecting the input.

55. After configuring the system so that the first operation is performed without detecting the input, the first posture is detected via one or more input devices. In response to detecting the first posture, In accordance with the determination that a threshold time has elapsed, the execution of the first operation is stopped, The method according to any one of claims 36 to 54, further comprising performing the first operation in accordance with the determination that the threshold time amount has not elapsed.

56. The method according to claim 55, wherein the threshold time amount is a threshold time amount for non-activity.

57. The method according to claim 55 or 56, wherein the threshold time amount is the threshold time amount since the first input was detected.

58. The method according to any one of claims 55 to 57, wherein the threshold time amount is the threshold time amount since the detection of the first posture.

59. The method according to any one of claims 55 to 58, wherein the threshold time is the amount of time since the first posture was detected in conjunction with the detection of the first input.

60. After performing the first operation and configuring the system so that the first operation is performed without detecting the first input, a twelfth posture different from the first posture is detected via one or more input devices without detecting the first input. The method according to any one of claims 36 to 59, further comprising performing the first operation in response to detecting the 12th posture without detecting the first input.

61. A non-temporary computer-readable medium storing one or more programs configured to be executed by one or more processors of a computer system communicating with one or more input devices, wherein the one or more programs include instructions for performing the method according to any one of claims 36 to 60.

62. A computer system that communicates with one or more input devices, One or more processors, A computer system comprising: a memory for storing one or more programs configured to be executed by one or more processors, wherein the one or more programs include instructions for performing the method according to any one of claims 36 to 60.

63. A computer system that communicates with one or more input devices, A computer system comprising means for performing the method described in any one of claims 36 to 60.

64. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more input devices, wherein the one or more programs comprises instructions for performing the method according to any one of claims 36 to 60.

65. A non-temporary computer-readable storage medium for storing one or more programs configured to be executed by one or more processors of a computer system communicating with one or more input devices, wherein the one or more programs are The system detects a first input and a first attitude via one or more input devices. In response to detecting the first input and the first attitude, Perform the first action, The system is configured such that the first operation is executed without detecting the first input, After performing the first operation and configuring the system so that the first operation is performed without detecting the first input, the first attitude is detected via one or more input devices without detecting the first input. A non-temporary computer-readable storage medium containing instructions for executing a first operation in response to detecting a first posture without detecting the first input.

66. A computer system that communicates with one or more input devices, One or more processors, The system comprises a memory that stores one or more programs configured to be executed by one or more processors, and the one or more programs are The system detects a first input and a first attitude via one or more input devices. In response to detecting the first input and the first attitude, Perform the first action, The system is configured such that the first operation is executed without detecting the first input, After performing the first operation and configuring the system so that the first operation is performed without detecting the first input, the first attitude is detected via one or more input devices without detecting the first input. A computer system including an instruction to perform a first action in response to detecting a first posture without detecting the first input.

67. A computer system that communicates with one or more input devices, A means for detecting a first input and a first attitude via one or more input devices, In response to detecting the first input and the first attitude, Means for performing the first operation, Means for configuring the first operation to be performed without detecting the first input, After performing the first operation and configuring the system so that the first operation is performed without detecting the first input, means for detecting the first attitude without detecting the first input via one or more input devices, A computer system comprising means for performing a first operation in response to detecting a first posture without detecting the first input.

68. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system communicating with one or more input devices, wherein the one or more programs are The system detects a first input and a first attitude via one or more input devices. In response to detecting the first input and the first attitude, Perform the first action, The system is configured such that the first operation is executed without detecting the first input, After performing the first operation and configuring the system so that the first operation is performed without detecting the first input, the first attitude is detected via one or more input devices without detecting the first input. A computer program product including an instruction that performs a first action in response to detecting a first posture without detecting the first input.

69. It is a method, In a computer system that communicates with one or more input devices and one or more output devices, To detect input corresponding to a user request via one or more input devices, Upon detecting the input corresponding to the request from the user, The computer system is operating in a first context, and according to the determination that the first context corresponds to a first set of one or more learned characteristics corresponding to the user, the system outputs audio content having a first set of one or more audio characteristics via one or more output devices. A method comprising: outputting the audio content having a second set of one or more audio characteristics different from the first set of one or more audio characteristics via one or more output devices, based on the determination that the computer system is operating in a second context different from the first context, and the second context corresponds to a second set of one or more learned characteristics different from the first set of one or more learned characteristics corresponding to the user.

70. According to the determination that the computer system is currently in a first location, the first set of one or more learned characteristics is a set of one or more learned characteristics corresponding to the first location. The method according to claim 69, wherein, according to the determination that the computer system is currently in a second location different from the first location, the first set of one or more learned characteristics is a set of one or more learned characteristics corresponding to the second location.

71. In accordance with the determination that a user has a first set of one or more user characteristics, the first set of one or more learned characteristics is a set of one or more learned characteristics that corresponds to the first set of one or more user characteristics. The method according to claim 69 or 70, wherein, according to the determination that the user has a second set of one or more user characteristics different from the first set of one or more user characteristics, the first set of one or more learned characteristics is a set of one or more learned characteristics corresponding to the second set of one or more user characteristics.

72. According to the determination that the input is a first input, the first set of one or more learned characteristics is a set of one or more learned characteristics corresponding to the first input. The method according to any one of claims 69 to 71, wherein, according to the determination that the input is a second input different from the first input, the first set of one or more learned characteristics is a set of one or more learned characteristics corresponding to the second input.

73. In accordance with the determination that the first set of one or more learned characteristics corresponding to the user is associated with a first set of one or more audio pitches, the first set of one or more audio characteristics includes a second set of one or more audio pitches. The method according to any one of claims 69 to 72, wherein the first set of one or more audio characteristics includes a fourth set of one or more audio pitches different from the third set of one or more audio pitches, in accordance with a determination that the first set of one or more learned characteristics corresponding to the user is associated with a third set of one or more audio pitches different from the first set of one or more audio pitches.

74. In accordance with the determination that the first set of one or more learned characteristics corresponding to the user is associated with a first set of one or more volume levels, the first set of one or more audio characteristics includes a second set of one or more volume levels. The method according to any one of claims 69 to 73, wherein the first set of one or more audio characteristics includes a fourth set of one or more volume levels different from the third set of one or more volume levels, in accordance with a determination that the first set of one or more learned characteristics corresponding to the user is associated with a third set of one or more volume levels different from the first set of one or more volume levels.

75. In accordance with the determination that the first set of one or more learned characteristics corresponding to the user indicates that the user is associated with a first set of one or more beats, the first set of one or more audio characteristics includes a second set of one or more beats. The method according to any one of claims 69 to 74, further comprising the first set of one or more audio characteristics including a fourth set of one or more beats, which is different from the third set of one or more beats, according to a determination that the first set of one or more learned characteristics corresponding to the user indicates that the user is associated with a third set of one or more beats different from the first set of one or more beats.

76. In accordance with the determination that the first set of one or more learned characteristics corresponding to the user indicates that the user is associated with a first set of one or more tempos, the first set of one or more audio characteristics includes a second set of one or more tempos. The method according to any one of claims 69 to 75, wherein the first set of one or more audio characteristics includes a fourth set of one or more tempos different from the third set of one or more tempos, in accordance with a determination that the first set of one or more learned characteristics corresponding to the user indicates that the user is associated with a third set of one or more tempos different from the first set of one or more tempos.

77. The method according to any one of claims 69 to 76, further comprising outputting audio content having a third set of one or more audio characteristics different from the first set of one or more audio characteristics via one or more output devices before detecting the input corresponding to the request.

78. The method according to any one of claims 69 to 77, wherein the input corresponding to the request is detected while outputting audio content having a fourth set of one or more audio characteristics different from the first set of one or more audio characteristics via one or more output devices.

79. The above requirement is a first requirement, and audio content having the first set of one or more audio characteristics is the first audio content, and the method is To detect an input corresponding to a second request via one or more input devices, In response to detecting the input corresponding to the second request, The method according to any one of claims 69 to 78, further comprising outputting, via one or more output devices, a second audio content having the first set of one or more audio characteristics, which is different from the first audio content, in accordance with the determination that the computer system is operating in the first context and the first context corresponds to the first set of one or more learned characteristics corresponding to the user.

80. The method according to any one of claims 69 to 79, wherein detecting the input corresponding to the request via one or more input devices includes receiving an input including a question via one or more input devices.

81. The method according to any one of claims 69 to 80, wherein detecting the input corresponding to the request via one or more input devices includes receiving an input containing a statement via one or more input devices.

82. The method according to any one of claims 69 to 81, wherein detecting the input corresponding to the request via one or more input devices includes receiving an input including a command via one or more input devices.

83. The method according to any one of claims 69 to 82, wherein detecting the input corresponding to the request via one or more input devices includes receiving an oral input via one or more input devices.

84. The method according to any one of claims 69 to 83, wherein detecting the input corresponding to the request via one or more input devices includes receiving an air gesture via the one or more input devices.

85. The method according to any one of claims 69 to 84, wherein detecting the input corresponding to the request via one or more input devices includes receiving a gaze input via one or more input devices.

86. The aforementioned requirement is a third requirement, and the method is After outputting audio content having the first set of one or more audio characteristics via one or more output devices, the system operates in the first context, and then transitions to a third context different from the first context, the third context corresponding to the first set of one or more learned characteristics. While operating in the third context, detect an input corresponding to a fourth request that is different from the third request, The method according to any one of claims 69 to 85, further comprising: detecting the input corresponding to the fourth request while operating in the third context, outputting the audio content having a fifth set of one or more audio characteristics different from the first set of one or more audio characteristics via one or more output devices.

87. In response to detecting the input corresponding to the request, The method according to any one of claims 69 to 86, further comprising outputting audio content via one or more output devices having a sixth set of one or more audio characteristics different from the first set of one or more audio characteristics and the second set of one or more audio characteristics, in accordance with the determination that the computer system is operating in a first context and the first context corresponds to one or more learned characteristics corresponding to a second user, wherein the second user is different from the first user.

88. A non-temporary computer-readable medium for storing one or more programs configured to be executed by one or more processors of a computer system communicating with one or more input devices and one or more output devices, wherein the one or more programs include instructions for performing the method according to any one of claims 69 to 87.

89. A computer system that communicates with one or more input devices and one or more output devices, One or more processors, A computer system comprising: a memory for storing one or more programs configured to be executed by one or more processors, wherein the one or more programs include instructions for performing the method according to any one of claims 69 to 87.

90. A computer system that communicates with one or more input devices and one or more output devices, A computer system comprising means for performing the method described in any one of claims 69 to 87.

91. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system communicating with one or more input devices and one or more output devices, wherein the one or more programs include instructions for performing the method according to any one of claims 69 to 87.

92. A non-temporary computer-readable storage medium for storing one or more programs configured to be executed by one or more processors of a computer system communicating with one or more input devices and one or more output devices, wherein the one or more programs are The system detects input corresponding to a user request via one or more input devices. Upon detecting the input corresponding to the request from the user, The computer system is operating in a first context, and according to the determination that the first context corresponds to a first set of one or more learned characteristics corresponding to the user, it outputs audio content having a first set of one or more audio characteristics via one or more output devices. A non-temporary computer-readable storage medium, including instructions for outputting the audio content having a second set of one or more audio characteristics different from the first set of one or more audio characteristics, via one or more output devices, according to a determination that the computer system is operating in a second context different from the first context, and the second context corresponds to a second set of one or more learned characteristics different from the first set of one or more learned characteristics corresponding to the user.

93. A computer system that communicates with one or more input devices and one or more output devices, One or more processors, The system comprises a memory that stores one or more programs configured to be executed by one or more processors, and the one or more programs are The system detects input corresponding to a user request via one or more input devices. Upon detecting the input corresponding to the request from the user, The computer system is operating in a first context, and according to the determination that the first context corresponds to a first set of one or more learned characteristics corresponding to the user, it outputs audio content having a first set of one or more audio characteristics via one or more output devices. A computer system including instructions to output audio content having a second set of one or more audio characteristics different from the first set of one or more audio characteristics via one or more output devices, according to a determination that the computer system is operating in a second context different from the first context, and that the second context corresponds to a second set of one or more learned characteristics different from the first set of one or more learned characteristics corresponding to the user.

94. A computer system that communicates with one or more input devices and one or more output devices, means for detecting input corresponding to a user request via one or more input devices, Upon detecting the input corresponding to the request from the user, A means for outputting audio content having one or more audio characteristics via one or more output devices, in accordance with the determination that the computer system is operating in a first context and that the first context corresponds to a first set of one or more learned characteristics corresponding to the user, A computer system comprising: means for outputting audio content having a second set of one or more audio characteristics different from the first set of one or more audio characteristics via one or more output devices, according to a determination that the computer system is operating in a second context different from the first context, and that the second context corresponds to a second set of one or more learned characteristics different from the first set of one or more learned characteristics corresponding to the user.

95. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system communicating with one or more input devices and one or more output devices, wherein the one or more programs are The system detects input corresponding to a user request via one or more input devices. Upon detecting the input corresponding to the request from the user, The computer system is operating in a first context, and according to the determination that the first context corresponds to a first set of one or more learned characteristics corresponding to the user, it outputs audio content having a first set of one or more audio characteristics via one or more output devices. A computer program product including instructions to output the audio content having a second set of one or more audio characteristics different from the first set of one or more audio characteristics via one or more output devices, according to the determination that the computer system is operating in a second context different from the first context, and the second context corresponds to a second set of one or more learned characteristics different from the first set of one or more learned characteristics corresponding to the user.

96. It is a method, In a computer system that communicates with one or more input devices and audio generation components, To detect a first input via one or more input devices, After detecting the first input, In accordance with the determination that the first input corresponds to a first set of one or more audio characteristics, a first audio content having a second set of one or more audio characteristics is output via the audio generation component. A method comprising: outputting a second audio content having a fourth set of one or more audio characteristics different from the second set of one or more audio characteristics, via the audio generation component, in accordance with the determination that the first input corresponds to a third set of one or more audio characteristics different from the first set of one or more audio characteristics.

97. The method according to claim 96, wherein the first audio content includes a first content, and the second audio content includes a second content different from the first content.

98. The method according to claim 96, wherein the first audio content includes a third content, and the second audio content includes the third content.

99. The method according to any one of claims 96 to 98, wherein the second set of one or more audio characteristics includes pitch.

100. The method according to any one of claims 96 to 99, wherein the second set of one or more audio characteristics includes volume.

101. The method according to any one of claims 96 to 100, wherein the second set of one or more audio characteristics includes rhythm.

102. The method according to any one of claims 96 to 101, wherein the second set of one or more audio characteristics includes tempo.

103. The computer system includes a first display component, and the method is The first display component is used to display user interface elements in a first manner, The method according to any one of claims 96 to 102, further comprising: detecting the first input and, in accordance with the determination that the first input corresponds to one or more audio characteristics, displaying the user interface elements via the first display component in a second manner different from the first manner.

104. The method according to any one of claims 96 to 103, wherein the first input corresponds to a request, and the first audio content is a first response to the request.

105. The method according to any one of claims 96 to 103, wherein the first input corresponds to a statement, and the first audio content corresponds to the statement.

106. The method according to any one of claims 96 to 105, wherein, in response to the detection of the first input and in accordance with the determination that the first input corresponds to the first set of one or more audio characteristics, the first audio content is output with the second set of one or more audio characteristics.

107. The method according to any one of claims 96 to 106, further comprising detecting a second input different from the first input via one or more input devices after detecting the first input, and outputting the first audio content in the second set of one or more audio characteristics in response to the detection of the second input and in accordance with the determination that the first input corresponds to the first set of one or more audio characteristics.

108. To detect a third input different from the first input via one or more input devices, The method according to any one of claims 96 to 107, further comprising: detecting the third input; outputting a fourth audio content having a fifth set of one or more audio characteristics via the audio generation component.

109. After detecting the first input, a fourth input different from the first input is detected via one or more input devices, The method according to any one of claims 96 to 108, further comprising: detecting the fourth input, outputting a fifth audio content having a sixth set of one or more audio characteristics via the audio generation component, wherein the sixth set of one or more audio characteristics is selected based on the fourth input and the first input.

110. The method according to any one of claims 96 to 109, wherein the first input includes oral input.

111. The method according to any one of claims 96 to 110, wherein the first input includes an air gesture.

112. The method according to any one of claims 96 to 111, wherein the first input includes a gaze input.

113. The method according to any one of claims 96 to 112, wherein the first input includes touch input.

114. The method according to any one of claims 96 to 113, wherein the first input includes the movement of a user within the environment.

115. The method according to any one of claims 96 to 114, wherein the first set of one or more audio characteristics is the second set of one or more audio characteristics.

116. The method according to any one of claims 96 to 115, wherein the first set of one or more audio characteristics is different from the second set of one or more audio characteristics.

117. The method according to any one of claims 96 to 116, further comprising outputting a sixth audio content via the audio generation component having a seventh set of one or more audio characteristics different from the second set of one or more audio characteristics and the third set of one or more audio characteristics, before detecting the first input.

118. The method according to claim 117, further comprising detecting the first input and, in accordance with the determination that the first input corresponds to the seventh set of one or more audio characteristics, outputting a seventh audio content having the seventh set of one or more audio characteristics via the audio generation component.

119. The computer system communicates with the display components, and the method is The method according to any one of claims 96 to 118, further comprising displaying first visual content via the display component while the first audio content is being output.

120. The computer system communicates with the mobile component, and the method is After detecting the first input, Moving a part of the computer system in a first pattern of movement via the moving component, in accordance with the determination that the first input corresponds to the first set of one or more audio characteristics. The method according to any one of claims 96 to 119, further comprising moving the portion of the computer system via the moving component in a second pattern of movement different from the first pattern of movement, according to a determination that the first input corresponds to a third set of one or more audio characteristics.

121. In accordance with the determination that the first input has first redundancy, the first audio content has first redundancy, The method according to any one of claims 96 to 120, wherein the first audio content has the second redundancy, in accordance with the determination that the first input has a second redundancy different from the first redundancy.

122. A non-temporary computer-readable medium storing one or more programs configured to be executed by one or more processors of a computer system communicating with one or more input devices and audio generation components, wherein the one or more programs include instructions for performing the method according to any one of claims 96 to 121.

123. A computer system that communicates with one or more input devices and audio generation components, One or more processors, A computer system comprising: a memory for storing one or more programs configured to be executed by one or more processors, wherein the one or more programs include instructions for performing the method according to any one of claims 96 to 121.

124. A computer system that communicates with one or more input devices and audio generation components, A computer system comprising means for performing the method described in any one of claims 96 to 121.

125. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more input devices and audio generation components, wherein the one or more programs comprises instructions for performing the method according to any one of claims 96 to 121.

126. A non-temporary computer-readable storage medium for storing one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more input devices and audio generation components, wherein the one or more programs are The first input is detected via one or more input devices. After detecting the first input, In accordance with the determination that the first input corresponds to a first set of one or more audio characteristics, the audio generation component outputs a first audio content having a second set of one or more audio characteristics. A non-temporary computer-readable storage medium including instructions for outputting a second audio content having a fourth set of one or more audio characteristics different from the second set of one or more audio characteristics, via the audio generation component, according to a determination that the first input corresponds to a third set of one or more audio characteristics different from the first set of one or more audio characteristics.

127. A computer system that communicates with one or more input devices and audio generation components, One or more processors, The system comprises a memory that stores one or more programs configured to be executed by one or more processors, and the one or more programs are The first input is detected via one or more input devices. After detecting the first input, In accordance with the determination that the first input corresponds to a first set of one or more audio characteristics, the audio generation component outputs a first audio content having a second set of one or more audio characteristics. A computer system including instructions to output, via the audio generation component, a second audio content having a fourth set of one or more audio characteristics different from the second set of one or more audio characteristics, based on the determination that the first input corresponds to a third set of one or more audio characteristics different from the first set of one or more audio characteristics.

128. A computer system that communicates with one or more input devices and audio generation components, A means for detecting a first input via one or more input devices, After detecting the first input, A means for outputting a first audio content having a second set of one or more audio characteristics via the audio generation component, in accordance with the determination that the first input corresponds to a first set of one or more audio characteristics, A computer system comprising: means for outputting a second audio content having a fourth set of one or more audio characteristics different from the second set of one or more audio characteristics, via the audio generation component, according to a determination that the first input corresponds to a third set of one or more audio characteristics different from the first set of one or more audio characteristics.

129. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more input devices and audio generation components, wherein the one or more programs are The first input is detected via one or more input devices. After detecting the first input, In accordance with the determination that the first input corresponds to a first set of one or more audio characteristics, the audio generation component outputs a first audio content having a second set of one or more audio characteristics. A computer program product including instructions to output a second audio content having a fourth set of one or more audio characteristics different from the second set of one or more audio characteristics, via the audio generation component, according to a determination that the first input corresponds to a third set of one or more audio characteristics different from the first set of one or more audio characteristics.

130. It is a method, In a computer system having one or more input devices and mobile components, Detecting a request to perform an action via one or more input devices, In response to detecting the request to perform the aforementioned operation, Before the aforementioned operation is performed, in accordance with the determination that a user in the environment should perform a first action within the environment, the user is moved in a first manner via the movement component before the operation is performed. A method comprising: canceling the movement in the first manner via the movement component, based on a determination that the user in the environment should perform a second action different from the first action in the environment before the operation is performed.

131. In response to detecting the request to perform the aforementioned operation, The method according to claim 130, further comprising moving the moving component in a second manner different from the first manner, in accordance with a determination that the user in the environment should perform the second action in the environment before the operation described above is performed.

132. The method according to claim 131, wherein the computer system moves in a first direction and moves in the first manner, and the computer system moves in a second direction different from the first direction and moves in the second manner.

133. In response to detecting the request to perform the aforementioned operation, The method according to claim 131, further comprising moving the user in the environment in a third manner different from the first manner via the moving component, in accordance with the determination that the user in the environment should not perform a second action in the environment different from the first action in the environment before the operation is performed.

134. The method according to claim 133, wherein the computer system moves in a third direction and moves in the first manner, and the computer system moves in a fourth direction different from the third direction and moves in the third manner.

135. The method according to any one of claims 130 to 134, wherein the computer system moves in the first manner by rotating in the rotational direction.

136. The computer system moves at individual speeds, according to any one of claims 130 to 135.

137. The method according to any one of claims 130 to 136, wherein the computer system moves along individual paths and moves in the first manner.

138. The method according to any one of claims 130 to 137, wherein moving in the first manner before performing the operation includes performing two or more separate sets of moves.

139. The computer system is located within the environment and can be moved in the first manner. In accordance with the determination that the environment has one or more characteristics, one or more sets of movements are performed. The method according to any one of claims 130 to 138, comprising: performing a second set of one or more moves different from the first set of one or more moves, according to a determination that the environment has a second set of one or more characteristics different from the first set of one or more characteristics.

140. The computer system is located within the environment and can be moved in the first manner. The first action is to perform a third set of one or more moves according to the determination that it has a first set of one or more attributes, The method according to any one of claims 130 to 139, comprising: performing a fourth set of one or more moves different from a third set of one or more moves, based on a determination that the environment has a second set of one or more attributes different from the first set of one or more attributes.

141. In response to detecting the request to perform the aforementioned operation, Before the aforementioned operation is performed, an indication that the first action should be performed is output via one or more output devices, in accordance with the determination that the user in the environment should perform the first action in the environment. The method according to any one of claims 130 to 140, further comprising: outputting an indication via one or more output devices that the second action should be performed, in accordance with a determination that the user in the environment should perform the second action.

142. The method according to any one of claims 130 to 141, wherein the first method is a method of movement corresponding to the first action.

143. A non-temporary computer-readable medium for storing one or more programs configured to be executed by one or more processors of a computer system having one or more input devices and mobile components, wherein the one or more programs include instructions for performing the method according to any one of claims 130 to 142.

144. A computer system having one or more input devices and mobile components, One or more processors, A computer system comprising: a memory for storing one or more programs configured to be executed by one or more processors, wherein the one or more programs include instructions for performing the method according to any one of claims 130 to 142.

145. A computer system having one or more input devices and mobile components, A computer system comprising means for performing the method described in any one of claims 130 to 142.

146. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system having one or more input devices and mobile components, wherein the one or more programs comprises instructions for performing the method according to any one of claims 130 to 142.

147. A non-temporary computer-readable storage medium for storing one or more programs configured to be executed by one or more processors of a computer system having one or more input devices and mobile components, wherein the one or more programs are Detects a request to perform an action via one or more input devices, In response to detecting the request to perform the aforementioned operation, Before the aforementioned operation is performed, in accordance with the determination that a user in the environment should perform a first action within the environment, the user is moved in a first manner via the movement component before the operation is performed. A non-temporary computer-readable storage medium including an instruction to cancel moving via the moving component in the first manner, based on a determination that the user in the environment should perform a second action different from the first action in the environment before the operation is performed.

148. A computer system having one or more input devices and mobile components, One or more processors, The system comprises a memory that stores one or more programs configured to be executed by one or more processors, and the one or more programs are Detects a request to perform an action via one or more input devices, In response to detecting the request to perform the aforementioned operation, Before the aforementioned operation is performed, in accordance with the determination that a user in the environment should perform a first action within the environment, the user is moved in a first manner via the movement component before the operation is performed. A computer system including an instruction to cancel moving via the moving component in the first manner, based on a determination that the user in the environment should perform a second action different from the first action in the environment before the operation is performed.

149. A computer system having one or more input devices and mobile components, Means for detecting a request to perform an action via one or more input devices, In response to detecting the request to perform the aforementioned operation, Before the aforementioned operation is performed, means for moving the user in the environment in a first manner via the moving component before performing the aforementioned operation, in accordance with the determination that the user in the environment should perform a first action within the environment. A computer system comprising: means for canceling movement in the first manner via the movement component, based on a determination that the user in the environment should perform a second action different from the first action in the environment before the operation is performed.

150. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system having one or more input devices and mobile components, wherein the one or more programs are Detects a request to perform an action via one or more input devices, In response to detecting the request to perform the aforementioned operation, Before the aforementioned operation is performed, in accordance with the determination that a user in the environment should perform a first action within the environment, the user is moved in a first manner via the movement component before the operation is performed. A computer program product including an instruction to cancel moving via the moving component in the first manner, based on a determination that the user in the environment should perform a second action different from the first action in the environment before the operation is performed.

151. It is a method, In a computer system having one or more input devices and one or more output devices, To detect the user's intent without detecting explicit instructions to perform an action determined to be the user's intent via one or more input devices, Without detecting the explicit instruction to perform the action determined to be the detected intent, in response to detecting the user's intent, In accordance with the determination that the context corresponding to the intent is a first type of context, output a first set of one or more proposed actions for performing the operation via one or more output devices, A method comprising: determining that the context corresponding to the intent is a second type of context different from the first type of context, and then ceasing to output the first set of one or more proposed actions for performing the operation.

152. Without detecting the explicit instruction to perform the action determined to be the detected intent, in response to detecting the user's intent, The method according to claim 151, further comprising, in accordance with the determination that the context corresponding to the intent is a third type of context different from the first type of context, outputting a second set of one or more proposed actions different from the first set of one or more proposed actions via one or more output devices in order to perform the operation.

153. The computer system communicates with a first type of output device and a second type of output device that is different from the first type of output device. The first set of one or more proposed actions for performing the said operation includes a first proposed action for performing the said operation and a second proposed action for performing the said operation. Outputting the first set of one or more proposed Actions for performing the operation via one or more output devices is: To provide an output of the first proposed action in order to perform the operation via the first type of output device, The method according to claim 151 or 152, comprising providing an output of the second proposed action to perform the operation via the second type of output device.

154. While outputting the first set of one or more proposed actions for performing the said operation, a first input directed to the one or more proposed actions for performing the said operation is detected. The method according to any one of claims 151 to 153, further comprising detecting the first input directed to the one or more proposed actions for performing the operation, and performing the first operation corresponding to the one or more proposed actions.

155. While outputting the first set of one or more proposed actions for performing the said operation, a second input directed to the one or more proposed actions for performing the said operation is detected. In response to detecting the second input directed to one or more proposed actions for performing the aforementioned operation, Performing a second action corresponding to one or more of the proposed actions, The method according to any one of claims 151 to 154, further comprising performing a third action different from the second action, which corresponds to one or more of the proposed actions.

156. The method according to any one of claims 151 to 155, wherein the computer system communicates with a display component, and outputting the first set of one or more proposed actions includes displaying a representation of an application configured to perform the actions via the display component.

157. The operation is the fourth operation, and in response to the detection of the user's intent, a fifth operation different from the fourth operation is performed without detecting the explicit instruction to perform the operation which has been determined to be the detected intent, and the method is, Detecting the user's intent while detecting an explicit instruction to perform the first action, The method according to any one of claims 151 to 156, further comprising detecting the user's intent while detecting an explicit instruction to perform the fourth action, and then ceasing to perform the fifth action.

158. Performing the sixth operation described above means In accordance with the determination that the sixth operation includes the first type of response characteristics, the system moves in a manner that indicates agreement with the user, The method according to claim 157, further comprising: determining that the sixth operation includes a second type of response characteristic different from the first type of response characteristic, and then ceasing to move in the manner that indicates agreement with the user.

159. The express instructions herein, without any questions, are the method according to any one of claims 151 to 158.

160. The express instructions include questions, as described in any one of claims 151 to 159.

161. The method according to any one of claims 151 to 160, wherein the explicit instruction includes a command.

162. The method according to any one of claims 151 to 161, further comprising performing the operation in response to detecting the user's intent and in accordance with the determination that the context corresponding to the intent is of the first type of context.

163. The method according to any one of claims 151 to 162, further comprising performing the operation in conjunction with outputting a first set of one or more proposed actions, and in conjunction with determining that a predetermined amount of time has elapsed.

164. The method according to claim 162 or 163, wherein the operation is performed based on at least a third action within the first set of one or more proposed actions.

165. The method according to claim 164, wherein the operation is performed based on at least a fourth action, which is different from the third action, within the first set of one or more proposed actions.

166. In response to the detection of the user's intent without detecting the explicit instruction to perform the action determined to be the detected intent, and in accordance with the determination that the user's intent corresponds to the first subject, Outputting the first response, which includes one or more indications of sources on which the first response is based, via one or more output devices, The method according to any one of claims 151 to 165, further comprising outputting a second response different from the first response via one or more output devices, wherein the second response does not include an indication of one or more sources on which the second response is based.

167. The method according to claim 166, wherein the one or more proposed actions include an expression of one or more steps for resolving the detected intent.

168. A non-temporary computer-readable medium for storing one or more programs configured to be executed by one or more processors of a computer system having one or more input devices and one or more output devices, wherein the one or more programs include instructions for performing the method according to any one of claims 151 to 167.

169. A computer system having one or more input devices and one or more output devices, One or more processors, A computer system comprising: a memory for storing one or more programs configured to be executed by one or more processors, wherein the one or more programs include instructions for performing the method according to any one of claims 151 to 167.

170. A computer system having one or more input devices and one or more output devices, A computer system comprising means for performing the method described in any one of claims 151 to 167.

171. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system having one or more input devices and one or more output devices, wherein the one or more programs comprises instructions for performing the method according to any one of claims 151 to 167.

172. A non-temporary computer-readable storage medium for storing one or more programs configured to be executed by one or more processors of a computer system having one or more input devices and one or more output devices, wherein the one or more programs are The system detects the user's intent without detecting explicit instructions to perform an action determined to be the user's intent via one or more input devices. Without detecting the explicit instruction to perform the action determined to be the detected intent, in response to detecting the user's intent, In accordance with the determination that the context corresponding to the intent is a first type of context, a first set of one or more proposed actions for performing the operation is output via one or more output devices. A non-temporary computer-readable storage medium including an instruction that, upon determination that the context corresponding to the intent is a second type of context different from the first type of context, refrains from outputting the first set of one or more proposed actions for performing the operation.

173. A computer system having one or more input devices and one or more output devices, One or more processors, The system comprises a memory that stores one or more programs configured to be executed by one or more processors, and the one or more programs are The system detects the user's intent without detecting explicit instructions to perform an action determined to be the user's intent via one or more input devices. Without detecting the explicit instruction to perform the action determined to be the detected intent, in response to detecting the user's intent, In accordance with the determination that the context corresponding to the intent is a first type of context, a first set of one or more proposed actions for performing the operation is output via one or more output devices. A computer system including an instruction that, upon determination that the context corresponding to the intent is a second type of context different from the first type of context, refrains from outputting the first set of one or more proposed actions for performing the operation.

174. A computer system having one or more input devices and one or more output devices, Means for detecting the user's intent without detecting explicit instructions to perform an action determined to be the user's intent via one or more input devices, Without detecting the explicit instruction to perform the action determined to be the detected intent, in response to detecting the user's intent, A means for outputting a first set of one or more proposed actions for performing the operation via one or more output devices, in accordance with the determination that the context corresponding to the intent is a first type of context, A computer system comprising: means for refraining from outputting the first set of one or more proposed actions for performing the operation, based on the determination that the context corresponding to the intent is a second type of context different from the first type of context.

175. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system having one or more input devices and one or more output devices, wherein the one or more programs are The system detects the user's intent without detecting explicit instructions to perform an action determined to be the user's intent via one or more input devices. Without detecting the explicit instruction to perform the action determined to be the detected intent, in response to detecting the user's intent, In accordance with the determination that the context corresponding to the intent is a first type of context, a first set of one or more proposed actions for performing the operation is output via one or more output devices. A computer program product that includes instructions to refrain from outputting the first set of one or more proposed actions for performing the operation, based on the determination that the context corresponding to the intent is a second type of context different from the first type of context.

176. It is a method, In a computer system that communicates with one or more input devices and one or more output devices, The detection of user input via one or more input devices, After detecting the input from the user, without detecting a request to provide a suggestion, In accordance with the determination that the current context is the first context, a first proposal is output via one or more output devices, wherein the first proposal is based on the input from the user. A method comprising: determining that the current context is not the first context, and ceasing to output the first proposal via one or more output devices.

177. The method according to claim 176, wherein the input from the user is an implicit request.

178. The method according to claim 176 or 177, wherein the input from the user corresponds to a preference for media content.

179. The method according to any one of claims 176 to 178, wherein the one or more output devices include a first display component, and outputting the first proposal includes displaying a user interface including the first proposal via the first display component, the user interface not displayed while detecting the input from the user.

180. The method according to claim 179, wherein the user interface corresponds to a virtual assistant.

181. The first proposal is the method according to any one of claims 176 to 180, based on one or more prior interactions with the user other than the input from the user.

182. The first proposal is the method according to any one of claims 176 to 181, which was not included in the input from the user.

183. While the first proposal is being output, an input corresponding to the first proposal is detected via one or more input devices, The method according to any one of claims 176 to 182, further comprising detecting the input corresponding to the first proposal, and performing an action corresponding to the first proposal, wherein the indication of the action is not included in the input from the user.

184. The method according to any one of claims 176 to 183, further comprising outputting a representation of a virtual assistant via one or more output devices while outputting the first proposal.

185. After detecting the input from the user, without detecting a request to provide suggestions for what the user should do, The method according to any one of claims 175 to 184, further comprising outputting a second suggestion for the user to do via one or more output devices, in accordance with the determination that the current context is the first context, wherein the second suggestion differs from the first suggestion, and the second suggestion is based on the input from the user.

186. The second proposal is the method according to any one of claims 176 to 185, which is output simultaneously with the first proposal.

187. A non-temporary computer-readable medium for storing one or more programs configured to be executed by one or more processors of a computer system having one or more input devices and one or more output devices, wherein the one or more programs include instructions for performing the method according to any one of claims 176 to 186.

188. A computer system having one or more input devices and one or more output devices, One or more processors, A computer system comprising: a memory for storing one or more programs configured to be executed by one or more processors, wherein the one or more programs include instructions for performing the method according to any one of claims 176 to 186.

189. A computer system having one or more input devices and one or more output devices, A computer system comprising means for performing the method described in any one of claims 176 to 186.

190. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system having one or more input devices and one or more output devices, wherein the one or more programs comprises instructions for performing the method according to any one of claims 176 to 186.

191. A non-temporary computer-readable storage medium for storing one or more programs configured to be executed by one or more processors of a computer system having one or more input devices and one or more output devices, wherein the one or more programs are The system detects user input via one or more input devices. After detecting the input from the user, without detecting a request to provide a suggestion, In accordance with the determination that the current context is the first context, a first proposal is output via one or more output devices, wherein the first proposal is based on the input from the user. A non-temporary computer-readable storage medium including an instruction to stop outputting the first proposal via one or more output devices, in accordance with the determination that the current context is not the first context.

192. A computer system having one or more input devices and one or more output devices, One or more processors, The system comprises a memory that stores one or more programs configured to be executed by one or more processors, and the one or more programs are The system detects user input via one or more input devices. After detecting the input from the user, without detecting a request to provide a suggestion, In accordance with the determination that the current context is the first context, a first proposal is output via one or more output devices, wherein the first proposal is based on the input from the user. A computer system including an instruction to stop outputting the first proposal via one or more output devices, in accordance with the determination that the current context is not the first context.

193. A computer system having one or more input devices and one or more output devices, Means for detecting user input via one or more input devices, After detecting the input from the user, without detecting a request to provide a suggestion, In accordance with the determination that the current context is the first context, means for outputting a first proposal, which is based on the input from the user, via one or more output devices, A computer system comprising: means for ceasing to output the first proposal via one or more output devices in accordance with the determination that the current context is not the first context.

194. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system having one or more input devices and one or more output devices, wherein the one or more programs are The system detects user input via one or more input devices. After detecting the input from the user, without detecting a request to provide a suggestion, In accordance with the determination that the current context is the first context, a first proposal is output via one or more output devices, wherein the first proposal is based on the input from the user. A computer program product that includes instructions to stop outputting the first proposal via one or more output devices, in accordance with the determination that the current context is not the first context.

195. It is a method, In a computer system that communicates with one or more input devices and one or more output devices, The system detects input from a first user via one or more input devices, wherein the input includes identification information of one or more users. After detecting the aforementioned input, a second user different from the first user is detected via one or more input devices, Upon detecting the second user, In accordance with the determination that the second user corresponds to the set of identification information of one or more users, the first acknowledgment directed to the second user is output via one or more output devices, A method comprising: outputting a second acknowledgment directed to the second user via one or more output devices, in accordance with a determination that the second user does not correspond to the identification information corresponding to the set of one or more users, wherein the second acknowledgment is different from the first acknowledgment.

196. The method according to claim 195, wherein the identification information corresponds to one or more sets of characteristics corresponding to the set of one or more users, and according to the determination that the second user matches the set of one or more characteristics, the second user corresponds to the identification information of the set of one or more users, and according to the determination that the second user does not match the set of one or more characteristics, the second user does not correspond to the identification information of the set of one or more users.

197. The method according to claim 195 or 196, wherein the set of one or more characteristics includes a set of one or more visually identifiable features.

198. The method according to any one of claims 195 to 197, wherein the identification information includes names corresponding to the set of one or more users, and according to a determination that the second user corresponds to the name, the second user corresponds to the identification information of the set of one or more users, and according to a determination that the second user does not correspond to the name, the second user does not correspond to the identification information of the set of one or more users.

199. The method according to claim 198, wherein detecting the second user includes detecting, via one or more input devices, an input containing the name corresponding to the set of one or more users.

200. The method according to any one of claims 195 to 199, wherein the input from the first user is detected while the second user is not detected.

201. The method according to any one of claims 195 to 200, wherein the input is an audible input.

202. The method according to any one of claims 195 to 201, wherein the input from the first user includes a first indication of a first action to be performed when one or more users from the set of one or more users are detected.

203. The input is a first input, and the method is The method according to any one of claims 195 to 202, further comprising detecting a second input from the first user via the one or more input devices, the second input being different from the first input, the second input being different from the first input.

204. The method according to claim 203, wherein the second indication of the second operation includes the movement of the first user.

205. The method according to claim 204, wherein the first acknowledgment is an expression of the movement.

206. The method according to any one of claims 195 to 205, wherein the input includes non-verbal input.

207. The method according to any one of claims 195 to 206, wherein the first acknowledgment includes a first audio characteristic, and the second acknowledgment includes a second audio characteristic different from the first audio characteristic.

208. The method according to claim 207, wherein the first audio characteristic includes outputting audio in a first language, and the second audio characteristic includes outputting audio in a second language different from the first language.

209. The method according to any one of claims 195 to 208, wherein the first acknowledgment includes a first movement, and the second acknowledgment includes a second movement different from the first movement.

210. The method according to any one of claims 195 to 209, wherein the first acknowledgment includes a first visual characteristic, and the second acknowledgment includes a second visual characteristic different from the first visual characteristic.

211. The set of one or more users is a first set of one or more users, and the method is To detect a third input from a third user via one or more input devices, wherein the third input includes identification information of a second set of one or more users that is different from the first set of one or more users, After detecting the third input, a fourth user is detected via one or more input devices, Upon detecting the fourth user, In accordance with the determination that the fourth user corresponds to the second set of identification information of one or more users, a third acknowledgment directed to the fourth user is output via one or more output devices, The method according to any one of claims 195 to 210, further comprising: outputting a fourth acknowledgment directed to the fourth user via one or more output devices, in accordance with the determination that the fourth user does not correspond to the second set of identification information of one or more users, wherein the fourth acknowledgment is different from the third acknowledgment.

212. The first user is detected via one or more input devices, The method according to any one of claims 195 to 211, further comprising, in response to detecting the first user, outputting a fifth acknowledgment directed to the first user via one or more output devices, wherein the fifth acknowledgment is different from the first acknowledgment and the second acknowledgment.

213. A non-temporary computer-readable medium for storing one or more programs configured to be executed by one or more processors of a computer system communicating with one or more input devices and one or more output devices, wherein the one or more programs include instructions for performing the method according to any one of claims 195 to 212.

214. A computer system that communicates with one or more input devices and one or more output devices, One or more processors, A computer system comprising: a memory for storing one or more programs configured to be executed by one or more processors, wherein the one or more programs include instructions for performing the method according to any one of claims 195 to 213.

215. A computer system that communicates with one or more input devices and one or more output devices, A computer system comprising means for performing the method described in any one of claims 195 to 214.

216. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system communicating with one or more input devices and one or more output devices, wherein the one or more programs include instructions for performing the method according to any one of claims 195 to 215.

217. A non-temporary computer-readable storage medium for storing one or more programs configured to be executed by one or more processors of a computer system communicating with one or more input devices and one or more output devices, wherein the one or more programs are The system detects input from a first user via one or more input devices, wherein the input includes identification information of one or more users. After detecting the input, a second user different from the first user is detected via one or more input devices. Upon detecting the second user, In accordance with the determination that the second user corresponds to the set of identification information of one or more users, a first acknowledgment directed to the second user is output via one or more output devices. A non-temporary computer-readable storage medium including an instruction that outputs a second acknowledgment directed to the second user via one or more output devices, in accordance with the determination that the second user does not correspond to the identification information corresponding to the set of one or more users, wherein the second acknowledgment is different from the first acknowledgment.

218. A computer system that communicates with one or more input devices and one or more output devices, One or more processors, The system comprises a memory that stores one or more programs configured to be executed by one or more processors, and the one or more programs are The system detects input from a first user via one or more input devices, wherein the input includes identification information of one or more users. After detecting the input, a second user different from the first user is detected via one or more input devices. Upon detecting the second user, In accordance with the determination that the second user corresponds to the set of identification information of one or more users, a first acknowledgment directed to the second user is output via one or more output devices. A computer system including an instruction to output a second acknowledgment directed to the second user via one or more output devices, in accordance with a determination that the second user does not correspond to the identification information corresponding to the set of one or more users, wherein the second acknowledgment is different from the first acknowledgment.

219. A computer system that communicates with one or more input devices and one or more output devices, The means for detecting input from a first user via one or more input devices, wherein the input includes identification information of one or more users. After detecting the aforementioned input, means for detecting a second user different from the first user via one or more input devices, Upon detecting the second user, A means for outputting a first acknowledgment directed to the second user via one or more output devices, in accordance with the determination that the second user corresponds to the set of identification information of one or more users, A computer system comprising: means for outputting a second acknowledgment directed to the second user via one or more output devices, in accordance with a determination that the second user does not correspond to the identification information corresponding to the set of one or more users, wherein the second acknowledgment is different from the first acknowledgment.

220. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system communicating with one or more input devices and one or more output devices, wherein the one or more programs are The system detects input from a first user via one or more input devices, wherein the input includes identification information of one or more users. After detecting the input, a second user different from the first user is detected via one or more input devices. Upon detecting the second user, In accordance with the determination that the second user corresponds to the set of identification information of one or more users, a first acknowledgment directed to the second user is output via one or more output devices. A computer program product including an instruction to output a second acknowledgment directed to the second user via one or more output devices, in accordance with a determination that the second user does not correspond to the identification information corresponding to the set of one or more users, wherein the second acknowledgment is different from the first acknowledgment.

221. It is a method, In a computer system that communicates with one or more input devices and one or more output devices, To detect a first set of one or more inputs, including an indication of a first context and an indication of a first set of one or more movements, via one or more input devices, After detecting the first set of one or more inputs, the occurrence of individual contexts is detected via the one or more input devices, In response to detecting the occurrence of the aforementioned individual context, In accordance with the determination that the individual context is the first context, output a representation of the first set of one or more movements via the one or more output devices, A method comprising: determining that the individual context is a second context different from the first context, and then ceasing to output the representation of the first set of one or more moves via the one or more output devices.

222. The first context includes the identification of a first set of one or more users, and detecting the individual context includes detecting a separate set of one or more users via the one or more input devices, and in response to detecting the individual context, According to the determination that the individual set of one or more users is the first set of one or more users, the individual context is the first context, The method according to claim 221, wherein, according to the determination that the individual set of one or more users is not the first set of one or more users, the individual context is not the first context.

223. The method according to claim 222, wherein the first set of one or more users is the first user.

224. The method according to claim 222, wherein the first set of one or more users corresponds to two or more users.

225. The indication of the first context includes identification information of the user type from the first set of one or more users, and in response to detecting the individual context, According to the determination that the individual set of one or more users is of the type of user, the individual context is the first context, The method according to any one of claims 221 to 224, wherein, according to the determination that the individual set of one or more users is not of the type of user, the individual context is not the first context.

226. The detection of the individual context includes detecting a distinct set of one or more user characteristics via the one or more input devices, and in response to the detection of the individual context, According to the determination that the individual set of one or more characteristics is a first set of one or more characteristics, the individual context is the first context, The method according to any one of claims 221 to 225, wherein, according to the determination that the individual set of one or more characteristics is not the first set of one or more characteristics, the individual context is not the first context.

227. The method according to claim 226, wherein the first set of one or more characteristics includes a set of one or more visually identifiable features.

228. Detecting the individual contexts includes detecting a separate set of one or more queues made by the user via one or more input devices, and in response to detecting the individual contexts, According to the determination that the individual set of one or more queues is a first set of one or more queues, the individual context is the first context, The method according to any one of claims 221 to 227, wherein, according to the determination that the individual set of one or more queues is not the first set of one or more queues, the individual context is not the first context.

229. The method according to claim 228, wherein the first set of one or more cues includes verbal cues.

230. The method according to claim 229, wherein the oral cue includes one or more words.

231. The method according to any one of claims 221 to 230, wherein the verbal cue includes one or more sounds.

232. The method according to any one of claims 221 to 231, wherein the first set of one or more queues includes physical queues.

233. The method according to claim 232, wherein the physical cue includes facial features.

234. The method according to any one of claims 221 to 233, wherein the physical cue includes a body posture.

235. The method according to any one of claims 221 to 234, wherein the physical cue includes a touch input detected via a touch-sensing surface.

236. The occurrence of the aforementioned individual context is a first occurrence, and the method is After detecting the first occurrence of the individual context, the second occurrence of the individual context is detected via one or more input devices. In response to detecting the second occurrence of the individual context, In accordance with the determination that the second occurrence of the individual context is the first context, the representation of the first set of one or more movements is output via one or more output devices. The method according to any one of claims 221 to 235, further comprising: determining that the individual context is a second context different from the first context, and then ceasing to output the representation of the first set of one or more moves via the one or more output devices.

237. The method according to any one of claims 221 to 236, wherein the indication of the first set of one or more moves includes a demonstration of the first set of one or more moves.

238. The method according to any one of claims 221 to 237, further comprising outputting the representation of the first set of one or more moves via the one or more output devices in response to detecting input of the first set of one or more inputs.

239. The expression described above is the first expression, and the method described above is After outputting the first representation of the first set of one or more movements via the one or more output devices, the feedback corresponding to the first representation of the first set of one or more movements is detected via the one or more input devices. After detecting the feedback, output via one or more output devices a second representation of the first set of one or more movements, wherein the second representation is different from the first representation. After outputting the second representation of the first set of one or more movements, the occurrence of the first context is detected via the one or more input devices, The method of claim 238, further comprising, in response to detecting the occurrence of the first context, outputting the second representation of the first set of one or more movements via one or more output devices.

240. The method according to any one of claims 221 to 239, wherein the indication of the first set of one or more moves is different from the representation of the first set of one or more moves.

241. The method according to any one of claims 221 to 240, wherein the first set of one or more inputs includes oral input.

242. The method according to any one of claims 221 to 241, wherein the first set of one or more inputs includes movement.

243. The method according to any one of claims 221 to 242, wherein the first set of one or more inputs is detected while the first context is not detected.

244. The method according to any one of claims 221 to 243, further comprising outputting an audio output via the one or more output devices while outputting the representation of the first set of one or more movements.

245. The method according to any one of claims 221 to 244, wherein outputting the representation of the first set of one or more movements includes displaying a visual output via the one or more output devices.

246. The method according to any one of claims 221 to 245, further comprising outputting the representation of the first set of one or more movements via one or more output devices in response to the detection of the occurrence of the individual context and in accordance with the determination that the individual context is a third context that is different from the first context but corresponds to the first context.

247. The aforementioned expression is a third expression, and the aforementioned method is The method according to any one of claims 221 to 246, further comprising, in response to the detection of the individual context and in accordance with the determination that the individual context is the second context, outputting a fourth representation via one or more output devices that is different from the third representation of the first set of one or more movements.

248. The expression is the fifth expression, the individual context is the first individual context, and the method is To detect a second set of one or more inputs different from the first set of one or more inputs via the one or more input devices, After detecting the second set of one or more inputs, the occurrence of a second individual context is detected via the one or more input devices, The method according to any one of claims 221 to 247, further comprising: detecting the occurrence of the second individual context, outputting a sixth expression different from the fifth expression via one or more output devices.

249. The method according to any one of claims 221 to 248, further comprising canceling the movement in response to the detection of the individual context and in accordance with the determination that the individual context is a fourth context different from the first context and the second context.

250. A non-temporary computer-readable medium for storing one or more programs configured to be executed by one or more processors of a computer system communicating with one or more input devices and one or more output devices, wherein the one or more programs include instructions for performing the method according to any one of claims 221 to 249.

251. A computer system that communicates with one or more input devices and one or more output devices, One or more processors, A computer system comprising: a memory for storing one or more programs configured to be executed by one or more processors, wherein the one or more programs include instructions for performing the method according to any one of claims 221 to 249.

252. A computer system that communicates with one or more input devices and one or more output devices, A computer system comprising means for performing the method described in any one of claims 221 to 249.

253. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system communicating with one or more input devices and one or more output devices, wherein the one or more programs include instructions for performing the method according to any one of claims 221 to 249.

254. A non-temporary computer-readable storage medium for storing one or more programs configured to be executed by one or more processors of a computer system communicating with one or more input devices and one or more output devices, wherein the one or more programs are A first set of one or more inputs is detected via one or more input devices, which includes an indication of a first context and an indication of a first set of one or more movements. After detecting the first set of one or more inputs, the occurrence of individual contexts is detected via the one or more input devices. In response to detecting the occurrence of the aforementioned individual context, In accordance with the determination that the individual context is the first context, the first set of representations of one or more movements is output via the one or more output devices. A non-temporary computer-readable storage medium including an instruction to stop outputting the representation of the first set of one or more moves via one or more output devices, in accordance with the determination that the individual context is a second context different from the first context.

255. A computer system that communicates with one or more input devices and one or more output devices, One or more processors, The system comprises a memory that stores one or more programs configured to be executed by one or more processors, and the one or more programs are A first set of one or more inputs is detected via one or more input devices, which includes an indication of a first context and an indication of a first set of one or more movements. After detecting the first set of one or more inputs, the occurrence of individual contexts is detected via the one or more input devices. In response to detecting the occurrence of the aforementioned individual context, In accordance with the determination that the individual context is the first context, the first set of representations of one or more movements is output via the one or more output devices. A computer system including an instruction to stop outputting the representation of the first set of one or more moves via one or more output devices, in accordance with the determination that the individual context is a second context different from the first context.

256. A computer system that communicates with one or more input devices and one or more output devices, Means for detecting one or more first sets of inputs, including an indication of a first context and an indication of one or more first sets of movements, via one or more input devices, After detecting the first set of one or more inputs, means for detecting the occurrence of individual contexts via the one or more input devices, In response to detecting the occurrence of the aforementioned individual context, A means for outputting a representation of the first set of one or more movements via one or more output devices, in accordance with the determination that the individual context is the first context. A computer system comprising: means for stopping outputting the representation of the first set of one or more moves via one or more output devices, in accordance with the determination that the individual context is a second context different from the first context.

257. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system communicating with one or more input devices and one or more output devices, wherein the one or more programs are A first set of one or more inputs is detected via one or more input devices, which includes an indication of a first context and an indication of a first set of one or more movements. After detecting the first set of one or more inputs, the occurrence of individual contexts is detected via the one or more input devices. In response to detecting the occurrence of the aforementioned individual context, In accordance with the determination that the individual context is the first context, the first set of representations of one or more movements is output via the one or more output devices. A computer program product that includes instructions to stop outputting the representation of the first set of one or more moves via one or more output devices, in accordance with the determination that the individual context is a second context different from the first context.

Images