Device, method, and graphical user interface for generating and displaying representation of user

Abstract

To provide devices, methods, and graphical user interfaces for generating and displaying a representation of a user.SOLUTION: A computer system displays a prompt to remove the computer system from the body of a user while the computer system is placed on the body of the user so that the computer system can capture information about the user for generating a representation of the user, and then captures the information about the user, generates the representation of the user, and displays the representation of the user.SELECTED DRAWING: None

Description

Technical Field

[0001] Cross - Reference to Related Applications This application claims the benefit of U.S. Patent Application No. 17 / 988,532, filed on November 16, 2022, entitled "DEVICES, METHODS, AND GRAPHICAL USER INTERFACES FOR GENERATING AND DISPLAYING A REPRESENTATION OF A USER", and U.S. Patent Application No. 63 / 283,969, filed on November 29, 2021, entitled "DEVICES, METHODS, AND GRAPHICAL USER INTERFACES FOR GENERATING AND DISPLAYING A REPRESENTATION OF A USER", the entire contents of each of which are hereby incorporated by reference in their entirety.

[0002] Technical Field The present disclosure generally relates to computer systems that provide computer - generated experiences, including, but not limited to, electronic devices that provide virtual reality and mixed - reality experiences via a display.

Background Art

[0003] The development of computer systems for augmented reality has advanced significantly in recent years. Exemplary augmented - reality environments include at least some virtual elements that replace or enhance the physical world. Input devices such as cameras, controllers, joysticks, touch - sensitive surfaces, and touch - screen displays for computer systems and other electronic computing devices are used to interact with virtual / augmented - reality environments. Exemplary virtual elements include virtual objects such as digital images, videos, text, icons, and control elements such as buttons and other graphics.

Summary of the Invention

[0004] In environments (e.g., applications, augmented reality environments, mixed reality environments, and virtual reality environments) that include at least some virtual elements, some methods and interfaces for generating and / or displaying a user's representation are cumbersome, inefficient, and limited. For example, systems that capture data for generating a user's representation, systems that display a user's representation, and / or systems that receive insufficient feedback while displaying a user's representation are complex, tedious, error-prone, impose a significant cognitive burden on the user, and detract from the experience in virtual / augmented reality environments. In addition, those methods are time-consuming more than necessary, thereby wasting the energy of the computer system. This latter consideration is particularly important in battery-operated devices.

[0005] Accordingly, there is a need for a computer system having improved methods and interfaces for providing a computer-generated experience to a user that enables more efficient and intuitive creation and / or display of a user's representation. Such methods and interfaces optionally complement or replace conventional methods for generating and / or displaying a user's representation within an environment that includes at least some virtual elements. Such methods and interfaces reduce the number, degree, and / or type of inputs from the user by assisting the user in understanding the connection between the provided input and the device response to that input, thereby creating a more efficient human-machine interface.

[0006] The above-mentioned drawbacks and other problems associated with the user interface of a computer system are reduced or eliminated by the disclosed system. In some embodiments, the computer system is a desktop computer with an associated display. In some embodiments, the computer system is a portable device (e.g., a notebook computer, a tablet computer, or a handheld device). In some embodiments, the computer system is a personal electronic device (e.g., a wearable electronic device such as a wristwatch or a head-mounted device). In some embodiments, the computer system has a touchpad. In some embodiments, the computer system has one or more cameras. In some embodiments, the computer system has a touch-sensitive display (also known as a "touch screen" or "touch screen display"). In some embodiments, the computer system has one or more eye-tracking components. In some embodiments, the computer system has one or more hand-tracking components. In some embodiments, the computer system has one or more output devices in addition to a display generation component, and the output devices include one or more haptic output generators and / or one or more audio output devices. In some embodiments, the computer system has a graphical user interface (GUI), one or more processors, memory, and one or more modules, programs, or sets of instructions stored in the memory for performing a plurality of functions. In some embodiments, the user interacts with the GUI through contact and gestures of a stylus and / or finger on a touch-sensitive surface, movement of the user's eyes and hands in space relative to the GUI (and / or the computer system) when captured by a camera and other motion sensors, and voice input when captured by one or more audio input devices.In some embodiments, the functions executed through the interaction optionally include image editing, drawing, presenting, word processing, spreadsheet creation, game play, making a phone call, video conferencing, sending an email, instant messaging, training support, digital photography, digital video recording, web browsing, playing digital music, taking notes, and / or playing digital video. The executable instructions for performing those functions are optionally included in a primary computer-readable storage medium and / or a non-transitory computer-readable storage medium, or in other computer program products configured to be executed by one or more processors.

[0007] There is a need for an electronic device having an improved method and interface for generating and / or displaying a user representation. Such a method and interface can complement or replace conventional methods for generating and / or displaying a user representation. Such a method and interface can reduce the number, degree, and / or type of input from the user and generate a more efficient human-machine interface. Such a method and interface can also display relevant portions of a user representation such that the processing power of the computer system is reduced, thereby generating a more efficient human-machine interface. In the case of a battery-operated computing device, such a method and interface can conserve power and lengthen the battery charging interval.

[0008] According to some embodiments, a method is described. The method is executed in a computer system communicating with one or more display generation components. The method includes, while the computer system is disposed on a user's body, displaying, via the one or more display generation components, a prompt to remove the computer system from the user's body and to capture information related to the user using the computer system; after displaying a prompt to instruct the computer system to be removed from the user's body, detecting that the computer system has been removed from the user's body; and, after detecting that the computer system, which is configured to generate a representation of the user using the information, has been removed from the user's body, capturing information related to the user.

[0009] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system communicating with one or more display generation components, the one or more programs including instructions to, while the computer system is disposed on a user's body, display, via the one or more display generation components, a prompt to remove the computer system from the user's body and to capture information related to the user using the computer system; after displaying a prompt to instruct the computer system to be removed from the user's body, detect that the computer system has been removed from the user's body; and, after detecting that the computer system, which is configured to generate a representation of the user using the information, has been removed from the user's body, capture information related to the user.

[0010] According to some embodiments, a temporary computer-readable storage medium is described. The temporary computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system in communication with one or more display generation components, the one or more programs causing the computer system to, while disposed on a user's body, display, via the one or more display generation components, a prompt instructing removal of the computer system from the user's body and capture of information related to the user using the computer system, display a prompt instructing removal of the computer system from the user's body, detect that the computer system has been removed from the user's body after displaying the prompt instructing removal of the computer system from the user's body, and, after detecting that the computer system has been removed from the user's body, capture information related to the user, the computer system being configured to use the information to generate a representation of the user.

[0011] According to some embodiments, a computer system is described. The computer system communicates with one or more display generation components. The computer system includes one or more processors and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs causing the computer system to, while disposed on a user's body, display, via the one or more display generation components, a prompt instructing removal of the computer system from the user's body and capture of information related to the user using the computer system, display a prompt instructing removal of the computer system from the user's body, detect that the computer system has been removed from the user's body after displaying the prompt instructing removal of the computer system from the user's body, and, after detecting that the computer system has been removed from the user's body, capture information related to the user, the computer system being configured to use the information to generate a representation of the user.

[0012] According to some embodiments, a computer system is described. The computer system communicates with one or more display generation components. The computer system is configured to display, via the one or more display generation components, a prompt for removing the computer system from the user's body and using the computer system to capture information related to the user while the computer system is placed on the user's body; a means for detecting that the computer system has been removed from the user's body after displaying a prompt for instructing to remove the computer system from the user's body; and a means for capturing information related to the user after detecting that the computer system has been removed from the user's body, wherein the computer system is configured to generate a representation of the user using the information.

[0013] According to some embodiments, a method is described. The method is executed in a computer system communicating with one or more display generation components. The method includes capturing information about one or more physical characteristics of a user of the computer system during a registration process for generating a representation of the user; selecting one or more physical characteristics of the representation based on the one or more captured physical characteristics of the user after capturing the information about the one or more physical characteristics of the user of the computer system; generating a representation of the user based on the information about the one or more physical characteristics of the user; and displaying, via the one or more display generation components, at least a portion of the representation of the user within an extended reality environment after generating the representation of the user.

[0014] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system in communication with one or more display generation components, the one or more programs including capturing information regarding one or more physical characteristics of a user of the computer system during a registration process for generating a representation of the user, selecting, after capturing the information regarding one or more physical characteristics of the user of the computer system, one or more physical characteristics of the representation based on the one or more captured physical characteristics of the user, generating a representation of the user based on the information regarding the one or more physical characteristics of the user, and after generating the representation of the user, displaying at least a portion of the representation of the user within an extended reality environment via the one or more display generation components.

[0015] According to some embodiments, a transitory computer-readable storage medium is described. The transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system in communication with one or more display generation components, the one or more programs including capturing information regarding one or more physical characteristics of a user of the computer system during a registration process for generating a representation of the user, selecting, after capturing the information regarding one or more physical characteristics of the user of the computer system, one or more physical characteristics of the representation based on the one or more captured physical characteristics of the user, generating a representation of the user based on the information regarding the one or more physical characteristics of the user, and after generating the representation of the user, displaying at least a portion of the representation of the user within an extended reality environment via the one or more display generation components.

[0016] According to some embodiments, a computer system is described. The computer system communicates with one or more display generation components. The computer system includes one or more processors and a memory storing one or more programs configured to be executed by the one or more processors. The one or more programs capture information regarding one or more physical characteristics of a user of the computer system during a registration process for generating a user representation, select one or more physical characteristics of the representation based on the one or more captured physical characteristics of the user after capturing the information regarding the one or more physical characteristics of the user of the computer system, generate a user representation based on the information regarding the one or more physical characteristics of the user, and after generating the user representation, display at least a portion of the user representation within an extended reality environment via the one or more display generation components.

[0017] According to some embodiments, a computer system is described. The computer system communicates with one or more display generation components. The computer system includes means for capturing information regarding one or more physical characteristics of a user of the computer system during a registration process for generating a user representation, means for generating a user representation based on the information regarding the one or more physical characteristics of the user, including selecting one or more physical characteristics of the representation based on the one or more captured physical characteristics of the user after capturing the information regarding the one or more physical characteristics of the user of the computer system, and means for displaying at least a portion of the user representation within an extended reality environment via the one or more display generation components after generating the user representation.

[0018] According to some embodiments, a method is described. The method is executed in a first computer system that is communicating with one or more display generation components. The method includes, while the first computer system is being used by a first user of the first computer system, displaying, via the one or more display generation components, a representation of a second user in an extended reality environment at a first fidelity, where the representation of the second user moves based on detected movement of the second user detected by a second computer system during a live communication session with the first computer system; while displaying the representation of the second user in the extended reality environment, detecting a change in the amount of direct information regarding the physical state of the second user; and in response to detecting the change in the amount of direct information regarding the physical state of the second user, the first computer system starting to display the representation of the second user at a different fidelity via the one or more display generation components. The displaying includes displaying, via the one or more display generation components, the representation of the second user at a second fidelity lower than the first fidelity according to a determination that direct information regarding the physical state of the second user is not received for a first amount of time that is longer than a first time threshold and shorter than a second time threshold; and displaying, via the one or more display generation components, the representation of the second user at a third fidelity lower than the second fidelity according to a determination that direct information regarding the physical state of the second user is not received for a second amount of time that is longer than the first time threshold and longer than the second time threshold.

[0019] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a first computer system in communication with one or more display generation components, and the one or more programs cause the first computer system to, while being used by a first user of the first computer system, via the one or more display generation components, display, in an extended reality environment at a first fidelity, a representation of a second user, the representation of the second user moving based on detected movement of the second user detected by a second computer system during a live communication session with the first computer system; while displaying the representation of the second user in the extended reality environment, the amount of direct information regarding the physical state of the second user changes, and in response to the amount of direct information regarding the physical state of the second user changing, the first computer system starts, via the one or more display generation components, displaying the representation of the second user at a different fidelity, where displaying includes, in accordance with a determination that direct information regarding the physical state of the second user is not received for a first amount of time that is longer than a first time threshold and shorter than a second time threshold, displaying the representation of the second user at a second fidelity lower than the first fidelity via the one or more display generation components; and in accordance with a determination that direct information regarding the physical state of the second user is not received for a second amount of time that is longer than the first time threshold and longer than the second time threshold, displaying the representation of the second user at a third fidelity lower than the second fidelity via the one or more display generation components.

[0020] According to some embodiments, a non - transitory computer - readable storage medium is described. The non - transitory computer - readable storage medium stores one or more programs configured to be executed by one or more processors of a first computer system communicating with one or more display - generating components. The one or more programs cause the first computer system, while being used by a first user of the first computer system, to display, via the one or more display - generating components, a representation of a second user, where the representation of the second user moves based on detected movement of the second user detected by a second computer system during a live communication session with the first computer system, in an extended reality environment with a first fidelity. While the representation of the second user is being displayed in the extended reality environment, the amount of direct information regarding the physical state of the second user changes, and in response to the change in the amount of direct information regarding the physical state of the second user, the first computer system starts, via the one or more display - generating components, to display the representation of the second user with a different fidelity. Displaying includes, according to a determination that direct information regarding the physical state of the second user is not received for a first amount of time that is longer than a first time threshold and shorter than a second time threshold, displaying the representation of the second user with a second fidelity lower than the first fidelity via the one or more display - generating components, and according to a determination that direct information regarding the physical state of the second user is not received for a second amount of time that is longer than the first time threshold and longer than the second time threshold, displaying the representation of the second user with a third fidelity lower than the second fidelity via the one or more display - generating components.

[0021] According to some embodiments, a first computer system is described. The first computer system communicates with one or more display generation components. The first computer system includes one or more processors and a memory storing one or more programs configured to be executed by the one or more processors. The one or more programs cause the first computer system to display, via the one or more display generation components, a representation of a second user, in a first fidelity, within an extended reality environment, while the first computer system is being used by a first user of the first computer system. The representation of the second user moves based on detected movement of the second user detected by a second computer system during a live communication session with the first computer system. While displaying the representation of the second user within the extended reality environment, the amount of direct information regarding the physical state of the second user changes, and in response to the change in the amount of direct information regarding the physical state of the second user, the first computer system starts to display the representation of the second user in a different fidelity via the one or more display generation components. The displaying includes displaying, via the one or more display generation components, the representation of the second user in a second fidelity lower than the first fidelity according to a determination that direct information regarding the physical state of the second user is not received for a first amount of time longer than a first time threshold and shorter than a second time threshold, and displaying, via the one or more display generation components, the representation of the second user in a third fidelity lower than the second fidelity according to a determination that direct information regarding the physical state of the second user is not received for a second amount of time longer than the first time threshold and longer than the second time threshold.

[0022] According to some embodiments, a first computer system is described. The first computer system communicates with one or more display generation components. The first computer system, while being used by a first user of the first computer system, via the one or more display generation components, displays, in an extended reality environment with a first fidelity, a representation of a second user, the representation of the second user moving based on detected movements of the second user detected by a second computer system during a live communication session with the first computer system; means for changing the amount of direct information regarding the physical state of the second user while the representation of the second user is being displayed in the extended reality environment; and means for the first computer system to start, in response to a change in the amount of direct information regarding the physical state of the second user, displaying the representation of the second user with a different fidelity via the one or more display generation components, wherein displaying comprises, in accordance with a determination that direct information regarding the physical state of the second user is not received for a first amount of time longer than a first time threshold and shorter than a second time threshold, displaying the representation of the second user with a second fidelity lower than the first fidelity via the one or more display generation components; and, in accordance with a determination that direct information regarding the physical state of the second user is not received for a second amount of time longer than the first time threshold and longer than the second time threshold, displaying the representation of the second user with a third fidelity lower than the second fidelity via the one or more display generation components.

[0023] According to some embodiments, a method is described. The method is executed in a first computer system that is communicating with one or more display generation components. The method includes, while the first computer system is being used by a first user of the first computer system, displaying, via the one or more display generation components, within an extended reality environment, a representation of a second user, the representation of the second user moving based on detected movement of the second user detected by a second computer system during a live communication session with the first computer system; receiving information corresponding to an utterance of the second user while the representation of the second user is being displayed within the extended reality environment; and updating an appearance of the representation of the second user based on the information corresponding to the utterance of the second user in response to receiving the information corresponding to the utterance of the second user, wherein updating includes, in accordance with a determination that information regarding a detected physical state of the mouth of the second user does not meet a set of one or more criteria, displaying, via the one or more display generation components, a first mouth representation of the representation of the second user, the first mouth representation being generated based on audio information corresponding to the utterance of the second user; and, in accordance with a determination that information regarding a detected physical state of the mouth of the second user meets a set of one or more criteria, displaying, via the one or more display generation components, a second mouth representation of the representation of the second user, the second mouth representation being generated based on information regarding the detected physical state of the mouth of the second user without using audio information corresponding to the utterance of the second user to generate the second mouth representation.

[0024] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a first computer system communicating with one or more display generation components. The one or more programs cause the first computer system to display, via the one or more display generation components, within an extended reality environment, a representation of a second user that moves based on detected movement of the second user detected by a second computer system during a live communication session with the first computer system while the first computer system is being used by a first user of the first computer system. While displaying the representation of the second user within the extended reality environment, receive information corresponding to an utterance of the second user, and in response to receiving the information corresponding to the utterance of the second user, update an appearance of the representation of the second user based on the information corresponding to the utterance of the second user. Updating includes, in accordance with a determination that information regarding a detected physical state of the mouth of the second user does not meet a set of one or more criteria, displaying, via the one or more display generation components, a first mouth representation of the representation of the second user, the first mouth representation being generated based on audio information corresponding to the utterance of the second user; and in accordance with a determination that information regarding a detected physical state of the mouth of the second user meets a set of one or more criteria, displaying, via the one or more display generation components, a second mouth representation of the representation of the second user, the second mouth representation being generated based on information regarding the detected physical state of the mouth of the second user without using audio information corresponding to the utterance of the second user to generate the second mouth representation.

[0025] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a first computer system in communication with one or more display generation components. The one or more programs, while the first computer system is being used by a first user of the first computer system, via the one or more display generation components, within an extended reality environment, display a representation of a second user, wherein the representation of the second user moves based on detected movements of the second user detected by a second computer system during a live communication session with the first computer system. While displaying the representation of the second user within the extended reality environment, receive information corresponding to an utterance of the second user, and in response to receiving the information corresponding to the utterance of the second user, update an appearance of the representation of the second user based on the information corresponding to the utterance of the second user. Updating includes, in accordance with a determination that information regarding a detected physical state of the mouth of the second user does not meet a set of one or more criteria, via the one or more display generation components, display a first mouth representation of the representation of the second user, wherein the first mouth representation is generated based on audio information corresponding to the utterance of the second user; and in accordance with a determination that information regarding a detected physical state of the mouth of the second user meets a set of one or more criteria, via the one or more display generation components, display a second mouth representation of the representation of the second user, wherein the second mouth representation is generated based on information regarding the detected physical state of the mouth of the second user without using audio information corresponding to the utterance of the second user to generate the second mouth representation.

[0026] According to some embodiments, a first computer system is described. The first computer system communicates with one or more display generation components. The first computer system includes one or more processors and a memory storing one or more programs configured to be executed by the one or more processors. The one or more programs cause the first computer system to display, via the one or more display generation components, within an extended reality environment, a representation of a second user while the first computer system is being used by a first user of the first computer system. The representation of the second user moves based on detected movement of the second user detected by a second computer system during a live communication session with the first computer system. While displaying the representation of the second user within the extended reality environment, the first computer system receives information corresponding to speech of the second user, and in response to receiving the information corresponding to the speech of the second user, updates an appearance of the representation of the second user based on the information corresponding to the speech of the second user. Updating includes, in accordance with a determination that information regarding a detected physical state of the mouth of the second user does not meet a set of one or more criteria, displaying, via the one or more display generation components, a first mouth representation of the representation of the second user, the first mouth representation being generated based on audio information corresponding to the speech of the second user; and in accordance with a determination that information regarding a detected physical state of the mouth of the second user meets a set of one or more criteria, displaying, via the one or more display generation components, a second mouth representation of the representation of the second user, the second mouth representation being generated based on information regarding the detected physical state of the mouth of the second user without using audio information corresponding to the speech of the second user to generate the second mouth representation.

[0027] According to some embodiments, a first computer system is described. The first computer system communicates with one or more display generation components. The first computer system, while being used by a first user of the first computer system, via the one or more display generation components, within an extended reality environment, displays a representation of a second user, wherein the representation of the second user moves based on detected movements of the second user detected by a second computer system during a live communication session with the first computer system, means for receiving information corresponding to an utterance of the second user while the representation of the second user is being displayed within the extended reality environment, and means for updating an appearance of the representation of the second user based on the information corresponding to the utterance of the second user in response to receiving the information corresponding to the utterance of the second user, wherein updating includes, in accordance with a determination that information regarding a detected physical state of the mouth of the second user does not meet a set of one or more criteria, via the one or more display generation components, displaying a first mouth representation of the representation of the second user, wherein the first mouth representation is generated based on audio information corresponding to the utterance of the second user, and, in accordance with a determination that information regarding a detected physical state of the mouth of the second user meets a set of one or more criteria, via the one or more display generation components, displaying a second mouth representation of the representation of the second user, wherein the second mouth representation is generated based on information regarding the detected physical state of the mouth of the second user without using audio information corresponding to the utterance of the second user to generate the second mouth representation.

[0028] According to some embodiments, a method is described. The method is executed in a first computer system that is communicating with one or more display generation components. The method includes, while the first computer system is being used by a first user of the first computer system, displaying, via the one or more display generation components, within an extended reality environment, a representation of a second user, the representation of the second user moving based on detected movement of the second user detected by a second computer system during a live communication session with the first computer system, the representation of the second user including a visual representation of hair of the second user, the visual representation of hair of the second user including a first portion of a hair representation positioned at a first distance from a portion of the representation of the second user corresponding to an individual body part of the second user, the first portion of the hair representation including a first visual fidelity, and a second portion of a hair representation positioned at a second distance greater than the first distance from a portion of the representation of the second user corresponding to an individual body part of the second user, the second portion of the hair representation including a second visual fidelity less than the first visual fidelity.

[0029] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a first computer system communicating with one or more display generation components, the one or more programs causing the first computer system, while being used by a first user of the first computer system, to display, via the one or more display generation components, within an extended reality environment, a representation of a second user, the representation of the second user being a representation that moves based on detected movement of the second user detected by a second computer system during a live communication session with the first computer system. The representation of the second user includes a visual representation of the second user's hair, the visual representation of the second user's hair being a first portion of a hair representation positioned at a first distance from a portion of the representation of the second user corresponding to an individual body part of the second user, the first portion of the hair representation including a first visual fidelity, and a second portion of the hair representation positioned at a second distance greater than the first distance from a portion of the representation of the second user corresponding to an individual body part of the second user, the second portion of the hair representation including a second visual fidelity less than the first visual fidelity.

[0030] According to some embodiments, a non-transitory computer-readable memory medium is described. The non-transitory computer-readable memory medium stores one or more programs configured to be executed by one or more processors of a first computer system communicating with one or more display generation components, and the one or more programs cause the first computer system, while being used by a first user of the first computer system, to display, via the one or more display generation components, within an extended reality environment, a representation of a second user, the representation of the second user moving based on detected movement of the second user detected by a second computer system during a live communication session with the first computer system. The representation of the second user includes a visual representation of the second user's hair, and the visual representation of the second user's hair is a first portion of a hair representation positioned at a first distance from a portion of the representation of the second user corresponding to an individual body part of the second user, the first portion of the hair representation including a first visual fidelity, and a second portion of the hair representation positioned at a second distance greater than the first distance from a portion of the representation of the second user corresponding to an individual body part of the second user, the second portion of the hair representation including a second visual fidelity less than the first visual fidelity.

[0031] According to some embodiments, a first computer system is described. The first computer system communicates with one or more display generation components. The first computer system includes one or more processors and a memory storing one or more programs configured to be executed by the one or more processors. The one or more programs cause the first computer system to display, via the one or more display generation components, within an extended reality environment, a representation of a second user while the first computer system is being used by a first user of the first computer system. The representation of the second user moves based on detected movements of the second user detected by a second computer system during a live communication session with the first computer system. The representation of the second user includes a visual representation of the hair of the second user. The visual representation of the hair of the second user is a first portion of a representation of the hair positioned at a first distance from a portion of the representation of the second user corresponding to an individual body part of the second user. The first portion of the representation of the hair includes a first visual fidelity. The visual representation of the hair of the second user further includes a second portion of a representation of the hair positioned at a second distance greater than the first distance from a portion of the representation of the second user corresponding to an individual body part of the second user. The second portion of the representation of the hair includes a second visual fidelity less than the first visual fidelity.

[0032] According to some embodiments, a first computer system is described. The first computer system communicates with one or more display generation components. The first computer system, while being used by a first user of the first computer system, via the one or more display generation components, within an extended reality environment, displays a representation of a second user, the representation of the second user being based on detected movements of the second user detected by a second computer system during a live communication session with the first computer system and moving in accordance therewith. The first computer system includes means for displaying the representation of the second user, the representation of the second user including a visual representation of the hair of the second user, the visual representation of the hair of the second user being a first portion of a representation of the hair positioned at a first distance from a portion of the representation of the second user corresponding to an individual body part of the second user, the first portion of the representation of the hair including a first visual fidelity, and a second portion of the representation of the hair positioned at a second distance greater than the first distance from a portion of the representation of the second user corresponding to an individual body part of the second user, the second portion of the representation of the hair including a second visual fidelity less than the first visual fidelity.

[0033] According to some embodiments, a method is described. The method is executed in a first computer system that is communicating with one or more display generation components. The method includes displaying, via the one or more display generation components, within an extended reality environment, a representation of a second user while the first computer system is being used by a first user of the first computer system, wherein the representation of the second user moves based on detected movement of the second user detected by a second computer system during a live communication session with the first computer system, and wherein the representation of the second user includes a first portion of the representation of the second user that corresponds to a boundary between the representation of the second user and another portion of the extended reality environment, the first portion of the representation of the second user being displayed using a first visual appearance, and a second portion of the representation of the second user that does not correspond to a boundary between the representation of the second user and another portion of the extended reality environment, the second portion of the representation of the second user being displayed using a second visual appearance, and the first visual appearance being emphasized as compared to the second visual appearance.

[0034] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a first computer system communicating with one or more display generation components, and the one or more programs cause the first computer system to, while being used by a first user of the first computer system, display, via the one or more display generation components, within an extended reality environment, a representation of a second user, the representation of the second user moving based on detected movements of the second user detected by a second computer system during a live communication session with the first computer system, the representation of the second user including a first portion of the representation of the second user corresponding to a boundary between the representation of the second user and other portions of the extended reality environment, the first portion of the representation of the second user being displayed using a first visual appearance, and a second portion of the representation of the second user not corresponding to a boundary between the representation of the second user and other portions of the extended reality environment, the second portion of the representation of the second user being displayed using a second visual appearance, the first visual appearance being emphasized as compared to the second visual appearance.

[0035] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a first computer system in communication with one or more display generation components, the one or more programs including instructions to display, via the one or more display generation components, within an extended reality environment, a representation of a second user while the first computer system is being used by a first user of the first computer system, the representation of the second user being a representation of the second user that moves based on detected movement of the second user detected by a second computer system during a live communication session with the first computer system, the representation of the second user including a first portion of the representation of the second user corresponding to a boundary between the representation of the second user and other portions of the extended reality environment, the first portion of the representation of the second user being displayed using a first visual appearance, and a second portion of the representation of the second user not corresponding to a boundary between the representation of the second user and other portions of the extended reality environment, the second portion of the representation of the second user being displayed using a second visual appearance, the first visual appearance being emphasized as compared to the second visual appearance.

[0036] According to some embodiments, a first computer system is described. The first computer system communicates with one or more display generation components. The first computer system includes one or more processors and a memory storing one or more programs configured to be executed by the one or more processors. The one or more programs cause the first computer system to display, via the one or more display generation components, within an extended reality environment, a representation of a second user while the first computer system is being used by a first user of the first computer system. The representation of the second user moves based on detected movement of the second user detected by a second computer system during a live communication session with the first computer system. The representation of the second user includes a first portion of the representation of the second user corresponding to a boundary between the representation of the second user and other parts of the extended reality environment. The first portion of the representation of the second user is displayed using a first visual appearance. The representation of the second user also includes a second portion of the representation of the second user not corresponding to a boundary between the representation of the second user and other parts of the extended reality environment. The second portion of the representation of the second user is displayed using a second visual appearance. The first visual appearance is emphasized as compared to the second visual appearance.

[0037] According to some embodiments, a first computer system is described. The first computer system communicates with one or more display generation components. The first computer system, while being used by a first user of the first computer system, via the one or more display generation components, within an extended reality environment, displays a representation of a second user, the representation of the second user moving based on detected movement of the second user detected by a second computer system during a live communication session with the first computer system. The representation of the second user includes a first portion of the representation of the second user corresponding to a boundary between the representation of the second user and other parts of the extended reality environment, the first portion of the representation of the second user being displayed using a first visual appearance, and a second portion of the representation of the second user not corresponding to a boundary between the representation of the second user and other parts of the extended reality environment, the second portion of the representation of the second user being displayed using a second visual appearance, the first visual appearance being emphasized as compared to the second visual appearance.

[0038] Note that the various embodiments described above can be combined with any other embodiments described herein. The features and advantages described herein are not exhaustive, and in particular, many additional features and advantages will be apparent to those skilled in the art in view of the drawings, the specification, and the claims. Further, note that the language used herein has been selected solely for readability and for the purpose of explanation, and not for the purpose of defining or limiting the subject matter of the invention.

Brief Description of the Drawings

[0039] To better understand the various embodiments described, the following "Modes for Carrying Out the Invention" should be referred to in conjunction with the following drawings, and like reference numerals refer to corresponding parts throughout the following figures.

[0040]

Figure 1

[0041]

Figure 2

[0042]

Figure 3

[0043]

Figure 4

[0044]

Figure 5

[0045]

Figure 6

[0046]

Figure 7A

Figure 7B

Figure 7C

Figure 7D

Figure 7E

Figure 7F

Figure 7G

Figure 7H

Figure 7I

Figure 7J

[0047]

Figure 8

[0048]

Figure 9

[0049]

Figure 10A

Figure 10B

Figure 10C

Figure 10D

Figure 10E

Figure 10F

Figure 10G

Figure 10H

Figure 10I

[0050]

Figure 11

[0051]

Figure 12

[0052]

Figure 13

[0053]

Figure 14

DETAILED DESCRIPTION OF THE INVENTION

[0054] The present disclosure relates to a user interface for providing a user with an extended reality (XR) experience according to some embodiments.

[0055] The systems, methods, and GUIs described herein improve user interface interactions with virtual / augmented reality environments in multiple ways.

[0056] In some embodiments, a computer system captures information related to a user and uses the captured information to generate a representation of the user. While the computer system is positioned on the user's body, the computer system prompts the user to remove the computer system from the user's body and use the computer system to capture information related to the user. The computer system detects that the computer system has been removed from the user's body and, after detecting that the computer system has been removed from the user's body, captures information related to the user. In some embodiments, the computer system is a wearable computer system, such as a head-mounted display generation component and / or a watch, that can be worn in an orientation and / or position specific to the user's body. In some embodiments, the computer system captures information related to the user's head and / or face while the computer system is removed from the user's body and captures information related to the user's hand while the computer system is positioned on the user's body. In some embodiments, the computer system displays a first prompt on a first display generation component that prompts the user to remove the computer system from the user's body and displays a second prompt on a second display generation component that provides an instruction to capture information related to the user while the computer system is removed from the user's body.

[0057] In some embodiments, a computer system captures information about one or more physical characteristics of a user, generates a representation of the user based on the information about the one or more physical characteristics of the user, and displays the representation of the user within an extended reality environment such as an augmented reality environment and / or a virtual reality environment. In some embodiments, the computer system displays the representation of the user to include a representative state that is a mirror image of the physical state of the user within the physical environment. In some embodiments, the computer system animates and / or displays the movement of the representation based on the physical movement of the user within the physical environment. In some embodiments, the computer system provides selectable options for editing the representation of the user and / or for recapturing information about one or more physical characteristics of the user while the representation of the user is being displayed within the extended reality environment.

[0058] In some embodiments, the first computer system used by the first user displays the representation of the second user within the extended reality environment and adjusts the appearance of the representation of the second user based on the amount of direct information regarding the physical state of the second user. For example, the computer system displays the representation of the second user with a first visual fidelity and / or accuracy. When direct information regarding the physical state of the second user is not received for a first amount of time that is longer than a first time threshold and shorter than a second time threshold, the computer system displays the representation of the second user with a second visual fidelity and / or accuracy that is lower than the first visual fidelity and / or accuracy. When direct information regarding the physical state of the second user is not received for a second amount of time that is longer than the first time threshold and longer than the second time threshold, the computer system displays the representation of the second user with a third visual fidelity and / or accuracy that is lower than the first visual fidelity and / or accuracy and lower than the second visual fidelity and / or accuracy. In some embodiments, when direct information regarding the physical state of the second user is not received for a second amount of time, the computer system displays the representation of the second user in a presentation mode such that the representation of the second user does not have anthropomorphic features and / or is an inanimate substance within the extended reality environment.

[0059] In some embodiments, the first computer system used by the first user displays a representation of the second user within an extended reality environment and displays an oral expression of the representation of the second user based on one or more of audio information corresponding to the utterance of the second user and / or information regarding the detected physical state of the mouth of the second user. The computer system receives audio information corresponding to the utterance of the second user and updates the appearance of the representation of the second user based on the audio information corresponding to the utterance of the user. When the information regarding the detected physical state of the mouth of the second user does not meet a set of one or more criteria, such as the information regarding the detected physical state of the mouth of the second user being less than a confidence level threshold, the computer system displays a representation of the second user having a first oral expression generated based on the audio information corresponding to the utterance of the second user. When the information regarding the detected physical state of the mouth of the second user meets a set of one or more criteria, such as the information regarding the detected physical state of the mouth of the second user being greater than a confidence level threshold, the computer system displays a representation of the second user having a second oral expression generated based on the information regarding the detected physical state of the mouth of the second user without using the audio information corresponding to the utterance of the second user. In some embodiments, the first oral expression is a combination and / or overlay of a third oral expression generated based on the audio information corresponding to the utterance of the second user and a fourth oral expression generated based on the information regarding the detected physical state of the mouth of the second user. In some embodiments, the first oral expression is generated using different amounts of the third oral expression and the fourth oral expression based on the confidence level of the information regarding the detected physical state of the mouth of the second user.

[0060] In some embodiments, a first computer system used by a first user displays a representation of a second user within an extended reality environment, the representation of the second user including a visual representation of the second user's hair. The visual representation of the second user's hair is positioned at a first distance from a portion of the representation of the second user corresponding to an individual body part of the second user, such as the face and / or neck, and includes a first portion having a first visual fidelity and / or accuracy. The visual representation of the hair includes a second portion positioned at a second distance greater than the first distance from a portion of the representation of the second user corresponding to an individual body part of the second user, and having a second visual fidelity and / or accuracy lower than the first visual fidelity and / or accuracy. Thus, the visual representation of the second user's hair becomes less distinct the further the visual representation of the hair is positioned away from a portion of the representation of the second user corresponding to an individual body part of the second user. In some embodiments, the visual representation of the hair corresponds only to the hair and / or beard of the second user's face.

[0061] In some embodiments, a first computer system used by a first user displays a representation of a second user within an extended reality environment and displays different portions of the representation of the second user with different levels and / or degrees of visual emphasis. For example, a first portion of the representation of the second user corresponding to a boundary between the representation of the second user and other portions of the extended reality environment is displayed using a first visual appearance. A second portion of the representation of the second user that does not correspond to a boundary between the representation of the second user and other portions of the extended reality environment is displayed using a second visual appearance, and the first visual appearance is visually emphasized compared to the second visual appearance. In some embodiments, the computer system adjusts the appearance of the representation of the second user based on a change in the displayed perspective and / or viewpoint of the representation of the second user such that the first and second portions of the representation of the second user change based on the displayed perspective and / or change in perspective of the representation of the second user. In some embodiments, the computer system displays the representation of the second user in a presentation mode when the representation of the second user is displayed in a rearward orientation, and the presentation mode includes displaying the representation of the second user without anthropomorphic features and / or as an inanimate substance.

[0062] Figures 1-6 illustrate an exemplary computer system for providing an XR experience to a user. Figures 7A-7J show exemplary techniques for generating a user representation and displaying the user representation according to some embodiments. Figure 8 is a flowchart of a method for generating a user representation according to various embodiments. Figure 9 is a flowchart of a method for displaying a user representation according to various embodiments. The user interfaces of Figures 7A-7J are used to illustrate the processes of Figures 8 and 9. Figures 10A-10I show exemplary techniques for adjusting the appearance of a user representation according to some embodiments. Figure 11 is a flowchart of a method for adjusting the appearance of a user representation according to various embodiments. Figure 12 is a flowchart of a method for displaying an oral expression of a user representation according to various embodiments. Figure 13 is a flowchart of a method for displaying a hair expression of a user representation according to various embodiments. Figure 14 is a flowchart of a method for displaying a portion of a user representation with visual emphasis according to various embodiments. The user interfaces of Figures 10A-10I are used to illustrate the processes of Figures 11-14.

[0063] The processes described below improve the operability of a device (e.g., by helping a user provide appropriate input, reducing user errors when operating / interacting with the device), provide improved visual feedback to the user, reduce the number of inputs required to perform an action, provide additional control options without cluttering the user interface with additional displayed controls, perform an action when a set of conditions is met without requiring further user input, improve privacy and / or security, provide a more diverse, detailed, and / or realistic user experience while saving storage space, and / or through additional techniques, and make the user device interface more efficient through various techniques. These techniques also reduce power usage and improve the battery life of the device by enabling the user to use the device more quickly and efficiently. Saving battery power, and thus weight, improves the ergonomics of the device. These techniques also enable real-time communication, enable the use of fewer and / or less accurate sensors, result in more compact, lighter, and less expensive devices, and enable the device to be used under various lighting conditions. These techniques reduce energy usage, thereby reducing the heat emitted by the device, which is particularly important for wearable devices where the device may generate too much heat to be comfortable for the user to wear, as the operating parameters for the device components are well within range.

[0064] Furthermore, in the method described herein, conditioned on one or more conditions being met by one or more steps, it should be understood that the described method can be repeated in multiple iterations such that, over the course of the repetitions, all of the conditions conditioned on by the steps of the method are met in different repetitions of the method. For example, if a method requires performing a first step when a condition is met and a second step when the condition is not met, one of ordinary skill in the art will understand that the steps described in 2 will be repeated in a particular order until the condition is met and then ceases to be met. Thus, a method described in terms of one or more steps that depend on one or more conditions being met can be rewritten as a method that is repeated until each condition described in the method is met. However, this is not required in claims for a system or computer-readable medium that includes instructions to perform conditional operations based on the fulfillment of the corresponding one or more conditions, and thus can determine whether the contingency is met without explicitly repeating the steps of the method until all of the conditions for which the steps of the method are conditional are met. One of ordinary skill in the art will also understand that, similar to a method with conditional steps, a system or computer-readable storage medium can repeat the steps of the method as many times as necessary to ensure that all of the conditional steps are executed.

[0065] In some embodiments, as shown in FIG. 1, an XR experience is provided to a user via an operating environment 100 that includes a computer system 101. The computer system 101 includes a controller 110 (e.g., a processor of a portable electronic device or a remote server), a display generation component 120 (e.g., a head-mounted device (HMD), a display, a projector, a touch screen, etc.), one or more input devices 125 (e.g., an eye tracking device 130, a hand tracking device 140, other input devices 150), one or more output devices 155 (e.g., speakers 160, a haptic output generator 170, and other output devices 180), one or more sensors 190 (e.g., an image sensor, a light sensor, a depth sensor, a tactile sensor, an orientation sensor, a proximity sensor, a temperature sensor, a location sensor, a motion sensor, a speed sensor, etc.), and optionally one or more peripheral devices 195 (e.g., home appliances, wearable devices, etc.). In some embodiments, one or more of the input device 125, the output device 155, the sensor 190, and the peripheral device 195 are integrated with the display generation component 120 (e.g., within a head-mounted device or a handheld device).

[0066] When describing an XR experience, various related but distinct environments are individually referred to using various terms for the user to perceive and / or interact with (e.g., using inputs detected by the computer system 101 to generate audio, visual, and / or haptic feedback corresponding to various inputs provided to the computer system 101 that generates the XR experience). The following is a subset of these terms.

[0067] Physical Environment: The physical environment refers to the physical world that people can perceive and / or interact with without the aid of an electronic system. Physical environments such as a physical park include physical objects such as physical trees, physical buildings, and physical people. People can directly perceive and / or interact with the physical environment through senses such as vision, touch, hearing, taste, and smell.

[0068] Extended Reality: In contrast, an extended reality (XR) environment refers to an environment that is wholly or partially simulated and with which people can perceive and / or interact through an electronic system. In XR, a subset or representation of a person's body movements is tracked, and in response, one or more characteristics of one or more virtual objects simulated within the XR environment are adjusted to behave according to at least one law of physics. For example, an XR system can detect the rotation of a person's head and, in response, adjust the graphic content and sound field presented to the person in a manner similar to how such views and sounds would change in the physical environment. Depending on the situation (e.g., for accessibility reasons), the adjustment of the characteristics of the virtual object(s) in the XR environment may be made in response to a representation of a body movement (e.g., a voice command). People may use any one of these senses including vision, hearing, touch, taste, and smell to perceive and / or interact with XR objects. For example, a person can perceive and / or interact with an audio object that creates a 3D or spatial audio environment that provides a perception of a point audio source within a 3D space. In another example, an audio object can enable audio transparency that selectively incorporates ambient sound from the physical environment, with or without including computer-generated audio. In some XR environments, people may only perceive and / or interact with audio objects.

[0069] Examples of XR include virtual reality and mixed reality.

[0070] Virtual Reality: A virtual reality (VR) environment refers to an imitation environment designed to be based entirely on computer-generated sensory inputs for one or more senses. A VR environment includes multiple virtual objects that a person can perceive and / or interact with. For example, computer-generated images of trees, buildings, and avatars representing people are examples of virtual objects. A person can perceive and / or interact with virtual objects in a VR environment through a simulation of the person's presence within the computer-generated environment and / or through a simulation of a subset of the person's physical movements within the computer-generated environment.

[0071] Mixed Reality: In contrast to a VR environment designed to be based entirely on computer-generated sensory inputs, a mixed reality (MR) environment refers to an imitation environment designed to incorporate sensory inputs or their representations from the physical environment in addition to including computer-generated sensory inputs (e.g., virtual objects). On the virtual continuum, an MR environment is anywhere between, but not including, a complete physical environment at one end and a virtual reality environment at the other end. In some MR environments, the computer-generated sensory inputs can respond to changes in sensory inputs from the physical environment. Also, some electronic systems for presenting an MR environment may track the location and / or orientation with respect to the physical environment to enable virtual objects to interact with real objects (i.e., physical items or their representations from the physical environment). For example, the system may take movement into account so that a virtual tree appears stationary relative to the physical ground.

[0072] Examples of mixed reality include augmented reality and augmented virtuality.

[0073] Augmented Reality: An augmented reality (AR) environment refers to an imitative environment in which one or more virtual objects are superimposed on a physical environment or its representation. For example, an electronic system for presenting an AR environment may have a transparent or translucent display through which a person can directly view the physical environment. The system may be configured to present virtual objects on the transparent or translucent display, whereby a person can use the system to perceive virtual objects superimposed on the physical environment. Alternatively, the system may have an opaque display and one or more imaging sensors that capture an image or video of the physical environment, which is a representation of the physical environment. The system synthesizes the image or video with virtual objects and presents the composite on the opaque display. A person uses this system to indirectly view the physical environment through the image or video of the physical environment and perceive virtual objects superimposed on the physical environment. As used herein, a video of the physical environment shown on an opaque display is referred to as a "pass-through video," meaning that the system uses one or more image sensors (singular or plural) to capture an image of the physical environment and uses those images when presenting the AR environment on the opaque display. Further alternatively, the system may have a projection system that projects virtual objects into the physical environment or onto a physical surface, for example, as a hologram, whereby a person can use the system to perceive virtual objects superimposed on the physical environment. An augmented reality environment also refers to an imitative environment in which the representation of the physical environment is transformed by computer-generated sensory information. For example, when providing a pass-through video, the system may transform one or more sensor images to map to a selected perspective (e.g., viewpoint) different from the perspective captured by the imaging sensor. As another example, the representation of the physical environment may be transformed by graphically modifying (e.g., magnifying) a portion thereof, thereby making the modified portion a modified version that represents the original captured image but is non-photorealistic. As a further example, the representation of the physical environment may be transformed by graphically removing or obscuring a portion thereof.

[0074] Augmented Virtuality: An augmented virtuality (AV) environment refers to an emulated environment in which a virtual environment or computer-generated environment incorporates one or more sensory inputs from the physical environment. The sensory input can be a representation of one or more characteristics of the physical environment. For example, an AV park may have virtual trees and virtual buildings, but people with faces are realistically reproduced from images of physical people. As another example, a virtual object may adopt the shape or color of a physical item imaged by one or more imaging sensors. As a further example, a virtual object can adopt a shadow that coincides with the position of the sun in the physical environment.

[0075] Viewpoint-locked virtual object: A virtual object is viewpoint-locked when the computer system displays the virtual object at the same location and / or position within the user's viewpoint even when the user's viewpoint shifts (e.g., changes). In an embodiment where the computer system is a head-mounted device, the user's viewpoint is locked in the forward direction of the user's head (e.g., the user's viewpoint is at least a portion of the user's field of view when the user is looking straight ahead). Thus, the user's viewpoint remains fixed even when the user's line of sight moves without moving the user's head. In an embodiment where the computer system has a display generation component (e.g., a display screen) that can be repositioned relative to the user's head, the user's viewpoint is the augmented reality view presented to the user on the computer system's display generation component. For example, a viewpoint-locked virtual object that is displayed at the upper left corner of the user's viewpoint when the user's viewpoint is in a first orientation (e.g., the user's head is facing north) continues to be displayed at the upper left corner of the user's viewpoint even when the user's viewpoint changes to a second orientation (e.g., the user's head is facing west). In other words, the location and / or position at which the viewpoint-locked virtual object is displayed in the user's viewpoint is independent of the user's position and / or orientation in the physical environment. In an embodiment where the computer system is a head-mounted device, the user's viewpoint is locked to the orientation of the user's head such that the virtual object is also referred to as a "head-locked virtual object".

[0076] Environment-Locked Virtual Object: A virtual object is environment-locked (or, "world-locked") when a computer system displays the virtual object at a location and / or position within the user's field of view that is based on (e.g., selected with reference to and / or fixed to) a location and / or object within a three-dimensional environment (e.g., a physical environment or a virtual environment). When the user's perspective shifts, the location and / or object within the environment relative to the user's perspective changes, and as a result, the environment-locked virtual object is displayed at a different location and / or position within the user's field of view. For example, an environment-locked virtual object locked to a tree directly in front of the user is displayed at the center of the user's field of view. If the user's perspective shifts to the right (e.g., the user's head is turned to the right) and the tree moves to the left within the user's field of view (e.g., the position of the tree within the user's field of view shifts), the environment-locked virtual object locked to the tree is displayed to the left within the user's field of view. In other words, the location and / or position at which the environment-locked virtual object is displayed within the user's field of view depends on the location and / or position and / or orientation of the location and / or object within the environment to which the virtual object is locked. In some embodiments, the computer system uses a stationary reference frame (e.g., a coordinate system fixed to a fixed location and / or object within a physical environment) to determine the position at which to display the environment-locked virtual object within the user's field of view. The environment-locked virtual object can be locked to a stationary part of the environment (e.g., the floor, a wall, a table, or other stationary object), or to a movable part of the environment (e.g., a vehicle, an animal, a person, or a representation of a part of the user's body such as the user's hand, wrist, arm, foot, etc. that moves independently of the user's perspective), such that the virtual object moves as the perspective or the part of the environment moves in order to maintain a fixed relationship between the virtual object and the part of the environment.

[0077] In some embodiments, an environment-locked or viewpoint-locked virtual object exhibits a delayed following behavior that reduces or delays the movement of the environment-locked or viewpoint-locked virtual object relative to the movement of a reference point that the virtual object is following. In some embodiments, when exhibiting the delayed following behavior, the computer system intentionally delays the movement of the virtual object when detecting the movement of a reference point (e.g., a part of the environment, a viewpoint, or a point fixed relative to the viewpoint such as a point between 5 and 300 cm from the viewpoint) that the virtual object is following. For example, when the reference point (e.g., a part of the environment or a viewpoint) moves at a first speed, the virtual object is moved by the device so as to remain locked to the reference point but moves at a second speed that is slower than the first speed (e.g., until the reference point stops or decelerates its movement, at which point the virtual object begins to catch up to the reference point). In some embodiments, when the virtual object exhibits the delayed following behavior, the device ignores a small amount of movement of the reference point (e.g., movement less than a threshold amount of movement such as movement of 0 to 5 degrees or 0 to 50 cm). For example, when the reference point (e.g., the part of the environment or the viewpoint to which the virtual object is locked) moves by a first amount, the distance between the reference point and the virtual object increases (e.g., because the virtual object is displayed to maintain a position fixed or substantially fixed relative to a viewpoint or a part of the environment different from the reference point to which the virtual object is locked), and when the reference point (e.g., the part of the environment or the viewpoint to which the virtual object is locked) moves by a second amount that is greater than the first amount, the distance between the reference point and the virtual object first increases (e.g., because the virtual object is displayed to maintain a position fixed or substantially fixed relative to a viewpoint or a part of the environment different from the reference point to which the virtual object is locked), and then is moved by the computer system so as to maintain a position fixed or substantially fixed relative to the reference point, and thus decreases as the amount of movement of the reference point increases beyond a threshold (e.g., a "delayed following" threshold).In some embodiments, a virtual object that maintains a position substantially fixed relative to a reference point includes the virtual object being displayed within a threshold distance (e.g., 1, 2, 3, 5, 15, 20, 50 cm) of the reference point in one or more dimensions (e.g., up / down, left / right, and / or forward / backward relative to the position of the reference point).

[0078] Hardware: There are many different types of electronic systems that enable a person to perceive and / or interact with various XR environments. Examples include head-mounted systems, projection-based systems, head-up displays (HUDs), vehicle windshields with integrated display capabilities, windows with integrated display capabilities, displays formed as lenses designed to be placed on top of a person's eyes (e.g., contact lenses), headphones / earphones, speaker arrays, input systems (e.g., wearable controllers or handheld controllers with or without tactile feedback), smartphones, tablets, and desktop / laptop computers. A head-mounted system may include speakers integrated into the head-mounted system and / or other audio output devices to provide audio output. A head-mounted system may have one or more speakers (singular or plural) and an integrated opaque display. Alternatively, a head-mounted system may be configured to accept an external opaque display (e.g., a smartphone). A head-mounted system may incorporate one or more imaging sensors for capturing an image or video of the physical environment and / or one or more microphones for capturing audio of the physical environment. A head-mounted system may have a transparent or translucent display instead of an opaque display. The transparent or translucent display may have a medium through which light representing an image is directed towards a person's eyes. The display can utilize digital light projection, OLED, LED, uLED, liquid crystal on silicon, laser scan light sources, or any combination of these technologies. The medium may be an optical waveguide, hologram medium, optical coupler, optical reflector, or any combination thereof. In one embodiment, the transparent or translucent display may be configured to selectively become opaque. A projection-based system can employ retinal projection technology to project a graphical image onto a person's retina.The projection system may also be configured to project virtual objects into the physical environment, for example, as holograms or onto a physical surface. In some embodiments, the controller 110 is configured to manage and adjust the XR experience for the user. In some embodiments, the controller 110 includes a suitable combination of software, firmware, and / or hardware. The controller 110 will be described in more detail below with reference to FIG. 2. In some embodiments, the controller 110 is a computing device that is local or remote to the scene 105 (e.g., a physical environment). For example, the controller 110 is a local server located within the scene 105. In another example, the controller 110 is a remote server (e.g., a cloud server, a central server, etc.) located outside the scene 105. In some embodiments, the controller 110 is communicatively coupled to the display generation component 120 (e.g., an HMD, a display, a projector, a touch screen, etc.) via one or more wired or wireless communication channels 144 (e.g., BLUETOOTH, IEEE802.11x, IEEE802.16x, IEEE802.3x, etc.). In another example, the controller 110 is included within the housing (e.g., a physical housing) of one or more of the display generation component 120 (e.g., an HMD, or a portable electronic device including a display and one or more processors, etc.), one or more of the input devices 125, one or more of the output devices 155, one or more of the sensors 190, and / or one or more of the peripheral devices 195, or shares the same physical housing or support structure as one or more of the above.

[0079] In some embodiments, the display generation component 120 is configured to provide a user with an XR experience (e.g., at least a visual component of the XR experience). In some embodiments, the display generation component 120 includes a suitable combination of software, firmware, and / or hardware. The display generation component 120 will be described in more detail below with reference to FIG. 3. In some embodiments, the functions of the controller 110 are provided by and / or combined with the display generation component 120.

[0080] According to some embodiments, the display generation component 120 provides a user with an XR experience while the user is virtually and / or physically present within the scene 105.

[0081] In some embodiments, the display generation component is worn on a part of the user's body (e.g., the user's own head or hand). Thus, the display generation component 120 includes one or more XR displays provided for displaying XR content. For example, in various embodiments, the display generation component 120 surrounds the user's field of view. In some embodiments, the display generation component 120 is a handheld device (such as a smartphone or a tablet) configured to present XR content, and the user holds a device having a display directed towards the user's field of view and a camera directed towards the scene 105. In some embodiments, the handheld device is optionally disposed within a housing worn on the user's head. In some embodiments, the handheld device is optionally disposed on a support (e.g., a tripod) in front of the user. In some embodiments, the display generation component 120 is an XR chamber, housing, or room configured to present XR content with the user not wearing or holding the display generation component 120. Many user interfaces described with reference to one type of hardware for displaying XR content (e.g., a device on a handheld or tripod) can be implemented on another type of hardware for displaying XR content (e.g., an HMD or other wearable computing device). For example, a user interface that indicates an interaction with XR content triggered based on an interaction occurring within the space in front of a handheld or tripod-mounted device can be implemented in the same way as an HMD where the interaction occurs within the space in front of the HMD and the response of the XR content is displayed via the HMD. Similarly, a user interface that indicates an interaction with XR content triggered based on the movement of a handheld or tripod-mounted device relative to the physical environment (e.g., scene 105 or a part of the user's body (e.g., the user's eye(s), head, or hand)) can be implemented in the same way as an HMD where the movement is caused by the movement of the HMD relative to the physical environment (e.g., scene 105 or a part of the user's body (e.g., the user's eye(s), head, or hand)).

[0082] Although the relevant features of the operating environment 100 are shown in FIG. 1, those skilled in the art will understand from this disclosure that various other features are not shown for the sake of brevity so as not to obscure more suitable aspects of the exemplary embodiments disclosed herein.

[0083] FIG. 2 is a block diagram of an example of a controller 110 according to some embodiments. Although certain features are shown, those skilled in the art will understand from this disclosure that various other features are not shown for the sake of brevity so as not to obscure more suitable aspects of the embodiments disclosed herein. Thus, by way of non-limiting example, in some embodiments, the controller 110 includes one or more processing units 202 (e.g., microprocessors, application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), graphics processing units (GPUs), central processing units (CPUs), processing cores, etc.), one or more input / output (I / O) devices 206, one or more communication interfaces 208 (e.g., Universal Serial Bus (USB), FIREWIRE, THUNDERBOLT, IEEE 802.3x, IEEE 802.11x, IEEE 802.16x, Global System for Mobile Communications (GSM), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Global Positioning System (GPS), Infrared (IR), BLUETOOTH, ZIGBEE, or similar types of interfaces), one or more programming (e.g., I / O) interfaces 210, a memory 220, and one or more communication buses 204 for interconnecting these and various other components.

[0084] In some embodiments, one or more communication buses 204 include circuitry for interconnecting and controlling communication between system components. In some embodiments, one or more I / O devices 206 include at least one of a keyboard, a mouse, a touchpad, a joystick, one or more microphones, one or more speakers, one or more image sensors, one or more displays, etc.

[0085] Memory 220 includes high-speed random access memory such as dynamic random-access memory (DRAM), static random-access memory (SRAM), double-data-rate random-access memory (DDRRAM), or other random access solid-state memory devices. In some embodiments, memory 220 includes non-volatile memory such as one or more magnetic storage devices, optical storage devices, flash memory devices, or other non-volatile solid-state storage devices. Memory 220 optionally includes one or more storage devices located remotely from one or more processing units 202. Memory 220 includes a non-transitory computer-readable storage medium. In some embodiments, memory 220, or the non-transitory computer-readable storage medium of memory 220, stores the following programs, modules, and data structures, or subsets thereof, including an optional operating system 230 and XR experience module 240.

[0086] Operating system 230 includes instructions for processing various basic system services and performing hardware-dependent tasks. In some embodiments, XR experience module 240 is configured to manage and coordinate one or more XR experiences for one or more users (e.g., a single XR experience for one or more users, or multiple XR experiences for each of one or more groups of users). To that end, in various embodiments, XR experience module 240 includes a data acquisition unit 241, a tracking unit 242, an adjustment unit 246, and a data transmission unit 248.

[0087] In some embodiments, the data acquisition unit 241 is configured to acquire data (e.g., presentation data, interaction data, sensor data, location data, etc.) from at least the display generation component 120 of FIG. 1, and optionally from one or more of the input device 125, the output device 155, the sensor 190, and / or the peripheral device 195. For that purpose, in various embodiments, the data acquisition unit 241 includes its instructions and / or logic, and the heuristics and metadata therefor.

[0088] In some embodiments, the tracking unit 242 is configured to map the scene 105 and track at least the position / location of the display generation component 120 with respect to the scene 105 of FIG. 1 and optionally with respect to one or more of the input device 125, the output device 155, the sensor 190, and / or the peripheral device 195. For that purpose, in various embodiments, the tracking unit 242 includes its instructions and / or logic, and the heuristics and metadata therefor. In some embodiments, the tracking unit 242 includes a hand tracking unit 244 and / or an eye tracking unit 243. In some embodiments, the hand tracking unit 244 is configured to track the position / location of one or more parts of the user's hand and / or the movement of one or more parts of the user's hand with respect to the scene 105 of FIG. 1, with respect to the display generation component 120, and / or with respect to a coordinate system defined for the user's hand. The hand tracking unit 244 will be described in more detail below with respect to FIG. 4. In some embodiments, the eye tracking unit 243 is configured to track the position and movement of the user's line of sight (or more generally the user's eyes, face, or head) with respect to the scene 105 (e.g., the physical environment and / or the user (e.g., the user's hand)) or with respect to the XR content displayed via the display generation component 120. The eye tracking unit 243 will be described in more detail below with respect to FIG. 5.

[0089] In some embodiments, the adjustment unit 246 is configured to manage and adjust the XR experience presented to the user by the display generation component 120 and, optionally, by one or more of the output device 155 and / or the peripheral device 195. For that purpose, in various embodiments, the adjustment unit 246 includes its instructions and / or logic, as well as the heuristics and metadata therefor.

[0090] In some embodiments, the data transmission unit 248 is configured to transmit data (e.g., presentation data, location data, etc.) to at least the display generation component 120 and, optionally, to one or more of the input device 125, the output device 155, the sensor 190, and / or the peripheral device 195. For that purpose, in various embodiments, the data transmission unit 248 includes its instructions and / or logic, as well as the heuristics and metadata therefor.

[0091] The data acquisition unit 241, the tracking unit 242 (including, for example, the eye tracking unit 243 and the hand tracking unit 244), the adjustment unit 246, and the data transmission unit 248 are shown as being present on a single device (e.g., the controller 110), but it should be understood that in other embodiments, any combination of the data acquisition unit 241, the tracking unit 242 (including, for example, the eye tracking unit 243 and the hand tracking unit 244), the adjustment unit 246, and the data transmission unit 248 can be located in separate computing devices.

[0092] Furthermore, FIG. 2 is more intended to illustrate the functions of various features that may exist in a particular embodiment, as contrasted with the structural overview of the embodiments described herein. As will be recognized by those skilled in the art, the separately shown items can be combined and some items can be separated. For example, several functional modules separately shown in FIG. 2 can be implemented in a single module, and the various functions of a single functional block can be implemented by one or more functional blocks in various embodiments. The actual number of modules, as well as the specific division of a particular function and how functions are assigned among them, vary depending on the implementation form and, in some embodiments, depend in part on a particular combination of hardware, software, and / or firmware selected for a particular implementation form.

[0093] FIG. 3 is a block diagram of an example of a display generation component 120 according to some embodiments. Although specific features are shown, those skilled in the art will understand from this disclosure that various other features are not shown for the sake of brevity so as not to obscure more suitable aspects of the embodiments disclosed herein. For that purpose, by way of non-limiting example, in some embodiments, the display generation component 120 (e.g., an HMD) includes one or more processing units 302 (e.g., a microprocessor, ASIC, FPGA, GPU, CPU, processing core, etc.), one or more input / output (I / O) devices and sensors 306, one or more communication interfaces 308 (e.g., USB, FIREWIRE, THUNDERBOLT, IEEE 802.3x, IEEE 802.11x, IEEE 802.16x, GSM, CDMA, TDMA, GPS, infrared, BLUETOOTH, ZIGBEE, and / or similar types of interfaces), one or more programming (e.g., I / O) interfaces 310, one or more XR displays 312, one or more optional inward and / or outward image sensors 314, a memory 320, and one or more communication buses 304 for interconnecting these and various other components.

[0094] In some embodiments, one or more communication buses 304 include circuitry that interconnects and controls communication between system components. In some embodiments, one or more I / O devices and sensors 306 include at least one of an inertial measurement unit (IMU), accelerometer, gyroscope, thermometer, one or more physiological sensors (e.g., blood pressure monitor, heart rate monitor, blood oxygen sensor, blood glucose sensor, etc.), one or more microphones, one or more speakers, a tactile engine, one or more depth sensors (e.g., structured light, time-of-flight, etc.), and the like.

[0095] In some embodiments, one or more XR displays 312 are configured to provide a user with an XR experience. In some embodiments, one or more XR displays 312 correspond to holographic, digital light processing (DLP), liquid crystal display (LCD), liquid crystal on silicon (LCoS), organic light emitting field effect transistor (OLET), organic light emitting diode (OLED), surface conduction electron emission device display (SED), field emission display (FED), quantum dot light emitting diode (QD-LED), MEMS, and / or similar display types. In some embodiments, one or more XR displays 312 correspond to waveguide displays, such as diffractive, reflective, polarizing, holographic, etc. For example, the display generation component 120 (e.g., an HMD) includes a single XR display. In another example, the display generation component 120 includes an XR display for each eye of the user. In some embodiments, one or more XR displays 312 can present MR or VR content. In some embodiments, one or more XR displays 312 can present MR or VR content.

[0096] In some embodiments, one or more image sensors 314 are configured to acquire image data corresponding to at least a portion of a user's face, including the user's eyes (and may be referred to as an eye-tracking camera). In some embodiments, one or more image sensors 314 are configured to acquire image data corresponding to at least a portion of the user's hand(s) and optionally the user's arm(s) (and may be referred to as a hand-tracking camera). In some embodiments, one or more image sensors 314 are configured to face forward to acquire image data corresponding to a scene that the user views when the display generation component 120 (e.g., an HMD) is not present (and may be referred to as a scene camera). One or more optional image sensors 314 can include one or more RGB cameras, one or more infrared (IR) cameras, one or more event-based cameras, and / or the like (e.g., including a complementary metal-oxide semiconductor (CMOS) image sensor or a charge-coupled device (CCD) image sensor).

[0097] Memory 320 includes high-speed random access memory, such as DRAM, SRAM, DDR RAM, or other random access solid-state memory devices. In some embodiments, memory 320 includes non-volatile memory, such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. Memory 320 optionally includes one or more storage devices located remotely from one or more processing units 302. Memory 320 includes a non-transitory computer-readable storage medium. In some embodiments, memory 320, or the non-transitory computer-readable storage medium of memory 320, stores the following programs, modules, and data structures, or subsets thereof, including an optional operating system 330 and an XR presentation module 340.

[0098] The operating system 330 includes instructions for processing various basic system services and instructions for performing hardware-dependent tasks. In some embodiments, the XR presentation module 340 is configured to present XR content to a user via one or more XR displays 312. For that purpose, in various embodiments, the XR presentation module 340 includes a data acquisition unit 342, an XR presentation unit 344, an XR map generation unit 346, and a data transmission unit 348.

[0099] In some embodiments, the data acquisition unit 342 is configured to acquire data (e.g., presentation data, interaction data, sensor data, location data, etc.) from at least the controller 110 of FIG. 1. For that purpose, in various embodiments, the data acquisition unit 342 includes its instructions and / or logic, as well as the heuristics and metadata therefor.

[0100] In some embodiments, the XR presentation unit 344 is configured to present XR content via one or more XR displays 312. For that purpose, in various embodiments, the XR presentation unit 344 includes its instructions and / or logic, as well as the heuristics and metadata therefor.

[0101] In some embodiments, the XR map generation unit 346 is configured to generate an XR map (e.g., a 3D map of a composite reality scene or a map of a physical environment in which computer-generated objects can be placed to generate augmented reality) based on media content data. For that purpose, in various embodiments, the XR map generation unit 346 includes its instructions and / or logic, as well as the heuristics and metadata therefor.

[0102] In some embodiments, the data transmission unit 348 is configured to transmit data (e.g., presentation data, location data, etc.) to at least the controller 110 and optionally one or more of the input device 125, output device 155, sensor 190, and / or peripheral device 195. For that purpose, in various embodiments, the data transmission unit 348 includes its instructions and / or logic, as well as the heuristics and metadata therefor.

[0103] The data acquisition unit 342, XR presentation unit 344, XR map generation unit 346, and data transmission unit 348 are shown as being present on a single device (e.g., the display generation component 120 of FIG. 1), but in other embodiments, it should be understood that any combination of the data acquisition unit 342, XR presentation unit 344, XR map generation unit 346, and data transmission unit 348 may be disposed within separate computing devices.

[0104] Furthermore, FIG. 3 is more intended to illustrate the functions of various features that may exist in a particular implementation, as opposed to the structural overview of the embodiments described herein. As will be recognized by those skilled in the art, the separately shown matters can be combined, and some matters can be separated. For example, several functional modules separately shown in FIG. 3 can be implemented within a single module, and the various functions of a single functional block can be executed by one or more functional blocks in various embodiments. The actual number of modules, as well as the specific division of particular functions and how functions are allocated among them, vary depending on the implementation, and in some embodiments, they depend in part on the particular combination of hardware, software, and / or firmware selected for a particular implementation.

[0105] FIG. 4 is a schematic diagram of an exemplary embodiment of a hand tracking device 140. In some embodiments, the hand tracking device 140 (FIG. 1) is for the scene 105 of FIG. 1 (e.g., for a part of the physical environment surrounding the user, for the display generation component 120, or for a part of the user (e.g., the user's face, eyes, or head), and / or for a coordinate system defined with respect to the user's hand) to track the location / position of one or more parts of the user's hand and / or the movement of one or more parts of the user's hand, and is controlled by a hand tracking unit 244 (FIG. 2). In some embodiments, the hand tracking device 140 is part of the display generation component 120 (e.g., embedded in or attached to a head-mounted device). In some embodiments, the hand tracking device 140 is separate from the display generation component 120 (e.g., located in a separate housing or attached to a separate physical support structure).

[0106] In some embodiments, the hand tracking device 140 includes an image sensor 404 (e.g., one or more IR cameras, 3D cameras, depth cameras, and / or color cameras, etc.) that captures three-dimensional scene information including at least the hand 406 of a human user. The image sensor 404 captures hand images at a resolution sufficient to distinguish the fingers and their respective positions. The image sensor 404 typically captures images of other parts of the user's body, or all of the body, and can have either a zoom function or a dedicated sensor with high magnification to capture hand images at the desired resolution. In some embodiments, the image sensor 404 also captures 2D color video images of the hand 406 and other elements of the scene. In some embodiments, the image sensor 404 is used in conjunction with other image sensors that capture the physical environment of the scene 105, or functions as an image sensor that captures the physical environment of the scene 105. In some embodiments, the image sensor 404 is positioned relative to the user or the user's environment such that the field of view of the image sensor or a portion thereof is used to define an interaction space in which hand movements captured by the image sensor are processed as inputs to the controller 110.

[0107] In some embodiments, the image sensor 404 outputs a sequence of frames including 3D map data (and optionally also color image data) to the controller 110, thereby extracting high-level information from the map data. This high-level information is typically provided to an application running on the controller via an application programming interface (API), and in response drives the display generation component 120. For example, the user can interact with the software running on the controller 110 by moving their hand 406 and changing the pose of their hand.

[0108] In some embodiments, the image sensor 404 projects a spot pattern onto a scene that includes the hand 406 and captures an image of the projected pattern. In some embodiments, the controller 110 calculates the 3D coordinates of points in the scene (including points on the surface of the user's hand) by triangulation based on the lateral shift of the spots of the pattern. This approach is advantageous in that the user does not need to hold or wear any kind of beacon, sensor, or other marker. This gives the depth coordinates of points in the scene relative to a predetermined reference plane at a particular distance from the image sensor 404. In the present disclosure, it is assumed that the image sensor 404 defines a series of orthogonal x, y, and z axes such that the depth coordinates of points in the scene correspond to the z component measured by the image sensor. Alternatively, the image sensor 404 (e.g., a hand tracking device) can use other 3D mapping methods such as stereoscopy or time-of-flight measurement based on single or multiple cameras or other types of sensors.

[0109] In some embodiments, the hand tracking device 140 captures and processes a temporal sequence of depth maps of the user's hand while the user is moving their hand (e.g., the entire hand or one or more fingers). Software operating on a processor within the image sensor 404 and / or the controller 110 processes the 3D map data to extract hand patch descriptors within these depth maps. The software compares these descriptors to patch descriptors stored in the database 408 based on a previous learning process to estimate the hand pose in each frame. The pose typically includes the 3D locations of the user's hand joints and fingertips.

[0110] Software can also analyze the trajectories of hands and / or fingers over multiple frames within a sequence to identify gestures. The pose estimation function described herein may be interleaved with the motion tracking function, such that patch-based pose estimation is only performed once every two (or more) frames, while tracking is used to detect changes in pose occurring over the remaining frames. Pose, motion, and gesture information are provided to application programs running on the controller 110 via the APIs described above. This program can, for example, move and modify an image presented on the display generation component 120 or perform other functions in response to pose and / or gesture information.

[0111] In some embodiments, gestures include air gestures. An air gesture is a gesture that is detected without (or independently of) the user touching an input element that is part of a device (e.g., computer system 101, one or more input devices 125, and / or hand tracking device 140), and is based on detected movement of a part of the user's body in the air (e.g., head, one or more arms, one or more hands, one or more fingers, and / or one or more legs), including movement of the user's body relative to an absolute reference (e.g., the angle of the user's arm relative to the ground, or the distance of the user's hand relative to the ground), movement of the user's body relative to another part of the user's body (e.g., movement of the user's hand relative to the user's shoulder, movement of one of the user's hands relative to the other of the user's hands, and / or movement of the user's fingers relative to another finger or part of the user's hand), and / or absolute movement of a part of the user's body (e.g., tap gestures including movement of the hand in a predetermined pose by a predetermined amount and / or speed, or shake gestures including a predetermined speed or amount of rotation of a part of the user's body).

[0112] In some embodiments, the input gestures used in the various examples and embodiments described herein are air gestures performed by the movement of a user's finger(s) relative to other finger(s) or part(s) of the user's hand for interacting with an XR environment (e.g., a virtual or mixed reality environment) according to some embodiments. In some embodiments, an air gesture is a gesture that is detected without the user touching (or independently of) an input element that is part of the device, and is based on detected movement of a part of the user's body, such as movement of the user's body relative to an absolute reference (e.g., the angle of the user's arm relative to the ground, or the distance of the user's hand relative to the ground), movement of the user's body relative to another part of the user's body (e.g., movement of the user's hand relative to the user's shoulder, movement of the user's other hand relative to one of the user's hands, and / or movement of the user's finger relative to another finger or part of the user's hand), and / or absolute movement of a part of the user's body (e.g., a tap gesture including movement of the hand in a predetermined pose with a predetermined amount and / or speed, or a shake gesture including rotation of a part of the user's body at a predetermined speed or amount).

[0113] In some embodiments where the input gesture is an air gesture (i.e., there is no physical contact with an input device that provides the computer system with information regarding which user interface element is the target of the user input, such as contact with a user interface element displayed on a touch screen or contact with a mouse or trackpad to move a cursor to a user interface element), the gesture takes into account the user's attention (e.g., line of sight) to determine the target of the user input (e.g., in the case of direct input). Thus, in implementations that include air gestures, the input gesture is, for example, detected attention (e.g., line of sight) to a user interface element in combination with (e.g., simultaneously) movement of the user's finger(s) and / or hand for performing a pinch and / or tap input, as described in more detail below.

[0114] In some embodiments, input gestures directed to a user interface object are performed directly or indirectly with reference to the user interface object. For example, user input is performed directly on a user interface object when performing an input gesture with the user's hand at a position corresponding to the position of the user interface object in a three-dimensional environment (e.g., as determined based on the user's current perspective). In some embodiments, the input gesture is performed indirectly on the user interface object according to the user who performs the input gesture while detecting the user's attention (e.g., line of sight) to the user interface object, during which the position of the user's hand is not at a position corresponding to the position of the user interface object in the three-dimensional environment. For example, in the case of a direct input gesture, the user can direct the user's input to the user interface object by starting a gesture at a position corresponding to or near the display position of the user interface object (e.g., within a distance of 0.5 cm, 1 cm, 5 cm, or 0 - 5 cm measured from the outer edge of the option or the central part of the option). In the case of an indirect input gesture, the user can direct the user's input to the user interface object by paying attention to the user interface object (e.g., by gazing at the user interface object), and while paying attention to the option, the user starts an input gesture (e.g., at any position detectable by the computer system) (e.g., at a position not corresponding to the display position of the user interface object).

[0115] In some embodiments, the input gestures (e.g., air gestures) used in the various examples and embodiments described herein include pinch inputs and tap inputs for interacting with a virtual or augmented reality environment in some embodiments. For example, the pinch inputs and tap inputs described below are performed as air gestures.

[0116] In some embodiments, the pinch input is part of an air gesture that includes one or more of a pinch gesture, a long pinch gesture, a pinch and drag gesture, or a double pinch gesture. For example, the pinch gesture, which is an air gesture, involves moving two or more fingers of a hand so as to contact each other, i.e., optionally including an interruption immediately after contacting each other (e.g., within 0 to 1 second). The long pinch gesture, which is an air gesture, involves moving two or more fingers of a hand so as to contact each other for at least a threshold amount of time (e.g., at least 1 second) before detecting an interruption in the contact with each other. For example, the long pinch gesture includes the user holding a pinch gesture (e.g., when two or more fingers are in contact), and the long pinch gesture continues until an interruption in the contact between two or more fingers is detected. In some embodiments, the double pinch gesture, which is an air gesture, includes two (e.g., or more) pinch inputs (e.g., performed with the same hand) that are detected directly in succession (e.g., within a predetermined period) of each other. For example, the user performs a first pinch input (e.g., a pinch input or a long pinch input), releases the first pinch input (e.g., breaks the contact between two or more fingers), and then performs a second pinch input within a predetermined period (e.g., within 1 second or within 2 seconds) after releasing the first pinch input.

[0117] In some embodiments, a pinch-and-drag gesture, which is an air gesture, includes a pinch gesture (e.g., a pinch gesture or a long pinch gesture) that is performed in relation to (e.g., after) a drag input that changes the position of the user's hand from a first position (e.g., the starting position of the drag) to a second position (e.g., the ending position of the resistance). In some embodiments, the user maintains the pinch gesture while performing the drag input and releases the pinch gesture (e.g., opens two or more fingers) to end the drag gesture (e.g., at the second position). In some embodiments, the pinch input and the drag input are performed by the same hand (e.g., the user pinches two or more fingers together and touches each other, and moves the same hand to a second position in the air with a drag gesture). In some embodiments, the pinch input is performed by the user's first hand, and the drag input is performed by the user's second hand (e.g., the user's second hand moves from the first position to the second position in the air while the user continues the pinch input with the user's first hand). In some embodiments, an input gesture, which is an air gesture, includes an input (e.g., a pinch input and / or a tap input) that is performed using both of the user's hands. For example, the input gesture includes two (e.g., or more) pinch inputs that are performed in relation to each other (e.g., simultaneously within a predetermined period or within a predetermined period). For example, a first pinch gesture (e.g., a pinch input, a long pinch input, or a pinch-and-drag input) performed using the user's first hand, and in relation to performing the pinch input using the first hand, a second pinch input is performed using the other hand (e.g., the second hand of the user's two hands). In some embodiments, the movement between the user's two hands (e.g., to increase and / or decrease the distance or relative orientation between the user's two hands).

[0118] In some embodiments, a tap input that is performed as an air gesture (e.g., directed at a user interface element) includes movement(s) of the user's finger(s) toward the user interface element, optionally movement of the user's hand with the user's finger(s) extended toward the user interface element, movement of the user's finger downward (e.g., mimicking a mouse click or a tap on a touch screen), or other predefined movement of the user's hand. In some embodiments, a tap input that is performed as an air gesture is detected based on movement characteristics of a finger or hand that performs a tap gesture away from the user's perspective and / or toward an object that is the target of the tap input and where the movement continues to an end. In some embodiments, an end of the movement is detected based on a change in movement characteristics of a finger or hand that performs a tap gesture (e.g., movement away from the user's perspective and / or movement toward an object that is the target of the tap input, reversal of the direction of movement of the finger or hand, and / or reversal of the direction of acceleration of the movement of the finger or hand).

[0119] In some embodiments, the user's attention is determined to be directed at a portion of a three-dimensional environment based on detection of a line of sight directed at the portion of the three-dimensional environment (optionally, without requiring other conditions). In some embodiments, for the device to determine that the user's attention is directed at a portion of a three-dimensional environment, while the user's viewpoint is within a distance threshold from the portion of the three-dimensional environment, at least a threshold duration (e.g., dwell time) of the line of sight being directed at the portion of the three-dimensional environment is required, and / or one or more additional conditions such as the line of sight being directed at the portion of the three-dimensional environment are required. Based on detection of a line of sight directed at a portion of the three-dimensional environment with one or more of the additional conditions, the user's attention is determined to be directed at the portion of the three-dimensional environment. If one of the additional conditions is not satisfied, the device determines that the attention is not directed at the portion of the three-dimensional environment where the line of sight is directed (e.g., until one or more of the additional conditions are satisfied).

[0120] In some embodiments, the detection of the ready state configuration of the user or a part of the user is detected by a computer system. The detection of the ready state configuration of the hand is used by the computer system as an indication that the user is likely preparing to interact with the computer system using one or more air gesture inputs (e.g., pinch, tap, pinch and drag, double pinch, long pinch, or other air gestures described herein) performed by the hand. For example, the ready state of the hand is determined based on whether the hand has a predetermined hand shape (e.g., a pre-pinch shape where the thumb and one or more fingers are extended and spaced apart to be ready to perform a pinch or grab gesture, or a pre-tap where one or more fingers are extended and the palm is facing away from the user), whether the hand is in a predetermined position relative to the user's perspective (e.g., under the user's head, above the user's waist, extended at least 15 cm, 20 cm, 25 cm, 30 cm, or 50 cm from the body), and / or whether the hand has moved in a particular way (e.g., moved towards the area in front of the user above the user's waist and under the user's head, or away from the user's body or legs). In some embodiments, the ready state is used to determine whether the interaction elements of the user interface respond to attention (e.g., gaze) input.

[0121] In some embodiments, software may be downloaded in electronic form to the controller 110, e.g., over a network, or alternatively may be provided on a tangible non-transitory medium such as an optical, magnetic, or electronic memory medium. In some embodiments, the database 408 is similarly stored in a memory associated with the controller 110. Alternatively or additionally, some or all of the described functions of the computer may be implemented in dedicated hardware such as a custom or semi-custom integrated circuit or a programmable digital signal processor (DSP). The controller 110 is shown in FIG. 4 as a separate unit from the image sensor 404 by way of example, but some or all of the processing functions of the controller can be associated with the image sensor 404 by a suitable microprocessor and software, or by dedicated circuitry within the housing of the image sensor 404 (e.g., a hand tracking device), or in other ways. In some embodiments, at least some of these processing functions are performed by a suitable processor integrated with the display generation component 120 (e.g., in a television set, a handheld device, or a head-mounted device), or using any other suitable computerized device such as a game console or a media player. The sensing function of the image sensor 404 can similarly be integrated with a computer or other computerized device controlled by the sensor output.

[0122] FIG. 4 further includes a schematic diagram of a depth map 410 captured by an image sensor 404 in some embodiments. The depth map includes a matrix of pixels having respective depth values, as described above. The pixels 412 corresponding to the hand 406 are segmented from the background and wrist in this map. The luminance of each pixel in the depth map 410 is inversely proportional to the depth value, i.e., the measured z - distance from the image sensor 404, and the tone becomes darker as the depth increases. The controller 110 processes these depth values to identify and segment components (i.e., groups of adjacent pixels) of an image having the characteristics of a human hand. These characteristics can include, for example, the overall size, shape, and movement from frame to frame of a sequence of depth maps.

[0123] FIG. 4 also schematically shows a hand skeleton 414 that the controller 110 ultimately extracts from the depth map 410 of the hand 406 in some embodiments. In FIG. 4, the hand skeleton 414 is superimposed on the hand background 416 segmented from the original depth map. In some embodiments, the hand (e.g., finger joints, fingertips, the center of the palm, the end of the hand connected to the wrist, etc.), and optionally major feature points on the wrist or arm connected to the hand are identified and placed on the hand skeleton 414. In some embodiments, the locations and movements of these major feature points over a plurality of image frames are used by the controller 110 to determine, in some embodiments, the hand gesture or the current state of the hand being performed.

[0124] FIG. 5 shows an exemplary embodiment of an eye tracking device 130 (FIG. 1). In some embodiments, the eye tracking device 130 is controlled by an eye tracking unit 243 (FIG. 2) to track the position and movement of the user's line of sight with respect to scene 105 or XR content displayed via display generation component 120. In some embodiments, the eye tracking device 130 is integrated with the display generation component 120. For example, in some embodiments, if the display generation component 120 is a head-mounted device such as a headset, helmet, goggles, or glasses, or a handheld device disposed on a wearable frame, the head-mounted device includes both a component for generating XR content for viewing by the user and a component for tracking the user's line of sight with respect to the XR content. In some embodiments, the eye tracking device 130 is separate from the display generation component 120. For example, if the display generation component is a handheld device or an XR chamber, the eye tracking device 130 is optionally a device separate from the handheld device or XR chamber. In some embodiments, the eye tracking device 130 is a head-mounted device or part of a head-mounted device. In some embodiments, the head-mounted eye tracking device 130 is optionally used with a display generation component worn on the head or a display generation component not worn on the head. In some embodiments, the eye tracking device 130 is not a head-mounted device and is optionally used in combination with a head-mounted display generation component. In some embodiments, the eye tracking device 130 is not a head-mounted device and is optionally part of a non-head-mounted display generation component.

[0125] In some embodiments, the display generation component 120 uses a display mechanism (e.g., left and right near-eye display panels) that presents a frame including left and right images in front of the user's eyes to provide the user with a 3D virtual view. For example, the head-mounted display generation component may include left and right optical lenses (referred to herein as eyepieces) positioned between the display and the user's eyes. In some embodiments, the display generation component may include or be coupled to one or more external video cameras that capture video of the user's environment for display. In some embodiments, the head-mounted display generation component may have a transparent or translucent display on which the user can directly view the physical environment and on which virtual objects can be displayed. In some embodiments, the display generation component projects virtual objects onto the physical environment. The virtual objects are projected, for example, onto a physical surface or as a hologram, whereby an individual can use the system to observe virtual objects superimposed on the physical environment. In such cases, separate display panels and image frames for the left and right eyes may not be required.

[0126] As shown in FIG. 5, in some embodiments, the eye tracking device 130 (e.g., a gaze tracking device) includes at least one eye tracking camera (e.g., an infrared (IR) camera or a near-IR (NIR) camera), as well as an illumination source (e.g., an IR light source or an NIR light source such as an array or ring of LEDs) that emits light (e.g., IR light or NIR light) toward the user's eyes. The eye tracking camera may be directed at the user's eyes to directly receive reflected IR or NIR light from the light source, or alternatively, may be directed at a "hot" mirror placed between the user's eyes and a display panel that reflects IR or NIR light from the eyes to the eye tracking camera while allowing visual light to pass through. The eye tracking device 130 optionally captures an image of the user's eyes (e.g., as a video stream captured at 60 - 120 frames per second (fps)), analyzes the image to generate gaze tracking information, and communicates the gaze tracking information to the controller 110. In some embodiments, both of the user's eyes are tracked separately by respective eye tracking cameras and illumination sources. In some embodiments, only one of the user's eyes is tracked by an individual eye tracking camera and illumination source.

[0127] In some embodiments, the eye tracking device 130 is calibrated using a device-specific calibration process to determine parameters of the eye tracking device for a particular operating environment 100, such as the 3D geometric relationships and parameters of the LED, camera, hot mirror (if present), eyepiece, and display screen. The device-specific calibration process may be performed at the factory or another facility prior to delivery of the AR / VR device to the end user. The device-specific calibration process may be an automatic calibration process or a manual calibration process. The user-specific calibration process may include an estimation of specific user eye parameters such as pupil location, foveal location, optical axis, visual axis, interpupillary distance, etc. In some embodiments, once the device-specific and user-specific parameters for the eye tracking device 130 are determined, the images captured by the eye tracking camera are processed using a glint assist method to determine the user's current visual axis and viewpoint with respect to the display.

[0128] As shown in FIG. 5, the eye tracking device 130 (e.g., 130A or 130B) includes a line-of-sight tracking system including one or more eyepieces 520, at least one eye tracking camera 540 (e.g., an infrared (IR) or near-IR (NIR) camera) disposed on the side of the user's face where eye tracking is performed, and an illumination source 530 (e.g., an IR or NIR light source such as an array or ring of NIR light-emitting diodes (LEDs)) that emits light (e.g., IR or NIR light) toward the user's eye(s) 592. The eye tracking camera 540 is positioned between the user's eye(s) 592 and the display 510 (e.g., a display panel on the left or right side of a head-mounted display, or a display of a handheld device, a projector, etc.), and may be directed toward a mirror 550 that reflects IR or NIR light from the eye(s) 592 while transmitting visible light (as shown, for example, at the top of FIG. 5), or may be directed toward the user's eye(s) 592 to receive the reflected IR or NIR light from the eye(s) 592 (as shown, for example, at the bottom of FIG. 5).

[0129] In some embodiments, the controller 110 renders an AR or VR frame 562 (e.g., the left and right frames of the left and right display panels) and provides the frame 562 to the display 510. The controller 110 uses the eye tracking input 542 from the eye tracking camera 540, for example, when processing the frame 562 for display, for various purposes. The controller 110 optionally estimates the user's viewpoint on the display 510 based on the eye tracking input 542 obtained from the eye tracking camera 540 using a glint assist method or other suitable method. The viewpoint estimated from the eye tracking input 542 is optionally used to determine the direction in which the user is currently looking.

[0130] Examples of several possible use cases of the user's current line of sight direction are described below, but this is not intended to be limiting. As an exemplary use case, the controller 110 can render virtual content differently based on the determined line of sight direction of the user. For example, the controller 110 may generate virtual content at a higher resolution in the central visual region determined from the user's current line of sight direction than in the peripheral region. As another example, the controller may position or move virtual content within the view based at least in part on the user's current line of sight direction. As another example, the controller may display specific virtual content within the view based at least in part on the user's current line of sight direction. As another exemplary use case in an AR application, the controller 110 can capture the physical environment of the XR experience and direct the external camera to focus in the determined direction. The autofocus mechanism of the external camera can then focus on an object or surface within the environment that the user is currently looking at on the display 510. As another exemplary use case, the eyepiece 520 may be a focusable lens, and the line of sight tracking information is used by the controller to adjust the focus of the eyepiece 520 so that the virtual object the user is currently looking at has appropriate binocular coordination to match the convergence of the user's eyes 592. The controller 110 can utilize the line of sight tracking information to direct and adjust the focus of the eyepiece 520 so that the nearby object the user is looking at appears at the correct distance.

[0131] In some embodiments, the eye-tracking device is part of a head-mounted device that includes a display (e.g., display 510), two eyepieces (e.g., eyepiece(s) 520), an eye-tracking camera (e.g., eye-tracking camera(s) 540), and a light source (e.g., light source 530 (e.g., IR LED or NIR LED)) attached to a wearable housing. The light source emits light (e.g., IR light or NIR light) towards the user's eye(s) 592. In some embodiments, the light source may be arranged in a ring or circularly around each lens, as shown in FIG. 5. In some embodiments, eight light sources 530 (e.g., LEDs) are arranged around each lens 520 as an example. However, more or fewer light sources 530 may be used, and other arrangements and locations of the light sources 530 may be employed.

[0132] In some embodiments, the display 510 emits light within the visible light range and does not emit light within the IR or NIR range, so as not to introduce noise into the eye-tracking system. Note that the location and angle of the eye-tracking camera(s) 540 are given as an example and are not intended to be limiting. In some embodiments, a single eye-tracking camera 540 is located on each side of the user's face. In some embodiments, two or more NIR cameras 540 can be used on each side of the user's face. In some embodiments, a camera 540 with a wider field of view (FOV) and a camera 540 with a narrower FOV may be used on each side of the user's face. In some embodiments, a camera 540 operating at one wavelength (e.g., 850 nm) and a camera 540 operating at a different wavelength (e.g., 940 nm) may be used on each side of the user's face.

[0133] An embodiment of a gaze tracking system as shown in FIG. 5 can be used, for example, in computer-generated reality, virtual reality, and / or mixed reality applications to provide a user with an experience of computer-generated reality, virtual reality, augmented reality, and / or augmented virtuality.

[0134] FIG. 6 shows a glint-assisted gaze tracking pipeline according to some embodiments. In some embodiments, the gaze tracking pipeline is implemented by a glint-assisted gaze tracking system (e.g., an eye tracking device 130 as shown in FIGS. 1 and 5). The glint-assisted gaze tracking system can maintain a tracking state. Initially, the tracking state is off or "no". When in the tracking state, the glint-assisted gaze tracking system uses prior information from the previous frame when analyzing the current frame to track the pupil contour and glint within the current frame. When not in the tracking state, the glint-assisted gaze tracking system attempts to detect the pupil and glint within the current frame, and if successful, initializes the tracking state to "yes" and continues to the next frame in the tracking state.

[0135] As shown in FIG. 6, the gaze tracking camera can capture left and right images of the user's left and right eyes. The captured images are then input into the gaze tracking pipeline for processing starting at 610. As indicated by the arrow returning to element 600, the gaze tracking system can continue to capture images of the user's eyes, for example, at a rate of 60 to 120 frames per second. In some embodiments, each set of captured images may be input into the pipeline for processing. However, in some embodiments, or under some conditions, not all captured frames are processed by the pipeline.

[0136] At 610, for the currently captured image, if the tracking state is yes, this method proceeds to element 640. At 610, if the tracking state is no, as shown at 620, the image is analyzed to detect the user's pupils and glints within the image. At 630, if the pupils and glints are detected normally, the method proceeds to element 640. If not detected normally, the method returns to element 610 to process the next image of the user's eyes.

[0137] At 640, when proceeding from element 610, the current frame is analyzed to track the pupils and glints based in part on previous information from the previous frame. At 640, when proceeding from element 630, the tracking state is initialized based on the detected pupils and glints within the current frame. The result of the processing at element 640 is checked to confirm that the tracking or detection result is reliable. For example, the result can be checked to determine whether a sufficient number of glints for performing pupil and gaze estimation are tracked or detected normally in the current frame. At 650, if the result is not reliable, the tracking state is set to no at element 660 and the method returns to element 610 to process the next image of the user's eyes. At 650, if the result is reliable, the method proceeds to element 670. At 670, the tracking state is set to yes (if not already yes), and the pupil and glint information is passed to element 680 to estimate the user's viewpoint.

[0138] Figure 6 is intended to function as an example of an eye tracking technique that can be used in a particular implementation. As will be recognized by those skilled in the art, other eye tracking techniques that currently exist or may be developed in the future can be used in the computer system 101 to provide an XR experience to a user in some embodiments, instead of or in combination with the glint-assisted eye tracking technique described herein.

[0139] In the present disclosure, various input methods are described with respect to interaction with a computer system. If one example is provided using one input device or input method and another example is provided using another input device or input method, it should be understood that each example may be compatible with and optionally utilize the input device or input method described in another example. Similarly, various output methods are described with respect to interaction with a computer system. If one example is provided using one output device or output method and another example is provided using another output device or output method, it should be understood that each example may be compatible with and optionally utilize the output device or output method described in another example. Similarly, various methods are described with respect to interaction with a virtual environment or a mixed reality environment via a computer system. If one example is provided using interaction with a virtual environment and another example is provided using a mixed reality environment, it should be understood that each example may be compatible with and optionally utilize the method described in another example. Accordingly, the present disclosure discloses embodiments that are combinations of features of multiple examples without comprehensively listing all features of the embodiments in the description of each exemplary embodiment. User Interface and Related Processes

[0140] Next, attention is paid to embodiments of a user interface ("UI") and related processes that may be implemented on a computer system such as a portable multifunctional device or a head-mounted device that communicates with one or more display generation components.

[0141] Figures 7A - 7J show examples of generating and displaying a user representation. FIG. 8 is a flowchart of an exemplary method 800 for generating a user representation. FIG. 9 is a flowchart of an exemplary method 900 for displaying a user representation. The user interfaces of Figures 7A - 7J are used to illustrate the processes described below, including the processes of FIGS. 8 and 9.

[0142] Figures 7A-7J illustrate examples for capturing information used to generate a user's representation. In some embodiments, the user's representation is displayed for communication during a real-time communication session and / or otherwise used. In some embodiments, the real-time communication session includes real-time communication between a user of an electronic device and a second user associated with a second electronic device different from the first electronic device, and the real-time communication session includes displaying, via the electronic device and / or the second electronic device, a representation of the user's face and / or body expression to the second user via the user's representation and / or otherwise communicating. In some embodiments, the real-time communication session includes displaying the user's representation and / or outputting in real time audio corresponding to the user's utterance. In some embodiments, the first electronic device and the second electronic device communicate with each other (e.g., wirelessly) to enable information indicative of the user's representation and / or audio corresponding to the user's utterance to be transmitted between them. In some embodiments, the real-time communication session includes displaying the user's representation (and optionally, the representation of the second user) within an extended reality environment via the display devices of the first electronic device and the second electronic device.

[0143] FIG. 7A shows an electronic device 700 (e.g., a watch and / or a smartwatch) that displays a prompt 702 on a display 704. Additionally, FIG. 7A shows a physical environment 706 of a user 708 who is using and / or associated with the electronic device 700. In FIG. 7A, the electronic device 700 is worn on the wrist 708a of the user 708 within the physical environment 706. The electronic device 700 is a wearable device configured to be worn on the body of the user 708 (e.g., the wrist 708a of the user 708). In FIG. 7A, the electronic device 700 is a watch (e.g., a smartwatch). In some embodiments, the electronic device 700 is a headset, a helmet, goggles, glasses, or a handheld device disposed within a wearable frame. In some embodiments, the electronic device 700 is configured to be primarily used when worn on the body of the user 708, but the electronic device 700 can also be used when removed from the body of the user 708 (e.g., interacted with via the user 708 and / or used to capture information).

[0144] FIG. 7A shows a first portion 710 (e.g., a first face and / or a first side, a front side, and / or an inner portion of a head-mounted device (HMD)) of an electronic device 700 that includes a display 704 and a sensor 712 (e.g., an image sensor such as a camera). When the electronic device 700 is worn on a wrist 708a of a user 708 (or another part of the user 708's body such as a head 708d and / or a face 708c), the first portion 710 of the device 700 is visible from and / or unobstructed by the user 708's wrist 708a and / or arm 708b. In other words, the first portion 710 of the device is configured such that when the electronic device 700 is positioned on the user 708's wrist 708a (or another part of the user 708's body such as the user 708's head 708d and / or face 708c), the display 704 is positioned to be visible to the user 708 (e.g., the display 704 faces away from the wrist 708a, and / or the display 704 is positioned above and / or in front of the user 708's eyes). As described below, the electronic device 700 also includes a second portion 714 (e.g., a second face and / or a second side, a rear side, and / or an outer portion of the HMD) shown in FIG. 7D. When the electronic device 700 is worn on a wrist 708a of a user 708 (or another part of the user 708's body such as the user 708's head 708d and / or face 708c), the second portion 714 of the electronic device 700 is blocked by the user 708's wrist 708a and / or arm 708b (e.g., placed thereon, contacted thereby, and / or otherwise positioned adjacent thereto) (e.g., the second portion 714 of the HMD is not visible to the user because when the HMD is placed on the user 708's head 708d, the first portion 710 covers and / or is in front of the user 708's eyes). In other words, the second portion 714 of the electronic device 700 is positioned such that while the electronic device 700 is worn on the user 708's wrist 708a, the surface of the second portion 714 faces in a direction toward the user 708's wrist 708a (e.g., away from the user's face).

[0145] Figures 7A - 7J show the electronic device 700 as a wristwatch, but in some embodiments, the electronic device 700 is a head - mounted device (HMD). The HMD is configured to be worn on the head 708d of the user 708 and includes a first display on and / or within an inner portion of the HMD. The first display is visible to the user 708 when the user 708 wears the HMD on the user 708's head 708d. For example, when the HMD is disposed on the user 708's head 708d such that the first display is positioned above and / or in front of the user 708's eyes, it at least partially covers the user 708's eyes. In some embodiments, the HMD also includes a second display positioned on and / or within an outer portion of the HMD. In some embodiments, the second display is not visible to the user 708 when the HMD is disposed on the user 708's head 708d. Thus, the first display of the HMD displays a prompt 702 that instructs the user 708 to remove the HMD from the user 708's head 708d, and the second display of the HMD displays one or more additional prompts (e.g., content 722a) that provide the user 708 with instructions and / or guidance for using the HMD to capture one or more physical characteristics of the user 708 as described below.

[0146] In FIG. 7A, an electronic device 700 is worn on a body of a user 708 (e.g., a wrist 708a and / or another part of the body such as a head 708d and / or a face 708c), and a prompt 702 is displayed on a display 704. The prompt 702 includes an indication (e.g., text and / or an image) instructing the user 708 to remove the electronic device 700 from the body of the user 708 (e.g., remove the electronic device 700 from the wrist 708a of the user 708 and / or remove the electronic device 700 from another part of the body of the user 708 such as the head 708d and / or the face 708c of the user 708) in order to continue the registration process (e.g., setup process) of the electronic device 700. In FIG. 7A, the electronic device 700 is undergoing a registration process that includes capturing one or more physical characteristics of the user 708 to generate a representation 726 of the user 708 (e.g., a virtual representation such as an avatar including an appearance based on one or more captured physical characteristics of the user 708). As described below, the electronic device 700 uses sensors 720a - 720j that are in a position relative to the user 708 that is inaccessible, blocked, and / or otherwise not suitable for capturing one or more physical characteristics of the user 708 when the electronic device 700 is worn on the body of the user 708 (e.g., when the HMD is worn on the head 708d of the user 708, the sensors 720a - 720j of the HMD are not directed at individual body parts of the user 708). Thus, the electronic device 700 outputs a prompt 702 instructing the user 708 to remove the electronic device 700 from the body of the user 708 so that one or more of the sensors 720a - 720j can be effectively used to capture at least a portion of one or more physical characteristics of the user 708.FIG. 7A shows the prompt 702 as being displayed on the display 704 of the electronic device 700. However, in some embodiments, the prompt 702 instructs the user 708 to remove the electronic device 700 from the user 708's body (e.g., another part of the body such as the wrist 708a and / or the head 708d and / or the face 708c) (e.g., via the speaker of the electronic device 700) and / or haptic output (e.g., via one or more haptic output devices of the electronic device 700).

[0147] In some embodiments, the electronic device 700 starts a registration process when the electronic device 700 is powered on and / or in response thereto (e.g., when first powered on before the user 708 signs into an account associated with the electronic device 700, and / or when powered on while the electronic device 700 is in a setup operation mode). In some embodiments, the registration process is included within the initial setup process of the electronic device 700. In some embodiments, the initial setup process of the electronic device 700 captures one or more physical characteristics of the user 708 (e.g., via the sensor 712 and / or the sensors 720a-720j), captures biometric information of the user 708 (e.g., facial features, eye features, and / or fingerprints), an input calibration process (e.g., the electronic device 700 captures information that enables the electronic device 700 to detect, recognize, and / or respond to user input such as gaze user input, air gestures, voice commands, and / or tap gestures), and / or a spatial audio calibration process (e.g., the electronic device 700 outputs audio to simulate audio generated from a location within the physical environment 706 that is not the location of the speakers of the electronic device 700, and optionally, detects one or more user inputs corresponding to the perceived location of the output audio). In some embodiments, the electronic device 700 starts the registration process based on one or more user inputs that require the registration process to be started.

[0148] In FIG. 7B, the electronic device 700 remains positioned on the body of the user 708 (e.g., another part of the body such as the wrist 708a and / or the head 708d and / or the face 708c), and displays an instruction 716 (such as a direction) via the display 704. In some embodiments, the electronic device 700 displays the instruction 716 after a predetermined amount of time (e.g., 10 seconds, 15 seconds, 30 seconds, and / or 60 seconds) has elapsed after displaying the prompt 702, when the electronic device 700 has not been removed from the body of the user 708 (e.g., the wrist 708a and / or another part of the body such as the head 708d and / or the face 708c). The instruction 716 includes additional information, suggestions, and / or hints that provide guidance to the user 708 for completing the registration process. In FIG. 7B, the instruction 716 includes text that provides context to the user 708 about the registration process and notifies the user 708 how to use the electronic device 700 to complete at least a portion of the registration process. In FIG. 7B, the instruction 716 prompts the user 708 to direct sensors (e.g., sensors 720a - 720j) on a rear portion such as a second portion 714 of the electronic device 700 (e.g., an outer portion of the HMD) towards the face 708c and / or the head 708d of the user 708. FIG. 7B shows the instruction 716, which is text displayed on the display 704 of the electronic device 700, but in some embodiments, the instruction 716 includes an image, symbol, video, animation, audio, and / or text that provides guidance to the user 708 on how to orient and / or use the electronic device 700 to complete at least a portion of the registration process. For example, in some embodiments, the instruction 716 includes a video and / or an animated series of images that provide a visual example to the user 708 for using the electronic device 700 to complete at least a portion of the registration process.In some such embodiments, the video and / or animated series of images include visual indications of a person removing the electronic device 700 from the person's body, orienting the electronic device 700 (e.g., the second portion 714) towards a portion of the person's body, and / or the person moving and / or orienting a portion of their body, so that the user 708 can better understand how to complete at least a portion of the registration process.

[0149] In some embodiments, the instructions 716 include information indicating that one or more body features of the user 708 captured during at least a portion of the registration process are to be used to generate the representation 726. In some embodiments, the instructions 716 include information regarding using the representation 726 in a real-time communication session with another user associated with the external electronic device, which provides the user 708 with context regarding the purpose of capturing one or more body features of the user 708.

[0150] In FIG. 7C, the electronic device 700 remains positioned on the body of the user 708 (e.g., another part of the body such as the wrist 708a and / or the head 708d and / or the face 708c), and displays a prompt 718 via the display 704. In FIG. 7C, the prompt 718 includes an indication (e.g., text) related to the conditions of the physical environment 706 where the user 708 is located. In some embodiments, the sensor 712 (and / or other sensors) of the electronic device 700 captures information regarding the physical environment 706, and the electronic device 700 determines whether the captured information indicates one or more conditions that may affect capturing one or more physical characteristics of the user 708. In FIG. 7C, the electronic device 700 determines that the information regarding the physical environment 706 indicates that the physical environment 706 includes low illumination (e.g., light emitted from one or more light sources such as a light bulb, a lamp, and / or the sun does not reach the user in an amount sufficient to enable the electronic device to effectively capture one or more physical characteristics of the user 708). Accordingly, the electronic device 700 outputs a prompt 718 to warn and / or advise the user 708 that the illumination conditions in the physical environment 706 may affect capturing one or more physical characteristics of the user 708. FIG. 7C shows the electronic device 700 providing a prompt 718 related to the low illumination conditions of the physical environment 706, but in some embodiments, the electronic device 700 is configured to output prompts related to one or more other conditions of the physical environment 706, such as harsh illumination conditions, an object positioned between the electronic device 700 and the user 708 (e.g., an object that blocks an area where one or more sensors of the electronic device 700 are configured to capture information), and / or an object and / or accessory positioned on an individual part of the body of the user 708 (e.g., glasses, a face cover, a head cover, and / or a hat). In some embodiments, the electronic device 700 is configured to output a prompt when the electronic device 700 determines that a set of one or more criteria is met, such as when the electronic device 700 includes an amount of power and / or battery life that is less than a threshold amount.

[0151] In FIG. 7C, the prompt 718 includes a first portion 718a (e.g., the first portion of the text) that indicates conditions within the physical environment 706 that can affect capturing one or more physical characteristics of the user 708. Additionally, the prompt 718 includes a second portion 718b (e.g., the second portion of the text) that provides the user 708 with proposals and / or guidance regarding modifying conditions that can affect capturing one or more physical characteristics of the user 708. In FIG. 7C, the second portion 718b includes proposing to the user 708 to move to an area of the physical environment 706 (e.g., a brighter area) that includes an increased amount of illumination. In some embodiments, the second portion 718b includes proposals to turn on additional light sources and / or increase the amount of power supplied to the light sources. In some embodiments, the second portion 718b includes proposals for correcting and / or adjusting other conditions such as moving to an area within the physical environment 706 that includes less harsh illumination (e.g., cooler and / or darker illumination), removing and / or moving objects between the electronic device 700 and the user 708, removing and / or moving objects and / or accessories on individual parts of the user 708's body, and / or charging the electronic device 700.

[0152] In some embodiments, the prompt 718 includes visual prompts such as videos, images, symbols, emojis, animations, audio prompts, and / or tactile prompts that notify and / or warn the user 708 about conditions that can affect capturing one or more physical characteristics of the user 708 instead of and / or in addition to the text.

[0153] In FIG. 7D, user 708 is removing electronic device 700 from the user 708's body (e.g., another part of the body such as wrist 708a and / or head 708d and / or face 708c) within physical environment 706. Additionally, FIG. 7D shows a second portion 714 of electronic device 700 (e.g., the back and / or outer portion of the HMD) that is accessible and / or visible after user 708 removes electronic device 700 from the body (e.g., another part of the body such as wrist 708a and / or head 708d and / or face 708c). The second portion 714 of electronic device 700 includes sensors 720a - 720j configured to capture various information regarding user 708. In some embodiments, sensors 720a - 720j include one or more image sensors (e.g., IR camera, 3D camera, depth camera, color camera, RGB camera (e.g., having a complementary metal-oxide-semiconductor (CMOS) image sensor or a charge-coupled device (CCD) image sensor), one or more infrared (IR) cameras, and / or one or more event-based cameras), an inertial measurement unit (IMU), an accelerometer, a gyroscope, a thermometer, one or more physiological sensors (e.g., blood pressure monitor, heart rate monitor, blood oxygen sensor, blood glucose sensor, etc.), one or more microphones, one or more speakers, a tactile engine, one or more depth sensors (e.g., structured light, time-of-flight, and / or two or more cameras that determine depth based on the difference in perspective views of two or more cameras), one or more light sensors, one or more tactile sensors, one or more orientation sensors, one or more proximity sensors, one or more location sensors, one or more motion sensors, and / or one or more velocity sensors.

[0154] In FIG. 7D, the second portion 714 includes an area 722 (e.g., a portion of the second portion 714 that does not include sensors 720a-720j and / or an outer portion of the HMD that includes a display different from display 704). Area 722 includes content 722a (e.g., text as shown in FIG. 7D) that can be viewed and / or perceived by user 708. In some embodiments, area 722 includes one or more display generation components 722b that display content 722a. For example, area 722 is a display. In some embodiments, electronic device 700 provides instructions to user 708 to capture one or more physical characteristics of user 708 using electronic device 700 (e.g., via sensors 720a-720j) and / or otherwise guides user 708 to display visual indications on one or more display generation components 722b.

[0155] In some embodiments, the electronic device 700 detects that the electronic device 700 has been removed from the user 708's body (e.g., the wrist 708a and / or another part of the body such as the head 708d and / or the face 708c). In response to detecting that the electronic device 700 has been removed from the user 708's body (e.g., the wrist 708a and / or another part of the body such as the head 708d and / or the face 708c), the electronic device 700 causes one or more display generation components 722b to display one or more prompts that direct and / or guide the user 708 to use the electronic device 700 to capture one or more physical characteristics of the user 708. In some embodiments, the one or more prompts include text, images, symbols, videos, animations, and / or other visual cues that prompt the user 708 to move the electronic device 700 and / or move a part of the user 708's body to a specific orientation (e.g., move the electronic device 700 to a specific orientation relative to the user 708's body and / or move a part of the user 708's body to a specific orientation relative to the electronic device 700). For example, in some embodiments, the one or more prompts direct the user 708 to adjust the position of the electronic device 700 and / or the user 708's body within the physical environment 706 such that one or more of the sensors 720a - 720j are directed at a specific body part of the user, such as the face 708c and / or the head 708d. In some embodiments, the one or more prompts direct the user 708 to move a specific body part of the user 708 (e.g., the face 708c and / or the head 708d) relative to the electronic device 700 such that the sensors 720a - 720j capture features of the specific body part of the user 708. In some embodiments, the one or more prompts direct the user 708 to rotate (optionally, at a specific speed) the head 708d of the user 708 relative to the electronic device 700 such that the sensors 720a - 720j capture physical characteristics related to the face 708c of the user 708.In some embodiments, one or more prompts direct the user 708 to move and / or orient the electronic device 700 such that the sensors 720a-720j are directed towards the torso 708e of the user 708 (e.g., the shoulders and / or chest), whereby the electronic device 700 captures physical characteristics regarding the torso 708e and / or clothing worn by the user 708 (e.g., clothing covering and / or disposed on the torso 708e).

[0156] In some embodiments, the electronic device 700 provides one or more prompts (e.g., via one or more display generation components 722b) to instruct the user 708 to make one or more specific facial expressions (e.g., smiling, frowning, opening the mouth, and / or raising and / or lowering the eyebrows) to capture one or more physical characteristics of the user 708's face 708c. In some embodiments, the one or more prompts include information about the conditions of the physical environment 706 that affect the capture of information regarding one or more physical characteristics, and / or information regarding adjusting and / or correcting the conditions, similar to the prompt 718. In some embodiments, the one or more prompts instruct the user 708 to move a part of the user 708's body and / or move the electronic device 700 so that an individual part of the user 708's body is within a frame (e.g., a frame such as a box and / or a contour displayed via one or more display generation components 722b). In some embodiments, the one or more prompts instruct the user 708 to move closer to and / or away from the electronic device 700 and / or move the electronic device 700 closer to and / or away from the user 708. In some embodiments, the one or more prompts provided by the electronic device 700 are displayed via one or more display generation components 722b of the area 722. In some embodiments, the one or more prompts are audio prompts (e.g., output via a speaker of the electronic device 700) and / or tactile prompts (e.g., output via one or more tactile output devices of the electronic device 700) that provide instructions and / or guidance to the user 708 regarding capturing one or more physical characteristics of the user 708.

[0157] In FIG. 7D, user 708 moves head 708d and / or moves electronic device 700, as indicated by arrows 724a and / or 724b, respectively. While user 708 moves head 708d (and, optionally, other parts of user 708's body) and / or electronic device 700, sensors 720a - 720j capture information regarding one or more physical characteristics of user 708. Sensors 720a - 720j of electronic device 700 capture information regarding one or more facial features, one or more characteristics of user 708's hair (e.g., hair on user 708's head 708d and / or facial hair of user 708), one or more characteristics of user 708's torso 708e (e.g., shoulders, chest, and / or clothing), and / or other physical characteristics of user 708 that are not otherwise accessible and / or are outside the capture area of sensors 720a - 720j while electronic device 700 is positioned on user 708's body (e.g., on another part of the body such as wrist 708a and / or head 708d and / or face 708c). For example, while user 708 wears electronic device 700 on the body (e.g., on another part of the body such as wrist 708a and / or head 708d and / or face 708c), the capture area and / or field of sensors 720a - 720j is not directed towards a particular part of user 708's body (e.g., face 708c, head 708d, and / or torso 708e) and / or is prevented from capturing one or more physical characteristics of user 708. As described below, electronic device 700 uses the captured information regarding one or more physical characteristics of user 708 to generate representation 726 of user 708.

[0158] In FIG. 7E, user 708 places the electronic device 700 back on a part of user 708's body, such as the wrist 708a and / or the head 708d and / or the face 708c. In some embodiments, after capturing one or more body features of user 708, the electronic device 700 outputs a prompt (e.g., displays via one or more display generation components 722b and / or outputs audio and / or tactile) instructing user 708 to place the electronic device 700 back on a part of user 708's body, such as the wrist 708a and / or the head 708d and / or the face 708c, to continue the registration process. In FIG. 7E, the electronic device 700 determines and / or detects that the electronic device 700 is positioned on a part of user 708's body, such as the wrist 708a and / or the head 708d and / or the face 708c. In response to determining that the electronic device 700 is positioned on a part of user 708's body (e.g., the wrist 708a and / or the head 708d and / or the face 708c) (and optionally in response to detecting that one or more body features of user 708 have been captured), the electronic device 700 displays a prompt 728 via the display 704.

[0159] In FIG. 7E, the prompt 728 includes an indication (e.g., text) that instructs the user 708 to move and / or orient the electronic device 700 (and / or a part of the user 708's body) so that the sensor 712 faces in the direction of the user 708's left hand 708f (e.g., the sensor 712 of the HMD is a camera, and while the HMD is worn on the user 708's head 708d, the user 708 can turn the head 708d, the left hand 708f, and / or the eyes so that the left hand 708f is within the field of view of the camera). In some embodiments, the electronic device 700 captures first information regarding one or more first body features of the user 708 via sensors 720a - 720j while the electronic device 700 is removed from the user 708's body (e.g., another part of the body such as the wrist 708a and / or the head 708d and / or the face 708c), and captures second information regarding one or more second body features of the user 708 via the sensor 712 while the electronic device 700 is placed on the user 708's body (e.g., another part of the body such as the wrist 708a and / or the head 708d and / or the face 708c). In some embodiments, the electronic device 700 uses at least a portion of both one or more first body features of the user 708 and one or more second body features of the user 708 to generate the representation 726. In some embodiments, the electronic device 700 uses only one of one or more first body features of the user 708 and one or more second body features of the user 708 to generate the representation 726. In some embodiments, one or more first body features of the user 708 are inaccessible while the electronic device 700 is on the user 708's body (e.g., another part of the body such as the wrist 708a, and / or the head 708d and / or the face 708c), and / or correspond to body features of a part of the user 708's body that is outside the capture area and / or field of the sensors 720a - 720j, such as body features of the face 708c, the head 708d, and / or the torso 708e.In some embodiments, one or more first physical characteristics of user 708 correspond to portions of user 708's body that are inaccessible and / or otherwise unsuitable for capture via sensor 712 while the electronic device 700 is on user 708's body (e.g., another part of the body such as wrist 708a and / or head 708d and / or face 708c). For example, a portion of user 708's body that is covered by the electronic device when the electronic device is on user 708's body (e.g., face 708c and / or head 708d of user 708 are covered by the HMD when the HMD is worn on head 708d of user 708). In some embodiments, one or more second physical characteristics of user 708 correspond to portions of user 708's body that are accessible and / or suitable for capture via sensor 712 while the electronic device 700 is on user 708's body (e.g., another part of the body such as wrist 708a and / or head 708d and / or face 708c), such as physical characteristics of the left hand 708f and / or right hand 708g. (For example, the left hand 708f and / or right hand 708g can be captured via a camera (e.g., sensor 712) of the HMD while the HMD is worn on head 708d of user 708). Thus, the electronic device 700 outputs one or more prompts instructing the user to remove the electronic device 700 from user 708's body (e.g., another part of the body such as wrist 708a and / or head 708d and / or face 708c) and / or to place the electronic device 700 on user 708's body (e.g., another part of the body such as wrist 708a and / or head 708d and / or face 708c) in order to capture one or more first physical characteristics of user 708 and / or one or more second physical characteristics of user 708).

[0160] In FIG. 7F, the user 708 positions the electronic device 700, the left hand 708f, and / or the right hand 708g such that the sensor 712 is in a position where the capture area and / or field of the sensor 712 is directed towards the left hand 708f (for example, the sensor 712 of the HMD is a camera, and the user 708 adjusts the position of the head 708d, the position of the left hand 708f, and / or the position of the user's line of sight such that the left hand 708f is within the field of view of the camera). In addition, the electronic device 700 displays, via the display 704, a frame 730 indicating the target position of the left hand 708f relative to the electronic device 700 (for example, the sensor 712 of the electronic device 700). In FIG. 7F, the sensor 712 includes an image sensor such as a camera, and the electronic device 700 displays the information captured via the sensor 712 on the display 704. Accordingly, the electronic device 700 displays, on the display 704, a hand representation 732 indicating that the sensor 712 has captured and / or otherwise detected the left hand 708f of the user 708. In some embodiments, the user 708 can adjust the position of the left hand 708f and / or the electronic device 700 such that the hand representation 732 is within the frame 730 on the display 704. In some embodiments, when the hand representation 732 is within the frame 730, the left hand 708f of the user 708 is positioned within the target area relative to the electronic device 700 that enables the sensor 712 to capture information regarding one or more physical characteristics of the left hand 708f. In some embodiments, the electronic device 700 causes the sensor 712 to capture information regarding one or more physical characteristics of the left hand 708f of the user 708 in response to the hand representation 732 being within the frame 730 and / or in response to the hand representation 732 being within the frame 730 for a predetermined amount of time.

[0161] After and / or while the electronic device 700 captures information regarding one or more body characteristics of the left hand 708f, the electronic device 700 displays a prompt 734 via the display 704. In FIG. 7F, the prompt 734 includes an indication (e.g., text) instructing the user 708 to adjust the position of the left hand 708f and turn the left hand 708f over (e.g., rotate the left hand 708f approximately 180° with respect to the electronic device 700 and / or the sensor 712). In some embodiments, in response to detecting that the user's left hand 708f has been rotated and / or turned over, the electronic device 700 captures one or more additional body characteristics regarding the user's left hand 708f via the sensor 712. In some embodiments, the electronic device 700 uses one or more body characteristics regarding the user's left hand 708f and / or one or more additional body characteristics regarding the user's left hand 708f to generate a portion of the representation 726. In some embodiments, the electronic device 700 uses one or more body characteristics regarding the user's left hand 708f and / or one or more additional body characteristics regarding the user's left hand 708f as part of an input calibration process.

[0162] In some embodiments, the electronic device 700 captures information regarding one or more body characteristics regarding the user's right hand 708g while the electronic device 700 is positioned on the user 708's body (e.g., other parts of the body such as the wrist 708a, the wrist 708h, and / or the head 708d and / or the face 708c). In some embodiments, the electronic device 700 captures information regarding the user's right hand 708g while the electronic device 700 is removed from the user 708's body (e.g., captures information regarding the user's right hand 708g via the sensors 720a - 720j).

[0163] After capturing information about the left hand 708f of user 708 (and optionally, after completion of capturing information about one or more physical characteristics of user 708, and / or after detecting that the electronic device 700 is placed on a body part of user 708 such as the wrist 708a and / or the head 708d and / or the face 708c), the electronic device 700 displays, via the display 704, a user interface 736 including a representation 726 as shown in FIG. 7G. In FIG. 7G, the representation 726 includes an appearance based on one or more captured physical characteristics of user 708, such that the representation 726 looks like and / or appears to be otherwise similar to user 708. For example, the clothing representation 726i of the representation 726 includes an appearance including one or more attributes based on one or more physical attributes of the clothing 708i worn by user 708. In some embodiments, the electronic device 700 uses one or more captured physical characteristics of user 708 to generate the representation 726 three-dimensionally (e.g., by combining and / or overlaying two or more two-dimensional images of user 708 to create an appearance in which the representation 726 is three-dimensional).

[0164] In FIG. 7G, the electronic device 700 displays the representation 726 in a first region 736a of the user interface 736 and displays selectable options 738a - 738d in a second region 736b of the user interface 736. As described below, the electronic device 700 is configured to start a process of editing the appearance of the representation 726 and / or recapturing one or more physical characteristics of user 708 in response to detecting a user input that selects one or more of the selectable options 738a - 738d.

[0165] In FIG. 7G, representation 726 is displayed within environment 740 of the first area 726a. In some embodiments, environment 740 is a virtual reality environment. In some embodiments, environment 740 is an augmented reality environment 740. In some embodiments, environment 740 is a static background. In some embodiments, environment 740 includes one or more objects (e.g., virtual objects) such as a frame and / or a mirror.

[0166] In some embodiments, while displaying representation 726, electronic device 700 receives information indicating movement of user 708 within physical environment 706. In response to receiving information indicating movement of user 708 within physical environment 740, electronic device 700 displays movement of representation 726 within environment 706. In some embodiments, electronic device 700 displays movement of representation 726 within environment 740 so as to reflect physical movement of user 708 within physical environment 706. In other words, electronic device 700 displays movement of representation 726 as if user 708 were looking at representation 726 in a mirror (e.g., when user 708 moves their right hand 708g within physical environment 706, the electronic device displays movement of the left hand of representation 726). In some embodiments, electronic device 700 displays a frame and / or a mirror (e.g., a virtual frame and / or a virtual mirror) within environment 740 to indicate to user 708 that representation 726 is being displayed as a mirror image representation of user 708's body.

[0167] In some embodiments, electronic device 700 displays representation 726 as a preview of content to be presented to another user via an external electronic device while user 708 is participating in a real-time communication session with the other user. In some embodiments, electronic device 700 displays representation 726 and / or at least a portion of representation 726 via one or more display generation components 722b while electronic device 700 is removed from user 708's body (e.g., another part of the body such as wrist 708a and / or head 708d and / or face 708c). In some embodiments, electronic device 700 displays representation 726 when electronic device 700 detects that it is placed on user 708's body (e.g., another part of the body such as wrist 708a and / or head 708d and / or face 708c), and does not display representation 726 when electronic device 700 detects that it is removed from user 708's body (e.g., another part of the body such as wrist 708a and / or head 708d and / or face 708c).

[0168] As described above, the electronic device 700 displays selectable options 738a - 738d in a second region 736b of the user interface 736, which enables the user 708 to edit the appearance of the representation 726 and / or initiate a process of recapturing one or more physical characteristics of the user 708. In FIG. 7G, the first selectable option 738a corresponds to an option for editing the eyewear (e.g., glasses, sunglasses, bifocals, monocles, goggles, and / or headset) of the representation 726. In response to detecting a user input selecting the first selectable option 738a, the electronic device 700 enables the appearance of the representation 726 to be adjusted and / or changed such that the representation 726 is wearing (e.g., including) or not wearing (e.g., not including) eyewear of the selected type. In some embodiments, the electronic device 700 captures one or more physical characteristics of the user 708 while the user 708 is wearing eyewear, and thus the first selectable option 738a enables the user 708 to select whether the representation 726 is wearing eyewear that includes an appearance based on the one or more captured physical characteristics of the user 708 (e.g., the representation 726 includes an appearance having one or more attributes corresponding to the physical eyewear the user 708 was wearing while the electronic device 700 captured one or more physical characteristics of the user 708).

[0169] The second selectable option 738b corresponds to an option for editing an accessibility accessory (e.g., an eye patch, prosthesis, and / or hearing aid) of the representation 726. In response to detecting a user input selecting the second selectable option 738b, the electronic device 700 enables the appearance of the representation 726 to be adjusted and / or changed such that the representation 726 is wearing (e.g., includes) or not wearing (e.g., does not include) the selected accessibility accessory. In some embodiments, the electronic device 700 captures one or more physical characteristics of the user 708 while the user 708 is wearing the accessibility accessory, and thus the second selectable option 738b enables the user 708 to select whether the representation 726 is wearing an accessibility accessory having an appearance based on one or more of the captured physical characteristics of the user 708 (e.g., the representation 726 includes an appearance having one or more attributes corresponding to a physical accessibility accessory that the user 708 was wearing while the electronic device 700 captured one or more physical characteristics of the user 708).

[0170] The third selectable option 738c corresponds to an option for editing the skin tone (e.g., color, hue, shade, brightness, and / or darkness of the skin representation) of the representation 726. In response to detecting a user input selecting the third selectable option 738c, the electronic device 700 enables the appearance of the representation 726 to be adjusted and / or changed such that the skin tone of one or more portions of the representation 726 is adjusted. In some embodiments, the one or more captured physical characteristics of the user 708 do not include information regarding one or more physical skin tones of the user 708 and / or the displayed skin tone of the representation 726 does not otherwise accurately reflect one or more physical skin tones of the user 708. Accordingly, the third selectable option 738c enables the user 708 to change and / or adjust the skin tone representation of the representation 726 such that the representation 726 includes a skin tone representation that closely resembles the physical skin tone of the user 708.

[0171] The fourth selectable option 738d corresponds to an option for recapturing one or more physical characteristics of user 708 such that electronic device 700 can regenerate and / or update representation 726 based on the one or more recaptured physical characteristics of user 708. In some embodiments, in response to detecting a user input selecting the fourth selectable option 738d, electronic device 700, as shown in FIG. 7A, displays prompt 702 and / or otherwise initiates a process for recapturing one or more physical characteristics of user 708.

[0172] In FIG. 7G, electronic device 700 detects a user input 750a corresponding to the selection of the third selectable option 738c. In response to detecting user input 750a, electronic device 700, as shown in FIG. 7H, displays a user interface 742 via the display that includes representation 726 and selectable skin tone options 742a and 742b.

[0173] In FIG. 7H, the electronic device 700 displays a first skin tone option 742a and a second skin tone option 742b for editing the skin tones of different parts of the representation 726. As a result, the representation 726 can include different parts having different skin tones (e.g., the color, hue, luminance, and / or darkness of the skin representation on different representations of the body part of the representation 726). The first skin tone option 742a corresponds to editing the skin tone of the hand representation of the representation 726. In response to detecting a user input selecting the first skin tone option 742a, the electronic device 700 enables the appearance of the representation 726 to be adjusted and / or changed such that the skin tone of the hand representation of the representation 726 is adjusted. The second skin tone option 742b corresponds to editing the skin tone of the face representation 726c of the representation 726. In response to detecting a user input selecting the second skin tone option 742b, the electronic device 700 enables the appearance of the representation 726 to be adjusted and / or changed such that the skin tone of the face representation 726c of the representation 726 is adjusted. FIG. 7H shows a user interface 742 including two selectable skin tone options 742a and 742b. However, in some embodiments, the user interface 742 includes three or more selectable skin tone options corresponding to editing the skin tones of different parts of the representation 726.

[0174] In FIG. 7H, the electronic device 700 detects a user input 750b corresponding to the selection of the completion user interface object 744. After detecting the user input 750b, the electronic device 700 displays a menu user interface 746 as shown in FIG. 7I. In FIG. 7I, the menu user interface 746 includes menu user interface objects 746a - 746f corresponding to various functions, user interfaces, and / or applications configured to be executed and / or displayed by the electronic device 700. In some embodiments, the menu user interface 746 is the home user interface and / or the default user interface of the operating system of the electronic device 700.

[0175] In FIG. 7I, the electronic device 700 detects a user input 750c corresponding to the selection of the first menu user interface object 746a (e.g., "People"). In response to detecting the user input 750c, the electronic device 700 displays, via the display 704, a people user interface 748 (e.g., a representational user interface) as shown in FIG. 7J. The people user interface 748 corresponds to different representations of the user 708 (and optionally other users of the electronic device 700) generated by the electronic device 700. In FIG. 7J, the people user interface 748 includes a first person user interface object 748a corresponding to a first representation (e.g., representation 726) generated by the electronic device 700 and a second person user interface object 748b corresponding to a second representation (e.g., a representation different from representation 726) generated by the electronic device 700. In some embodiments, the first representation and / or the second representation correspond to representations of the user generated by the electronic device 700 based on one or more captured physical characteristics of the respective user.

[0176] In some embodiments, in response to detecting a user input corresponding to a selection of a first person user interface object 748a, the electronic device 700 displays a user interface 736 that includes a first representation (e.g., representation 726) corresponding to the first person user interface object 748a. Similarly, in response to detecting a user input corresponding to a selection of a second person user interface object 748b, the electronic device 700 displays a user interface 736 that includes a second representation (e.g., a representation different from representation 726) corresponding to the second person user interface object 748b.

[0177] Additional explanations regarding FIGS. 7A - 7J are provided below with reference to methods 800 and 900 described with respect to FIGS. 7A - 7J.

[0178] FIG. 8 is a flowchart of an exemplary method 800 for generating a user's representation according to some embodiments. In some embodiments, method 800 is performed in a computer system (e.g., 101, 700, and / or 1000) (e.g., a smartphone, a tablet, a head - mounted display generation component) that includes one or more display generation components (e.g., 120, 704, 722, 722b, and / or 1000a) (e.g., a visual output device, a 3D display, and / or a display (e.g., a see - through display) having at least a portion that is transparent or translucent onto which an image can be projected, a projector, a head - up display, and / or a display controller) and (optionally) communicates with one or more cameras (e.g., an infrared camera, a depth camera, and / or a visible - light camera). In some embodiments, method 800 is stored in a non - transitory (or transitory) computer - readable storage medium and is managed by instructions executed by one or more processors of the computer system, such as one or more processors 202 of the computer system 101 (e.g., control 110 of FIG. 1). Some operations of method 800 are optionally combined and / or the order of some operations is optionally changed.

[0179] A computer system (e.g., 101, 700, and / or 1000) is arranged on a user's (e.g., 708) body (e.g., 708a) while (e.g., the computer system is worn in an individual orientation and / or position with respect to an individual part of the user's body) (e.g., the computer system is a wearable computer system (e.g., a head-mounted display generating component, glasses, a headset, and / or a watch) configured to be worn on a body part of the user of the computer system) (in some embodiments, the computer system is a watch configured to be worn on the user's wrist (e.g., 708a) of the computer system) (in some embodiments, the computer system communicates with one or more sensors that capture data indicating whether the computer system is in a wearable position), the computer system (e.g., 101, 700, and / or 1000) removes the computer system (e.g., 101, 700, and / or 1000) from the user's (e.g., 708) body (e.g., 708a) via one or more display generating components (e.g., 120, 704, 722, 722b, and / or 1000a) (e.g., removes the wearable computer system so that it is no longer worn on the user's body part), and the computer system (e.g., 101, 700, and / or 1000) (e.g., one or more sensors of the computer system) is used to display a prompt (e.g., 702) (e.g., text, an image, and / or a user interface object including an instruction) that instructs to capture information about the user (e.g., information about one or more physical characteristics of the user of the computer system) (802).

[0180] In some embodiments, a computer system (e.g., 101, 700, and / or 1000) displays a prompt (e.g., 702) to remove the computer system from a wearable position during a registration process (e.g., a process that includes capturing data (e.g., image data, sensor data, and / or depth data) indicative of one or more body parts of the user and / or the size, shape, position, pose, color, depth, and / or other characteristics of the body part) for generating a user representation (e.g., 726).

[0181] After (e.g., while) displaying a prompt (e.g., 702) instructing the user (e.g., 708) to remove the computer system (e.g., 101, 700, and / or 1000) from the user's body (e.g., 708a), the computer system (e.g., 101, 700, and / or 1000) detects (804) that the computer system (e.g., 101, 700, and / or 1000) has been removed from the user's body (e.g., 708a) (e.g., receives data captured via one or more sensors that communicate with the computer system, the data indicating that the computer system is not worn on a body part of the user (e.g., a particular body part)).

[0182] After a computer system (e.g., 101, 700, and / or 1000) detects that it has been removed from a user's body (e.g., 708) (e.g., in response thereto), the computer system captures (806) information related to (e.g., regarding) the user (e.g., 708) (e.g., image data, sensor data, and / or depth data indicating the size, shape, position, pose, color, depth, and / or other characteristics of one or more body parts of the user (e.g., the head and / or face), (e.g., information regarding one or more physical characteristics of the user of the computer system) (e.g., via one or more sensors such as a camera). The computer system (e.g., 101, 700, and / or 1000) is configured to use the information to generate a representation of the user (e.g., 726) (e.g., a (2D or 3D) virtual representation, a (2D or 3D) avatar) (e.g., the computer system generates a representation of the user (e.g., an avatar) based on information related to the user such that the representation of the user includes visual indications (e.g., similar) based on the size, shape, position, pose, color, depth, and / or other characteristics of the body, hair, clothing, and / or other features of the user).

[0183] By capturing information related to the user after the computer system detects that it has been removed from the user's body, the computer system can capture information regarding body parts of the user that were not accessible to the computer system while the computer system was disposed on the user's body. Thus, the computer system can capture information related to the user without additional and / or external devices and / or sensors. Additionally, the computer system can capture more information related to the user that can be used to generate a more accurate representation of the user.

[0184] In some embodiments, the representation (e.g., 726) of a user (e.g., 708) is configured to be displayed in an augmented reality environment (e.g., 740 and / or 1008) (e.g., a simulated environment in which one or more virtual objects are superimposed on a physical environment or a representation thereof, and / or a simulated environment in which a representation of a physical environment is transformed by computer-generated sensory information) and / or a virtual reality environment (e.g., 740 and / or 1008) (e.g., a simulated environment designed to be completely based on computer-generated sensory input for one or more senses that includes a plurality of virtual objects with which a person can perceive and / or interact).

[0185] In some embodiments, the representation (e.g., 726) of a user (e.g., 708) is configured to be displayed in an augmented reality environment (e.g., 740 and / or 1008) and / or a virtual reality environment (e.g., 740 and / or 1008) during a real-time communication session between the user (e.g., 708) and a second user (e.g., the user associated with the second representation 1012) associated with a second computer system different from the computer system (e.g., 101, 700, and / or 1000).

[0186] Displaying a user's representation within an augmented reality environment and / or a virtual reality environment enables the user viewing the representation to obtain context regarding the state of the device, thereby providing improved feedback regarding the state of the device.

[0187] In some embodiments, the computer system (e.g., 101, 700, and / or 1000) is configured to generate the representation (e.g., 726) of the user (e.g., 708) stereoscopically (e.g., the representation is a series of two-dimensional images that appear to be three-dimensional within the environment in which the representation is displayed when viewed together and / or in combination with each other). Generating the user's representation stereoscopically enables the computer system to generate a more accurate and / or realistic representation of the user.

[0188] In some embodiments, before the computer system (e.g., 101, 700, and / or 1000) detects that it has been removed from the user's body (e.g., 708a) (e.g., while the computer system is positioned on the user's body), the computer system (e.g., 101, 700, and / or 1000) provides an instruction (e.g., 716) (e.g., a text instruction, an image instruction, a video instruction, an animation instruction, an audio instruction, and / or other instructions) to capture information about the user (e.g., instructions explaining how the user of the computer system should use, operate, and / or otherwise position the computer system and / or the user's body to capture information about the user). In some embodiments, the instruction (e.g., 716) to use the computer system (e.g., 101, 700, and / or 1000) to capture information related to the user (e.g., 708) is provided (e.g., output and / or displayed separately from or simultaneously with a prompt to remove the computer system from the user's body and instruct the user to use the computer system to capture information about the user). In some embodiments, the instruction (e.g., 716) to use the computer system (e.g., 101, 700, and / or 1000) to capture information related to the user (e.g., 708) includes a series of images, text instructions, and / or videos that provide examples of how the user (e.g., 708) is expected to use the computer system (e.g., 101, 700, and / or 1000) to capture information related to the user. For example, in some embodiments, the instruction (e.g., 716) includes examples of using the computer system (e.g., 101, 700, and / or 1000) and / or movements that the user (e.g., 708) should mimic to capture information about the user (e.g., 708).

[0189] Providing instructions for using a computer system to capture information about a user facilitates the user's ability to use a computer system to capture information about the user, thereby reducing the number and / or amount of time of input required to capture information about the user.

[0190] In some embodiments, providing instructions (e.g., 716) includes displaying an animation (e.g., 716) (e.g., a series of visual indications and / or video) that demonstrates (e.g., provides a visual example of) a computer system (e.g., 101, 700, and / or 1000) using one or more display generation components to capture information related to a user (e.g., 708) (e.g., instructions explaining how a user of the computer system should use, manipulate, and / or otherwise position the computer system and / or the user's body to capture information related to the user). Displaying an animation that demonstrates using a computer system to capture information related to a user facilitates the user's ability to use a computer system to capture information related to the user, thereby reducing the number and / or amount of time of input required to capture information related to the user.

[0191] In some embodiments, before a computer system (e.g., 101, 700, and / or 1000) detects that it has been removed from a user's (e.g., 708) body (e.g., 708a) (e.g., while the computer system is positioned on the user's body), and according to a determination that a set of criteria is met (e.g., the computer system has low power and / or low battery life (e.g., an amount of power and / or battery life below a threshold amount), an object is blocking one or more portions of the user's body (e.g., glasses, a hat, and / or a face covering), the environment in which the user is located includes harsh lighting (e.g., bright lighting that can affect capturing information about the user), the environment in which the user is located includes low lighting (e.g., lighting that is not sufficient to accurately and / or completely capture information about the user), and / or another condition of the environment in which the user is located indicates that it can affect capturing information about the user, by receiving information and / or data from one or more sensors communicating with the computer system), the computer system (e.g., 101, 700, and / or 1000) displays an indication (e.g., 718) (e.g., an alert such as a visual notification and / or an audio notification) associated with a condition that affects capturing information related to the user (e.g., the computer system has low power, an object is blocking one or more portions of the user's body, the environment in which the user is located includes harsh lighting, the environment in which the user is located includes low lighting, and / or the environment in which the user is located includes another condition that can affect capturing information related to the user) via one or more display generation components (e.g., 120, 704, 722, 722b, and / or 1000a).Before a computer system (e.g., 101, 700, and / or 1000) detects that it has been removed from a user's body (e.g., while the computer system is disposed on the user's body), in accordance with a determination that a set of criteria is not met, the computer system (e.g., 101, 700, and / or 1000) ceases to display an indication (e.g., 718) associated with a condition that affects the capture of information about the user (and, optionally, removes the computer system from the user's body and maintains the display of a prompt (e.g., 702) instructing the computer system to capture information about the user).

[0192] In some embodiments, the set of criteria is a first set of criteria corresponding to a first condition that affects the capture of information related to the user, and the indication is a first indication associated with the first condition that affects the capture of information related to the user. In accordance with the second set of criteria being satisfied, and the second set of criteria corresponding to a second condition that affects the capture of information related to the user and that is different from the first set of criteria, the computer system (e.g., 101, 700, and / or 1000) displays a second indication associated with the second condition that affects the capture of information related to the user (e.g., simultaneously with the first indication, before and / or after the first indication, and / or instead of the first indication). (In some embodiments, the computer system displays an individual indication that includes a higher priority than one or more other indications, and the priority of the individual indication is based on an individual condition that affects the capture of information related to the user (e.g., when the second condition is associated with a condition that is more likely or to a greater extent to affect the capture of information related to the user, and thus the second condition has a higher priority than the first condition, the computer system displays the second indication instead of the first indication)). In accordance with a determination that the set of criteria is not satisfied, the computer system (e.g., 101, 700, and / or 1000) discontinues displaying a second indication associated with the second condition that affects the capture of information related to the user.

[0193] Displaying an indication associated with a condition that affects the capture of information related to the user enables the user to proactively address the condition that affects the capture of information, thereby reducing the amount of time required to capture information related to the user.

[0194] In some embodiments, an indication (e.g., 718) associated with a condition that affects the capture of information about a user (e.g., 708) includes information (e.g., 718b) (e.g., a proposal and / or an instruction) regarding an action to take that serves to modify (e.g., modify the condition so that it no longer affects the capture of information about the user and / or otherwise adjust it) a condition (e.g., information suggesting charging a computer system, information suggesting removing an object that blocks one or more parts of the user's body, and / or information suggesting that the user adjust lighting conditions and / or move to a different location and / or environment that includes improved lighting conditions, etc.) that promotes and / or otherwise improves one or more steps and / or proposals for capturing information about the user. Including information regarding an action to take that serves to modify the condition enables the user to proactively address the condition that affects the capture of information, thereby reducing the amount of time required to capture information relevant to the user.

[0195] In some embodiments, in response to detecting that a computer system (e.g., 101, 700, and / or 1000) has been removed from a user's (e.g., 708) body (e.g., 708a), the computer system (e.g., 101, 700, and / or 1000) initiates a process of capturing information about the user (e.g., the process of capturing information about the user is triggered, initiated, and / or started in response to detecting that the computer system has been removed from the user's body). Initiating a process of capturing information related to the user in response to detecting that the computer system has been removed from the user's body reduces the number of inputs required to capture information related to the user.

[0196] In some embodiments, after a computer system (e.g., 101, 700, and / or 1000) detects that it has been removed from a user's (e.g., 708) body (e.g., 708a) (e.g., before, at the same time as, and / or after capturing at least a portion of information about the user), the computer system (e.g., 101, 700, and / or 1000) provides a second prompt (e.g., 722a) that includes instructions (e.g., instructions to use the computer system to capture information about the user, suggestions, and / or text, images, videos, audio, and / or tactile outputs that provide examples) to capture information about the user. In some embodiments, the second prompt (e.g., 722a) includes a plurality of prompts that include different instructions to capture information about the user. In some embodiments, the second prompt (e.g., 722a) includes a sequence of second prompts that include instructions to capture information about the user.

[0197] Providing a second prompt that includes instructions to capture information about the user facilitates the user's ability to use the computer system to capture information about the user, thereby reducing the number and / or amount of input required to capture information about the user.

[0198] In some embodiments, providing a second prompt (e.g., 722a) includes the computer system (e.g., 101, 700, and / or 1000) displaying a visual prompt (e.g., information, instructions, suggestions, and / or examples that facilitate the user's ability to capture information related to the user, text, one or more images, and / or video) along with one or more registration instructions via one or more display generation components (e.g., 120, 704, 722, 722b, and / or 1000a). In some embodiments, the visual prompt (e.g., 722a) includes a plurality of visual prompts including a visual indication of an instruction to capture information related to the user. In some embodiments, the visual prompt (e.g., 722a) includes a sequence of visual prompts including a visual indication of an instruction to capture information related to the user. Displaying the visual prompt facilitates the user's ability to use the computer system to capture information related to the user, thereby reducing the number and / or amount of time of input required to capture information related to the user.

[0199] In some embodiments, a prompt (e.g., 702) that removes a computer system (e.g., 101, 700, and / or 1000) from a user's (e.g., 708) body and instructs the computer system (e.g., 101, 700, and / or 1000) to capture information about the user (e.g., 708) is displayed via a first display generation component (e.g., 704) of one or more display generation components (e.g., 120, 704, 722, 722b, and / or 1000a) (e.g., a first display device that communicates with the computer system and / or is included in a first location on and / or within the housing of the computer system) (in some embodiments, the first display generation component is inside the computer system when the computer system is disposed on the user's body) (in some embodiments, the computer system is a head-mounted device, and the first display generation component is a display generation component configured to be visually recognized by the user when the head-mounted device is disposed on the user's head and / or covers the user's eyes). A visual prompt (e.g., 722a) is displayed via a second display generation component (e.g., 722 and / or 722b) different from the first display generation component (e.g., 704) of one or more display generation components (e.g., 120, 704, 722, 722b, and / or 1000a) (e.g., a second display device that communicates with the computer system and / or is included in a second location different from the first location on and / or within the housing of the computer system) (in some embodiments, the second display generation component is outside the computer system when the computer system is disposed on the user's body) (in some embodiments, the computer system is a head-mounted device, and the second display generation component is a display generation component configured to be visually recognized by the user when the head-mounted device is not disposed on the user's head and / or does not cover the user's eyes, and / or the second display generation component is(configured not to be visually recognized by the user when the head-mounted device is placed on the user's head and / or covers the user's eyes).

[0200] Display a prompt to instruct the computer system to remove itself from the user's body via a first display generation component, and display a visual prompt via a second display generation component different from the first display generation component, which displays information to the user on an individual display generation component that is likely to be within the user's field of view, thereby reducing the amount of time required to capture information relevant to the user.

[0201] In some embodiments, providing a second prompt (e.g., 722a) includes outputting an audio prompt (e.g., an audio alert, an audio including a voice command, and / or an audio generated to simulate an audio from a specific location within the environment where the user is located) along with one or more registration commands via an audio device (e.g., a speaker and / or headphones) that communicates with a computer system (e.g., 101, 700, and / or 1000). Outputting an audio prompt along with one or more registration commands facilitates the user's ability to use the computer system to capture information relevant to the user, thereby reducing the number and / or amount of input required to capture information relevant to the user.

[0202] In some embodiments, providing a second prompt (e.g., 722a) includes providing an indication (e.g., 722a) (e.g., text, image, video, audio, and / or a user interface object) that instructs the user (e.g., 708) to orient a part of the user's body (e.g., face, hand, and / or torso) within a target location (e.g., a location for one or more sensors that communicate with a computer system to facilitate capturing information regarding a part of the user's body) relative to the computer system (e.g., 101, 700, and / or 1000). In some embodiments, the indication includes a frame and / or other user interface object that is displayed via one or more display generation components (e.g., 120, 704, 722, 722b, and / or 1000a), which provides the user (e.g., 708) with a visual indication of a target location for moving and / or orienting a part of the user's body relative to the computer system (e.g., 101, 700, and / or 1000).

[0203] By providing an indication that instructs the user to orient a part of the user's body within a target location relative to the computer system, the user is facilitated in using the computer system to capture information related to the user, thereby reducing the number and / or time of inputs required to capture information related to the user.

[0204] In some embodiments, providing a second prompt (e.g., 722a) includes providing an indication (e.g., 718 and / or 722a) (e.g., text, image, video, audio, and / or user interface object) (e.g., information suggesting charging the computer system, information suggesting removing an object blocking one or more parts of the user's body, and / or information suggesting that the user adjust lighting conditions and / or move to a different location and / or environment including improved lighting conditions, etc., one or more steps and / or suggestions that facilitate and / or otherwise improve capturing information about the user) to instruct the user (e.g., 708) to adjust conditions (e.g., the computer system has low power, an object is blocking one or more parts of the user's body, the environment where the user is located includes harsh lighting, the environment where the user is located includes low lighting, and / or the environment where the user is located includes another condition that may affect capturing information about the user) that affect capturing information of the user (e.g., 708).

[0205] Providing an indication to instruct the user to adjust conditions that affect capturing information of the user facilitates the user's ability to use the computer system to capture information related to the user, thereby reducing the number and / or amount of time of input required to capture information related to the user. Additionally, providing an indication to instruct the user to adjust conditions that affect capturing information of the user enables the computer system to capture more accurate information related to the user, which enables the computer system to generate a more accurate representation of the user.

[0206] In some embodiments, providing a second prompt (e.g., 722a) includes providing an indication (e.g., 722a) (e.g., text, image, video, audio, and / or user interface object) to the user (e.g., 708) that instructs the user (e.g., 708) to move the position of the user's head (e.g., 708d) (e.g., such that the computer system can capture information regarding the user's head from a particular angle and / or move the user's head relative to the computer system and / or one or more sensors that communicate with the computer system when the user's head is positioned in a particular orientation). Providing an indication to the user that instructs the user to move the position of the user's head facilitates the user's ability to use the computer system to capture information related to the user, thereby reducing the number and / or amount of input required to capture information related to the user.

[0207] In some embodiments, providing a second prompt (e.g., 722a) includes providing an indication (e.g., 722a) (e.g., text, image, video, audio, and / or user interface object) to the user (e.g., 708) that instructs the user (e.g., 708) to position one or more sets of the user's facial features (e.g., 708c) (e.g., eyes, cheeks, forehead, nose, mouth, and / or lips) into a predetermined set of one or more facial expressions (e.g., text, image, video, audio, and / or user interface object that instructs the user to make a particular facial expression with the user's eyes, cheeks, forehead, nose, mouth, and / or lips). Providing an indication to the user that instructs the user to position one or more sets of the user's facial features into a predetermined set of one or more facial expressions facilitates the user's ability to use the computer system to capture information related to the user, thereby reducing the number and / or amount of input required to capture information related to the user.

[0208] In some embodiments, providing a second prompt (e.g., 722a) involves adjusting the position of a computer system (e.g., 101, 700, and / or 1000) (e.g., moving the computer system relative to the user's body) and orienting the computer system (e.g., 101, 700, and / or 1000) with respect to a predetermined portion (e.g., 708e) of the user's (e.g., 708) body (e.g., the user's waist and / or torso) (e.g., a predetermined portion of the user's body including clothing such as a shirt, dress, pants, shorts, skirt, jacket, and / or jewelry) by providing an indication (e.g., 722a) (e.g., text, image, video, audio, and / or user interface object) that instructs the user (e.g., 708) to do so (e.g., orient one or more sensors that communicate with the computer system). By providing an indication that instructs the user to adjust the position of the computer so as to orient the computer system with respect to a predetermined portion of the user's body, the user is facilitated in capturing information relevant to the user using the computer system, thereby reducing the number and / or time of inputs required to capture information relevant to the user.

[0209] In some embodiments, a prompt (e.g., 702) that removes the computer system (e.g., 101, 700, and / or 1000) from the user's (e.g., 708) body (e.g., 708a) and instructs the computer system (e.g., 101, 700, and / or 1000) to capture information about the user (e.g., 708) is displayed via a first display generation component (e.g., 704) of one or more display generation components (e.g., 120, 704, 722, 722b, and / or 1000a) (e.g., a first display device that communicates with the computer system and / or is included at a first location on and / or within the housing of the computer system). After capturing information about the user (e.g., 708), the computer system (e.g., 101, 700, and / or 1000) displays a preview of a representation of the user (e.g., 726) (e.g., an image representing the user (e.g., an avatar) including an appearance based on the information about the user) via a second display generation component (e.g., 722 and / or 722b) that is different from the first display generation component (e.g., 704) of the one or more display generation components (e.g., 120, 704, 722, 722b, and / or 1000a) (e.g., a second display device that communicates with the computer system and / or is included at a second location that is different from the first location on and / or within the housing of the computer system). (In some embodiments, the preview of the user's representation is the initial and / or preliminary representation of the user that can be modified and / or regenerated based on one or more user inputs provided by the user.)

[0210] Displaying a preview of the user's representation via the second display generation component enables the user to view the user-generated representation on a display generation component that is likely to be within the user's field of view, enables the user to determine the accuracy of the user-generated representation, thereby providing improved visual feedback.

[0211] In some embodiments, after capturing information about a user (e.g., 708), a computer system (e.g., 101, 700, and / or 1000) detects (e.g., via one or more sensors communicating with the computer system) that the computer system is disposed on the user's (e.g., 708) body (e.g., 708a) (e.g., the computer system is worn in an individual orientation and / or position with respect to an individual part of the user's body). (e.g., the computer system is a wearable computer system (e.g., a head-mounted display generation component, glasses, a headset, and / or a watch) configured to be worn on a body part of the user of the computer system). After detecting that the computer system (e.g., 101, 700, and / or 1000) is disposed on the user's (e.g., 708) body (e.g., 708a), the computer system (e.g., 101, 700, and / or 1000) displays, via one or more display generation components (e.g., 120, 704, 722, and / or 722b), a preview of the user's (e.g., 708) representation (e.g., 726) (e.g., an image representing a user (e.g., an avatar) including an appearance based on information about the user). In some embodiments, the preview of the user's representation can be modified and / or regenerated based on one or more user inputs provided by the user and is an initial and / or preliminary representation of the user. In some embodiments, the preview of the user's (e.g., 708) representation (e.g., 726) is not displayed (after capturing information about the user) before the computer system (e.g., 101, 700, and / or 1000) detects that the computer system is disposed on the user's (e.g., 708) body (e.g., 708a) (e.g., via a first display generation component and / or via a second display generation component).

[0212] Displaying a preview of the user's representation enables the user to determine the accuracy of the user's generated representation, thereby providing improved visual feedback.

[0213] In some embodiments, capturing information about a user (e.g., 708) involves a computer system (e.g., 101, 700, and / or 1000) capturing first information (e.g., one or more facial features of the user) about a first portion (e.g., 708c, 708d, and / or 708e) of the user's body (e.g., the user's face and / or head). After capturing the first information about the first portion (e.g., 708c, 708d, and / or 708e) of the user's body (e.g., 708), the computer system (e.g., 101, 700, and / or 1000) detects (e.g., via one or more sensors communicating with the computer system) that the computer system (e.g., 101, 700, and / or 1000) is disposed on the user's body (e.g., 708a) (e.g., the computer system is worn in an individual orientation and / or position with respect to an individual portion of the user's body). The computer system (e.g., 101, 700, and / or 1000) is a wearable computer system (e.g., a head-mounted display generation component, glasses, a headset, and / or a watch) configured to be worn on a body portion of the user of the computer system. After detecting that the computer system (e.g., 101, 700, and / or 1000) is disposed on the user's body (e.g., 708a) (e.g., in response thereto), the computer system (e.g., 101, 700, and / or 1000) initiates a process of capturing second information (e.g., one or more features of the user's hand) about a second portion (e.g., 708b, 708f, and / or 708g) of the user's body (e.g., the user's hand and / or arm) that is different from the first portion (e.g., 708c, 708d, and / or 708e) of the user's body. In some embodiments, the second information about the second portion (e.g., 708b, 708f, and / or 708g) of the user's body (e.g., 708) is captured while the system (e.g., 101, 700, and / or 1000) is disposed on the user's body (e.g., 708a).

[0214] After detecting that the computer system is placed on the user's body, starting a process of capturing second information related to a second part of the user's body reduces the number of inputs required to perform the capture of the second information related to the second part of the user's body.

[0215] In some embodiments, starting a process of capturing second information related to a second part (e.g., 708b, 708f, and / or 708g) of a user's body (e.g., 708) involves the computer system (e.g., 101, 700, and / or 1000) via one or more display generation components (e.g., 120, 704, 722, 722b, and / or 1000a) causing the user (e.g., 708) to position a second part (e.g., 708b, 708f, and / or 708g) of the user's body (e.g., with respect to the computer system and / or one or more sensors communicating with the computer system) at a location (e.g., with respect to the computer system and / or one or more sensors communicating with the computer system) by displaying a visual indication (e.g., 730) (e.g., a user interface object including a contour, a shape of a human hand) indicating the location for positioning the second part of the user's body.

[0216] Displaying a visual indication indicating a location for the user to position a second part of the user's body facilitates the user's ability to use the computer system to capture second information related to the second part of the user's body, thereby reducing the amount of time required to capture the second information related to the second part of the user's body.

[0217] In some embodiments, initiating a process to capture second information regarding a second part of a user's body (e.g., 708b, 708f, and / or 708g) includes the computer system (e.g., 101, 700, and / or 1000) providing a prompt (e.g., 734) to the user (e.g., 708) to adjust the orientation of the second part of the user's body (e.g., 708b, 708f, and / or 708g) (e.g., the position and / or location of the user's hand relative to the computer system and / or relative to one or more sensors communicating with the computer system), via a visual prompt such as text, image, video, and / or a user interface object, and / or via an audio prompt. In some embodiments, prompting the user (e.g., 708) to adjust the orientation of the second part of the user's body (e.g., 708b, 708f, and / or 708g) includes providing the user with an instruction (e.g., 734) to turn the user's hand (e.g., 708f and / or 708g) over so that information regarding the palm side and / or back side of the hand can be captured.

[0218] Providing a prompt to instruct the user to adjust the orientation of the second part of the user's body facilitates the user's ability to use the computer system to capture second information regarding the second part of the user's body, thereby reducing the amount of time required to capture the second information regarding the second part of the user's body.

[0219] In some embodiments, after capturing second information related to a second part of a user's body (e.g., 708b, 708f, and / or 708g) of a user (e.g., 708), a computer system (e.g., 101, 700, and / or 1000) displays a representation of the user (e.g., 708) within an extended reality environment (e.g., 740 and / or 1008) (e.g., an environment that is wholly or partially simulated in which people perceive and / or interact via an electronic system, where a subset of the physical movement or its representation of a person is tracked and, in response, one or more characteristics of one or more virtual objects simulated within the extended reality environment are adjusted in a manner that conforms to at least one physical law) via one or more display generation components (e.g., 120, 704, 722, 722b, and / or 1000a). In some embodiments, the representation of the user (e.g., 726) includes a face representation (e.g., 726c) and a hand representation based on captured information about the user (e.g., 708) and / or captured second information related to a second part of the user's body (e.g., 708b, 708g, and / or 708f). Displaying the representation of the user within the extended reality environment after capturing the second information related to the second part of the user's body enables the user to determine the accuracy of the generated representation of the user, thereby providing improved visual feedback.

[0220] In some embodiments, aspects / operations of methods 900, 1100, 1200, 1300, and / or 1400 may be exchanged, replaced, and / or added among these methods. For example, the computer system of method 800 can be used to display a representation of the user, adjust the appearance of the representation of the user, display the mouth representation of the representation of the user, display the hair representation of the representation of the user, and / or display a portion of the representation of the user having visual emphasis. For the sake of brevity, their details are not repeated here.

[0221] FIG. 9 is a flowchart of an exemplary method 900 for displaying a user's expression according to some embodiments. In some embodiments, method 900 is performed in a computer system (e.g., 101, 700, and / or 1000) (e.g., a smartphone, a tablet, a head-mounted display generating component) that includes one or more display generation components (e.g., 120, 704, 722, 722b, and / or 1000a) (e.g., a visual output device, a 3D display, a display having at least a portion that is transparent or translucent onto which an image can be projected (e.g., a see-through display), a projector, a head-up display, and / or a display controller) (and optionally communicates with one or more cameras (e.g., an infrared camera, a depth camera, a visible light camera)). In some embodiments, method 900 is stored in a non-transitory (or transitory) computer-readable storage medium and is managed by instructions executed by one or more processors of the computer system, such as one or more processors 202 of computer system 101 (e.g., control 110 of FIG. 1). Some operations of method 900 are optionally combined and / or the order of some operations is optionally changed.

[0222] During a registration process (e.g., a process including capturing data (e.g., image data, sensor data, and / or depth data) indicating the size, shape, position, pose, color, depth, and / or other characteristics of one or more body parts and / or features of a body part of a user) for generating a representation (e.g., 726) of a user (e.g., 708) (e.g., an avatar and / or virtual representation of at least a portion of a first user), a computer system (e.g., 101, 700, and / or 1000) detects (902) information regarding one or more physical characteristics of a user (e.g., 708) of the computer system (e.g., 101, 700, and / or 1000) (e.g., data representing the size, shape, position, pose, color, depth, and / or other characteristics of one or more body parts and / or features of a body part of the user) (e.g., via one or more cameras).

[0223] After capturing information regarding one or more physical characteristics of a user (e.g., 708) of a computer system (e.g., 101, 700, and / or 1000), the computer system (e.g., 101, 700, and / or 1000) generates (904) a representation (e.g., 726) of the user (e.g., 708) based on the information regarding one or more physical characteristics of the user, including selecting one or more physical characteristics of the representation (e.g., 726) based on one or more captured physical characteristics of the user (e.g., the computer system uses information regarding the user of the computer system to generate a representation (e.g., an avatar) of the user including visual indications similar to the captured and / or detected size, shape, position, pose, color, depth, and / or other features of the body, clothing, hair, and / or features of the first user).

[0224] After generating a representation (e.g., 726) of a user (e.g., 708), a computer system (e.g., 101, 700, and / or 1000) displays (906) at least a portion of the representation (e.g., 726) of the user in an extended reality environment (e.g., 740) via one or more display generation components (e.g., 120, 704, 722, 722b, and / or 1000a). (For example, a subset of the physical movements of a person or a representation thereof is tracked, and in response, one or more characteristics of one or more virtual objects simulated in the extended reality environment are adjusted to conform to at least one physical law. It is a fully or partially simulated environment in which people perceive and / or interact with an electronic system.) In some embodiments, the computer system (e.g., 101, 700, and / or 1000) enables the user (e.g., 708) to view the representation (e.g., 726) and, in some embodiments, edit and / or modify the representation (e.g., 726) after the registration process is complete, and then displays the representation (e.g., 726) of the user within the extended reality environment (e.g., 740).

[0225] Displaying at least a portion of the user's representation within the extended reality environment after generating the user's representation enables the user to determine the accuracy of the generated representation of the user and to determine whether the computer system needs to recapture information related to the user, thereby providing improved visual feedback.

[0226] In some embodiments, an extended reality environment (e.g., 740) includes an augmented reality environment (e.g., a simulated environment in which one or more virtual objects are superimposed on a physical environment or a representation thereof, and / or a simulated environment in which a representation of the physical environment is transformed by computer-generated perceptual information). Displaying a representation of a user within the augmented reality environment enables a user viewing the representation to obtain context regarding the state of the device, thereby providing improved feedback regarding the state of the device.

[0227] In some embodiments, an extended reality environment (e.g., 740) includes a virtual reality environment (e.g., a simulated environment designed to be completely based on computer-generated sensory inputs for one or more senses that a person can perceive and / or interact with, including a plurality of virtual objects). Displaying a representation of a user within the virtual reality environment enables a user viewing the representation to obtain context regarding the state of the device, thereby providing improved feedback regarding the state of the device.

[0228] In some embodiments, capturing information regarding one or more physical characteristics of a user (e.g., 708) of a computer system (e.g., 101, 700, and / or 1000) includes the computer system (e.g., 101, 700, and / or 1000) capturing information regarding one or more physical characteristics of a user (e.g., 708) of the computer system while the computer system is removed from the user's body (e.g., 708a) (e.g., the computer system receives data captured via one or more sensors that communicate with the computer system, the data indicating that the computer system is not worn on a body part of the user (e.g., a particular body part)) (e.g., the computer system is a wearable computer system (e.g., a head-mounted display generation component, glasses, a headset, and / or a watch) configured to be worn on a body part of a user of the computer system) (in some embodiments, the computer system is a watch configured to be worn on a user's wrist of the computer system). Displaying at least a portion of a representation (e.g., 726) of a user (e.g., 708) within an extended reality environment (e.g., 740) includes the computer system (e.g., 101, 700, and / or 1000) detecting that the computer system is positioned on the user's body (e.g., 708a) (e.g., the computer system is worn in an individual orientation and / or position with respect to an individual part of the user's body) and then (e.g., in response thereto) the computer system (e.g., 101, 700, and / or 1000) displaying at least a portion of the representation (e.g., 726) of the user (e.g., 708) within the extended reality environment (e.g., 740).

[0229] By capturing information regarding one or more physical characteristics of a user while the computer system is removed from the user's body, the computer system can capture information regarding portions of the user's body that are not accessible to the computer system while the computer system is disposed on the user's body. Thus, the computer system can capture information about the user without additional and / or external devices and / or sensors. Additionally, the computer system can capture more information about the user that can be used to generate a more accurate representation of the user.

[0230] In some embodiments, displaying at least a portion of a representation (e.g., 726) of a user (e.g., 708) within an extended reality environment (e.g., 740) includes the computer system (e.g., 101, 700, and / or 1000) animating the representation (e.g., 726) (e.g., displaying movement of the representation that mirrors and / or mimics the movement of the user) based on movement of the user (e.g., 708) relative to at least a portion of the computer system (e.g., 101, 700, and / or 1000) (e.g., within the physical environment in which the user is located). In some embodiments, the animation of the representation (e.g., 726) is displayed in conjunction with (e.g., in correspondence with) the detected movement of the user (e.g., 708). Animating the representation based on movement of the user relative to at least a portion of the computer system enables the user to understand that the representation is associated with the user, thereby providing improved feedback regarding the state of the device.

[0231] In some embodiments, animating a representation (e.g., 726) includes the computer system (e.g., 101, 700, and / or 1000) displaying movement of the representation (e.g., 726) that is a mirror image of the movement of a user (e.g., 708) with respect to at least a portion of the computer system (e.g., within a physical environment) (e.g., the movement of the representation is displayed to the user as if the user were looking at their reflection in a mirror). In some embodiments, the animation of the representation (e.g., 726) is displayed in conjunction with (e.g., in correspondence with) the detected movement of the user (e.g., 708). Displaying movement of the representation as a mirror image of the movement of the user with respect to at least a portion of the computer system enables the user to understand that the representation is associated with the user, thereby providing improved feedback regarding the state of the device.

[0232] In some embodiments, displaying at least a portion of a representation (e.g., 726) of a user (e.g., 708) in an extended reality environment (e.g., 740) includes the computer system (e.g., 101, 700, and / or 1000) displaying a representation (e.g., 726) having a first orientation (e.g., posture, position, pose, and / or stance) that is a mirror image (e.g., as if the user is viewing the representation as a reflection of the user in a mirror and / or as if the representation of the user is flipped over the vertical axis without being flipped over the horizontal axis) of a second orientation (e.g., posture, position, pose, and / or stance) of the user (e.g., 708) in the physical environment (e.g., 706) in which the user is located (e.g., the computer system receives information regarding the state of the user's body and, based on the received information, displays at least a portion of the user's representation within the extended reality environment). Displaying a representation having a first orientation that is a mirror image of a second orientation of the user in the physical environment in which the user is located enables the user to understand that the representation is associated with the user, thereby providing improved feedback regarding the state of the device.

[0233] In some embodiments, displaying at least a portion of a representation (e.g., 726) of a user (e.g., 708) within an extended reality environment (e.g., 740) includes the computer system (e.g., 101, 700, and / or 1000) displaying a frame (e.g., a user interface object similar to a frame surrounding a mirror and / or a reflective surface) around the representation (e.g., 726) within the extended reality environment (e.g., 740). The frame indicates (e.g., to the user) that the representation of the user (e.g., 708) within the extended reality environment (e.g., 740) has an orientation (e.g., a physical and / or actual posture, position, pose, and / or stance) that is a mirror image of the orientation (e.g., the physical and / or actual posture, position, pose, and / or stance) of the user (e.g., 708) within the physical environment (e.g., 706) in which the user (e.g., 708) is located (e.g., is displayed as if the user is viewing the representation as a reflection in a mirror surrounded by the frame). Displaying a frame around the representation within the extended reality environment enables the user to understand that the representation is associated with the user, thereby providing improved feedback regarding the state of the device.

[0234] In some embodiments, while displaying at least a portion of a representation (e.g., 726) of a user (e.g., 708) in an extended reality environment (e.g., 740), a computer system (e.g., 101, 700, and / or 1000) edits visual characteristics of the representation (e.g., 726) (e.g., modifies, adjusts, and / or changes the visual appearance of the representation to add and / or remove accessories (e.g., headgear, head cover, eyewear, and / or clothing), prosthetics, eye patches, and / or hearing aids, adjusts the skin tone of one or more parts of the body of the representation, adjusts the hair color and / or hair style of the representation, adjusts the facial hair features of the representation, recaptures information regarding one or more physical characteristics of the user, and / or resumes capture of information regarding one or more physical characteristics of the user) via one or more display generation components (e.g., 120, 704, 722, 722b, and / or 1000a) by displaying one or more selectable options (e.g., 738a - 738d) (e.g., selectable user interface objects such as virtual buttons and / or text). Displaying one or more selectable options for editing visual characteristics of the representation enables the representation to be edited without requiring additional user input to navigate to a separate editing user interface, thereby reducing the number of inputs required to edit visual characteristics of the representation.

[0235] In some embodiments, one or more selectable options (e.g., 738a - 738d) include an eyewear selectable option (e.g., 738a) (e.g., a selectable user interface object such as a virtual button and / or text) for editing the eyewear of a representation (e.g., 726) (e.g., whether the user's representation is wearing glasses (and optionally, the type of glasses), a headset, a monocle, and / or sunglasses, and / or selecting the type, shape (e.g., frame shape), color, and / or size of the eyewear included in the representation). Including the eyewear selectable option enables the eyewear of the representation to be edited without requiring additional user input to navigate to a separate editing user interface, thereby reducing the number of inputs required to edit the eyewear of the representation.

[0236] In some embodiments, one or more selectable options (e.g., 738a - 738d) include an accessory selectable option (e.g., 738b) (e.g., a selectable user interface object such as a virtual button and / or text) for editing the accessories of a representation (e.g., 726) (e.g., whether the user's representation includes an eye patch, prosthetic, and / or hearing aid). Including the accessory selectable option enables the accessories of the representation to be edited without requiring additional user input to navigate to a separate editing user interface, thereby reducing the number of inputs required to edit the accessories of the representation.

[0237] In some embodiments, one or more selectable options (e.g., 738a - 738d) include one or more skin tone selectable options (e.g., 738c, 742a, and / or 742b) (e.g., selectable user interface objects such as virtual buttons and / or text) for editing the skin tone of a representation (e.g., 726) (e.g., adjusting, modifying, and / or changing the hue and / or color of the skin representation included in one or more portions of the user's representation). Including one or more skin tone selectable options enables the skin tone of the representation to be edited without requiring additional user input to navigate to a separate editing user interface, thereby reducing the number of inputs required to edit the skin tone of the representation.

[0238] In some embodiments, one or more skin tone selectable options (e.g., 738c, 742a, and / or 742b) (e.g., selectable user interface objects such as virtual buttons and / or text) include a first skin tone selectable option (e.g., 742a) (e.g., selectable user interface object such as virtual button and / or text) for editing the skin tone of the face (e.g., 726c) of the representation (e.g., 726), and a second skin tone selectable option (e.g., 724b) (e.g., selectable user interface object such as virtual button and / or text) for editing the skin tone of the hand of the representation (e.g., 726). In some embodiments, the user's skin tone varies on different parts of the user's body, and thus providing multiple skin tone selectable options enables the user (e.g., 708) to modify the appearance of the user's representation (e.g., 726) to more accurately reflect the user's (e.g., 708) actual appearance. Including a first skin tone selectable option for editing the skin tone of the face of the representation and a second skin tone selectable option for editing the skin tone of the hand of the representation option enables the skin tone of different parts of the representation to be edited without requiring additional user input to navigate to a separate editing user interface, thereby reducing the number of inputs required to edit the skin tone of the representation.

[0239] In some embodiments, one or more selectable options (e.g., 738a - 738d), when selected, initiate a re - capture selectable option (e.g., 738d) (e.g., a selectable user interface object such as a virtual button and / or text) that starts a process of re - capturing information regarding one or more physical characteristics of a user (e.g., 708) (e.g., selection of the re - capture selectable option causes the computer system to display a user interface and / or initiate a process of re - capturing information regarding one or more of the user's one or more physical characteristics). In some embodiments, the initial capture of information about one or more physical characteristics of a user (e.g., 708) may be inaccurate and / or incomplete, and thus providing the user (e.g., 708) with the ability to re - capture at least a portion of the information about one or more physical characteristics of the user enables the computer system (e.g., 101, 700, and / or 1000) to generate a representation (e.g., 726) that more accurately reflects the user's actual appearance. Including a re - capture selectable option enables information regarding one or more physical characteristics of the user to be re - captured without requiring additional user input to navigate to a separate user interface, thereby reducing the number of inputs required to re - capture information regarding one or more physical characteristics of the user.

[0240] In some embodiments, one or more selectable options (e.g., 738a - 738d), when selected, initiate steps of a registration process that include capturing second information regarding one or more physical characteristics of a user (e.g., 708) of a computer system (e.g., 101, 700, and / or 1000), including a resumable selectable option (e.g., 738d) (e.g., a selectable user interface object such as a virtual button and / or text) (e.g., selection of the resumable selectable option causes the computer system to resume capturing information regarding one or more physical characteristics of the user of the computer system using one or more sensors of the computer system, and optionally causes the computer system to delete and / or otherwise not use the first captured information regarding one or more physical characteristics of the user to generate a representation of the user). Including a resumable selectable option enables the capture of second information regarding one or more physical characteristics of the user without requiring additional user input to navigate to a separate user interface, thereby reducing the number of inputs required to capture second information regarding one or more physical characteristics of the user.

[0241] In some embodiments, one or more physical characteristics of a user (e.g., 708) include one or more first characteristics (e.g., facial features) of the face (e.g., 708c) of the user (e.g., 708) and one or more second characteristics (e.g., size, shape, skin tone, and / or contour) of the hand (e.g., 708f and / or 708g) of the user (e.g., 708). During a registration process for generating a representation (e.g., 726) of the user (e.g., 708), and while the computer system (e.g., 101, 700, and / or 1000) is removed from the body (e.g., 708a) of the user (e.g., 708) (e.g., the computer system receives data captured via one or more sensors that communicate with the computer system, and the data indicates that the computer system is not worn on a body part of the user (e.g., a particular body part)) (e.g., the computer system is a wearable computer system (e.g., a head-mounted display generating component, glasses, a headset, and / or a watch) configured to be worn on a body part of the user of the computer system) (in some embodiments, the computer system is a watch configured to be worn on the wrist of the user of the computer system) (in some embodiments, the computer system communicates with one or more sensors that capture data indicating whether the computer system is in a wearable position), the computer system (e.g., 101, 700, and / or 1000) captures one or more first characteristics of the face (e.g., 708c) of the user (e.g., 708) (e.g., without capturing characteristics of the user's hand). After capturing one or more first characteristics of the face (e.g., 708c) of the user (e.g., 708), the computer system (e.g., 101, 700, and / or 1000) detects that the computer system (e.g., 101, 700, and / or 1000) is placed on the body (e.g., 708a) of the user (e.g., the computer system is worn in an individual orientation and / or position with respect to an individual part of the user's body).After a computer system (e.g., 101, 700, and / or 1000) detects that it is placed on a user's body (e.g., 708a) (e.g., in response to and / or during that), the computer system (e.g., 101, 700, and / or 1000) captures one or more second features of the user's hand (e.g., 708f and / or 708g) (e.g., without capturing features of the user's face) (e.g., via one or more sensors (e.g., cameras) that communicate with the computer system to capture one or more second features of the user's hand).

[0242] Capturing one or more first features of the user's face while the computer system is removed from the user's body and capturing one or more second features of the user's hand while the computer system is placed on the user's body promotes the computer system's ability to capture information regarding different parts of the user's body, thereby reducing the amount of time required to capture information regarding one or more physical features of the user.

[0243] In some embodiments, the registration process is part of a setup process for a computer system (e.g., 101, 700, and / or 1000) (e.g., a setup process that begins when the computer system is first turned on, and / or a setup process that begins when a user of the computer system is creating an account and / or first signing in to use the computer system). During the setup process for the computer system (e.g., 101, 700, and / or 1000), the computer system (e.g., 101, 700, and / or 1000) captures one or more biometric features of the user (e.g., one or more features of the user's face, one or more features of the user's eyes, one or more features of the user's hand and / or fingers, and / or one or more features of the user's voice). Capturing one or more biometric features of the user during the setup process for the computer system enables the computer system to obtain additional information without requiring additional user input, thereby reducing the number of inputs required to capture one or more biometric features of the user.

[0244] In some embodiments, the registration process is part of a setup process for a computer system (e.g., 101, 700, and / or 1000) (e.g., a setup process that starts when the computer system is first turned on, and / or a setup process that starts when a user of the computer system is creating an account for using the computer system and / or signing in to it for the first time). During the setup process of the computer system (e.g., 101, 700, and / or 1000), the computer system (e.g., 101, 700, and / or 1000) performs an input calibration process that enables the computer system (e.g., 101, 700, and / or 1000) to calibrate the detection of one or more input technologies (e.g., detecting, observing, and / or capturing information about the user's line of sight (e.g., the user is attempting to provide a known and / or predetermined sequence of line-of-sight inputs, and the detected, observed, and / or captured information about the user's line of sight is compared with the known and / or predetermined sequence of line-of-sight inputs, and the comparison is used to adjust how the computer system interprets line-of-sight inputs so that the detected, observed, and / or captured information about the user's line of sight matches the known and / or predetermined sequence of line-of-sight inputs), and / or detecting and / or capturing information about the user's hand, the movement of the user's hand, and / or gestures made by the user's hand (e.g., the user is attempting to provide a known and / or predetermined series of hand gesture inputs, and the detected, observed, and / or captured information about the user's hand is compared with the known and / or predetermined series of hand gesture inputs, and the comparison is used to adjust how the computer system interprets hand gesture inputs so that the detected, observed, and / or captured information about the user's hand matches the known and / or predetermined series of hand gesture inputs, the computer system can detect and execute one or more functions based on the input, and / or the computer system can detect the input more accurately)).

[0245] By performing an input calibration process during the setup process of a computer system, the computer system can obtain additional information without requiring additional user input, thereby reducing the number of inputs required to perform the input calibration process.

[0246] In some embodiments, the registration process is part of the setup process for a computer system (e.g., 101, 700, and / or 1000) (e.g., a setup process that starts when the computer system is first turned on, and / or a setup process that starts when a user of the computer system is creating an account and / or first signing in to use the computer system). During the setup process of the computer system (e.g., 101, 700, and / or 1000), the computer system (e.g., 101, 700, and / or 1000) performs a spatial audio calibration process (e.g., a process that includes outputting audio via an audio output device (e.g., speakers and / or headphones) that communicates with the computer system, wherein the output audio is generated to simulate audio generated from at least one location different from the actual location of the audio output device). In some embodiments, spatial audio calibration includes outputting audio, detecting feedback and / or one or more user inputs corresponding to the perceived location of the output audio, and calibrating the perceived location to cause the output audio to simulate audio generated from a target location).

[0247] Performing a spatial audio calibration process during the setup process for a computer system enables the computer system to obtain additional information without requiring additional user input, thereby reducing the number of inputs required to perform the spatial audio calibration.

[0248] In some embodiments, the registration process is part of a setup process for a computer system (e.g., 101, 700, and / or 1000) (e.g., a setup process that begins when the computer system is first turned on, and / or a setup process that begins when a user of the computer system is creating and / or first signing into an account for using the computer system). During the setup process of the computer system (e.g., 101, 700, and / or 1000), the computer system (e.g., 101, 700, and / or 1000) provides an indication (e.g., via one or more display generating components) of instructions (e.g., instructions on how a user of the computer system can use an expression (e.g., 726) during a real-time communication session to communicate with one or more additional users (e.g., additional users associated with an external computer system) during a real-time communication session (e.g., a real-time communication session between a user of the computer system and a second user associated with a second computer system different from the first computer system, the real-time communication session including displaying and / or otherwise communicating an expression of the user's face and / or body to the second user via the computer system and / or the second computer system)).

[0249] Providing an indication of instructions for using an expression during a real-time communication session during the setup process of a computer system causes the device to automatically perform an operation of providing the user with additional context regarding how the expression can be used.

[0250] In some embodiments, one or more physical characteristics of a user (e.g., 708) include the user's clothing (e.g., 708i) (e.g., physical clothing worn by the user within the physical environment in which the user is located), and an expression (e.g., 726) includes a clothing expression (726i) (e.g., a visual image and / or indication of clothing that is similar to and / or includes one or more similar attributes of the user's physical clothing) based on the user's clothing (e.g., 708i) detected during a registration process for generating an expression of the user (e.g., 708). An expression that includes a clothing expression based on the user's clothing enables the appearance of the expression to more closely resemble the user's actual appearance, thereby providing improved visual feedback.

[0251] In some embodiments, after displaying at least a portion of a representation (e.g., 726) of a user (e.g., 708) within an extended reality environment (e.g., 740), a computer system (e.g., 101, 700, and / or 1000) displays a menu user interface (e.g., 746 and / or 748) (e.g., a user interface including one or more selectable options for performing functions of the computer system such as starting a real-time communication session, editing and / or modifying a representation, and / or starting a game) via one or more display generation components (e.g., 120, 704, 722, 722b, and / or 1000a). The menu user interface (e.g., 746 and / or 748), when selected, causes the computer system (e.g., 101, 700, and / or 1000) to display at least a portion of the representation (e.g., 726) of the user (e.g., 708) (e.g., such that the representation of the user within the extended reality environment is a mirror image' having an orientation (e.g., the physical and / or actual pose, position, pose, and / or stance of the user within the physical environment in which the user is located) that is the same as the orientation (e.g., pose, position, pose, and / or stance) of the user as if the user were viewing a reflection in a mirror surrounding the frame) (e.g., shown to the user) and includes selectable options (e.g., 746a, 748a, and / or 748b) (e.g., selectable user interface objects such as virtual buttons and / or text) (e.g., for displaying and / or redisplaying the representation of the user within the extended reality environment and optionally displaying one or more selectable options for editing the representation of the user). In some embodiments, the representation (e.g., 726) of the user (e.g., 708) is animated and is displayed in conjunction with detected movement of the user (e.g., in accordance with the movement of the user).In some embodiments, the physical movement of a user (e.g., 708) with respect to a portion of a computer system (e.g., 101, 700, and / or 1000) within the physical environment (e.g., 706) in which the user is located is displayed via movement of a representation (e.g., 726) within an extended reality environment (e.g., 740). In some embodiments, displaying movement of a representation (e.g., 726) within an extended reality environment (e.g., 740) includes displaying movement of a representation (e.g., 726) that is a mirror image of the physical movement of the user (e.g., 708) with respect to a portion of a computer system (e.g., 101, 700, and / or 1000) within the physical environment (e.g., 706) in which the user is located.

[0252] Displaying a menu user interface that includes selectable options enables a computer system to quickly and easily display at least a portion of a user's representation within an extended reality environment, thereby reducing the number of inputs required to display the user's representation within the extended reality environment.

[0253] Figures 10A - 10I illustrate examples of techniques for adjusting the appearance of a user's representation. FIG. 11 is a flowchart of an exemplary method 1100 for adjusting the appearance of a user's representation. FIG. 12 is a flowchart of an exemplary method 1200 for displaying an oral representation of a user's representation. FIG. 13 is a flowchart of an exemplary method 1300 for displaying a hair representation of a user's representation. FIG. 14 is a flowchart of an exemplary method 1400 for displaying a portion of a user's representation with visual emphasis. The user interfaces of Figures 10A - 10I are used to illustrate the processes described below, including the processes of Figures 11 - 14.

[0254] Figures 10A - 10I show examples of an electronic device 1000 that displays a representation 1002 of one or more parts of the body of a user 1004 having different appearances based on information received by the electronic device 1000. Figures 10A - 10I also show an example of an electronic device 1000 that displays a communication interface 1006 including a first participant area 1006a corresponding to the user 1004 and a second participant area 1006b corresponding to a second user (e.g., a second user associated with and / or using the electronic device 1000) via a display 1000a. In Figure 10A, the first participant area 1006a includes an extended reality environment 1008, as well as a representation 1002 of the user 1004 and a table representation 1010 (e.g., an image representing a virtual table and / or an image representing a table 1016 in a physical environment 1014) within the extended reality environment 1008. Additionally, the second participant area 1006b includes a second representation 1012 of the second user (e.g., an avatar and / or an image representing the second user). In some embodiments, the user 1004 is participating in a real - time communication session such as a video conference and / or a virtual video conference with the second user (e.g., the electronic device 1000 communicates with an external electronic device of the user 1004, enabling the user 1004 and / or the second user to communicate with each other via audio, video, and / or images displayed on the electronic device 1000 and / or the external electronic device).

[0255] Figures 10A - 10I also show user 1004 within physical environment 1014 (e.g., the actual environment where user 1004 is physically located), and physical environment 1014 includes user 1004 and table 1016 (e.g., a physical table). Electronic device 1000 communicates with sensors 1018a and 1018b positioned within physical environment 1014 (e.g., wireless communication via an external electronic device associated with and / or used by user 1004). In some embodiments, sensors 1018a and 1018b include cameras, image sensors, light sensors, depth sensors, tactile sensors, orientation sensors, proximity sensors, temperature sensors, location sensors, motion sensors, and / or velocity sensors. Sensors 1018a and 1018b are configured to capture data and / or information regarding the state (e.g., position, orientation, posture, and / or pose) of user 1004 within physical environment 1014. For example, sensors 1018a and 1018b are configured to detect and capture information related to the position and / or movement of various body parts of user 1004 within physical environment 1014. Figures 10A - 10I show electronic device 1000 communicating with two sensors (e.g., sensors 1018a and 1018b), but in some embodiments, electronic device 1000 communicates with any suitable number of sensors (e.g., via an external electronic device associated with user 1004).

[0256] Figures 10A - 10I illustrate an electronic device 1000 that displays a representation 1002 of a user 1004. In some embodiments, however, the electronic device 700 displays a communication interface 1006 that includes a representation 1002 of the user 1004 via a display 704. In some embodiments, the electronic device 1000 is configured to capture one or more physical characteristics of the user 708 (and / or the user 1004) and generate a representation 726 (and / or a representation 1002) as described above with reference to FIGS. 7A - 7J, and / or display the representation 726 (and / or the representation 1002) on a display 1000a of the electronic device 1000. In some embodiments, the same electronic device (e.g., the electronic device 700 and / or the electronic device 1000) is used to generate and display the representation 726 as described above with reference to FIGS. 7A - 7J and to display the representation 1002 as described below with reference to FIGS. 10A - 10I.

[0257] In FIG. 10A, the electronic device 1000 receives information indicating the state of one or more body parts of the user 1004 in the physical environment 1014 (e.g., via sensors 1018a and / or 1018b and / or via an external device). In response to receiving the information, the electronic device 1000 displays a representation 1002 within the extended reality environment 1008 of the first participant area 1006a. As shown in FIG. 10A, the representation 1002 includes an appearance that mimics the physical appearance of the user 1004 in the physical environment 1014. For example, the first representation 1002 includes a waist 1004a, hands 1004b, hands 1004c, legs 1004d, legs 1004e, a head 1004f, and a face 1004g corresponding to the waist 1002a, hands 1002b, hands 1002c, legs 1002d, legs 1002e, a head 1002f, and a face 1002g of the user 900. Specifically, the hand 1002b of the representation 1002 is lifted above the waist 1002a within the extended reality environment 1008, similar to the hand 1004b of the user 1004 in the physical environment 1014. The hand 1002c of the representation 1002 is positioned at or near the waist 1002a of the representation 1002 within the extended reality environment 1008, which is similar to the hand 1004c of the user 1004 positioned at or near the waist 1004a of the user 1004 in the physical environment 1014.

[0258] In FIG. 10A, an electronic device 1000 receives information indicating a state of a user 1004's body (e.g., position, orientation, posture, and / or pose). Based on the received information, the electronic device 1000 displays a representation 1002 as having a first appearance within an extended reality environment 1008 (e.g., as indicated by the solid lines shown in FIG. 10A). In FIG. 10A, the electronic device 1000 displays the representation 1002 with a first amount of visual fidelity and / or without blur applied to at least a portion of the representation 1002. In some embodiments, the electronic device 1000 displays the representation 1002 as an anatomically accurate representation of the user 1004 without applying any amount of blur to the representation 1002. In some embodiments, the received information indicates a state of a portion of the user 1004's body. In some such embodiments, the electronic device 1000 displays a first portion of the representation 1002 corresponding to a portion of the user 1004's body having a first appearance and a second portion of the representation 1002 not corresponding to a portion of the user 1004's body having a second appearance different from the first appearance.

[0259] In FIG. 10A, as indicated by arrow 1019, electronic device 1000 displays the movement of representation 1002 within extended reality environment 1008. If electronic device 1000 receives information indicating the state of user 1004, and the information indicating the state of user 1004 includes direct information regarding the state of at least a portion of the body of user 1004 that is received within a first predetermined amount of time (e.g., information directly captured via sensors 1018a and / or 1018b indicating the position of a portion of the body of user 1004 within physical environment 1014), then electronic device 1000 maintains the display of representation 1002 having a first appearance. In some embodiments, the first appearance of representation 1002 does not include transparency (e.g., zero amount of transparency applied to representation 1002), such that portion 1010a of table representation 1010 is obscured and / or otherwise blocked by representation 1002. In some embodiments, when electronic device 1000 displays the movement of representation 1002 within extended reality environment 1008, electronic device 1000 displays representation 1002 as obscuring and / or otherwise blocking other portions of table representation 1010.

[0260] In FIG. 10B, the electronic device 1000 receives information indicating the state of the user 1004 within the physical environment 1014. However, the information indicating the state of the user 1004 within the physical environment 1014 does not include direct information regarding the state of at least a portion of the user 1004's body (e.g., information directly captured via sensors 1018a and / or 1018b indicating the position of a portion of the user 1004's body within the physical environment 1014). In some embodiments, the electronic device 1000 determines that the information indicating the state of the user 1004 within the physical environment 1014 does not include direct information regarding the state of at least a portion of the user 1004's body and / or did not include direct information regarding the state of at least a portion of the user 1004's body for a first predetermined amount of time. In some embodiments, the information indicating the state of the user 1004 within the physical environment 1014 includes instructions and / or additional information indicating to the electronic device 1000 that direct information regarding the state of at least a portion of the user 1004's body is not available and / or was not available for a first predetermined amount of time.

[0261] In FIG. 10B, the electronic device 1000 displays the representation 1002 as having a second appearance that is different from the first appearance based on direct information regarding the state of at least a portion of the user 1004's body that has not been received and / or is not available for a first predetermined amount of time. In some embodiments, the first predetermined amount of time is an amount of time that is longer than a first time threshold such as 1 second, 5 seconds, 10 seconds, and / or 30 seconds, but shorter than a second time threshold such as 45 seconds, 60 seconds, 90 seconds, and / or 120 seconds. In some embodiments, when direct information regarding the state of at least a portion of the user 1004's body is received (e.g., received by the electronic device 1000 and / or received by another electronic device in communication with the electronic device 1000) at a point in time before the first predetermined amount of time has elapsed (e.g., within an amount of time less than the first predetermined amount of time), the electronic device 1000 maintains the display of the representation 1002 having the first appearance, as shown in FIG. 10A.

[0262] If direct information regarding the state of at least a part of the body of user 1004 has not been received for a first predetermined amount of time (e.g., not received by electronic device 1000 and / or not received by another electronic device communicating with electronic device 1000), then electronic device 1000 displays representation 1002 having a second appearance, as shown in FIG. 10B. For example, in FIG. 10B, representation 1002 is shown as being displayed by electronic device 1000 with a first dashed line to indicate that the electronic device is displaying representation 1002 in the second appearance. In some embodiments, the second appearance includes displaying representation 1002 with a second amount of visual fidelity (e.g., accuracy and / or clarity) and / or with an increased amount of blur compared to the first amount of visual fidelity. In some embodiments, the second appearance includes displaying representation 1002 having a particle size larger than the particle size of the first appearance. Thus, in some embodiments, electronic device 1000 displays a less accurate version of representation 1002 when direct information regarding the state of at least a part of the body of user 1004 has not been received for a first predetermined amount of time (e.g., not received by electronic device 1000 and / or not received by another electronic device communicating with electronic device 1000). Although FIG. 10B shows representation 1002 as a whole having the second appearance, in some embodiments, electronic device 1000 displays a first portion of representation 1002 (e.g., the portion of representation 1002 corresponding to the part of the body of user 1004 for which direct information is not received) using the second appearance and displays a second portion of representation 1002 using the first appearance.

[0263] In some embodiments, when direct information regarding the state of at least a portion of the body of user 1004 has not been received over a first predetermined amount of time (e.g., not received by electronic device 1000 and / or not received by another electronic device in communication with electronic device 1000), electronic device 1000 displays representation 1002 as being static and / or stationary within extended reality environment 1008. For example, in some embodiments, information regarding the state of user 1004 and / or direct information regarding the state of at least a portion of the body of user 1004 includes information indicating movement of user 1004 within physical environment 1014 (e.g., movement of one or more body parts of user 1004). In some embodiments, when electronic device 1000 receives direct information regarding the state of at least a portion of the body of user 1004 within a time amount shorter than the first predetermined amount of time, electronic device 1000 displays movement of representation 1002 based on the direct information regarding the state of at least a portion of the body of user 1004, which indicates physical movement of user 1004 within physical environment 1014. However, in some embodiments, when the electronic device does not receive direct information regarding the state of at least a portion of the body of user 1004 over the first predetermined amount of time, electronic device 1000 maintains the display of representation 1002 at a certain position within extended reality environment 1008 and does not display movement of representation 1002 otherwise (e.g., even when user 1004 moves within physical environment 1014).

[0264] In some embodiments, electronic device 1000 displays representation 1002 using a second appearance while maintaining the general shape of representation 1002. In other words, electronic device 1000 displays representation 1002 having a first appearance and displays representation 1002 having a second appearance as having the same shape (e.g., a shape similar to the shape and / or silhouette of user 1004 and / or including a different but similar appearance).

[0265] In some embodiments, the electronic device 1000 displays the movement of the representation 1002 having a second appearance within the extended reality environment 1008, as indicated by the arrow 1021. In some embodiments, the second appearance of the representation 1002 includes a first amount of transparency (e.g., a non-zero amount of transparency applied to the representation 1002) such that the portion 1010a of the table representation 1010 is at least partially visible and / or distinguishable through the representation 1002. In some embodiments, when the electronic device 1000 displays the movement of the representation 1002 within the extended reality environment 1008 and when the electronic device 1000 is displaying the representation 1002 having the second appearance, the electronic device 1000 displays other portions of the table representation 1010 - the representation 1002.

[0266] In FIG. 10C, the electronic device 1000 receives information indicating the state of the user 1004 within the physical environment 1014. However, the information indicating the state of the user 1004 within the physical environment 1014 does not include direct information regarding the state of at least a portion of the user 1004's body (e.g., information directly captured via sensors 1018a and / or 1018b indicating the position of a portion of the user 1004's body within the physical environment 1014). In some embodiments, the electronic device 1000 determines that the information indicating the state of the user 1004 within the physical environment 1014 does not include direct information regarding the state of at least a portion of the user 1004's body and / or has not included direct information regarding the state of at least a portion of the user 1004's body for a second predetermined amount of time that is longer than the first predetermined amount of time. In some embodiments, the information indicating the state of the user 1004 within the physical environment 1014 includes instructions and / or additional information indicating to the electronic device 1000 that direct information regarding the state of at least a portion of the user 1004's body is not available and / or has not been available for the second predetermined amount of time.

[0267] In FIG. 10C, based on the fact that direct information regarding the state of at least a part of the body of user 1004 has not been received and / or is not available for a second predetermined amount of time, the electronic device 1000 displays the representation 1002 as having a third appearance different from the first appearance and the second appearance. In some embodiments, the second predetermined amount of time is an amount of time greater than a first time threshold such as 1 second, 5 seconds, 10 seconds, and / or 30 seconds, and greater than a second time threshold such as 45 seconds, 60 seconds, 90 seconds, and / or 120 seconds. In some embodiments, if direct information regarding the state of at least a part of the body of user 1004 is received within the time before the second predetermined amount of time (e.g., within a time less than the second predetermined amount of time), the electronic device 1000 maintains the display of the representation 1002 having the first appearance as shown in FIG. 10A and / or maintains the display of the representation 1002 having the second appearance as shown in FIG. 10B. In some embodiments, the electronic device 100 displays the representation 1002 having the second appearance when direct information regarding at least a part of the body of user 1004 has not been received for a first predetermined amount of time, and the electronic device 1000 displays the representation 1002 having the third appearance when direct information regarding at least a part of the body of user 1004 has not been received for a second predetermined amount of time (e.g., a transition from displaying the representation 1002 having the second appearance to displaying the representation 1002 having the third appearance). In some embodiments, the electronic device 1000 displays the representation 1002 having the second appearance when direct information regarding at least a part of the body of user 1004 has not been received during a first predetermined amount of time, and the electronic device 1000 displays the representation 1002 having the first appearance when direct information regarding at least a part of the body of user 1004 is received within the amount of time before the second predetermined amount of time but after the first predetermined amount of time has already elapsed (e.g., a transition from displaying the representation 1002 having the second appearance to displaying the representation having the first appearance).

[0268] If direct information regarding the state of at least a part of the body of user 1004 has not been received over a second predetermined amount of time (e.g., not received by electronic device 1000 and / or not received by another electronic device communicating with electronic device 1000), then electronic device 1000 displays representation 1002 having a third appearance, as shown in FIG. 10C. For example, in FIG. 10C, representation 1002 is shown as being displayed by electronic device 1000 with a second dashed line to indicate that the electronic device is displaying representation 1002 having a third appearance. In some embodiments, the third appearance includes displaying representation 1002 with a third amount of visual fidelity (e.g., accuracy and / or clarity) and / or with an increased amount of blur compared to the first amount of visual fidelity and / or the second amount of visual fidelity. In some embodiments, the third appearance includes displaying representation 1002 having a particle size that is larger than the particle size of the first appearance and / or larger than the particle size of the second appearance. Thus, in some embodiments, electronic device 1000 displays a less accurate version of representation 1002 when direct information regarding the state of at least a part of the body of user 1004 has not been received by electronic device 1000 over a second predetermined amount of time. Although FIG. 10C shows representation 1002 as a whole having a third appearance, in some embodiments, electronic device 1000 displays a first portion of representation 1002 having a third appearance (e.g., a portion of representation 1002 corresponding to a part of the body of user 1004 for which direct information is not received) and a second portion of representation 1002 having a first appearance and / or a second appearance.

[0269] In some embodiments, when direct information regarding the state of at least a portion of user 1004's body has not been received for a second predetermined amount of time (e.g., not received by electronic device 1000 and / or not received by another electronic device communicating with electronic device 1000), electronic device 1000 displays representation 1002 in a presentation mode. In some embodiments, the presentation mode includes displaying representation 1002 as a blurred circle and / or other non-anatomically accurate representation of user 1004. In some embodiments, the presentation mode includes displaying representation 1002 in an audio presence mode, where representation 1002 includes an icon and / or monogram having an appearance based on the detected speech of user 1004 in physical environment 1014. In some embodiments, the presentation mode includes displaying representation 1002 as having a shape that does not visually respond to changes in the movement of user 1004. In some embodiments, the presentation mode includes displaying representation 1002 in a size smaller than the size of representation 1002 when displayed using a first appearance and / or a second appearance.

[0270] In some embodiments, electronic device 1000 maintains the display of representation 1002 having a third appearance when direct information regarding the state of at least a portion of user 1004's body has not been received for a time period longer than the second predetermined amount of time. In other words, electronic device 1000 maintains the display of representation 1002 having a third appearance unless direct information regarding the state of at least a portion of user 1004's body is received after the second predetermined amount of time has elapsed. In some embodiments, when electronic device 1000 receives direct information regarding the state of at least a portion of user 1004's body, it transitions from displaying representation 1002 having a third appearance to displaying representation 1002 having a first appearance.

[0271] In some embodiments, the electronic device 1000 displays the movement of the representation 1002 having a third appearance within the extended reality environment 1008, as indicated by the arrow 1023. In some embodiments, the third appearance of the representation 1002 includes a second amount of transparency (e.g., a non-zero amount of transparency applied to the representation 1002 that is greater than the first amount of transparency) such that the portion 1010a of the table representation 1010 is at least partially visible and / or distinguishable through the representation 1002. In some embodiments, the portion 1010a of the table representation 1010 is more visible and / or distinguishable through the representation 1002 when the electronic device 1000 displays the representation 1002 having the third appearance as compared to when the electronic device 1000 displays the representation 1002 having the second appearance. In some embodiments, when the electronic device 1000 displays the movement of the representation 1002 within the extended reality environment 1008, the electronic device 1000 displays other portions of the table representation 1010 - the representation 1002 when the electronic device 1000 is displaying the representation 1002 having the third appearance.

[0272] In FIG. 10D, the electronic device 1000 displays a zoomed-in view of the representation 1002 within the extended reality environment 1008 in the first participant area 1006a. In some embodiments, the electronic device 1000 zooms the first participant area 1006a to a specific portion of the extended reality environment 1008 in response to user input (e.g., a tap gesture, a voice command, and / or an air gesture). In some embodiments, the electronic device 1000 zooms the first participant area 1006a to a specific portion of the extended reality environment 1008 when conditions are met, such as when the user 1004 is outputting (e.g., speaking and / or creating) utterances (e.g., speech, humming, vocalizing, and / or other sounds created verbally in another manner).

[0273] In FIG. 10D, user 1004 is outputting speech 1020 (“Hello JANE, how are you today?”) within physical environment 1014. Accordingly, the user's mouth 1004h is open, indicating that user 1004 is speaking speech 1020. In FIG. 10D, electronic device 1000 receives information indicating the state of user 1004's mouth 1004h within physical environment 1014. Additionally, electronic device 1000 receives audio information indicating that user 1004 is outputting speech 1020 (e.g., via a speaker of electronic device 1000 associated with user 1004 and / or via sensors 1018a and / or 1018b). Based on the received information indicating the state of user 1004's mouth 1004h and / or based on the received audio information indicating that user 1004 is outputting speech 1020, electronic device 1000 displays representation 1002 having a first appearance and having mouth 1002h in an open position, as shown in FIG. 10D.

[0274] In FIG. 10D, electronic device 1000 displays mouth 1002h of representation 1002 with a first amount of visual fidelity (e.g., accuracy and / or clarity). In some embodiments, electronic device 1000 displays mouth 1002h of representation 1002 as an anatomically accurate representation of user 1004's mouth 1004h without applying any blurring amount to mouth 1002h.

[0275] In some embodiments, electronic device 1000 displays mouth 1002h of representation 1002 in an open position based on the received information indicating the state of user 1004's mouth 1004h and without based on the received audio information indicating that user 1004 is outputting speech 1020. In some embodiments, while displaying mouth 1002h of representation 1002 in an open position, electronic device 1000 outputs audio corresponding to speech 1020 via a speaker.

[0276] In FIG. 10E, the electronic device 1000 receives information indicating the state of the mouth 1004h of the user 1004, but the information indicating the state of the mouth 1004h of the user 1004 does not meet a set of one or more criteria. For example, in some embodiments, the set of one or more criteria includes a first criterion that is met when the information indicating the state of the mouth 1004h of the user 1004 is received within a predetermined period (e.g., within a repeating predetermined time interval such as every 1 second, every 5 seconds, and / or every 10 seconds), a second criterion that is met when the information indicating the state of the mouth 1004h of the user 1004 includes information indicating the movement of the mouth 1004h at a time corresponding to the time when the speech 1020 is output by the user 1004 (e.g., the time when the speech 1020 is detected via the microphone and / or sensors 1018a and / or 1018b), and / or a third criterion that is met when the information indicating the state of the mouth 1004h of the user 1004 includes an amount of accuracy greater than a threshold amount of accuracy (e.g., the information includes data indicating a position, pose, orientation, and / or expression of the mouth 1004h that is greater than a confidence level threshold determined at least in part based on the amount of information, the amount of information received over time, and / or the accuracy and / or certainty of the information regarding detecting and / or estimating the actual state of the mouth 1004h).

[0277] When the information indicating the state of the mouth 1004h of the user 1004 does not meet a set of one or more criteria, the electronic device 1000 displays the mouth 1002p of the representation 1002 having a second appearance. For example, in FIG. 10E, the mouth 1002p of the representation 1002 is shown as being displayed by the electronic device 1000 with a dashed line to indicate that the electronic device is displaying the mouth 1002p of the representation 1002 using the second appearance. In some embodiments, the second appearance includes displaying the mouth 1002p of the representation 1002 with a second amount of visual fidelity (e.g., accuracy and / or clarity) and / or with an increased amount of blur compared to the first amount of visual fidelity.

[0278] In some embodiments, the second appearance includes displaying the mouth 1002p of the representation 1002 based at least in part on the audio information corresponding to the speech 1020. For example, the electronic device 1000 displays the mouth 1002p of the representation 1002 in a particular pose, orientation, expression, and / or position (e.g., an estimated, extrapolated, and / or predicted pose, orientation, expression, and / or position based on the audio information corresponding to the speech 1020) based at least in part on the audio information corresponding to the speech 1020. In some embodiments, the electronic device 1000 displays the mouth 1002p of the representation 1002 based on both the audio information corresponding to the speech 1020 and information indicating the state of the user's 1004 mouth 1004h when the information indicating the state of the mouth 1004h does not meet one or more sets of criteria. In some embodiments, when the information indicating the state of the mouth 1004h does not meet one or more sets of criteria, the electronic device 1000 displays the mouth 1002p of the representation 1002 as a combination of a first portion (e.g., a mouth 1002h having a first appearance) generated based on the information indicating the state of the user's 1004 mouth 1004h and a second portion generated based on the audio information corresponding to the speech 1020. For example, in some embodiments, the first portion and the second portion are combined, overlaid on each other, and / or otherwise used to generate the mouth 1002p of the representation 1002 displayed by the electronic device 1000. In some embodiments, the first portion is a static representation and the second portion is a dynamic representation. In some embodiments, both the first portion and the second portion are dynamic representations.

[0279] In some embodiments, the mouth 1002p of the representation 1002 includes different amounts and / or degrees of emphasis of the first and second portions based on information indicating the state of the mouth 1004h of the user 1004. For example, in some embodiments, when it is determined that one or more sets of criteria are not met and the information indicating the state of the mouth 1004h of the user 1004 includes a confidence level less than a confidence level threshold (e.g., via the electronic device 1000 and / or via another electronic device associated with the user 1004), the mouth 1002p of the representation 1002 is generated using a first portion having a first amount of emphasis (e.g., a first visual emphasis amount and / or a first weight) and a second portion having a second amount of emphasis greater than the first amount of emphasis (e.g., a second visual emphasis amount and / or a second weight). Similarly, in some embodiments, when it is determined that one or more sets of criteria are not met and the information indicating the state of the mouth 1004h of the user 1004 includes a confidence level greater than a confidence level threshold (e.g., via the electronic device 1000 and / or via another electronic device associated with the user 1004), the mouth 1002p of the representation 1002 is generated using a first portion having a third...

Claims

1. A method, comprising: In a computer system communicating with one or more display generation components, While the computer system is placed on the user's body, display, via the one or more display generation components, a prompt instructing to remove the computer system from the user's body and use the computer system to capture information related to the user; After displaying the prompt instructing to remove the computer system from the user's body, detect that the computer system has been removed from the user's body; After detecting that the computer system has been removed from the user's body, capture information related to the user, wherein the computer system is configured to generate a representation of the user using the information; A method comprising the above steps.

2. The method according to claim 1, wherein the representation of the user is configured to be displayed in an augmented reality environment and / or a virtual reality environment.

3. The method according to claim 1 or 2, wherein the computer system is configured to generate the representation of the user three-dimensionally.

4. The method according to any one of claims 1 to 3, further comprising providing an instruction to capture the information related to the user using the computer system before detecting that the computer system has been removed from the user's body.

5. The method according to claim 4, wherein providing the instruction includes displaying, via the one or more display generation components, an animation demonstrating capturing the information related to the user using the computer system.

6. Before detecting that the computer system has been removed from the user's body, According to a determination that a set of criteria is met, display, via the one or more display generation components, an indication related to a condition affecting the capture of the information related to the user. Ceasing to display the indication associated with the condition affecting the capture of information related to the user, in accordance with the determination that the set of criteria is not met; and further comprising the method according to any one of claims 1 to 5. **Claim 7** The indication associated with the condition affecting the capture of information related to the user includes information regarding taking an action useful for modifying the condition, according to the method of claim 6. **Claim 8** Further comprising starting a process of capturing the information related to the user in response to detecting that the computer system has been removed from the user's body, according to the method of any one of claims 1 to 7. **Claim 9** Further comprising providing a second prompt including an instruction to capture the information related to the user after detecting that the computer system has been removed from the user's body, according to the method of any one of claims 1 to 8. **Claim 10** Providing the second prompt includes displaying a visual prompt together with one or more registration instructions via one or more display generation components, according to the method of claim 9. **Claim 11** The prompt for removing the computer system from the user's body and instructing to capture information related to the user using the computer system is displayed via a first display generation component among the one or more display generation components. The visual prompt is displayed via a second display generation component different from the first display generation component among the one or more display generation components, according to the method of claim 10. **Claim 12** Providing the second prompt includes outputting an audio prompt together with one or more registration instructions via an audio device communicating with the computer system, according to the method of any one of claims 9 to 11. **Claim 13** Providing the second prompt includes providing an indication instructing the user to orient a part of the user's body within a target location with respect to the computer system, according to the method of any one of claims 9 to 12. **Claim 14** Providing the second prompt includes providing an indication that instructs the user to adjust conditions that affect the capture of the user's information, the method according to any one of claims 9 to 13.

15. Providing the second prompt includes providing an indication that instructs the user to move the position of the user's head, the method according to any one of claims 9 to 14.

16. Providing the second prompt includes providing an indication that instructs the user to position one or more sets of the user's facial features within a predefined set of facial expressions, the method according to any one of claims 9 to 15.

17. Providing the second prompt includes providing an indication that instructs the user to adjust the position of the computer system to orient the computer system towards a predefined part of the user's body, the method according to any one of claims 9 to 16.

18. The prompt that instructs to remove the computer system from the user's body and use the computer system to capture information related to the user is displayed via a first display generation component among the one or more display generation components, and the method further includes, after capturing the information related to the user, displaying a preview of the user's expression via a second display generation component different from the first display generation component among the one or more display generation components, the method according to any one of claims 1 to 17.

19. after capturing the information related to the user, detecting that the computer system is disposed on the user's body; and after detecting that the computer system is disposed on the user's body, displaying a preview of the user's expression via the one or more display generation components, the method according to any one of claims 1 to 18.

20. Capturing the information related to the user includes capturing first information regarding a first part of the user's body, and the method After capturing the first information related to the first part of the user's body, detecting that the computer system is placed on the user's body; After detecting that the computer system is placed on the user's body, further including starting a process of capturing second information related to a second part of the user's body that is different from the first part of the user's body, the method according to any one of claims 1 to 19.

21. Starting the process of capturing the second information related to the second part of the user's body includes displaying a visual indication indicating a location for the user to position the second part of the user's body via the one or more display generation components, the method according to claim 20.

22. Starting the process of capturing the second information related to the second part of the user's body includes providing a prompt instructing the user to adjust the orientation of the second part of the user's body, the method according to claim 20 or 21.

23. After capturing the second information related to the second part of the user's body, further including displaying the representation of the user within an extended reality environment via the one or more display generation components, the method according to any one of claims 20 to 22.

24. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system communicating with one or more display generation components, the one or more programs including instructions for executing the method according to any one of claims 1 to 23, the non-transitory computer-readable storage medium.

25. A computer system communicating with one or more display generation components, the computer system including one or more processors, and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for executing the method according to any one of claims 1 to 23, the computer system.

26. A computer system communicating with one or more display generation components, the computer system comprising A computer system comprising means for executing the method according to any one of claims 1 to 23. **Claim 27** A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system communicating with one or more display generation components, the one or more programs comprising While the computer system is disposed on a user's body, display, via the one or more display generation components, a prompt instructing to remove the computer system from the user's body and capture information related to the user using the computer system. After displaying the prompt instructing to remove the computer system from the user's body, detect that the computer system has been removed from the user's body. A non-transitory computer-readable storage medium comprising instructions for capturing information related to the user after detecting that the computer system has been removed from the user's body, the computer system being configured to use the information to generate a representation of the user. **Claim 28** A computer system communicating with one or more display generation components, the computer system comprising One or more processors; and A memory storing one or more programs configured to be executed by the one or more processors, the one or more programs comprising While the computer system is disposed on a user's body, display, via the one or more display generation components, a prompt instructing to remove the computer system from the user's body and capture information related to the user using the computer system. After displaying the prompt instructing to remove the computer system from the user's body, detect that the computer system has been removed from the user's body. The computer system is configured to generate a representation of the user using the information, and the computer system includes instructions to capture information related to the user after detecting that the computer system has been removed from the user's body. The computer system is configured to generate a representation of the user using the information. **Claim 29** A computer system in communication with one or more display generation components, the computer system means for displaying a prompt to remove the computer system from the user's body via the one or more display generation components while the computer system is disposed on the user's body, and to use the computer system to capture information related to the user; means for detecting that the computer system has been removed from the user's body after displaying the prompt to instruct removal of the computer system from the user's body; The computer system is configured to generate a representation of the user using the information, and the computer system includes means for capturing information related to the user after detecting that the computer system has been removed from the user's body. The computer system is configured to generate a representation of the user using the information. **Claim 30** A method comprising: in a computer system in communication with one or more display generation components, capturing information regarding one or more physical characteristics of a user of the computer system during a registration process for generating a representation of the user; generating a representation of the user based on the information regarding the one or more physical characteristics of the user, including selecting one or more physical characteristics of the representation based on the one or more captured physical characteristics of the user after capturing the information regarding the one or more physical characteristics of the user of the computer system. After generating the expression of the user, displaying at least a part of the expression of the user within an extended reality environment via the one or more display generation components. A method including this.

31. The method according to claim 30, wherein the extended reality environment includes an augmented reality environment.

32. The method according to claim 30, wherein the extended reality environment includes a virtual reality environment.

33. Capturing the information regarding one or more physical characteristics of the user of the computer system includes capturing the information regarding one or more physical characteristics of the user of the computer system while the computer system is removed from the user's body. Displaying at least the part of the expression of the user within the extended reality environment includes displaying at least the part of the expression of the user within the extended reality environment after detecting that the computer system is placed on the user's body. The method according to any one of claims 30 to 32.

34. Displaying at least the part of the expression of the user within the extended reality environment includes animating the expression based on the movement of the user with respect to at least the part of the computer system. The method according to any one of claims 30 to 33.

35. Animating the expression includes displaying the movement of the expression that is a mirror image of the movement of the user with respect to at least the part of the computer system. The method according to claim 34.

36. Displaying at least the part of the expression of the user within the extended reality environment includes displaying the expression using a first orientation that is a mirror image of a second orientation of the user within the physical environment where the user is located. The method according to any one of claims 30 to 35.

37. Displaying at least the portion of the user's representation within the extended reality environment includes displaying a frame around the representation within the extended reality environment, the frame indicating that the user's representation within the extended reality environment has an orientation that is a mirror image of the orientation of the user within the physical environment in which the user is located. The method according to any one of claims 30 to 36.

38. The method according to any one of claims 30 to 37, further comprising displaying, via the one or more display generation components, one or more selectable options for editing visual characteristics of the representation while at least a portion of the user's representation is being displayed within the extended reality environment.

39. The method according to claim 38, wherein the one or more selectable options include eyewear selectable options for editing the eyewear of the representation. 【Claim40】 The method according to claim 38 or 39, wherein the one or more selectable options include accessory selectable options for editing the accessories of the representation. 【Claim41】 The method according to any one of claims 38 to 40, wherein the one or more selectable options include one or more skin tone selectable options for editing the skin tone of the representation. 【Claim42】 The method according to claim 41, wherein the one or more skin tone selectable options include a first skin tone selectable option for editing the skin tone of the face of the representation and a second skin tone selectable option for editing the skin tone of the hands of the representation. 【Claim43】 The method according to any one of claims 38 to 42, wherein the one or more selectable options include a recapture selectable option that, when selected, initiates a process of recapturing information regarding the one or more physical characteristics of the user. 【Claim44】 The method according to any one of claims 38 to 43, wherein the one or more selectable options include a resume selectable option that, when selected, includes capturing second information regarding the one or more physical characteristics of the user of the computer system and starts the steps of the registration process. 【Claim45】 The one or more physical characteristics of the user include one or more first characteristics of the user's face and one or more second characteristics of the user's hand, and the method comprises capturing the one or more first characteristics of the user's face during the registration process for generating the representation of the user and while the computer system is removed from the user's body; detecting that the computer system is disposed on the user's body after capturing the one or more first characteristics of the user's face; capturing the one or more second characteristics of the user's hand after detecting that the computer system is disposed on the user's body, the method according to any one of claims 30 to 44.

46. The registration process is part of a setup process for the computer system, and the method comprises further capturing one or more biometric characteristics of the user during the setup process for the computer system, the method according to any one of claims 30 to 45.

47. The registration process is part of a setup process for the computer system, and the method comprises further performing an input calibration process that enables the computer system to calibrate the detection of one or more input technologies during the setup process for the computer system, the method according to any one of claims 30 to 46.

48. The registration process is part of a setup process for the computer system, and the method comprises further performing a spatial audio calibration process during the setup process for the computer system, the method according to any one of claims 30 to 47.

49. The registration process is part of a setup process for the computer system, and the method comprises further providing an indication of an instruction to use the representation during a real-time communication session during the setup process for the computer system, the method according to any one of claims 30 to 48.

50. The one or more physical characteristics of the user include the user's clothing, and the representation includes a clothing representation based on the user's clothing detected during the registration process for generating the user's representation, according to any one of claims 30 to 49.

51. After displaying at least a portion of the user's representation within the extended reality environment, further including displaying a menu user interface via the one or more display generation components, the menu user interface When selected, includes selectable options that cause the computer system to display at least a portion of the user's representation within the extended reality environment, according to any one of claims 30 to 50.

52. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system in communication with one or more display generation components, the one or more programs including instructions for performing the method according to any one of claims 30 to 51.

53. A computer system in communication with one or more display generation components, the computer system One or more processors; A memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method according to any one of claims 30 to 51.

54. A computer system in communication with one or more display generation components, the computer system Comprising means for performing the method according to any one of claims 30 to 51.

55. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system in communication with one or more display generation components, the one or more programs During a registration process for generating a user representation, capture information regarding one or more physical characteristics of the user of the computer system After capturing the information regarding the one or more physical characteristics of the user of the computer system, selecting one or more physical characteristics of the representation based on the one or more captured physical characteristics of the user, generating the representation of the user based on the information regarding the one or more physical characteristics of the user, After generating the representation of the user, including instructions to display at least a portion of the representation of the user within an extended reality environment via the one or more display generation components, a non-transitory computer-readable storage medium. **Claim 56** A computer system in communication with one or more display generation components, the computer system comprising: One or more processors; A memory storing one or more programs configured to be executed by the one or more processors, the one or more programs comprising: During a registration process for generating a representation of a user, capturing information regarding one or more physical characteristics of the user of the computer system After capturing the information regarding the one or more physical characteristics of the user of the computer system, selecting one or more physical characteristics of the representation based on the one or more captured physical characteristics of the user, generating the representation of the user based on the information regarding the one or more physical characteristics of the user, After generating the representation of the user, including instructions to display at least a portion of the representation of the user within an extended reality environment via the one or more display generation components, a computer system. **Claim 57** A computer system in communication with one or more display generation components, the computer system comprising: Means for capturing information regarding one or more physical characteristics of the user of the computer system during a registration process for generating a representation of the user; After capturing the information regarding the one or more physical characteristics of the user of the computer system, means for generating the representation of the user based on the information regarding the one or more physical characteristics of the user, including selecting one or more physical characteristics of the representation based on the one or more captured physical characteristics of the user, After generating the expression of the user, means for displaying at least a part of the expression of the user within an extended reality environment via the one or more display generation components. A computer system comprising: **Claim 58** A method comprising: In a first computer system communicating with one or more display generation components, While the first computer system is being used by a first user of the first computer system, via the one or more display generation components, a representation of a second user, wherein the representation of the second user is based on a detected movement of the second user detected by a second computer system during a live communication session with the first computer system. Displaying, with a first fidelity, the representation of the second user within an extended reality environment; While displaying the representation of the second user within the extended reality environment, the amount of direct information regarding the state of the body of the second user changes; In response to the amount of direct information regarding the state of the body of the second user changing, the first computer system starts displaying the representation of the second user with a different fidelity via the one or more display generation components. A method comprising: wherein the displaying In accordance with a determination that the direct information regarding the state of the body of the second user is not received for a first amount of time that is longer than a first time threshold and shorter than a second time threshold, via the one or more display generation components, Displaying the representation of the second user with a second fidelity lower than the first fidelity; In accordance with a determination that the direct information regarding the state of the body of the second user is not received for a second amount of time that is longer than the first time threshold and longer than the second time threshold, via the one or more display generation components, Displaying the representation of the second user with a third fidelity lower than the second fidelity. A method comprising: **Claim 59** The method according to claim 58, wherein displaying the representation of the second user within the extended reality environment includes displaying the representation of the second user during a real-time communication session with the first user. **Claim 60** The method according to claim 58 or 59, further comprising maintaining displaying the representation of the second user in the extended reality environment with the first fidelity in response to no change in the amount of the direct information regarding the state of the body of the second user.

61. Displaying the representation of the second user with the second fidelity includes displaying the representation of the second user having one or more anthropomorphic features, and displaying the representation of the second user with a third fidelity lower than the second fidelity includes, via the one or more display generation components, displaying the representation of the second user not having an individual anthropomorphic feature among the one or more anthropomorphic features. The method according to any one of claims 58 to 60.

62. Displaying the representation of the second user not having the individual anthropomorphic feature among the one or more anthropomorphic features includes displaying the representation of the second user in a first size smaller than a second size of the representation of the second user displayed when the representation of the second user is displayed with the one or more anthropomorphic features. The method according to claim 61.

63. Displaying the representation of the second user having the one or more anthropomorphic features includes displaying a first portion of the representation of the second user with a fourth visual fidelity, and displaying the representation of the second user not having the individual anthropomorphic feature among the one or more anthropomorphic features includes displaying the first portion of the representation of the second user with a fifth visual fidelity lower than the fourth fidelity. The method according to claim 61 or 62.

64. Displaying the representation of the second user with the first fidelity includes displaying the representation of the second user with a first accuracy via the display generation components. Displaying the representation of the second user with the second fidelity includes displaying the representation of the second user with a second accuracy lower than the first accuracy via the display generation components. The method according to any one of claims 58 to 63.

65. detecting an individual type of movement of the user; in response to detecting the individual type of movement of the user; In accordance with the determination that the representation of the second user is being displayed with the first fidelity, the movement of the representation of the second user is displayed based on the individual type of movement of the user via the one or more display generation components, In accordance with the determination that the representation of the second user is being displayed with the second fidelity, ceasing to display the movement of the representation of the second user based on the individual type of movement of the user, the method according to any one of claims 58 to 64, comprising: **Claim 66** Displaying the representation of the second user with the first fidelity includes displaying the representation of the second user with a plurality of particles having a first average particle size, Displaying the representation of the second user with the second fidelity includes displaying the representation of the second user with a plurality of particles having a second average particle size greater than the first average particle size, the method according to any one of claims 58 to 65. **Claim 67** The first fidelity includes a first amount of blur, The second fidelity includes a second amount of blur greater than the first amount of blur, the method according to any one of claims 58 to 66. **Claim 68** Displaying the representation of the second user with the second fidelity includes displaying the representation of the second user having a shape based on the shape of the second user, the method according to any one of claims 58 to 67. **Claim 69** While displaying the representation of the second user with the second fidelity, In accordance with the determination that the direct information regarding the state of the body of the second user is not received over the second amount of time, further comprising displaying the representation of the second user with a third fidelity lower than the second fidelity via the one or more display generation components, the method according to any one of claims 58 to 68. **Claim 70** The direct information regarding the state of the body of the second user includes direct information regarding the state of a first portion of the body of the second user, The direct information regarding the state of the body of the second user does not include direct information regarding the state of a second portion of the body of the second user, different from the first portion of the body of the second user, the method according to any one of claims 58 to 69. **Claim 71** A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system communicating with one or more display generation components, wherein the one or more programs include instructions for performing the method according to any one of claims 58 to 70.

72. A computer system communicating with one or more display generation components, the computer system comprising: one or more processors; a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method according to any one of claims 58 to 70.

73. A computer system communicating with one or more display generation components, the computer system comprising: means for performing the method according to any one of claims 58 to 70.

74. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a first computer system communicating with one or more display generation components, the one or more programs including: while the first computer system is being used by a first user of the first computer system, via the one or more display generation components, a representation of a second user, the representation of the second user moving based on the detected movement of the second user detected by a second computer system during a live communication session with the first computer system, displaying the representation of the second user in an extended reality environment with a first fidelity; while displaying the representation of the second user in the extended reality environment, the amount of direct information regarding the physical state of the second user changes; in response to the change in the amount of direct information regarding the physical state of the second user, the first computer system starts to display the representation of the second user with a different fidelity via the one or more display generation components, the displaying including: In accordance with the determination that the direct information regarding the state of the body of the second user is not received over a first amount of time that is longer than a first time threshold and shorter than a second time threshold, displaying, via the one or more display generation components, the representation of the second user with a second fidelity that is lower than the first fidelity; In accordance with the determination that the direct information regarding the state of the body of the second user is not received over a second amount of time that is longer than the first time threshold and longer than the second time threshold, displaying, via the one or more display generation components, the representation of the second user with a third fidelity that is lower than the second fidelity, a non-transitory computer-readable storage medium comprising.

75. A first computer system in communication with one or more display generation components, the computer system comprising: One or more processors; A memory storing one or more programs configured to be executed by the one or more processors, the one or more programs comprising: While the first computer system is being used by a first user of the first computer system, displaying, via the one or more display generation components, a representation of a second user, the representation of the second user being based on detected movement of the second user detected by a second computer system during a live communication session with the first computer system and moving in an extended reality environment with a first fidelity; While the representation of the second user is being displayed in the extended reality environment, the amount of direct information regarding the state of the body of the second user changes; In response to the amount of the direct information regarding the state of the body of the second user changing, the first computer system starting to display, via the one or more display generation components, the representation of the second user with a different fidelity, the first computer system comprising instructions, the displaying comprising: In accordance with a determination that the direct information regarding the state of the body of the second user is not received over a first amount of time that is longer than a first time threshold and shorter than a second time threshold, displaying, via the one or more display generation components, the representation of the second user with a second fidelity that is lower than the first fidelity; In accordance with a determination that the direct information regarding the state of the body of the second user is not received over a second amount of time that is longer than the first time threshold and longer than the second time threshold, displaying, via the one or more display generation components, the representation of the second user with a third fidelity that is lower than the second fidelity, a first computer system comprising the same. [

76. ] A first computer system in communication with one or more display generation components, the computer system comprising: Means for displaying, within an extended reality environment with a first fidelity, a representation of a second user, the representation of the second user moving based on detected movement of the second user detected by a second computer system during a live communication session with the first computer system, via the one or more display generation components, while the first computer system is being used by a first user of the first computer system; Means for changing an amount of direct information regarding a state of the body of the second user while the representation of the second user is being displayed within the extended reality environment; Means for causing the first computer system to begin displaying, via the one or more display generation components, the representation of the second user with a different fidelity in response to a change in the amount of the direct information regarding the state of the body of the second user, the displaying comprising: In accordance with a determination that the direct information regarding the state of the body of the second user is not received over a first amount of time that is longer than a first time threshold and shorter than a second time threshold, displaying, via the one or more display generation components, the representation of the second user with a second fidelity that is lower than the first fidelity; In accordance with a determination that direct information regarding the state of the body of the second user is not received over a second amount of time that is longer than the first time threshold and longer than the second time threshold, displaying, via the one or more display generation components, the representation of the second user with a third fidelity that is lower than the second fidelity. A first computer system including the above.

77. A method, comprising: In a first computer system communicating with one or more display generation components, While the first computer system is being used by a first user of the first computer system, via the one or more display generation components, within an extended reality environment, a representation of the second user, wherein the representation of the second user moves based on detected movement of the second user detected by a second computer system during a live communication session with the first computer system. Displaying the representation of the second user. Receiving information corresponding to speech of the second user while displaying the representation of the second user within the extended reality environment. Updating an appearance of the representation of the second user based on the information corresponding to the speech of the second user in response to receiving the information corresponding to the speech of the second user. The method comprising: In accordance with a determination that information regarding a detected physical state of the mouth of the second user does not meet a set of one or more criteria, via the one or more display generation components, a first mouth representation of the representation of the second user, wherein the first mouth representation is generated based on audio information corresponding to the speech of the second user. Displaying the first mouth representation. In accordance with the determination that the information regarding the detected physical state of the mouth of the second user satisfies the set of one or more criteria, via the one or more display generation components, a second mouth expression of the expression of the second user is displayed, where the second mouth expression is generated based on the information regarding the detected physical state of the mouth of the second user without using audio information corresponding to the utterance of the second user to generate the second mouth expression. The method includes this.

78. Displaying the expression of the second user within the extended reality environment includes displaying the expression of the second user during a real-time communication session with the first user. The method according to claim 77 includes this.

79. The first mouth expression includes a first portion generated based on the audio information corresponding to the utterance of the second user and a second portion generated based on the information regarding the detected physical state of the mouth of the second user. The first portion and the second portion are combined to form the first mouth expression. The method according to claim 77 or 78 includes this.

80. The second portion is static. The method according to claim 79 includes this.

81. The second portion moves based on the information regarding the detected physical state of the mouth of the second user. The method according to claim 79 includes this.

82. The first portion generated based on the audio information corresponding to the utterance of the second user includes a first visual emphasis level. The second portion generated based on the information regarding the detected physical state of the mouth of the second user includes a second visual emphasis level. The relative magnitudes of the first visual emphasis level and the second visual emphasis level are based on the information regarding the detected physical state of the mouth of the second user. The method according to any one of claims 79 to 81 includes this.

83. The relative magnitudes of the first visual emphasis level and the second visual emphasis level change based on the information regarding the detected physical state of the mouth of the second user. The method according to claim 82 includes this.

84. The method according to any one of claims 77 to 83, further comprising determining the accuracy of the information regarding the detected physical state of the mouth of the second user based on the audio information corresponding to the utterance of the second user.

85. While displaying the first oral expression of the expression of the second user, According to a determination that one or more second sets of criteria are met, via the one or more display generation components, a first portion of the expression of the mouth of the second user is displayed with a first transparency different from a second transparency of a second portion of the expression of the mouth different from the first portion of the expression of the mouth. The method according to any one of claims 77 to 84, further comprising.

86. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system in communication with one or more display generation components, the one or more programs comprising instructions for performing the method according to any one of claims 77 to 85. Non-transitory computer-readable storage medium.

87. A computer system in communication with one or more display generation components, the computer system comprising: One or more processors; A memory storing one or more programs configured to be executed by the one or more processors, the one or more programs comprising instructions for performing the method according to any one of claims 77 to 85. Computer system.

88. A computer system in communication with one or more display generation components, the computer system comprising: Means for performing the method according to any one of claims 77 to 85. Computer system.

89. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a first computer system in communication with one or more display generation components, the one or more programs comprising: While the first computer system is being used by a first user of the first computer system, via the one or more display generation components, within an extended reality environment, a representation of the second user, wherein the representation of the second user moves based on detected movement of the second user detected by a second computer system during a live communication session with the first computer system, is displayed, While displaying the representation of the second user within the extended reality environment, information corresponding to speech of the second user is received, In response to receiving the information corresponding to the speech of the second user, a non-transitory computer-readable storage medium including instructions to update an appearance of the representation of the second user based on the information corresponding to the speech of the second user, wherein the updating In accordance with a determination that information regarding a detected physical state of the mouth of the second user does not meet a set of one or more criteria, via the one or more display generation components, a first mouth representation of the representation of the second user, wherein the first mouth representation is generated based on audio information corresponding to the speech of the second user, is displayed, In accordance with a determination that the information regarding the detected physical state of the mouth of the second user meets the set of one or more criteria, via the one or more display generation components, a second mouth representation of the representation of the second user, wherein the second mouth representation is generated based on the information regarding the detected physical state of the mouth of the second user without using the audio information corresponding to the speech of the second user to generate the second mouth representation, is displayed, a non-transitory computer-readable storage medium.

90. A first computer system in communication with one or more display generation components, the computer system comprising one or more processors, a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs comprising While the first computer system is being used by a first user of the first computer system, via the one or more display generation components, within an extended reality environment, a representation of the second user, wherein the representation of the second user moves based on detected movement of the second user detected by a second computer system during a live communication session with the first computer system, is displayed, While displaying the representation of the second user within the extended reality environment, information corresponding to speech of the second user is received, In response to receiving the information corresponding to the speech of the second user, a first computer system including instructions to update an appearance of the representation of the second user based on the information corresponding to the speech of the second user, wherein updating includes Displaying, via the one or more display generation components, a first mouth representation of the representation of the second user, wherein the first mouth representation is generated based on audio information corresponding to the speech of the second user, according to a determination that information regarding a detected physical state of the mouth of the second user does not meet a set of one or more criteria, Displaying, via the one or more display generation components, a second mouth representation of the representation of the second user, wherein the second mouth representation is generated based on the information regarding the detected physical state of the mouth of the second user without using the audio information corresponding to the speech of the second user to generate the second mouth representation, according to a determination that the information regarding the detected physical state of the mouth of the second user meets the set of one or more criteria, a first computer system. Claim 91 A first computer system in communication with one or more display generation components, the computer system comprising While the first computer system is being used by a first user of the first computer system, via the one or more display generation components, within an extended reality environment, a representation of the second user, wherein the representation of the second user moves based on detected movement of the second user detected by a second computer system during a live communication session with the first computer system, means for displaying the representation of the second user; While displaying the representation of the second user within the extended reality environment, means for receiving information corresponding to speech of the second user; In response to receiving the information corresponding to the speech of the second user, means for updating an appearance of the representation of the second user based on the information corresponding to the speech of the second user, a first computer system, wherein the updating In accordance with a determination that information regarding a detected physical state of the mouth of the second user does not meet a set of one or more criteria, via the one or more display generation components, a first mouth representation of the representation of the second user, wherein the first mouth representation is generated based on audio information corresponding to the speech of the second user, displaying the first mouth representation; In accordance with a determination that the information regarding the detected physical state of the mouth of the second user meets the set of one or more criteria, via the one or more display generation components, a second mouth representation of the representation of the second user, wherein the second mouth representation is generated based on the information regarding the detected physical state of the mouth of the second user without using audio information corresponding to the speech of the second user for generating the second mouth representation, displaying the second mouth representation, a first computer system. Claim 92 A method, In a first computer system communicating with one or more display generation components While the first computer system is being used by a first user of the first computer system, via the one or more display generation components, within an extended reality environment, a representation of the second user, wherein the representation of the second user moves based on detected movement of the second user detected by a second computer system during a live communication session with the first computer system, the representation of the second user comprising a visual representation of the hair of the second user, wherein the visual representation of the hair of the second user a first portion of the representation of the hair positioned at a first distance from a portion of the representation of the second user corresponding to an individual body part of the second user, wherein the first portion of the representation of the hair comprises a first visual fidelity, the first portion of the representation of the hair and a second portion of the representation of the hair positioned at a second distance greater than the first distance from the portion of the representation of the second user corresponding to the individual body part of the second user, wherein the second portion of the representation of the hair comprises a second visual fidelity less than the first visual fidelity, the second portion of the representation of the hair, a method comprising. Claim 93 The method of claim 92, wherein displaying the representation of the second user within the extended reality environment comprises displaying the representation of the second user during a real-time communication session with the first user. Claim 94 The method of claim 92 or 93, wherein the visual representation of the hair of the second user is a visual representation of the hair on the face of the second user. Claim 95 The method according to any one of claims 92 to 94, wherein the visual representation of the hair of the second user is a visual representation of the moustache of the second user and not a visual representation of other hair of the second user. Claim 96 The method according to any one of claims 92 to 95, wherein the first visual fidelity comprises a first amount of blur and the second visual fidelity comprises a second amount of blur greater than the first amount of blur. Claim 97 The first visual fidelity includes displaying the representation of the hair using a plurality of particles having a first average particle size, and the second visual fidelity includes displaying the representation of the hair using a plurality of particles having a second average particle size greater than the first average particle size. The method according to any one of claims 92 to 96.

98. The first visual fidelity includes a first amount of opacity, and the second visual fidelity includes a second amount of opacity less than the first amount of opacity. The method according to any one of claims 92 to 97.

99. The visual representation of the hair of the second user is the visual representation of the facial hair of the second user. The visual representation of the facial hair of the second user is partially transparent. The method according to any one of claims 92 to 98.

100. The individual body part of the second user is the face of the second user. The first visual fidelity includes a first amount of transparency, and the second visual fidelity includes a second amount of transparency greater than the first amount of transparency. The method according to claim 99.

101. The individual body part of the second user is the neck of the second user. The first visual fidelity includes a first amount of transparency, and the second visual fidelity includes a second amount of transparency greater than the first amount of transparency. The method according to claim 99 or 100.

102. In accordance with the determination that the hair of the second user exceeds a predetermined length, the visual representation of the hair of the second user includes a three-dimensional representation of hair separate from the representation of the second user. In accordance with the determination that the hair of the second user does not exceed the predetermined length, the visual representation of the hair of the second user includes a texture representation of the hair applied on top of the representation of the face of the second user without accompanying a three-dimensional representation of the corresponding hair. The method according to any one of claims 92 to 101.

103. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system in communication with one or more display generation components, the one or more programs including instructions for performing the method according to any one of claims 92 to 102. A non-transitory computer-readable storage medium.

104. A computer system communicating with one or more display generation components, wherein the computer system comprises: One or more processors; A memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions to execute the method according to any one of claims 92 to 102. A computer system. **Claim 105** A computer system communicating with one or more display generation components, wherein the computer system comprises: Means for executing the method according to any one of claims 92 to 102. A computer system. **Claim 106** A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a first computer system communicating with one or more display generation components, the one or more programs comprising: While the first computer system is being used by a first user of the first computer system, via the one or more display generation components, within an extended reality environment, a representation of the second user, wherein the representation of the second user is based on the detected movement of the second user detected by a second computer system during a live communication session with the first computer system. A non-transitory computer-readable storage medium comprising instructions to display a representation of the second user that moves, Including a visual representation of the hair of the second user, the visual representation of the hair of the second user comprising: A first portion of the representation of the hair positioned at a first distance from a portion of the representation of the second user corresponding to an individual body part of the second user, the first portion of the representation of the hair including a first visual fidelity. A first portion of the representation of the hair and A second portion of the representation of the hair positioned at a second distance greater than the first distance from the portion of the representation of the second user corresponding to the individual body part of the second user, the second portion of the representation of the hair including a second visual fidelity less than the first visual fidelity. A non-transitory computer-readable storage medium comprising a second portion of the representation of the hair. **Claim 107** A first computer system communicating with one or more display generation components, the computer system comprising: one or more processors; a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs comprising: while the first computer system is being used by a first user of the first computer system, via the one or more display generation components, within an extended reality environment, a representation of the second user, the representation of the second user being based on detected movement of the second user detected by a second computer system during a live communication session with the first computer system, and the representation of the second user moving, instructions to display the representation of the second user, a first computer system, wherein the representation of the second user: includes a visual representation of the hair of the second user, the visual representation of the hair of the second user: a first portion of the representation of the hair positioned at a first distance from a portion of the representation of the second user corresponding to an individual body part of the second user, the first portion of the representation of the hair including a first visual fidelity, the first portion of the representation of the hair; and a second portion of the representation of the hair positioned at a second distance greater than the first distance from the portion of the representation of the second user corresponding to the individual body part of the second user, the second portion of the representation of the hair including a second visual fidelity less than the first visual fidelity, the second portion of the representation of the hair, a first computer system. Claim 108 A first computer system communicating with one or more display generation components, the computer system comprising: While the first computer system is being used by a first user of the first computer system, via the one or more display generation components, within an extended reality environment, a representation of the second user, wherein the representation of the second user moves based on detected movement of the second user detected by a second computer system during a live communication session with the first computer system, means for displaying the representation of the second user, a first computer system, wherein the representation of the second user is including a visual representation of the hair of the second user, wherein the visual representation of the hair of the second user is a first portion of the representation of the hair positioned at a first distance from a portion of the representation of the second user corresponding to an individual body part of the second user, wherein the first portion of the representation of the hair includes a first visual fidelity, the first portion of the representation of the hair and a second portion of the representation of the hair positioned at a second distance greater than the first distance from the portion of the representation of the second user corresponding to the individual body part of the second user, wherein the second portion of the representation of the hair includes a second visual fidelity less than the first visual fidelity, the second portion of the representation of the hair, a first computer system. Claim 109 A method comprising: In a first computer system communicating with one or more display generation components, while the first computer system is being used by a first user of the first computer system, via the one or more display generation components, within an extended reality environment, a representation of the second user, wherein the representation of the second user moves based on detected movement of the second user detected by a second computer system during a live communication session with the first computer system, displaying the representation of the second user, a method, wherein the representation of the second user is a first portion of the representation of the second user corresponding to a boundary between the representation of the second user and another portion of the extended reality environment, wherein the first portion of the representation of the second user is displayed using a first visual appearance, the first portion A second portion of the representation of the second user that does not correspond to the boundary between the representation of the second user and the other parts of the extended reality environment, wherein the second portion of the representation of the second user is displayed using a second visual appearance, and the first visual appearance is emphasized as compared to the second visual appearance; and a method comprising the second portion.

110. The method according to claim 109, wherein displaying the representation of the second user within the extended reality environment includes displaying the representation of the second user during a real-time communication session with the first user.

111. While displaying the representation of the second user in a first orientation within the extended reality environment, In accordance with a determination that the orientation of the representation of the second user has changed from the first orientation to a second orientation, via the display generation component, A third portion of the representation of the second user that corresponds to a second boundary between the representation of the second user and the other parts of the extended reality environment, wherein the third portion of the representation of the second user is displayed using the first visual appearance; and a third portion. A fourth portion of the representation of the second user that does not correspond to the second boundary between the representation of the second user and the other parts of the extended reality environment, wherein the fourth portion of the representation of the second user is displayed using the second visual appearance, and the first visual appearance is emphasized as compared to the second visual appearance; and displaying the fourth portion. In accordance with a determination that the orientation of the representation of the second user has not changed, maintaining the display of the representation of the second user in the first orientation within the extended reality environment; and the method according to claim 109 or 110, further comprising the method.

112. The method according to claim 111, wherein the orientation of the representation of the second user changes from the first orientation to the second orientation based on a change in the perspective of the first user.

113. The method according to claim 111, wherein the orientation of the representation of the second user changes from the first orientation to the second orientation based on the movement of the representation of the second user within the extended reality environment.

114. While displaying the representation of the second user at a first angle within the extended reality environment, displaying, via the one or more display generation components, the fifth portion of the representation of the second user to which an individual visual effect that reduces the visual emphasis of the fifth portion of the representation of the second user has been applied; In response to the representation of the second user being displayed at a second angle different from the first angle within the extended reality environment, displaying, via the one or more display generation components, a sixth portion of the representation of the second user different from the fifth portion of the representation of the second user, applying the individual visual effect that reduces the visual emphasis of the sixth portion of the representation of the second user; The method according to any one of claims 109 to 113, further comprising: **Claim 115** Displaying the sixth portion of the representation of the second user to which the individual visual effect that reduces the visual emphasis of the sixth portion of the representation of the second user has been applied includes: from the fifth portion of the representation of the second user to which the individual visual effect that reduces the visual emphasis of the fifth portion of the representation of the second user has been applied; The method according to claim 114, comprising displaying a gradual transition to the sixth portion of the representation of the second user to which the individual visual effect that reduces the visual emphasis of the sixth portion of the representation of the second user has been applied. **Claim 116** While displaying the representation of the second user in a forward orientation from the perspective of the first user within the extended reality environment, displaying the representation of the second user having one or more anthropomorphic features; In response to the representation of the second user being displayed in a rearward orientation from the perspective of the first user within the extended reality environment, displaying, via the one or more display generation components, the representation of the second user not having an individual anthropomorphic feature among the one or more anthropomorphic features; The method according to any one of claims 109 to 115, further comprising: **Claim 117** While displaying the representation of the second user in a rearward orientation from the perspective of the first user within the extended reality environment, via the one or more display generation components, display the representation of the second user that does not have an individual anthropomorphic feature among the one or more anthropomorphic features, in response to the representation of the second user being displayed in a forward orientation from the perspective of the first user within the extended reality environment, display the representation of the second user that has the individual anthropomorphic feature among the one or more anthropomorphic features, the method according to any one of claims 109 to 116, further comprising.

118. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system in communication with one or more display generation components, the one or more programs comprising instructions for performing the method according to any one of claims 109 to 117, non-transitory computer-readable storage medium.

119. A computer system in communication with one or more display generation components, the computer system one or more processors and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs comprising instructions for performing the method according to any one of claims 109 to 117, computer system.

120. A computer system in communication with one or more display generation components, the computer system comprising means for performing the method according to any one of claims 109 to 117, computer system.

121. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a first computer system in communication with one or more display generation components, the one or more programs While the first computer system is being used by a first user of the first computer system, via the one or more display generation components, within an extended reality environment, a representation of the second user, wherein the representation of the second user moves based on detected movement of the second user detected by a second computer system during a live communication session with the first computer system, the representation of the second user comprising instructions to display the representation of the second user, a non-transitory computer-readable storage medium, wherein the representation of the second user is a first portion of the representation of the second user corresponding to a boundary between the representation of the second user and other portions of the extended reality environment, wherein the first portion of the representation of the second user is displayed using a first visual appearance, the first portion and a second portion of the representation of the second user not corresponding to the boundary between the representation of the second user and other portions of the extended reality environment, wherein the second portion of the representation of the second user is displayed using a second visual appearance, the first visual appearance being emphasized as compared to the second visual appearance, the second portion, comprising a non-transitory computer-readable storage medium. Claim 122 A first computer system in communication with one or more display generation components, the computer system comprising one or more processors and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs comprising While the first computer system is being used by a first user of the first computer system, via the one or more display generation components, within an extended reality environment, a representation of the second user, wherein the representation of the second user moves based on detected movement of the second user detected by a second computer system during a live communication session with the first computer system, the representation of the second user comprising instructions to display the representation of the second user, a non-transitory computer-readable storage medium, wherein the representation of the second user is A first part of the representation of the second user corresponding to a boundary between the representation of the second user and other parts of the extended reality environment, wherein the first part of the representation of the second user is displayed using a first visual appearance, the first part and, A second part of the representation of the second user that does not correspond to the boundary between the representation of the second user and other parts of the extended reality environment, wherein the second part of the representation of the second user is displayed using a second visual appearance, and the first visual appearance is emphasized as compared to the second visual appearance, the second part and, comprising a first computer system. **Claim 123** A first computer system in communication with one or more display generation components, the computer system While the first computer system is being used by a first user of the first computer system, via the one or more display generation components, within an extended reality environment, a representation of the second user, wherein the representation of the second user moves based on the detected movement of the second user detected by a second computer system during a live communication session with the first computer system, a means for displaying the representation of the second user, a first computer system, wherein the representation of the second user is A first part of the representation of the second user corresponding to a boundary between the representation of the second user and other parts of the extended reality environment, wherein the first part of the representation of the second user is displayed using a first visual appearance, the first part and, A second part of the representation of the second user that does not correspond to the boundary between the representation of the second user and other parts of the extended reality environment, wherein the second part of the representation of the second user is displayed using a second visual appearance, and the first visual appearance is emphasized as compared to the second visual appearance, the second part and, comprising a first computer system.

Images