Device, method, and graphical user interface for generating and displaying user expressions

Abstract

In some examples, the computer system provides non-visual feedback based on a determination that information about the user has been captured. In some examples, the computer system displays different portions of a representation of the user as the user and / or the computer system move relative to each other. In some examples, the computer system displays different three-dimensional content associated with different steps of a registration process. In some examples, the computer system displays visual elements at different simulated depths that move with a simulated parallax to facilitate alignment of the user and the computer system. In some examples, the computer system prompts the user to make an expression and displays a progress bar indicating the amount of progress toward making the expression. In some examples, the computer system adjusts dynamic audio output to indicate the amount of progress toward completing steps of a registration process.

Description

Cross - reference to related applications

[0001] This application claims priority to U.S. Provisional Patent Application No. 63 / 345,356, entitled "DEVICES, METHODS, AND GRAPHICAL USER INTERFACES FOR GENERATING AND DISPLAYING A REPRESENTATION OF A USER", filed on May 24, 2022; U.S. Provisional Patent Application No. 63 / 409,649, entitled "DEVICES, METHODS, AND GRAPHICAL USER INTERFACES FOR GENERATING AND DISPLAYING A REPRESENTATION OF A USER", filed on September 23, 2022; and U.S. Patent Application No. 18 / 131,833, entitled "DEVICES, METHODS, AND GRAPHICAL USER INTERFACES FOR GENERATING AND DISPLAYING A REPRESENTATION OF A USER", filed on April 6, 2023. The entire content of each of these applications is hereby incorporated by reference into this specification.

Technical Field

[0002] The present disclosure generally relates to computer - generated experiences, including but not limited to, one or more display - generating components that provide virtual reality and augmented reality experiences via a display, and optionally, a computer system in communication with one or more audio output devices.

Background Art

[0003] The development of computer systems for augmented reality has advanced significantly in recent years. Exemplary augmented reality environments include at least some virtual elements that replace or enhance the physical world. Input devices such as cameras, controllers, joysticks, touch-sensitive surfaces, and touchscreen displays for computer systems and other electronic computing devices are used to interact with the virtual / augmented reality environment. Exemplary virtual elements include virtual objects such as digital images, videos, text, icons, and control elements such as buttons and other graphics.

SUMMARY OF THE INVENTION

[0004] Some methods and interfaces for generating and / or displaying a user's representation in an environment (e.g., an application, an augmented reality environment, a mixed reality environment, and a virtual reality environment) that includes at least some virtual elements are cumbersome, inefficient, and limited. For example, systems that provide insufficient feedback and / or guidance for performing actions associated with capturing information for generating a user's representation, and systems that do not provide the ability to preview and / or edit a user's representation, are complex, tedious, error-prone, impose a significant cognitive burden on the user, and detract from the experience in the virtual / augmented reality environment. In addition, those methods are time-consuming more than necessary, thereby wasting the energy of the computer system. This latter consideration is particularly important in battery-operated devices.

[0005] Accordingly, there is a need for a computer system having an improved method and interface for providing a computer-generated experience to a user that makes it more efficient and intuitive for the user to generate a user expression using a computer system. Such a method and interface optionally complements or replaces conventional methods for generating a user expression. Such a method and interface reduces the number, degree, and / or type of inputs from the user by assisting the user in understanding the connection between the provided input and the device response to that input, thereby generating a more efficient human-machine interface.

[0006] The above-mentioned deficiencies and other problems related to the user interface for a computer system are reduced or eliminated by the disclosed system. In some embodiments, the computer system is a desktop computer with an associated display. In some embodiments, the computer system is a portable device (e.g., a notebook computer, a tablet computer, or a handheld device). In some embodiments, the computer system is a personal electronic device (e.g., a wearable electronic device such as a wristwatch or a head-mounted device). In some embodiments, the computer system has a touchpad. In some embodiments, the computer system has one or more cameras. In some embodiments, the computer system has a touch-sensitive display (also known as a "touch screen" or "touch screen display"). In some embodiments, the computer system has one or more eye-tracking components. In some embodiments, the computer system has one or more hand-tracking components. In some embodiments, the computer system has one or more output devices in addition to a display generation component, and the output devices include one or more haptic output generators and / or one or more audio output devices. In some embodiments, the computer system has a graphical user interface (GUI), one or more processors, memory, and one or more modules, programs, or sets of instructions stored in the memory for performing multiple functions. In some embodiments, the user interacts with the GUI through a stylus and / or finger contact and gestures on a touch-sensitive surface, the movement of the user's eyes and hands in space relative to the GUI (and / or the computer system) when captured by a camera and other motion sensors, and / or audio input when captured by one or more audio input devices.In some embodiments, the functions executed through the interaction optionally include image editing, drawing, presenting, word processing, spreadsheet creation, game play, making a phone call, video conferencing, sending an email, instant messaging, training support, digital photography, digital video shooting, web browsing, playing digital music, taking notes, and / or playing digital video. The executable instructions for performing those functions are optionally included in a primary computer-readable storage medium and / or a non-transitory computer-readable storage medium, or other computer program products configured to be executed by one or more processors.

[0007] There is a need for an electronic device having an improved method and interface for generating and / or displaying a user representation. Such a method and interface can complement or replace conventional methods for generating and / or displaying a user representation. Such a method and interface reduce the number, degree, and / or type of inputs from the user and generate a more efficient human-machine interface. In the case of a battery-operated computing device, such a method and interface conserve power and lengthen the battery charging interval. Additionally, such a method and interface improve the ergonomics of the device, provide a more varied, detailed, and / or realistic user experience, enable the use of fewer and / or less accurate sensors, result in a more compact, lighter, and less expensive device, and / or reduce the energy usage.

[0008] A method according to some embodiments is described. The method is executed in a computer system that communicates with one or more display generation components. The method is an enrollment process for generating a user representation, the enrollment process including using a first sensor positioned on the same side of the computer system as a first display generation component of the one or more display generation components to capture information regarding one or more physical characteristics of a user of the computer system, during the enrollment process, prompting the user of the computer system to move the position of the user's head relative to the computer system, and after prompting the user of the computer system to move the position of the user's head relative to the orientation of the computer system, outputting a non-visual indication confirming that information regarding a threshold amount of a first physical characteristic of the one or more physical characteristics has been captured, according to a determination that information regarding the threshold amount of the first physical characteristic has been captured using the first sensor and based on the position of the user's head having moved relative to the orientation of the computer system.

[0009] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system in communication with one or more display generation components, and the one or more programs are a registration process for generating a user representation, the registration process including using a first sensor positioned on the same side of the computer system as a first display generation component of the one or more display generation components to capture information about one or more physical characteristics of a user of the computer system, during the registration process, prompting the user of the computer system to move the position of the user's head relative to the computer system, prompting the user of the computer system to move the position of the user's head relative to the orientation of the computer system, and after that, according to a determination that a threshold amount of information about a first physical characteristic among the one or more physical characteristics has been captured using the first sensor, and based on the fact that the position of the user's head has moved relative to the orientation of the computer system, outputting a non-visual indication confirming that the threshold amount of information about the first physical characteristic has been captured, including instructions.

[0010] According to some embodiments, a temporary computer-readable storage medium is described. The temporary computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system in communication with one or more display generation components, the one or more programs being a registration process for generating a user representation, the registration process using a first sensor positioned on the same side of the computer system as a first display generation component of the one or more display generation components to capture information regarding one or more physical characteristics of a user of the computer system, during the registration process, prompting the user of the computer system to move the position of the user's head with respect to the computer system, prompting the user of the computer system to move the position of the user's head with respect to the orientation of the computer system, and after that, according to a determination that a threshold amount of information regarding a first physical characteristic of the one or more physical characteristics has been captured using the first sensor, and based on the fact that the position of the user's head has moved with respect to the orientation of the computer system, outputting a non-visual indication confirming that the threshold amount of information regarding the first physical characteristic has been captured, including instructions.

[0011] According to some embodiments, a computer system is described. The computer system communicates with one or more display generation components. The computer system includes one or more processors and a memory storing one or more programs configured to be executed by the one or more processors. The one or more programs include a registration process for generating a user representation. The registration process uses a first sensor positioned on the same side of the computer system as a first display generation component among the one or more display generation components to capture information regarding one or more physical characteristics of a user of the computer system. During the registration process, the user of the computer system is prompted to move the position of the user's head relative to the computer system, and after the user of the computer system is prompted to move the position of the user's head relative to the orientation of the computer system, in accordance with a determination that a threshold amount of information regarding a first physical characteristic among the one or more physical characteristics has been captured using the first sensor, and based on the fact that the position of the user's head has moved relative to the orientation of the computer system, output a non-visual indication confirming that the threshold amount of information regarding the first physical characteristic has been captured.

[0012] According to some embodiments, a computer system is described. The computer system communicates with one or more display generation components. The computer system has an enrollment process for generating a user representation, the enrollment process including using a first sensor positioned on the same side of the computer system as a first display generation component of the one or more display generation components to capture information regarding one or more physical characteristics of a user of the computer system. During the enrollment process, means for prompting the user of the computer system to move the position of the user's head relative to the computer system, and after prompting the user of the computer system to move the position of the user's head relative to the orientation of the computer system, in accordance with a determination that a threshold amount of information regarding a first physical characteristic of the one or more physical characteristics has been captured using the first sensor, and based on the fact that the position of the user's head has moved relative to the orientation of the computer system, means for outputting a non-visual indication confirming that the threshold amount of information regarding the first physical characteristic has been captured.

[0013] According to some embodiments, a computer program product is described. The computer program product includes one or more programs configured to be executed by one or more processors of a computer system in communication with one or more display generation components. The one or more programs include a registration process for generating a user representation. The registration process includes using a first sensor positioned on the same side of the computer system as a first display generation component of the one or more display generation components to capture information regarding one or more physical characteristics of a user of the computer system. During the registration process, prompting the user of the computer system to move the position of the user's head relative to the computer system and prompting the user of the computer system to move the position of the user's head relative to the orientation of the computer system. After that, according to the determination that a threshold amount of information regarding a first physical characteristic among the one or more physical characteristics has been captured using the first sensor, and based on the fact that the position of the user's head has moved relative to the orientation of the computer system, outputting a non-visual indication to confirm that the threshold amount of information regarding the first physical characteristic has been captured.

[0014] A method according to some embodiments is described. The method is executed in a computer system communicating with one or more display generation components. The method includes capturing information regarding one or more physical characteristics of a user of the computer system, and after capturing the information regarding one or more physical characteristics of the user of the computer system, displaying a first portion of the user's representation, wherein one or more physical characteristics of the user's representation are based on the information about the one or more physical characteristics of the user, without displaying a second portion of the user's representation via a first display generation component of the one or more display generation components; detecting a change in the orientation of the computer system with respect to the user of the computer system while displaying the first portion of the user's representation without displaying the second portion of the user's representation via the first display generation component; and in response to detecting the change in the orientation of the computer system with respect to the user of the computer system, displaying a second portion of the user's representation that is different from the first portion of the user's representation via the first display generation component of the one or more display generation components.

[0015] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system in communication with one or more display generation components, the one or more programs capturing information regarding one or more physical characteristics of a user of the computer system and, after capturing the information regarding one or more physical characteristics of the user of the computer system, displaying a first portion of a user representation, via a first display generation component of the one or more display generation components, without displaying a second portion of the user representation, the one or more physical characteristics of the user representation being based on the information regarding the one or more physical characteristics of the user, and detecting a change in the orientation of the computer system with respect to the user of the computer system while displaying the first portion of the user representation without displaying the second portion of the user representation via the first display generation component, and in response to detecting the change in the orientation of the computer system with respect to the user of the computer system, displaying, via the first display generation component of the one or more display generation components, a second portion of the user representation that is different from the first portion of the user representation, including instructions.

[0016] According to some embodiments, a temporary computer-readable storage medium is described. The temporary computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system in communication with one or more display generation components. The one or more programs capture information regarding one or more physical characteristics of a user of the computer system and, after capturing the information regarding one or more physical characteristics of a user of the computer system, display a first portion of a user representation, wherein the one or more physical characteristics of the user representation are based on the information about the one or more physical characteristics of the user, without displaying a second portion of the user representation via a first display generation component among the one or more display generation components. While displaying the first portion of the user representation without displaying the second portion of the user representation via the first display generation component, detect a change in the orientation of the computer system with respect to the user of the computer system, and in response to detecting the change in the orientation of the computer system with respect to the user of the computer system, display a second portion of the user representation that is different from the first portion of the user representation via the first display generation component among the one or more display generation components.

[0017] According to some embodiments, a computer system is described. The computer system communicates with one or more display generation components. The computer system includes one or more processors and a memory that stores one or more programs configured to be executed by the one or more processors. The one or more programs capture information regarding one or more physical characteristics of a user of the computer system. After capturing information regarding one or more physical characteristics of a user of the computer system, without displaying a second portion of the user's representation via a first display generation component of the one or more display generation components, display a first portion of the user's representation, wherein one or more physical characteristics of the user's representation are based on the information about the one or more physical characteristics of the user. While displaying the first portion of the user's representation without displaying the second portion of the user's representation via the first display generation component, detect a change in the orientation of the computer system with respect to the user of the computer system. In response to detecting the change in the orientation of the computer system with respect to the user of the computer system, display a second portion of the user's representation that is different from the first portion of the user's representation via the first display generation component of the one or more display generation components.

[0018] According to some embodiments, a computer system is described. The computer system communicates with one or more display generation components. The computer system includes means for capturing information regarding one or more physical characteristics of a user of the computer system, and after capturing information regarding one or more physical characteristics of a user of the computer system, means for displaying a first portion of a user representation, without displaying a second portion of the user representation, via a first display generation component of the one or more display generation components, wherein one or more physical characteristics of the user representation are based on the information about the one or more physical characteristics of the user, means for detecting a change in the orientation of the computer system with respect to the user of the computer system while displaying the first portion of the user representation without displaying the second portion of the user representation via the first display generation component, and means for displaying a second portion of the user representation, different from the first portion of the user representation, via the first display generation component of the one or more display generation components in response to detecting the change in the orientation of the computer system with respect to the user of the computer system.

[0019] According to some embodiments, a computer program product is described. The computer program product includes one or more programs configured to be executed by one or more processors of a computer system in communication with one or more display generation components. The one or more programs capture information regarding one or more physical characteristics of a user of the computer system. After capturing information regarding one or more physical characteristics of a user of the computer system, without displaying a second portion of the user's representation via a first display generation component of the one or more display generation components, display a first portion of the user's representation, wherein one or more physical characteristics of the user's representation are based on the information about the one or more physical characteristics of the user. While displaying the first portion of the user's representation without displaying the second portion of the user's representation via the first display generation component, detect a change in the orientation of the computer system with respect to the user of the computer system. In response to detecting a change in the orientation of the computer system with respect to the user of the computer system, include instructions to display a second portion of the user's representation that is different from the first portion of the user's representation via the first display generation component of the one or more display generation components.

[0020] A method according to some embodiments is described. The method is executed in a computer system that communicates with one or more display generation components. The method is a registration process for generating a user representation, the registration process including capturing information regarding one or more physical characteristics of a user of the computer system. Prior to the registration process, the method includes outputting a plurality of indications for guiding a user of the computer system to capture information regarding one or more physical characteristics of the user of the computer system. Outputting the plurality of indications corresponds to a first indication for a first step of a process for capturing information regarding one or more physical characteristics of a user of the computer system, the first indication including displaying first three-dimensional content associated with the first step via a first display generation component of the one or more display generation components. Outputting the first indication includes outputting the first indication and, after outputting the first indication, outputting a second indication corresponding to a second step of the process for capturing information regarding one or more physical characteristics of a user of the computer system that is different from the first step, the second indication including displaying second three-dimensional content associated with the second step via the first display generation component of the one or more display generation components, the second step being performed after the first step in the registration process.

[0021] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system in communication with one or more display generation components, and the one or more programs include instructions for a registration process for generating a user representation, the registration process including capturing information regarding one or more physical characteristics of a user of the computer system, and prior to the registration process, outputting a plurality of indications for guiding the user of the computer system to capture information regarding one or more physical characteristics of the user of the computer system, outputting the plurality of indications corresponding to a first indication for a first step of a process including capturing information regarding one or more physical characteristics of the user of the computer system, the first indication including displaying first three-dimensional content associated with the first step via a first display generation component of the one or more display generation components, outputting the first indication, and after outputting the first indication, a second indication corresponding to a second step of the process for capturing information regarding one or more physical characteristics of the user of the computer system that is different from the first step, the second indication including displaying second three-dimensional content associated with the second step, where the second step is performed after the first step in the registration process, via the first display generation component of the one or more display generation components, outputting the second indication, and including.

[0022] According to some embodiments, a temporary computer-readable storage medium is described. The temporary computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system in communication with one or more display generation components, the one or more programs being a registration process for generating a user representation, the registration process including capturing information regarding one or more physical characteristics of a user of the computer system, and prior to the registration process, outputting a plurality of indications for guiding the user of the computer system to capture information regarding one or more physical characteristics of the user of the computer system, outputting the plurality of indications including a first indication corresponding to a first step of a process including capturing information regarding one or more physical characteristics of the user of the computer system, the first indication including displaying first three-dimensional content associated with the first step via a first display generation component of the one or more display generation components, outputting the first indication, and after outputting the first indication, a second indication corresponding to a second step of the process for capturing information regarding one or more physical characteristics of the user of the computer system, different from the first step, the second indication including displaying second three-dimensional content associated with the second step, the second step being performed after the first step in the registration process, via the first display generation component of the one or more display generation components, outputting the second indication, and including.

[0023] According to some embodiments, a computer system is described. The computer system communicates with one or more display generation components. The computer system includes one or more processors and a memory storing one or more programs configured to be executed by the one or more processors. The one or more programs include instructions for a registration process for generating a user representation, the registration process including capturing information regarding one or more physical characteristics of a user of the computer system. Before the registration process, the computer system outputs a plurality of indications for guiding the user of the computer system to capture information regarding one or more physical characteristics of the user of the computer system. Outputting the plurality of indications corresponds to a first indication for a first step of a process including capturing information regarding one or more physical characteristics of the user of the computer system. The first indication includes displaying first three-dimensional content associated with the first step via a first display generation component of the one or more display generation components. Outputting the first indication and, after outputting the first indication, outputting a second indication for a second step of the process for capturing information regarding one or more physical characteristics of the user of the computer system, the second step being different from the first step. The second indication includes displaying second three-dimensional content associated with the second step via the first display generation component of the one or more display generation components, the second step being performed after the first step in the registration process.

[0024] According to some embodiments, a computer system is described. The computer system communicates with one or more display generation components. The computer system has a registration process for generating a user representation, the registration process including capturing information regarding one or more physical characteristics of a user of the computer system. Before the registration process, the computer system has means for outputting a plurality of indications for guiding the user of the computer system to capture information regarding one or more physical characteristics of the user of the computer system. Outputting the plurality of indications corresponds to a first indication for a first step of a process that includes capturing information regarding one or more physical characteristics of the user of the computer system. The first indication includes displaying first three-dimensional content associated with the first step via a first display generation component of the one or more display generation components. After outputting the first indication, there is outputting a second indication that corresponds to a second step of the process for capturing information regarding one or more physical characteristics of the user of the computer system, the second step being different from the first step. The second indication includes displaying second three-dimensional content associated with the second step via the first display generation component of the one or more display generation components, the second step being performed after the first step in the registration process.

[0025] According to some embodiments, a computer program product is described. The computer program product includes one or more programs configured to be executed by one or more processors of a computer system in communication with one or more display generation components. The one or more programs include instructions for a registration process for generating a user representation. The registration process includes capturing information regarding one or more physical characteristics of a user of the computer system. Before the registration process, the instructions include outputting a plurality of indications for guiding the user of the computer system to capture information regarding one or more physical characteristics of the user of the computer system. Outputting the plurality of indications corresponds to a first indication for a first step of a process that includes capturing information regarding one or more physical characteristics of the user of the computer system. The first indication includes displaying first three-dimensional content associated with the first step via a first display generation component of the one or more display generation components. Outputting the first indication includes outputting the first indication and, after outputting the first indication, outputting a second indication for a second step of the process for capturing information regarding one or more physical characteristics of the user of the computer system, the second step being different from the first step. The second indication includes displaying second three-dimensional content associated with the second step via the first display generation component of the one or more display generation components, the second step being performed after the first step in the registration process.

[0026] A method according to some embodiments is described. The method is executed in a computer system communicating with one or more display generation components. The method is an enrollment process for generating a user representation, the enrollment process including capturing information regarding one or more physical characteristics of a user of the computer via one or more sensors. During the enrollment process, via a display generation component of the one or more display generation components, a first visual indication indicating a target orientation of a user's body part with respect to the computer system, the first visual indication having a first simulated depth, and a second visual indication indicating the orientation of the user's body part with respect to the computer system, the second visual indication having a second simulated depth different from the first simulated depth, are displayed. While the first visual indication and the second visual indication are being displayed, an indication of a change in the posture of the user's body part with respect to the one or more sensors is received. In response to receiving the indication of the change in the posture of the user's body part with respect to the one or more sensors, the relative position of the first visual indication and the second visual indication is shifted using a simulated parallax based on a change in the orientation of the user's body part with respect to the one or more sensors and a difference between the first simulated depth of the first visual indication and the second simulated depth of the second visual indication. Shifting includes shifting the relative position of the first visual indication and the second visual indication towards the individual spatial arrangements of the first visual indication and the second visual indication according to a determination that the user's body part has moved closer to a target range of postures with respect to the one or more sensors. According to a determination that the user's body part has moved further away from a target range of postures with respect to the one or more sensors,Shifting the relative position of the first visual indication and the second visual indication includes shifting the relative position of the first visual indication and the second visual indication away from the individual spatial arrangements of the first visual indication and the second visual indication.

[0027] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system in communication with one or more display generation components. The one or more programs include a registration process for generating a user representation. The registration process includes capturing information regarding one or more physical characteristics of a user of the computer via one or more sensors. During the registration process, via a display generation component of the one or more display generation components, a first visual indication indicating a target orientation of a user's body part with respect to the computer system is displayed. The first visual indication has a first simulated depth. A second visual indication indicating the orientation of the user's body part with respect to the computer system is also displayed. The second visual indication has a second simulated depth different from the first simulated depth. While the first visual indication and the second visual indication are being displayed, an indication of a change in the posture of the user's body part with respect to the one or more sensors is received. In response to receiving the indication of the change in the posture of the user's body part with respect to the one or more sensors, the relative position of the first visual indication and the second visual indication is shifted using a simulated parallax based on a change in the orientation of the user's body part with respect to the one or more sensors and a difference between the first simulated depth of the first visual indication and the second simulated depth of the second visual indication. Shifting includes shifting the relative position of the first visual indication and the second visual indication toward the individual spatial arrangements of the first visual indication and the second visual indication according to a determination that the user's body part has moved closer to a target range of postures with respect to the one or more sensors.Determining that a user's body part has moved further away from a target range posture relative to one or more sensors, and shifting the relative positions of the first visual indication and the second visual indication includes shifting the relative positions of the first visual indication and the second visual indication away from the individual spatial arrangements of the first visual indication and the second visual indication.

[0028] According to some embodiments, a temporary computer-readable storage medium is described. The temporary computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system in communication with one or more display generation components, the one or more programs being a registration process for generating a user representation, the registration process including capturing information regarding one or more physical characteristics of a user of the computer via one or more sensors, during the registration process, via a display generation component of the one or more display generation components, a first visual indication indicating a target orientation of a body part of the user with respect to the computer system, the first visual indication having a first simulated depth, a second visual indication indicating an orientation of a body part of the user with respect to the computer system, the second visual indication having a second simulated depth different from the first simulated depth, displaying the first visual indication and the second visual indication, receiving an indication of a change in the posture of a body part of the user with respect to the one or more sensors while displaying the first visual indication and the second visual indication, in response to receiving the indication of a change in the posture of a body part of the user with respect to the one or more sensors, using a simulated parallax based on a change in the orientation of a body part of the user with respect to the one or more sensors and a difference between the first simulated depth of the first visual indication and the second simulated depth of the second visual indication to shift the relative positions of the first visual indication and the second visual indication, the shifting including shifting the relative positions of the first visual indication and the second visual indication according to a determination that the body part of the user has moved closer to a target range of postures with respect to the one or more sensors, the shifting of the relative positions of the first visual indication and the second visual indication including shifting the relative positions of the first visual indication and the second visual indication toward the individual spatial arrangements of the first visual indication and the second visual indication,In accordance with a determination that a user's body part has moved further away from a target range posture relative to one or more sensors, shifting the relative position of a first visual indication and a second visual indication includes shifting the relative position of the first visual indication and the second visual indication away from the individual spatial arrangements of the first visual indication and the second visual indication.

[0029] According to some embodiments, a computer system is described. The computer system communicates with one or more display generation components. The computer system includes one or more processors and a memory storing one or more programs configured to be executed by the one or more processors. The one or more programs include a registration process for generating a user representation. The registration process includes capturing information regarding one or more physical characteristics of a user of the computer via one or more sensors. During the registration process, via a display generation component of the one or more display generation components, a first visual indication indicating a target orientation of a user's body part with respect to the computer system, the first visual indication having a first simulated depth, and a second visual indication indicating an orientation of the user's body part with respect to the computer system, the second visual indication having a second simulated depth different from the first simulated depth, are displayed. While the first visual indication and the second visual indication are being displayed, an indication of a change in the posture of the user's body part with respect to the one or more sensors is received. In response to receiving the indication of the change in the posture of the user's body part with respect to the one or more sensors, instructions are included to shift the relative positions of the first visual indication and the second visual indication using a simulated parallax based on a change in the orientation of the user's body part with respect to the one or more sensors and a difference between the first simulated depth of the first visual indication and the second simulated depth of the second visual indication. Shifting includes shifting the relative positions of the first visual indication and the second visual indication according to a determination that the user's body part has moved closer to a target range of postures with respect to the one or more sensors, and shifting the relative positions of the first visual indication and the second visual indication towards the individual spatial arrangements of the first visual indication and the second visual indication.Determining that a user's body part has moved further away from a target range posture relative to one or more sensors, and shifting the relative position of the first visual indication and the second visual indication includes shifting the relative position of the first visual indication and the second visual indication away from the individual spatial arrangements of the first visual indication and the second visual indication.

[0030] According to some embodiments, a computer system is described. The computer system communicates with one or more display generation components. The computer system includes a registration process for generating a user representation, the registration process including capturing information regarding one or more physical characteristics of a user of the computer via one or more sensors. During the registration process, via a display generation component of the one or more display generation components, a first visual indication indicating a target orientation of a user's body part with respect to the computer system, the first visual indication having a first simulated depth, and a second visual indication indicating an orientation of the user's body part with respect to the computer system, the second visual indication having a second simulated depth different from the first simulated depth, are displayed. Means for receiving an indication of a change in the posture of the user's body part with respect to the one or more sensors while the first visual indication and the second visual indication are being displayed, and in response to receiving the indication of the change in the posture of the user's body part with respect to the one or more sensors, using a simulated parallax based on a change in the orientation of the user's body part with respect to the one or more sensors and a difference between the first simulated depth of the first visual indication and the second simulated depth of the second visual indication to shift the relative positions of the first visual indication and the second visual indication. Shifting includes shifting the relative positions of the first visual indication and the second visual indication towards the individual spatial arrangements of the first visual indication and the second visual indication according to a determination that the user's body part has moved closer to a target range of postures with respect to the one or more sensors, and according to a determination that the user's body part has moved further away from a target range of postures with respect to the one or more sensors,Shifting the relative position of the first visual indication and the second visual indication includes shifting the relative position of the first visual indication and the second visual indication away from the respective spatial arrangements of the first visual indication and the second visual indication.

[0031] According to some embodiments, a computer program product is described. The computer program product includes one or more programs configured to be executed by one or more processors of a computer system in communication with one or more display generation components. The one or more programs include a registration process for generating a user representation, the registration process including capturing information regarding one or more physical characteristics of a user of the computer via one or more sensors. During the registration process, via a display generation component among the one or more display generation components, a first visual indication indicating a target orientation of a user's body part with respect to the computer system, the first visual indication having a first simulated depth, and a second visual indication indicating an orientation of the user's body part with respect to the computer system, the second visual indication having a second simulated depth different from the first simulated depth, are displayed. While the first visual indication and the second visual indication are being displayed, an indication of a change in the posture of the user's body part with respect to the one or more sensors is received. In response to receiving the indication of the change in the posture of the user's body part with respect to the one or more sensors, the relative positions of the first visual indication and the second visual indication are shifted using a simulated parallax based on a change in the orientation of the user's body part with respect to the one or more sensors and a difference between the first simulated depth of the first visual indication and the second simulated depth of the second visual indication. Shifting includes shifting the relative positions of the first visual indication and the second visual indication towards the individual spatial arrangements of the first visual indication and the second visual indication according to a determination that the user's body part has moved closer to a target range of postures with respect to the one or more sensors.In accordance with a determination that a user's body part has moved further away from a target range posture relative to one or more sensors, shifting the relative position of the first visual indication and the second visual indication includes shifting the relative position of the first visual indication and the second visual indication away from the individual spatial arrangements of the first visual indication and the second visual indication.

[0032] A method is described according to some embodiments. The method is executed in a computer system communicating with one or more display generation components. The method is a registration process for generating a representation of a user, the registration process including capturing information regarding one or more physical characteristics of the user of the computer system, during the registration process, prompting the user to make one or more facial expressions, after prompting the user to make one or more facial expressions, detecting information regarding the user's facial features via one or more sensors, and displaying a progress indication based on the information regarding the user's facial features via a display generation component of the one or more display generation components. Displaying the progress indicator includes displaying a progress indicator having a first appearance indicating a first degree of progress according to a determination that the information about the user's facial features indicates a first degree of progress towards making one or more facial expressions, and displaying a progress indicator having a second appearance different from the first appearance indicating a second degree of progress according to a determination that the information regarding the user's facial features indicates a second degree of progress towards making one or more facial expressions that is different from the first degree of progress.

[0033] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system in communication with one or more display generation components, and the one or more programs include a registration process for generating a user representation, the registration process including capturing information regarding one or more physical characteristics of a user of the computer system, during the registration process, prompting the user to make one or more facial expressions, after prompting the user to make one or more facial expressions, detecting information regarding the user's facial features via one or more sensors, and displaying a progress indication based on the information regarding the user's facial features via a display generation component of the one or more display generation components, displaying the progress indicator includes displaying a progress indicator having a first appearance indicating a first degree of progress according to a determination that the information about the user's facial features indicates a first degree of progress towards making one or more facial expressions, and displaying a progress indicator having a second appearance different from the first appearance indicating a second degree of progress according to a determination that the information about the user's facial features indicates a second degree of progress towards making one or more facial expressions that is different from the first degree of progress.

[0034] According to some embodiments, a temporary computer-readable storage medium is described. The temporary computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system communicating with one or more display generation components, the one or more programs including a registration process for generating a user representation, the registration process including capturing information regarding one or more physical characteristics of a user of the computer system, during the registration process, prompting the user to make one or more facial expressions, after prompting the user to make one or more facial expressions, detecting, via one or more sensors, information regarding the user's facial features, and displaying, via a display generation component of the one or more display generation components, a progress indication based on the information regarding the user's facial features, displaying the progress indicator including displaying a progress indicator having a first appearance indicative of a first degree of progress according to a determination that the information about the user's facial features indicates a first degree of progress towards making one or more facial expressions, and displaying a progress indicator having a second appearance different from the first appearance indicative of a second degree of progress according to a determination that the information about the user's facial features indicates a second degree of progress towards making one or more facial expressions that is different from the first degree of progress.

[0035] According to some embodiments, a computer system is described. The computer system communicates with one or more display generation components. The computer system includes one or more processors and a memory that stores one or more programs configured to be executed by the one or more processors. The one or more programs include instructions for a registration process for generating a user representation, the registration process including capturing information regarding one or more physical characteristics of a user of the computer system, during the registration process, prompting the user to make one or more facial expressions, after prompting the user to make one or more facial expressions, detecting information regarding the user's facial features via one or more sensors, and displaying a progress indication based on the information regarding the user's facial features via a display generation component of the one or more display generation components. Displaying the progress indicator includes displaying a progress indicator having a first appearance indicative of a first degree of progress according to a determination that the information about the user's facial features indicates a first degree of progress towards making one or more facial expressions, and displaying a progress indicator having a second appearance different from the first appearance indicative of a second degree of progress according to a determination that the information about the user's facial features indicates a second degree of progress towards making one or more facial expressions that is different from the first degree of progress.

[0036] According to some embodiments, a computer system is described. The computer system communicates with one or more display generation components. The computer system includes a registration process for generating a user representation, the registration process including capturing information regarding one or more physical characteristics of a user of the computer system, means for prompting the user to make one or more facial expressions during the registration process, means for detecting information regarding the user's facial features via one or more sensors after prompting the user to make one or more facial expressions, and means for displaying a progress indication based on the information regarding the user's facial features via a display generation component of the one or more display generation components, wherein displaying the progress indicator includes displaying a progress indicator having a first appearance indicative of a first degree of progress according to a determination that the information about the user's facial features indicates a first degree of progress towards making one or more facial expressions, and displaying a progress indicator having a second appearance different from the first appearance indicative of a second degree of progress according to a determination that the information about the user's facial features indicates a second degree of progress towards making one or more facial expressions different from the first degree of progress.

[0037] According to some embodiments, a computer program product is described. The computer program product includes one or more programs configured to be executed by one or more processors of a computer system in communication with one or more display generation components. The one or more programs include instructions for a registration process for generating a user representation. The registration process includes capturing information regarding one or more physical characteristics of a user of the computer system, prompting the user to make one or more facial expressions during the registration process, detecting information regarding the user's facial features via one or more sensors after prompting the user to make one or more facial expressions, and displaying a progress indication based on the information regarding the user's facial features via a display generation component of the one or more display generation components. Displaying the progress indicator includes displaying a progress indicator having a first appearance indicative of a first degree of progress according to a determination that the information about the user's facial features indicates a first degree of progress towards making one or more facial expressions, and displaying a progress indicator having a second appearance different from the first appearance indicative of a second degree of progress according to a determination that the information about the user's facial features indicates a second degree of progress towards making one or more facial expressions different from the first degree of progress.

[0038] A method according to some embodiments is described. The method is executed in a computer system communicating with one or more audio output devices. The method is an enrollment process for generating a user representation, the enrollment process including capturing information regarding one or more physical characteristics of a user of the computer system, during the enrollment process, outputting a first type of dynamic audio output via the one or more audio output devices, receiving an indication of a change in the posture of the user's biometric features with respect to one or more biometric sensors of the computer system while the first type of dynamic audio output is being output, and adjusting the first type of dynamic audio output based on the change in the posture of the user's biometric features of the computer system to indicate an amount of progress towards meeting one or more sets of criteria in response to receiving the indication of the change in the posture of the user's biometric features with respect to the one or more biometric sensors.

[0039] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system in communication with one or more audio output devices, the one or more programs being a registration process for generating a user representation, the registration process including capturing information regarding one or more physical characteristics of a user of the computer system, during the registration process, outputting a first type of dynamic audio output via the one or more audio output devices, while outputting the first type of dynamic audio output, receiving an indication of a change in the posture of a user's biological characteristics with respect to one or more biosensors of the computer system, and in response to receiving the indication of the change in the posture of a user's biological characteristics with respect to one or more biosensors, adjusting the first type of dynamic audio output based on the change in the posture of a user's biological characteristics of the computer system to indicate an amount of progress towards meeting one or more sets of criteria, including instructions.

[0040] According to some embodiments, a temporary computer-readable storage medium is described. The temporary computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system in communication with one or more audio output devices, the one or more programs being a registration process for generating a user representation, the registration process including capturing information regarding one or more physical characteristics of a user of the computer system, during the registration process, outputting a first type of dynamic audio output via the one or more audio output devices, while outputting the first type of dynamic audio output, receiving an indication of a change in the posture of the user's biological characteristics with respect to one or more biosensors of the computer system, and in response to receiving the indication of the change in the posture of the user's biological characteristics with respect to one or more biosensors, adjusting the first type of dynamic audio output based on the change in the posture of the user's biological characteristics of the computer system to indicate an amount of progress towards meeting one or more sets of criteria, including instructions.

[0041] According to some embodiments, a computer system is described. The computer system communicates with one or more audio output devices. The computer system includes one or more processors and a memory storing one or more programs configured to be executed by the one or more processors. The one or more programs include a registration process for generating a user representation. The registration process includes capturing information regarding one or more physical characteristics of a user of the computer system. During the registration process, a first type of dynamic audio output is output via the one or more audio output devices. While outputting the first type of dynamic audio output, an indication of a change in the posture of a user's biological characteristics with respect to one or more biosensors of the computer system is received. In response to receiving the indication of the change in the posture of the user's biological characteristics with respect to the one or more biosensors, the first type of dynamic audio output is adjusted based on the change in the posture of the user's biological characteristics of the computer system to indicate an amount of progress towards meeting one or more sets of criteria. The instructions are included.

[0042] According to some embodiments, a computer system is described. The computer system communicates with one or more audio output devices. The computer system includes a registration process for generating a user representation, the registration process including capturing information regarding one or more physical characteristics of a user of the computer system. During the registration process, means for outputting a first type of dynamic audio output via one or more audio output devices, means for receiving an indication of a change in the posture of a user's biological characteristics with respect to one or more biosensors of the computer system while the first type of dynamic audio output is being output, and means for adjusting the first type of dynamic audio output based on a change in the posture of the user's biological characteristics of the computer system in order to indicate an amount of progress towards meeting one or more sets of criteria, in response to receiving the indication of the change in the posture of the user's biological characteristics with respect to one or more biosensors.

[0043] According to some embodiments, a computer program product is described. The computer program product includes one or more programs configured to be executed by one or more processors of a computer system communicating with one or more audio output devices. The one or more programs include a registration process for generating a user representation, the registration process including capturing information regarding one or more physical characteristics of a user of the computer system. During the registration process, output a first type of dynamic audio output via one or more audio output devices, receive an indication of a change in the posture of a user's biological characteristics with respect to one or more biosensors of the computer system while the first type of dynamic audio output is being output, and in response to receiving the indication of the change in the posture of the user's biological characteristics with respect to one or more biosensors, instructions for adjusting the first type of dynamic audio output based on a change in the posture of the user's biological characteristics of the computer system in order to indicate an amount of progress towards meeting one or more sets of criteria.

[0044] A method is described according to some embodiments. The method is executed in a computer system that communicates with one or more display generation components. The method includes prompting a user of the computer system to move the position of the user's hand to a first pose while the representation of the user's hand is visible in an extended reality environment; detecting that the position of the user's hand is in the first pose after prompting the user of the computer system to move the position of the user's hand to the first pose; prompting the user of the computer system to move the position of the user's hand to a second pose after detecting that the position of the user's hand is in the first pose; detecting that the position of the user's hand is in the second pose after prompting the user of the computer system to move the position of the user's hand to the second pose; and outputting a confirmation that the position of the user's hand has been detected in the second pose in response to detecting that the position of the user's hand is in the second pose.

[0045] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system communicating with one or more display generation components, and the one or more programs cause the user of the computer system to move the position of the user's hand to a first posture while the representation of the user's hand is visible in an extended reality environment, after causing the user of the computer system to move the position of the user's hand to the first posture, detect that the position of the user's hand is in the first posture, after detecting that the position of the user's hand is in the first posture, cause the user of the computer system to move the position of the user's hand to a second posture, after causing the user of the computer system to move the position of the user's hand to the second posture, detect that the position of the user's hand is in the second posture, and in response to detecting that the position of the user's hand is in the second posture, output a confirmation that the position of the user's hand has been detected in the second posture, including instructions.

[0046] According to some embodiments, a temporary computer-readable storage medium is described. The temporary computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system communicating with one or more display generation components, the one or more programs causing, while a representation of a user's hand is visible in an extended reality environment, the user of the computer system to move the position of the user's hand to a first posture, after causing the user of the computer system to move the position of the user's hand to the first posture, detecting that the position of the user's hand is in the first posture, after detecting that the position of the user's hand is in the first posture, causing the user of the computer system to move the position of the user's hand to a second posture, after causing the user of the computer system to move the position of the user's hand to the second posture, detecting that the position of the user's hand is in the second posture, and in response to detecting that the position of the user's hand is in the second posture, outputting a confirmation that the position of the user's hand has been detected in the second posture, including instructions.

[0047] According to some embodiments, a computer system is described. The computer system communicates with one or more display generation components. The computer system includes one or more processors and a memory storing one or more programs configured to be executed by the one or more processors. The one or more programs cause the user of the computer system to move the position of the user's hand to a first posture while the representation of the user's hand is visible in an extended reality environment, detect that the position of the user's hand is in the first posture after prompting the user of the computer system to move the position of the user's hand to the first posture, cause the user of the computer system to move the position of the user's hand to a second posture after detecting that the position of the user's hand is in the first posture, detect that the position of the user's hand is in the second posture after prompting the user of the computer system to move the position of the user's hand to the second posture, and output a confirmation that the position of the user's hand has been detected in the second posture in response to detecting that the position of the user's hand is in the second posture.

[0048] According to some embodiments, a computer system is described. The computer system communicates with one or more display generation components. The computer system includes means for prompting a user of the computer system to move the position of the user's hand to a first posture while the representation of the user's hand is visible in an extended reality environment; means for detecting that the position of the user's hand is in the first posture after prompting the user of the computer system to move the position of the user's hand to the first posture; means for prompting the user of the computer system to move the position of the user's hand to a second posture after detecting that the position of the user's hand is in the first posture; means for detecting that the position of the user's hand is in the second posture after prompting the user of the computer system to move the position of the user's hand to the second posture; and means for outputting a confirmation that the position of the user's hand has been detected in the second posture in response to detecting that the position of the user's hand is in the second posture.

[0049] According to some embodiments, a computer program product is described. The computer program product includes one or more programs configured to be executed by one or more processors of a computer system in communication with one or more display generation components. The one or more programs prompt a user of the computer system to move the position of the user's hand to a first posture while the representation of the user's hand is visible in an extended reality environment, detect that the position of the user's hand is in the first posture after prompting the user of the computer system to move the position of the user's hand to the first posture, prompt the user of the computer system to move the position of the user's hand to a second posture after detecting that the position of the user's hand is in the first posture, detect that the position of the user's hand is in the second posture after prompting the user of the computer system to move the position of the user's hand to the second posture, and output a confirmation that the position of the user's hand has been detected in the second posture in response to detecting that the position of the user's hand is in the second posture, including instructions.

[0050] A method according to some embodiments is described. The method is executed in a computer system that communicates with one or more display generation components. The method captures information regarding one or more physical characteristics of a user of the computer system, and then, via a first display generation component of the one or more display generation components, simultaneously displays a representation of the user, wherein one or more visual characteristics of the representation of the user are based on the captured information regarding the one or more physical characteristics of the user, and a control user interface object for adjusting an appearance of the representation of the user based on illumination characteristics associated with the representation of the user; and while simultaneously displaying the representation of the user and the control user interface object, receives an input corresponding to the control user interface object, and in response to receiving the input corresponding to the control user interface object, adjusts the appearance of the representation of the user based on the illumination characteristics associated with the representation of the user.

[0051] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more display generation components, the one or more programs capturing information regarding one or more physical characteristics of a user of the computer system, and then, via a first display generation component of the one or more display generation components, simultaneously displaying a representation of the user, wherein one or more visual characteristics of the representation of the user are based on the captured information regarding the one or more physical characteristics of the user, and a control user interface object for adjusting an appearance of the representation of the user based on illumination characteristics associated with the representation of the user, receiving an input corresponding to the control user interface object while simultaneously displaying the representation of the user and the control user interface object, and in response to receiving the input corresponding to the control user interface object, adjusting the appearance of the representation of the user based on the illumination characteristics associated with the representation of the user.

[0052] According to some embodiments, a transient computer-readable storage medium is described. The transient computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system in communication with one or more display generation components, the one or more programs, after capturing information regarding one or more physical characteristics of a user of the computer system, simultaneously display, via a first display generation component of the one or more display generation components, a user representation, wherein one or more visual characteristics of the user representation are based on the captured information regarding the one or more physical characteristics of the user, and a control user interface object for adjusting an appearance of the user representation based on lighting characteristics associated with the user representation, and while simultaneously displaying the user representation and the control user interface object, receive an input corresponding to the control user interface object, and in response to receiving the input corresponding to the control user interface object, adjust the appearance of the user representation based on the lighting characteristics associated with the user representation, including instructions.

[0053] According to some embodiments, a computer system is described. The computer system communicates with one or more display generation components. The computer system includes one or more processors and a memory storing one or more programs configured to be executed by the one or more processors. The one or more programs, after capturing information regarding one or more physical characteristics of a user of the computer system, simultaneously display, via a first display generation component among the one or more display generation components, a user representation, wherein one or more visual characteristics of the user representation are based on the captured information regarding the one or more physical characteristics of the user, and a control user interface object for adjusting an appearance of the user representation based on illumination characteristics associated with the user representation. While simultaneously displaying the user representation and the control user interface object, receive an input corresponding to the control user interface object, and in response to receiving the input corresponding to the control user interface object, include instructions to adjust an appearance of the user representation based on the illumination characteristics associated with the user representation.

[0054] According to some embodiments, a computer system is described. The computer system communicates with one or more display generation components. After capturing information regarding one or more physical characteristics of a user of the computer system, the computer system simultaneously displays, via a first display generation component of the one or more display generation components, a representation of the user, wherein one or more visual characteristics of the representation of the user are based on the captured information regarding the one or more physical characteristics of the user, and a control user interface object for adjusting an appearance of the representation of the user based on lighting characteristics associated with the representation of the user; means for receiving an input corresponding to the control user interface object while the representation of the user and the control user interface object are simultaneously displayed; and means for adjusting the appearance of the representation of the user based on lighting characteristics associated with the representation of the user in response to receiving an input corresponding to the control user interface object.

[0055] According to some embodiments, a computer program product is described. The computer program product includes one or more programs configured to be executed by one or more processors of a computer system that communicates with one or more display generation components, the one or more programs including instructions to: simultaneously display, via a first display generation component of the one or more display generation components, a representation of the user, wherein one or more visual characteristics of the representation of the user are based on captured information regarding one or more physical characteristics of the user, and a control user interface object for adjusting an appearance of the representation of the user based on lighting characteristics associated with the representation of the user; receive an input corresponding to the control user interface object while the representation of the user and the control user interface object are simultaneously displayed; and adjust the appearance of the representation of the user based on lighting characteristics associated with the representation of the user in response to receiving an input corresponding to the control user interface object.

[0056] It should be noted that the various embodiments described above can be combined with any other embodiments described herein. The features and advantages described herein are not all-inclusive, and in particular, many additional features and advantages will be apparent to those skilled in the art upon consideration of the drawings, the specification, and the claims. Further, it should be noted that the language used herein has been selected primarily for readability and for the purpose of instruction, and may not have been selected to describe or limit the subject matter of the invention.

Brief Description of the Drawings

[0057] To better understand the various embodiments described, reference should be made to the following description of the embodiments in conjunction with the following drawings, in which like reference numerals refer to corresponding parts throughout.

[0058]

Figure 1

[0059]

Figure 2

[0060]

Figure 3

[0061]

Figure 4

[0062]

Figure 5

[0063]

Figure 6

[0064]

Figure 7A

Figure 7B

Figure 7C

Figure 7D

Figure 7E

Figure 7F

Figure 7G

Figure 7H

Figure 7I

Figure 7J

Figure 7K

Figure 7L

Figure 7M

Figure 7N

Figure 7O

Figure 7P

Figure 7Q

Figure 7R

Figure 7S

Figure 7T

[0065]

Figure 8

[0066]

Figure 9

[0067]

Figure 10

[0068]

Figure 11A

Figure 11B

[0069]

Figure 12

[0070]

Figure 13

[0071]

Figure 14A

Figure 14B

Figure 14C

Figure 14D

[0072]

Figure 15

[0073]

Figure 16A

Figure 16B

Figure 16C

Figure 16D

Figure 16E

Figure 16F

Figure 16G

[0074]

Figure 17

[0075] The present disclosure relates to a user interface for providing an extended reality (XR) experience to a user according to some embodiments.

[0076] The systems, methods, and GUIs described herein improve user interface interactions with virtual / augmented reality environments in multiple ways.

[0077] In some embodiments, during a registration process that includes capturing information regarding one or more physical characteristics of a user, the computer system provides non-visual feedback, such as audio feedback and / or haptic feedback, to the user. During the registration process, the computer system prompts the user to move the position of the user's head relative to the orientation of the computer system. The computer system includes a first display generation component of the computer system and a sensor positioned on the same side of the computer system, and the sensor is configured to capture information regarding one or more physical characteristics of the user. In some embodiments, the computer system generates a representation of the user based on the captured information regarding one or more physical characteristics of the user. After prompting the user to move the position of the user's head, the computer system determines whether a threshold amount of information regarding a first physical characteristic of the user has been captured. When the computer system determines that a threshold amount of information regarding a first physical characteristic of the user has been captured, the computer system outputs non-visual feedback to confirm that the threshold amount of information has been captured and signals the user to prepare for the next step of the registration process. If the computer system determines that a threshold amount of information regarding a first physical characteristic of the user has not been captured, the computer system does not output non-visual feedback. In some embodiments, the computer system provides audio and / or visual feedback indicating the amount of movement of the position of the user's head relative to the computer system, such that the user can determine whether to continue and / or stop moving the position of the user's head relative to the computer system.

[0078] In some embodiments, the computer system displays different portions of the user's representation based on the movement of the user and / or the computer system relative to each other. The computer system is configured to generate a representation of the user using captured information regarding one or more physical characteristics of the user. While displaying a first portion of the user's representation, the computer system is configured to detect the movement of the user and / or the computer system relative to each other, and in response to detecting the movement, the computer system displays a second portion of the user's representation that is different from the first portion. In some embodiments, the computer system displays movement of the user's representation that reflects the detected movement of the user and / or the computer system relative to each other. In some embodiments, the computer system is configured to detect movement of the user and / or the computer system relative to each other in a plurality of different directions along and / or along individual axes.

[0079] In some embodiments, the computer system displays three-dimensional content associated with different steps of a registration process that includes capturing one or more physical characteristics of the user. The computer system outputs first three-dimensional content associated with a first step of the registration process, and after outputting the first three-dimensional content, the computer system outputs second three-dimensional content associated with a second step of the registration process. The three-dimensional content is configured to provide the user with guidance regarding the various steps of the registration process to facilitate the user's ability to execute and / or complete the registration process. In some embodiments, the computer system outputs audio feedback along with the three-dimensional content, which provides the user with additional guidance.

[0080] In some embodiments, the computer system displays first and second visual elements that guide the user to align the position of the user's body with the computer system. The first and second visual elements are displayed at different simulated depths and are configured to move relative to each other with a simulated parallax based on the movement of the user's body relative to the computer system. The computer system shifts the displayed positions of the first and second visual elements based on the movement of the user's body relative to the computer system. The first visual element indicates the target orientation and / or alignment of the user's body and the computer system, and the second visual element indicates the detected orientation and / or alignment of the user's body and the computer system. When the first and second visual elements are positioned such that they at least partially overlap each other and / or otherwise have a target spatial arrangement, the user's body and the computer system are aligned with each other such that one or more sensors of the computer system can capture one or more body features of the user.

[0081] In some embodiments, the computer system displays a progress bar indicating the amount of progress towards creating one or more expressions for the user making the expressions. During a registration process that includes capturing information about one or more physical characteristics of the user, the computer system prompts the user to make one or more expressions. The computer system detects information about the characteristics of the user's face and determines, based on the information about the characteristics of the user's face, the amount of progress towards creating one or more expressions. The computer system then displays a progress bar having an individual appearance based on the amount of progress towards creating one or more expressions. For example, when the information about the characteristics of the user's face corresponds to a first expression of one or more expressions, the computer system displays a progress bar having a first fill amount. When the information about the characteristics of the user's face does not correspond to the first expression of one or more expressions, the computer system displays a progress bar having a second fill amount that is less than the first fill amount. In some embodiments, the progress bar is three-dimensional and extends in the z-direction relative to the user's viewpoint. In some embodiments, the rate at which the progress bar is filled decelerates in the portion of the progress bar that extends in the z-direction relative to the user's viewpoint.

[0082] In some embodiments, the computer system outputs dynamic audio during a registration process that includes capturing one or more physical characteristics of the user. The computer system adjusts the output of the dynamic audio based on changes in the user's posture relative to the computer system to provide an audible indication of the amount of progress towards completion of the steps of the registration process. In some embodiments, the computer system outputs and / or displays visual feedback in addition to the dynamic audio. In some embodiments, the dynamic audio includes different components and / or portions based on the physical location of the user and / or the physical location of the computer system.

[0083] In some embodiments, the computer system prompts the user to position the user's hand in a first posture. After the computer system detects that the position of the user's hand is in the first posture, the computer system prompts the user to position the user's hand in a second posture. In response to detecting that the position of the user's hand is in the second posture, the computer system outputs a confirmation so that the user understands that the position of the user's hand is in the second posture. In some embodiments, the computer system outputs a confirmation in response to detecting that the position of the user's hand is in the first posture. In some embodiments, the computer system captures information about the user's hand when the position of the user's hand is in the first posture and / or the second posture. In some embodiments, the computer system generates a representation of the user's hand based on the captured information about the user's hand. In some embodiments, the computer system provides feedback to guide the user to position the user's hand in the first posture and / or the second posture.

[0084] In some embodiments, the computer system simultaneously displays a user representation and a control user interface object, and when the control user interface object is selected, causes the computer system to adjust the appearance of the user representation based on lighting characteristics associated with the user representation. In response to detecting a user input corresponding to the control user interface object, the computer system adjusts the appearance of the user representation based on lighting characteristics associated with the user representation. In some embodiments, the computer system adjusts the skin tone of the user representation in response to detecting a user input corresponding to the control user interface object. In some embodiments, the lighting characteristics are based on the actual lighting conditions present in the physical environment in which the physical characteristics of the user of the computer system were captured. In some embodiments, the lighting characteristics are based on simulated lighting within an extended reality environment in which the user representation is displayed. In some embodiments, the lighting characteristics include the color temperature, exposure, and / or luminance of the appearance of the user representation. In some embodiments, the computer system adjusts the appearance of the user representation based on the size and / or direction associated with the user input corresponding to the control user interface object. In some embodiments, when selected, the computer system causes the computer system to adjust whether the user representation is wearing an accessory and / or to adjust the visual characteristics of the accessory, and displays an additional control user interface object.

[0085] Figures 1-6 provide an illustration of an exemplary computer system for providing XR experiences to a user. Figures 7A-7T show exemplary techniques for generating and / or displaying a user's representation according to some embodiments. Figure 8 is a flowchart of a method for providing guidance to a user during a process for generating a user's representation according to various embodiments. Figure 9 is a flowchart of a method for displaying a preview of a user's representation according to various embodiments. Figure 10 is a flowchart of a method for providing guidance to a user prior to a process for generating a user's representation according to various embodiments. Figures 11A and 11B are flowcharts of a method for providing guidance to a user for aligning a user's body part with a device according to various embodiments. Figure 12 is a flowchart of a method for providing guidance to a user for making an expression according to various embodiments. Figure 13 is a flowchart of a method for outputting audio guidance during a process for generating a user's representation according to various embodiments. The user interfaces of Figures 7A-7T are used to illustrate the processes of Figures 8-13. Figures 14A-14D show exemplary techniques for prompting a user to position a user's hand in multiple poses according to some embodiments. Figure 15 is a flowchart of a method for prompting a user to position a user's hand in multiple poses according to various embodiments. The user interfaces of Figures 14A-14D are used to illustrate the process of Figure 15. Figures 16A-16G show exemplary techniques for adjusting the appearance of a user's representation according to some embodiments. Figure 17 is a flowchart of a method for adjusting the appearance of a user's representation according to various embodiments. The user interfaces of Figures 16A-16G are used to illustrate the process of Figure 17.

[0086] The processes described below improve the user experience by various techniques including, but not limited to, providing improved visual feedback to the user, reducing the number of inputs required to perform an operation, providing additional control options without cluttering the user interface with additional displayed controls, performing an operation when a set of conditions is met without requiring further user input, improving privacy and / or security, providing a more varied, detailed, and / or realistic user experience while saving memory space, and / or improving the operability of a device, (e.g., assisting the user in providing appropriate input when operating / interacting with the device, reducing user errors), thereby making the user-device interface more efficient. These techniques also reduce power consumption and improve the battery life of the device by enabling the user to use the device more quickly and efficiently. By conserving battery power and thus weight, the ergonomics of the device are improved. These techniques also enable real-time communication, allow for the use of fewer and / or less accurate sensors, result in a more compact, lighter, and less expensive device, and enable the device to be used under various lighting conditions. These techniques reduce energy usage, thereby reducing the heat emitted by the device, which is particularly important for wearable devices where a device generating too much heat can become uncomfortable for the user to wear as the operating parameters for the device components are well within the range of normal operation.

[0087] In addition, in the methods described herein where one or more steps are conditional upon one or more conditions being met, it should be understood that the described methods may be repeated in multiple iterations such that all of the conditions conditional upon the steps in the method are met in different iterations of the method. For example, if a method requires performing a first step when a condition is met and a second step when the condition is not met, one of ordinary skill in the art will understand that the claimed steps will be repeated in no particular order until both the condition being met and not being met have occurred. Thus, a method described using one or more steps conditional upon one or more conditions being met may be rewritten as a method that is repeated until each of the conditions described in that method are met. However, this is not required for claims of a system or computer-readable medium that includes instructions for performing ancillary operations based on satisfaction of the corresponding one or more conditions, and thus it is possible to determine whether the ancillary matters are satisfied without explicitly repeating the steps of the method until all of the conditions conditional upon the steps in the method are met. One of ordinary skill in the art will also understand that, similar to methods with incidental steps, a system or computer-readable storage medium can repeat the steps of the method as many times as necessary to ensure that all of the incidental steps have occurred.

[0088] In some embodiments, as shown in FIG. 1, the XR experience is provided to a user via an operating environment 100 that includes a computer system 101. The computer system 101 includes a controller 110 (e.g., a processor of a portable electronic device or a remote server), a display generation component 120 (e.g., a head-mounted device (HMD), a display, a projector, and / or a touch screen), one or more input devices 125 (e.g., an eye tracking device 130, a hand tracking device 140, other input devices 150), one or more output devices 155 (e.g., speakers 160, a haptic output generator 170, and other output devices 180), one or more sensors 190 (e.g., an image sensor, a light sensor, a depth sensor, a tactile sensor, an orientation sensor, a proximity sensor, a temperature sensor, a location sensor, a movement sensor, and / or a speed sensor), and optionally one or more peripheral devices 195 (e.g., home appliances, and / or wearable devices). In some embodiments, one or more of the input devices 125, output devices 155, sensors 190, and peripheral devices 195 are integrated with the display generation component 120 (e.g., within a head-mounted device or a handheld device).

[0089] When describing the XR experience, various terms are used to distinguish between multiple related but distinct environments that a user can perceive and / or interact with (e.g., inputs that can be detected by the computer system 101 that generates the XR experience and that cause the computer system that generates the XR experience to generate audio, visual, and / or haptic feedback corresponding to the various inputs provided to the computer system 101). The following is a subset of these terms.

[0090] Physical Environment: The physical environment refers to the physical world in which people can perceive and / or interact without the aid of an electronic system. A physical environment such as a physical park includes physical items such as physical trees, physical buildings, and physical people. People can directly perceive and / or interact with the physical environment through senses such as vision, touch, hearing, taste, and smell.

[0091] Extended Reality: In contrast, an extended reality (XR) environment refers to an environment that is wholly or partially simulated in which people can perceive and / or interact through an electronic system. In XR, a subset of a person's physical movements, or representations thereof, are tracked, and in response, one or more characteristics of one or more virtual objects simulated within the XR environment are adjusted to conform to at least one physical law. For example, an XR system can detect the rotation of a person's head and, in response, adjust the graphical content and sound field presented to the person in a manner similar to how such views and sounds would change in a physical environment. In some situations (e.g., for accessibility reasons), the adjustment of the characteristics of the virtual object(s) within the XR environment can be made in response to a representation of a physical movement (e.g., a voice command). A person can perceive and / or interact with XR objects using any one of those senses including vision, sound, touch, taste, and smell. For example, a person can perceive and / or interact with an audio object that creates a 3D or spatial audio environment that gives the perception of a point audio source in 3D space. In another example, an audio object can enable audio transparency that selectively incorporates ambient sound from the physical environment, with or without computer-generated audio. In some XR environments, a person may perceive and / or interact with only audio objects.

[0092] Examples of XR include virtual reality and mixed reality.

[0093] Virtual Reality: A virtual reality (VR) environment refers to an imitation environment designed to be completely based on computer-generated sensory inputs for one or more senses. A VR environment includes multiple virtual objects that a person can perceive and / or interact with. For example, computer-generated images of trees, buildings, and avatars representing people are examples of virtual objects. A person can perceive and / or interact with virtual objects in a VR environment through a simulation of the presence of a person within the computer-generated environment and / or through a simulation of a subset of the physical movement of a person within the computer-generated environment.

[0094] Mixed Reality: In contrast to a VR environment designed to be completely based on computer-generated sensory inputs, a mixed reality (MR) environment refers to an imitation environment designed to incorporate sensory inputs or representations thereof from the physical environment in addition to including computer-generated sensory inputs (e.g., virtual objects). On the virtual continuum, an MR environment is somewhere between a completely physical environment at one end and a virtual reality environment at the other end, but does not include them. In some MR environments, the computer-generated sensory inputs can respond to changes in sensory inputs from the physical environment. Also, some electronic systems for presenting an MR environment can track the location and / or orientation relative to the physical environment to enable virtual objects to interact with real objects (i.e., physical articles from the physical environment or its representation). For example, the system can account for movement so that a virtual tree appears stationary relative to the physical ground.

[0095] Examples of mixed reality include augmented reality and augmented virtuality.

[0096] Augmented Reality: An augmented reality (AR) environment refers to an emulated environment in which one or more virtual objects are superimposed on a physical environment or a representation thereof. For example, an electronic system for presenting an AR environment may have a transparent or translucent display through which a person can directly view the physical environment. The system may be configured to present virtual objects on the transparent or translucent display, such that a person, using the system, perceives the virtual objects superimposed on the physical environment. Alternatively, the system may have an opaque display and one or more imaging sensors that capture an image or video of the physical environment, which is a representation of the physical environment. The system synthesizes the image or video with virtual objects and presents the composite on the opaque display. A person uses this system to indirectly view the physical environment via the image or video of the physical environment and perceives the virtual objects superimposed on the physical environment. As used herein, a video of the physical environment shown on an opaque display is referred to as a "pass-through video," meaning that the system uses one or more image sensors to capture an image of the physical environment and uses those images when presenting the AR environment on the opaque display. Further alternatively, the system may have a projection system that projects virtual objects into the physical environment or onto a physical surface, for example, as holograms, such that a person, using the system, perceives the virtual objects superimposed on the physical environment. An augmented reality environment also refers to an emulated environment in which a representation of the physical environment is transformed by computer-generated sensory information. For example, when providing a pass-through video, the system may transform one or more sensor images to map to a selected perspective (e.g., viewpoint) different from the perspective captured by the imaging sensor. As another example, a representation of the physical environment may be transformed by graphically modifying (e.g., magnifying) a portion thereof, thereby making the modified portion a modified version that represents the original captured image but is non-photorealistic. As a further example, a representation of the physical environment may be transformed by graphically removing or obscuring a portion thereof.

[0097] Augmented Virtuality: An augmented virtuality (AV) environment refers to an imitative environment in which a virtual environment or a computer-generated environment incorporates one or more sensory inputs from the physical environment. The sensory input can be a representation of one or more features of the physical environment. For example, an AV park may have virtual trees and virtual buildings, but people with faces are realistically reproduced from images of physical people. As another example, a virtual object may adopt the shape or color of a physical item imaged by one or more imaging sensors. As a further example, a virtual object can adopt a shadow that coincides with the position of the sun in the physical environment.

[0098] Viewpoint-locked virtual object: A virtual object is viewpoint-locked when a computer system displays the virtual object at the same location and / or position within the user's viewpoint even if the user's viewpoint shifts (e.g., changes). In an embodiment where the computer system is a head-mounted device, the user's viewpoint is locked in the forward direction of the user's head (e.g., the user's viewpoint is at least a portion of the user's field of view when the user is looking straight ahead). Thus, the user's viewpoint remains fixed even if the user's line of sight moves without the user moving their head. In an embodiment where the computer system has a display generation component (e.g., a display screen) that can be repositioned relative to the user's head, the user's viewpoint is the augmented reality view presented to the user on the computer system's display generation component. For example, a viewpoint-locked virtual object that is displayed in the upper left corner of the user's viewpoint when the user's viewpoint is in a first orientation (e.g., the user's head is facing north) continues to be displayed in the upper left corner of the user's viewpoint even if the user's viewpoint changes to a second orientation (e.g., the user's head is facing west). In other words, the location and / or position at which the viewpoint-locked virtual object is displayed within the user's viewpoint is independent of the user's position and / or orientation in the physical environment. In an embodiment where the computer system is a head-mounted device, the user's viewpoint is locked to the orientation of the user's head such that the virtual object is also referred to as a "head-locked virtual object".

[0099] Environment-Locked Virtual Object: A virtual object is environment-locked (or "world-locked") when a computer system displays the virtual object at a location and / or position within the user's view that is based on (e.g., selected with reference to and / or fixed to) a location and / or object within a three-dimensional environment (e.g., a physical environment or a virtual environment). When the user's view shifts, the location and / or object within the environment relative to the user's view changes, and as a result, the environment-locked virtual object is displayed at a different location and / or position within the user's view. For example, an environment-locked virtual object locked to a tree directly in front of the user is displayed at the center of the user's view. If the user's view is shifted to the right (e.g., the user's head is turned to the right) such that the tree becomes leftward in the user's view (e.g., the position of the tree in the user's view shifts), the environment-locked virtual object locked to the tree is displayed leftward in the user's view. In other words, the location and / or position at which the environment-locked virtual object is displayed in the user's view depends on the location and / or position and / or orientation of the location and / or object in the environment to which the virtual object is locked. In some embodiments, the computer system uses a stationary reference frame (e.g., a coordinate system fixed to a fixed location and / or object in the physical environment) to determine the position at which to display the environment-locked virtual object in the user's view. The environment-locked virtual object can be locked to a stationary part of the environment (e.g., the floor, a wall, a table, or other stationary object), or to a movable part of the environment (e.g., a vehicle, an animal, a person, or a representation of a part of the user's body such as the user's hand, wrist, arm, foot, etc. that moves independently of the user's view), such that the virtual object moves as the view or the part of the environment moves in order to maintain a fixed relationship between the virtual object and the part of the environment.

[0100] In some embodiments, an environment-locked or viewpoint-locked virtual object exhibits a delayed following behavior that reduces or delays the movement of the environment-locked or viewpoint-locked virtual object relative to the movement of a reference point that the virtual object is following. In some embodiments, when exhibiting the delayed following behavior, the computer system intentionally delays the movement of the virtual object when it detects movement of a reference point (e.g., a part of the environment, a viewpoint, or a point fixed relative to the viewpoint such as a point between 5 and 300 cm from the viewpoint) that the virtual object is following. For example, when the reference point (e.g., a part of the environment or a viewpoint) moves at a first speed, the virtual object is moved by the device so as to remain locked to the reference point, but moves at a second speed that is slower than the first speed (e.g., until the reference point stops or decelerates its movement, at which point the virtual object begins to catch up to the reference point). In some embodiments, when the virtual object exhibits the delayed following behavior, the device ignores small movements of the reference point (e.g., movements of the reference point that are less than a threshold movement amount such as a movement of 0 to 5 degrees or a movement of 0 to 50 cm). For example, when the reference point (e.g., the part of the environment or the viewpoint to which the virtual object is locked) moves by a first amount, the distance between the reference point and the virtual object increases (e.g., because the virtual object is displayed to maintain a position fixed or substantially fixed relative to a viewpoint or a part of the environment different from the reference point to which the virtual object is locked), and when the reference point (e.g., the part of the environment or the viewpoint to which the virtual object is locked) moves by a second amount that is greater than the first amount, the distance between the reference point and the virtual object first increases (e.g., because the virtual object is displayed to maintain a position fixed or substantially fixed relative to a viewpoint or a part of the environment different from the reference point to which the virtual object is locked), and then is moved by the computer system so as to maintain a position fixed or substantially fixed relative to the reference point, and thus decreases as the movement amount of the reference point increases beyond a threshold (e.g., a “delayed following” threshold).In some embodiments, a virtual object that maintains a position substantially fixed relative to a reference point includes the virtual object being displayed within a threshold distance (e.g., 1, 2, 3, 5, 15, 20, 50 cm) of the reference point in one or more dimensions (e.g., up / down, left / right, and / or forward / backward relative to the position of the reference point).

[0101] Hardware: There are many different types of electronic systems that enable a person to perceive and / or interact with various XR environments. Examples include head-mounted systems, projection-based systems, head-up displays (HUDs), vehicle windshields with integrated display capabilities, windows with integrated display capabilities, displays formed as lenses designed to be placed on top of a person's eyes (e.g., contact lenses), headphones / earphones, speaker arrays, input systems (e.g., wearable controllers or handheld controllers with or without tactile feedback), smartphones, tablets, and desktop / laptop computers. A head-mounted system may include speakers integrated into the head-mounted system and / or other audio output devices to provide audio output. A head-mounted system may have one or more speakers (singular or plural) and an integrated opaque display. Alternatively, a head-mounted system may be configured to accept an external opaque display (e.g., a smartphone). A head-mounted system may incorporate one or more imaging sensors for capturing images or videos of the physical environment and / or one or more microphones for capturing audio of the physical environment. A head-mounted system may have a transparent or translucent display instead of an opaque display. The transparent or translucent display may have a medium through which light representing an image is directed towards a person's eyes. The display can utilize digital light projection, OLED, LED, uLED, liquid crystal on silicon, laser scan light sources, or any combination of these technologies. The medium may be an optical waveguide, hologram medium, optical combiner, optical reflector, or any combination thereof. In one embodiment, the transparent or translucent display may be configured to selectively become opaque. A projection-based system can employ retinal projection technology to project a graphical image onto a person's retina.The projection system may also be configured to project virtual objects into the physical environment, for example, as holograms or onto a physical surface. In some embodiments, the controller 110 is configured to manage and adjust the XR experience for the user. In some embodiments, the controller 110 includes a suitable combination of software, firmware, and / or hardware. The controller 110 will be described in more detail below with reference to FIG. 2. In some embodiments, the controller 110 is a computing device that is local or remote to the scene 105 (e.g., the physical environment). For example, the controller 110 is a local server located within the scene 105. In another example, the controller 110 is a remote server (e.g., a cloud server and / or a central server) located outside the scene 105. In some embodiments, the controller 110 is communicatively coupled to the display generation component 120 (e.g., an HMD, a display, a projector, a touch screen, etc.) via one or more wired or wireless communication channels 144 (e.g., BLUETOOTH, IEEE802.11x, IEEE802.16x, and / or IEEE802.3x). In another example, the controller 110 is included within the housing (e.g., a physical housing) of one or more of the display generation component 120 (e.g., an HMD, or a portable electronic device including a display and one or more processors), one or more of the input devices 125, one or more of the output devices 155, one or more of the sensors 190, and / or one or more of the peripheral devices 195, or shares the same physical housing or support structure as one or more of the above.

[0102] In some embodiments, the display generation component 120 is configured to provide the user with an XR experience (e.g., at least the visual components of the XR experience). In some embodiments, the display generation component 120 includes a suitable combination of software, firmware, and / or hardware. The display generation component 120 will be described in more detail below with reference to FIG. 3. In some embodiments, the functionality of the controller 110 is provided by and / or combined with the display generation component 120.

[0103] According to some embodiments, the display generation component 120 provides the user with an XR experience while the user is virtually and / or physically present within the scene 105.

[0104] In some embodiments, the display generation component is worn on a part of the user's body (e.g., the user's own head and / or the user's own hand). Accordingly, the display generation component 120 includes one or more XR displays provided for displaying XR content. For example, in various embodiments, the display generation component 120 surrounds the user's field of view. In some embodiments, the display generation component 120 is a handheld device (such as a smartphone or a tablet) configured to present XR content, and the user holds a device having a display directed towards the user's field of view and a camera directed towards the scene 105. In some embodiments, the handheld device is optionally disposed within a housing worn on the user's head. In some embodiments, the handheld device is optionally disposed on a support (e.g., a tripod) in front of the user. In some embodiments, the display generation component 120 is an XR chamber, housing, or room configured to present XR content while the user is not wearing or holding the display generation component 120. Many of the user interfaces described with reference to one type of hardware for displaying XR content (e.g., a device on a handheld or tripod) can be implemented on another type of hardware for displaying XR content (e.g., a HMD or other wearable computing device). For example, a user interface that indicates an interaction with XR content triggered based on an interaction occurring within the space in front of a handheld or tripod-mounted device can be implemented in the same manner as a HMD where the interaction occurs within the space in front of the HMD and the response of the XR content is displayed via the HMD. Similarly, a user interface that indicates an interaction with XR content triggered based on the movement of a handheld or tripod-mounted device relative to the physical environment (e.g., scene 105 or a part of the user's body (e.g., the user's eye(s), head, or hand)) can be implemented in the same manner as a HMD where the movement is caused by the movement of the HMD relative to the physical environment (e.g., scene 105 or a part of the user's body (e.g., the user's eye(s), head, or hand)).

[0105] Although the relevant features of the operating environment 100 are shown in FIG. 1, those skilled in the art will understand from this disclosure that various other features are not shown for the sake of brevity so as not to obscure more appropriate aspects of the exemplary embodiments disclosed herein.

[0106] FIG. 2 is a block diagram of an example of the controller 110 according to some embodiments. Although certain features are shown, those skilled in the art will understand from this disclosure that various other features are not shown for the sake of brevity so as not to obscure more appropriate aspects of the embodiments disclosed herein. Thus, by way of non-limiting example, in some embodiments, the controller 110 includes one or more processing units 202 (e.g., microprocessors, application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), graphics processing units (GPUs), central processing units (CPUs), processing cores, etc.), one or more input / output (I / O) devices 206, one or more communication interfaces 208 (e.g., Universal Serial Bus (USB), FIREWIRE, THUNDERBOLT, IEEE 802.3x, IEEE 802.11x, IEEE 802.16x, Global System for Mobile Communications (GSM), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Global Positioning System (GPS), Infrared (IR), BLUETOOTH, ZIGBEE, or similar types of interfaces), one or more programming (e.g., I / O) interfaces 210, a memory 220, and one or more communication buses 204 for interconnecting these and various other components.

[0107] In some embodiments, one or more communication buses 204 include circuitry for interconnecting system components and controlling communication between system components. In some embodiments, one or more I / O devices 206 include at least one of a keyboard, a mouse, a touchpad, a joystick, one or more microphones, one or more speakers, one or more image sensors, one or more displays, etc.

[0108] Memory 220 includes high-speed random access memory such as dynamic random-access memory (DRAM), static random-access memory (SRAM), double-data-rate random-access memory (DDRRAM), or other random access solid-state memory devices. In some embodiments, memory 220 includes non-volatile memory such as one or more magnetic storage devices, optical storage devices, flash memory devices, or other non-volatile solid-state storage devices. Memory 220 optionally includes one or more storage devices located remotely from one or more processing units 202. Memory 220 includes a non-transitory computer-readable storage medium. In some embodiments, memory 220, or the non-transitory computer-readable storage medium of memory 220, stores the following programs, modules, and data structures, or subsets thereof, including an optional operating system 230 and XR experience module 240.

[0109] Operating system 230 includes instructions for processing various basic system services and performing hardware-dependent tasks. In some embodiments, XR experience module 240 is configured to manage and coordinate one or more XR experiences for one or more users (e.g., a single XR experience for one or more users, or multiple XR experiences for each group of one or more users). To that end, in various embodiments, XR experience module 240 includes a data acquisition unit 241, a tracking unit 242, an adjustment unit 246, and a data transmission unit 248.

[0110] In some embodiments, the data acquisition unit 241 is configured to acquire data (e.g., presentation data, interaction data, sensor data, and / or location data) from at least the display generation component 120 of FIG. 1, and optionally from one or more of the input device 125, output device 155, sensor 190, and / or peripheral device 195. For that purpose, in various embodiments, the data acquisition unit 241 includes instructions and / or logic therefor, and heuristics and metadata therefor.

[0111] In some embodiments, the tracking unit 242 is configured to map the scene 105 and track at least the position / location of the display generation component 120 with respect to the scene 105 of FIG. 1, and optionally with respect to one or more of the input device 125, output device 155, sensor 190, and / or peripheral device 195. For that purpose, in various embodiments, the tracking unit 242 includes instructions and / or logic therefor, and heuristics and metadata therefor. In some embodiments, the tracking unit 242 includes a hand tracking unit 244 and / or an eye tracking unit 243. In some embodiments, the hand tracking unit 244 is configured to track the position / location of one or more parts of the user's hand, and / or the movement of one or more parts of the user's hand, with respect to the scene 105 of FIG. 1, with respect to the display generation component 120, and / or with respect to a coordinate system defined for the user's hand. The hand tracking unit 244 will be described in more detail below with respect to FIG. 4. In some embodiments, the eye tracking unit 243 is configured to track the position and movement of the user's line of sight (or, more generally, the user's eyes, face, or head) with respect to the scene 105 (e.g., the physical environment and / or the user (e.g., the user's hand)), or with respect to XR content displayed via the display generation component 120. The eye tracking unit 243 will be described in more detail below with respect to FIG. 5.

[0112] In some embodiments, the adjustment unit 246 is configured to manage and adjust the XR experience presented to the user by the display generation component 120 and, optionally, by one or more of the output device 155 and / or the peripheral device 195. For that purpose, in various embodiments, the adjustment unit 246 includes instructions and / or logic therefor, as well as heuristics and metadata therefor.

[0113] In some embodiments, the data transmission unit 248 is configured to transmit data (e.g., presentation data and / or location data) to at least the display generation component 120 and, optionally, to one or more of the input device 125, the output device 155, the sensor 190, and / or the peripheral device 195. For that purpose, in various embodiments, the data transmission unit 248 includes instructions and / or logic therefor, as well as heuristics and metadata therefor.

[0114] The data acquisition unit 241, the tracking unit 242 (including, e.g., the eye tracking unit 243 and the hand tracking unit 244), the adjustment unit 246, and the data transmission unit 248 are shown as being present on a single device (e.g., the controller 110), but it should be understood that in other embodiments, any combination of the data acquisition unit 241, the tracking unit 242 (including, e.g., the eye tracking unit 243 and the hand tracking unit 244), the adjustment unit 246, and the data transmission unit 248 can be located in separate computing devices.

[0115] Furthermore, FIG. 2 is more intended to illustrate the functions of various features that may exist in a particular embodiment, as contrasted with the structural overview of the embodiments described herein. As will be recognized by those skilled in the art, the separately shown items can be combined, and some items can be separated. For example, several functional modules separately shown in FIG. 2 can be implemented in a single module, and the various functions of a single functional block can be implemented by one or more functional blocks in various embodiments. The actual number of modules, as well as the specific division of functions and how features are allocated among them, vary depending on the implementation form, and in some embodiments, they depend in part on a specific combination of hardware, software, and / or firmware selected for a particular implementation form.

[0116] FIG. 3 is a block diagram of an example of a display generation component 120 according to some embodiments. Although specific features are shown, those skilled in the art will understand from this disclosure that various other features are not shown for the sake of brevity so as not to obscure more suitable aspects of the embodiments disclosed herein. For that purpose, by way of non-limiting example, in some embodiments, the display generation component 120 (e.g., an HMD) includes one or more processing units 302 (e.g., a microprocessor, ASIC, FPGA, GPU, CPU, processing core, etc.), one or more input / output (I / O) devices and sensors 306, one or more communication interfaces 308 (e.g., USB, FIREWIRE, THUNDERBOLT, IEEE 802.3x, IEEE 802.11x, IEEE 802.16x, GSM, CDMA, TDMA, GPS, infrared, BLUETOOTH, ZIGBEE, and / or similar types of interfaces), one or more programming (e.g., I / O) interfaces 310, one or more XR displays 312, one or more optional inward and / or outward image sensors 314, a memory 320, and one or more communication buses 304 for interconnecting these and various other components.

[0117] In some embodiments, one or more communication buses 304 include circuitry that interconnects and controls communication between system components. In some embodiments, one or more I / O devices and sensors 306 include at least one of an inertial measurement unit (IMU), an accelerometer, a gyroscope, a thermometer, one or more physiological sensors (e.g., a blood pressure monitor, a heart rate monitor, a blood oxygen sensor, and / or a blood glucose sensor), one or more microphones, one or more speakers, a tactile engine, one or more depth sensors (e.g., structured light, time of flight, etc.).

[0118] In some embodiments, one or more XR displays 312 are configured to provide a user with an XR experience. In some embodiments, one or more XR displays 312 correspond to holographic, digital light processing (DLP), liquid crystal display (LCD), liquid crystal on silicon (LCoS), organic light emitting field effect transistor (OLET), organic light emitting diode (OLED), surface conduction electron emission device display (SED), field emission display (FED), quantum dot light emitting diode (QD-LED), MEMS, and / or similar display types. In some embodiments, one or more XR displays 312 correspond to waveguide displays, such as diffractive, reflective, polarizing, holographic, etc. For example, a display generation component 120 (e.g., an HMD) includes a single XR display. In another example, the display generation component 120 includes an XR display for each eye of the user. In some embodiments, one or more XR displays 312 can present MR or VR content. In some embodiments, one or more XR displays 312 can present MR or VR content.

[0119] In some embodiments, one or more image sensors 314 are configured to acquire image data corresponding to at least a portion of a user's face, including the user's eyes (and may be referred to as an eye-tracking camera). In some embodiments, one or more image sensors 314 are configured to acquire image data corresponding to at least a portion of the user's hand(s) and optionally the user's arm(s) (and may be referred to as a hand-tracking camera). In some embodiments, one or more image sensors 314 are configured to face forward to acquire image data corresponding to a scene that the user views when the display generation component 120 (e.g., an HMD) is not present (and may be referred to as a scene camera). The one or more optional image sensors 314 can include one or more RGB cameras, one or more infrared (IR) cameras, one or more event-based cameras, and / or the like (e.g., including a complementary metal-oxide semiconductor (CMOS) image sensor or a charge-coupled device (CCD) image sensor).

[0120] Memory 320 includes high-speed random access memory, such as DRAM, SRAM, DDR RAM, or other random access solid-state memory devices. In some embodiments, memory 320 includes non-volatile memory, such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. Memory 320 optionally includes one or more storage devices located remotely from the one or more processing units 302. Memory 320 includes a non-transitory computer-readable storage medium. In some embodiments, memory 320, or the non-transitory computer-readable storage medium of memory 320, stores the following programs, modules, and data structures, or subsets thereof, including an optional operating system 330 and an XR presentation module 340.

[0121] The operating system 330 includes instructions for processing various basic system services and instructions for executing hardware-dependent tasks. In some embodiments, the XR presentation module 340 is configured to present XR content to a user via one or more XR displays 312. For that purpose, in various embodiments, the XR presentation module 340 includes a data acquisition unit 342, an XR presentation unit 344, an XR map generation unit 346, and a data transmission unit 348.

[0122] In some embodiments, the data acquisition unit 342 is configured to acquire data (e.g., presentation data, interaction data, sensor data, and / or location data) from at least the controller 110 of FIG. 1. For that purpose, in various embodiments, the data acquisition unit 342 includes instructions and / or logic therefor, as well as heuristics and metadata therefor.

[0123] In some embodiments, the XR presentation unit 344 is configured to present XR content via one or more XR displays 312. For that purpose, in various embodiments, the XR presentation unit 344 includes instructions and / or logic therefor, as well as heuristics and metadata therefor.

[0124] In some embodiments, the XR map generation unit 346 is configured to generate an XR map (e.g., a 3D map of a composite reality scene or a map of a physical environment in which computer-generated objects can be placed to generate extended reality) based on media content data. For that purpose, in various embodiments, the XR map generation unit 346 includes instructions and / or logic therefor, as well as heuristics and metadata therefor.

[0125] In some embodiments, data transmission unit 348 is configured to transmit data (e.g., presentation data, and / or location data) to at least controller 110 and optionally to one or more of input device 125, output device 155, sensor 190, and / or peripheral device 195. For that purpose, in various embodiments, data transmission unit 348 includes instructions and / or logic therefor, as well as heuristics and metadata therefor.

[0126] Although data acquisition unit 342, XR presentation unit 344, XR map generation unit 346, and data transmission unit 348 are shown as being present on a single device (e.g., display generation component 120 of FIG. 1), it should be understood that in other embodiments, any combination of data acquisition unit 342, XR presentation unit 344, XR map generation unit 346, and data transmission unit 348 may be arranged within separate computing devices.

[0127] Furthermore, FIG. 3 is more intended to illustrate the functions of various features that may exist in a particular implementation, as opposed to the structural overview of the embodiments described herein. As will be recognized by those skilled in the art, the separately shown matters can be combined, and some matters can be separated. For example, several functional modules separately shown in FIG. 3 can be implemented within a single module, and the various functions of a single functional block can be implemented by one or more functional blocks in various embodiments. The actual number of modules, as well as the particular division of specific functions and how features are allocated among them, vary depending on the implementation and, in some embodiments, depend in part on a particular combination of hardware, software, and / or firmware selected for a particular implementation.

[0128] FIG. 4 is a schematic diagram of an exemplary embodiment of the hand tracking device 140. In some embodiments, the hand tracking device 140 (FIG. 1) is for the scene 105 of FIG. 1 (e.g., for a part of the physical environment surrounding the user, for the display generation component 120, or for a part of the user (e.g., the user's face, eyes, or head), and / or for a coordinate system defined with respect to the user's hand) to track the location / position of one or more parts of the user's hand and / or the movement of one or more parts of the user's hand, and is controlled by the hand tracking unit 244 (FIG. 2). In some embodiments, the hand tracking device 140 is part of the display generation component 120 (e.g., embedded in or attached to a head-mounted device). In some embodiments, the hand tracking device 140 is separate from the display generation component 120 (e.g., located in a separate housing or attached to a separate physical support structure).

[0129] In some embodiments, the hand tracking device 140 includes an image sensor 404 (e.g., one or more IR cameras, 3D cameras, depth cameras, and / or color cameras) that captures three-dimensional scene information including at least the hand 406 of a human user. The image sensor 404 captures hand images at a resolution sufficient to distinguish the fingers and their respective positions. The image sensor 404 typically captures images of other parts of the user's body, or images of the entire body, and can have either a zoom function or a dedicated sensor with high magnification to capture hand images at a desired resolution. In some embodiments, the image sensor 404 also captures 2D color video images of the hand 406 and other elements of the scene. In some embodiments, the image sensor 404 is used in combination with other image sensors that capture the physical environment of the scene 105, or functions as an image sensor that captures the physical environment of the scene 105. In some embodiments, the image sensor 404 is positioned relative to the user or the user's environment such that the field of view of the image sensor or a portion thereof is used to define an interaction space in which hand movements captured by the image sensor are processed as inputs to the controller 110.

[0130] In some embodiments, the image sensor 404 outputs a sequence of frames including 3D map data (and optionally also color image data) to the controller 110, thereby extracting high-level information from the map data. This high-level information is typically provided to an application running on the controller via an application programming interface (API), and in response drives the display generation component 120. For example, the user can interact with software running on the controller 110 by moving their hand 406 and changing the pose of their hand.

[0131] In some embodiments, the image sensor 404 projects a spot pattern onto a scene that includes the hand 406 and captures an image of the projected pattern. In some embodiments, the controller 110 calculates the 3D coordinates of points in the scene (including points on the surface of the user's hand) by triangulation based on the lateral shift of the spots of the pattern. This approach is advantageous in that the user does not need to hold or wear any kind of beacon, sensor, or other marker. This gives the depth coordinates of points in the scene relative to a predetermined reference plane at a specific distance from the image sensor 404. In the present disclosure, it is assumed that the image sensor 404 defines a series of orthogonal x, y, and z axes such that the depth coordinates of points in the scene correspond to the z component measured by the image sensor. Alternatively, the image sensor 404 (e.g., a hand tracking device) can use other 3D mapping methods such as stereoscopy or time-of-flight measurement based on single or multiple cameras or other types of sensors.

[0132] In some embodiments, the hand tracking device 140 captures and processes a temporal sequence of depth maps of the user's hand while the user moves their hand (e.g., the entire hand or one or more fingers). Software operating on a processor within the image sensor 404 and / or the controller 110 processes the 3D map data to extract hand patch descriptors within these depth maps. The software compares these descriptors to patch descriptors stored in the database 408 based on a previous learning process to estimate the hand pose in each frame. The pose typically includes the 3D locations of the user's hand joints and fingertips.

[0133] Software can also analyze the trajectories of hands and / or fingers over multiple frames within a sequence to identify gestures. The pose estimation function described herein may be interleaved with the motion tracking function, such that patch-based pose estimation is only performed once every two (or more) frames, while tracking is used to detect changes in pose that occur over the remaining frames. Pose, motion, and gesture information is provided to an application program running on controller 110 via the API described above. This program can, for example, move and modify an image presented on display generation component 120 or perform other functions in response to pose and / or gesture information.

[0134] In some embodiments, gestures include air gestures. An air gesture is a gesture that is detected without (or independently of) the user touching an input element that is part of a device (e.g., computer system 101, one or more input devices 125, and / or hand tracking device 140), and is based on detected movement of a part of the user's body in the air (e.g., head, one or more arms, one or more hands, one or more fingers, and / or one or more legs), including movement of the user's body relative to an absolute reference (e.g., the angle of the user's arm relative to the ground, or the distance of the user's hand relative to the ground), movement of the user's body relative to another part of the user's body (e.g., movement of the user's hand relative to the user's shoulder, movement of one of the user's hands relative to the other hand of the user, and / or movement of the user's finger relative to another finger or part of the user's hand), and / or absolute movement of a part of the user's body (e.g., a tap gesture including movement of the hand in a predetermined pose by a predetermined amount and / or speed, or a shake gesture including a predetermined speed or amount of rotation of a part of the user's body).

[0135] In some embodiments, the input gestures used in the various examples and embodiments described herein are air gestures performed by movement of a user's finger(s) relative to other finger(s) or part(s) of the user's hand for interacting with an XR environment (e.g., a virtual or mixed reality environment) according to some embodiments. In some embodiments, an air gesture is a gesture that is detected without the user touching (or independently of) an input element that is part of the device, and is based on detected movement of a part of the user's body, including movement of the user's body relative to an absolute reference (e.g., the angle of the user's arm relative to the ground, or the distance of the user's hand from the ground), movement of the user's body relative to another part of the user's body (e.g., movement of the user's hand relative to the user's shoulder, movement of the user's one hand relative to the user's other hand, and / or movement of the user's finger relative to another finger or part of the user's hand), and / or absolute movement of a part of the user's body (e.g., a tap gesture including movement of the hand in a predetermined pose by a predetermined amount and / or speed, or a shake gesture including rotation of a part of the user's body by a predetermined speed or amount).

[0136] In some embodiments where the input gesture is an air gesture (i.e., there is no physical contact with an input device that provides information to the computer system regarding which user interface element is the target of the user input, such as contact with a user interface element displayed on a touch screen or contact with a mouse or trackpad to move a cursor to a user interface element), the gesture takes into account the user's attention (e.g., line of sight) to determine the target of the user input (e.g., in the case of direct input, as described below). Thus, in implementations that include air gestures, the input gesture is detected attention (e.g., line of sight) to a user interface element in combination with (e.g., simultaneously with) movement of the user's finger(s) and / or hand for performing a pinch and / or tap input, for example, as described in more detail below.

[0137] In some embodiments, an input gesture directed to a user interface object is executed directly or indirectly with reference to the user interface object. For example, a user input is executed directly on a user interface object in response to the user performing an input gesture with their hand at a position corresponding to the position of the user interface object in a three-dimensional environment (e.g., as determined based on the user's current perspective). In some embodiments, the input gesture is executed indirectly on the user interface object in accordance with a user who performs the input gesture while the position of the user's hand is not at a position corresponding to the position of the user interface object in the three-dimensional environment while detecting the user's attention (e.g., line of sight) to the user interface object. For example, in the case of a direct input gesture, the user can direct the user's input to the user interface object by starting a gesture at a position corresponding to or near the display position of the user interface object (e.g., within a distance of 0.5 cm, 1 cm, 5 cm, or 0 - 5 cm measured from the outer edge of the option or the central part of the option). In the case of an indirect input gesture, the user can direct the user's input to the user interface object by paying attention to the user interface object (e.g., by gazing at the user interface object), and while paying attention to the option, the user starts the input gesture (e.g., at any position detectable by the computer system) (e.g., at a position not corresponding to the display position of the user interface object).

[0138] In some embodiments, the input gestures (e.g., air gestures) used in the various examples and embodiments described herein include pinch inputs and tap inputs for interacting with a virtual or augmented reality environment according to some embodiments. For example, the pinch inputs and tap inputs described below are performed as air gestures.

[0139] In some embodiments, the pinch input is part of an air gesture that includes one or more of a pinch gesture, a long pinch gesture, a pinch and drag gesture, or a double pinch gesture. For example, the pinch gesture, which is an air gesture, involves moving two or more fingers of a hand so as to come into contact with each other, i.e., optionally including an interruption immediately after coming into contact with each other (e.g., within 0 to 1 second). The long pinch gesture, which is an air gesture, involves moving two or more fingers of a hand so as to come into contact with each other for at least a threshold amount of time (e.g., at least 1 second) before detecting an interruption in the contact with each other. For example, the long pinch gesture includes the user holding a pinch gesture (e.g., when two or more fingers are in contact), and the long pinch gesture continues until an interruption in the contact between two or more fingers is detected. In some embodiments, the double pinch gesture, which is an air gesture, includes two (e.g., or more) pinch inputs (e.g., performed with the same hand) that are detected continuously and directly with each other (e.g., within a predetermined period). For example, the user performs a first pinch input (e.g., a pinch input or a long pinch input), releases the first pinch input (e.g., breaks the contact between two or more fingers), and then performs a second pinch input within a predetermined period (e.g., within 1 second or within 2 seconds) after releasing the first pinch input.

[0140] In some embodiments, a pinch-and-drag gesture, which is an air gesture, includes a pinch gesture (e.g., a pinch gesture or a long pinch gesture) that is performed in relation to (e.g., subsequent to) a drag input that changes the position of the user's hand from a first position (e.g., the start position of the drag) to a second position (e.g., the end position of the resistance). In some embodiments, the user maintains the pinch gesture while performing the drag input and releases the pinch gesture (e.g., opens two or more fingers) to end the drag gesture (e.g., at the second position). In some embodiments, the pinch input and the drag input are performed by the same hand (e.g., the user pinches two or more fingers together and moves the same hand to a second position in the air with a drag gesture). In some embodiments, the pinch input is performed by the user's first hand and the drag input is performed by the user's second hand (e.g., the user's second hand moves from the first position to the second position in the air while the user continues the pinch input with the user's first hand). In some embodiments, an input gesture, which is an air gesture, includes an input (e.g., a pinch input and / or a tap input) that is performed using both of the user's hands. For example, the input gesture includes two (e.g., or more) pinch inputs that are performed in relation to each other (e.g., simultaneously with or within a predetermined period). For example, a first pinch gesture (e.g., a pinch input, a long pinch input, or a pinch-and-drag input) performed using the user's first hand and, in relation to performing the pinch input with the first hand, a second pinch input is performed using the other hand (e.g., the second hand of the user's two hands). In some embodiments, movement occurs between the user's two hands (e.g., to increase and / or decrease the distance or relative orientation between the user's two hands).

[0141] In some embodiments, a tap input that is performed as an air gesture (e.g., directed at a user interface element) includes a movement (s) of the user's finger (s) toward the user interface element, optionally a movement of the user's hand toward the user interface element with the user's finger (s) extended toward the user interface element, a downward movement of the user's finger (e.g., mimicking a mouse click operation or a tap on a touch screen), or other predefined movement of the user's hand. In some embodiments, a tap input that is performed as an air gesture is detected based on movement characteristics of a finger or hand that performs a tap gesture of the finger or hand away from the user's perspective and / or toward an object that is the target of the tap input where the end of the movement follows. In some embodiments, the end of the movement is detected based on a change in movement characteristics of a finger or hand that performs a tap gesture (e.g., movement away from the user's perspective and / or toward the object that is the target of the tap input, reversal of the direction of movement of the finger or hand, and / or reversal of the direction of acceleration of the movement of the finger or hand).

[0142] In some embodiments, the user's attention is determined to be directed to a portion of a three - dimensional environment based on detection of a line of sight directed at the portion of the three - dimensional environment (optionally without requiring other conditions). In some embodiments, in order for the device to determine that the user's attention is directed to a portion of a three - dimensional environment, while the user's perspective is within a distance threshold from the portion of the three - dimensional environment, at least a threshold duration (e.g., dwell duration), detection of a line of sight directed at the portion of the three - dimensional environment, and / or one or more additional conditions such as requiring that the line of sight be directed at the portion of the three - dimensional environment are required. Based on detection of a line of sight directed at the portion of the three - dimensional environment with one or more of the additional conditions, it is determined that the user's attention is directed to the portion of the three - dimensional environment. If one of the additional conditions is not satisfied, the device determines that the attention is not directed to the portion of the three - dimensional environment where the line of sight is directed (e.g., until one or more of the additional conditions are satisfied).

[0143] In some embodiments, the detection of the prepared state configuration of the user or a part of the user is detected by the computer system. The detection of the prepared state configuration of the hand is used by the computer system as an indication that the user is likely preparing to interact with the computer system using one or more air gesture inputs (e.g., pinch, tap, pinch and drag, double pinch, long pinch, or other air gestures described herein) performed by the hand. For example, the prepared state of the hand is determined based on whether the hand has a predetermined hand shape (e.g., a pre-pinch shape where the thumb and one or more fingers are extended and spaced apart to perform a pinch or grab gesture, or a pre-tap where one or more fingers are extended and the palm is facing away from the user), whether the hand is in a predetermined position relative to the user's perspective (e.g., under the user's head, above the user's waist, extended at least 15 cm, 20 cm, 25 cm, 30 cm, or 50 cm from the body), and / or whether the hand has moved in a particular way (e.g., moved towards the front region of the user above the user's waist and under the user's head, or away from the user's body or legs). In some embodiments, the prepared state is used to determine whether the interaction element of the user interface responds to attention (e.g., line of sight) input.

[0144] In some embodiments, the software may be downloaded in electronic form to the controller 110, for example, over a network, or alternatively may be provided on a tangible non-transitory medium such as an optical, magnetic, or electronic memory medium. In some embodiments, the database 408 is similarly stored in a memory associated with the controller 110. Alternatively or additionally, some or all of the described functions of the computer may be implemented in dedicated hardware such as a custom or semi-custom integrated circuit or a programmable digital signal processor (DSP). The controller 110 is shown in FIG. 4 as a separate unit from the image sensor 404, for example, but some or all of the processing functions of the controller can be associated with the image sensor 404 by a suitable microprocessor and software, or by dedicated circuitry within the housing of the image sensor 404 (e.g., a hand-tracking device), or in other ways. In some embodiments, at least some of these processing functions are performed by a suitable processor integrated with the display generation component 120 (e.g., in a television set, a handheld device, or a head-mounted device), or using any other suitable computerized device such as a game console or a media player. The sensing function of the image sensor 404 can similarly be integrated with a computer or other computerized device controlled by the sensor output.

[0145] FIG. 4 further includes a schematic diagram of a depth map 410 captured by an image sensor 404 according to some embodiments. The depth map includes a matrix of pixels having respective depth values, as described above. The pixel 412 corresponding to the hand 406 is segmented in this map from the background and the wrist. The luminance of each pixel in the depth map 410 is inversely proportional to the depth value, i.e., the measured z - distance from the image sensor 404, and the tone becomes darker as the depth increases. The controller 110 processes these depth values to identify and segment components of an image (i.e., groups of adjacent pixels) having characteristics of a human hand. These characteristics can include, for example, the overall size, shape, and movement from frame to frame of a sequence of depth maps.

[0146] FIG. 4 also schematically shows a hand skeleton 414 that the controller 110 ultimately extracts from the depth map 410 of the hand 406 according to some embodiments. In FIG. 4, the hand skeleton 414 is superimposed on the background 416 of the hand segmented from the original depth map. In some embodiments, the hand (e.g., knuckles, fingertips, the center of the palm, and / or the end of the hand connected to the wrist), and optionally major feature points on the wrist or arm connected to the hand, are identified and placed on the hand skeleton 414. In some embodiments, the locations and movements of these major feature points over a plurality of image frames are used by the controller 110 to determine, according to some embodiments, hand gestures performed by the hand or the current state of the hand.

[0147] FIG. 5 shows an exemplary embodiment of the eye tracking device 130 (FIG. 1). In some embodiments, the eye tracking device 130 is controlled by the eye tracking unit 243 (FIG. 2) to track the position and movement of the user's line of sight with respect to the scene 105 or the XR content displayed via the display generation component 120. In some embodiments, the eye tracking device 130 is integrated with the display generation component 120. For example, in some embodiments, when the display generation component 120 is a head-mounted device such as a headset, helmet, goggles, or glasses, or a handheld device disposed on a wearable frame, the head-mounted device includes both a component for generating XR content for viewing by the user and a component for tracking the user's line of sight with respect to the XR content. In some embodiments, the eye tracking device 130 is separate from the display generation component 120. For example, when the display generation component is a handheld device or an XR chamber, the eye tracking device 130 is optionally a device separate from the handheld device or the XR chamber. In some embodiments, the eye tracking device 130 is a head-mounted device or a part of a head-mounted device. In some embodiments, the head-mounted eye tracking device 130 is optionally used with a display generation component worn on the head or a display generation component not worn on the head. In some embodiments, the eye tracking device 130 is not a head-mounted device and is optionally used in combination with a head-mounted display generation component. In some embodiments, the eye tracking device 130 is not a head-mounted device and is optionally a part of a non-head-mounted display generation component.

[0148] In some embodiments, the display generation component 120 uses a display mechanism (e.g., left and right near-eye display panels) that presents a frame including left and right images in front of the user's eyes to provide the user with a 3D virtual view. For example, the head-mounted display generation component may include left and right optical lenses (referred to herein as eyepieces) positioned between the display and the user's eyes. In some embodiments, the display generation component may include or be coupled to one or more external video cameras that capture video of the user's environment for display. In some embodiments, the head-mounted display generation component may have a transparent or translucent display on which the user can directly view the physical environment and display virtual objects. In some embodiments, the display generation component projects virtual objects onto the physical environment. The virtual objects may be projected, for example, onto a physical surface or as a hologram, such that an individual uses the system to observe virtual objects superimposed on the physical environment. In such cases, separate display panels and image frames for the left and right eyes may not be required.

[0149] As shown in FIG. 5, in some embodiments, the eye tracking device 130 (e.g., a gaze tracking device) includes at least one eye tracking camera (e.g., an infrared (IR) camera or a near IR (NIR) camera), and an illumination source (e.g., an IR light source or an NIR light source such as an array or a ring of LEDs) that emits light (e.g., IR light or NIR light) towards the user's eyes. The eye tracking camera may be directed towards the user's eyes to directly receive reflected IR or NIR light from the light source, or alternatively, may be directed towards a "hot" mirror disposed between the user's eyes and a display panel that reflects IR or NIR light from the eyes while allowing visible light to pass through to the eye tracking camera. The eye tracking device 130 optionally captures an image of the user's eyes (e.g., as a video stream captured at 60 - 120 frames per second (fps)), analyzes the image to generate gaze tracking information, and communicates the gaze tracking information to the controller 110. In some embodiments, both of the user's eyes are tracked separately by respective eye tracking cameras and illumination sources. In some embodiments, only one of the user's eyes is tracked by an individual eye tracking camera and illumination source.

[0150] In some embodiments, the eye tracking device 130 is calibrated using a device-specific calibration process to determine the parameters of the eye tracking device for a particular operating environment 100, such as the 3D geometric relationships and parameters of the LEDs, cameras, hot mirrors (if present), eyepieces, and display screens. The device-specific calibration process may be performed at a factory or another facility prior to delivery of the AR / VR device to the end user. The device-specific calibration process may be an automatic calibration process or a manual calibration process. The user-specific calibration process may include an estimation of specific user eye parameters, such as pupil location, foveal location, optical axis, visual axis, interpupillary distance, etc. According to some embodiments, once the device-specific and user-specific parameters for the eye tracking device 130 are determined, the images captured by the eye tracking camera are processed using a glint assist method to determine the user's current visual axis and viewpoint with respect to the display.

[0151] As shown in FIG. 5, the eye tracking device 130 (e.g., 130A or 130B) includes a line-of-sight tracking system that includes one or more eyepieces 520, at least one eye tracking camera 540 (e.g., an infrared (IR) or near-IR (NIR) camera) positioned on the side of the user's face where eye tracking is performed, and an illumination source 530 (e.g., an IR or NIR light source such as an array or ring of NIR light emitting diodes (LEDs)) that emits light (e.g., IR or NIR light) toward the user's eye(s) 592. The eye tracking camera 540 is positioned between the user's eye(s) 592 and the display 510 (e.g., the left or right display panel of a head-mounted display, or the display of a handheld device, and / or a projector), and may be directed toward a mirror 550 that reflects IR or NIR light from the eye(s) 592 while transmitting visible light (e.g., as shown at the top of FIG. 5), or may be directed toward the user's eye(s) 592 to receive the reflected IR or NIR light from the eye(s) 592 (e.g., as shown at the bottom of FIG. 5).

[0152] In some embodiments, the controller 110 renders an AR or VR frame 562 (e.g., the left and right frames of the left and right display panels) and provides the frame 562 to the display 510. The controller 110 uses the eye tracking input 542 from the eye tracking camera 540 for various purposes, e.g., when processing the frame 562 for display. The controller 110 optionally estimates the user's viewpoint on the display 510 based on the eye tracking input 542 obtained from the eye tracking camera 540 using a glint assist method or other suitable method. The viewpoint estimated from the eye tracking input 542 is optionally used to determine the direction in which the user is currently looking.

[0153] Examples of some possible use cases of the user's current line of sight direction are described below, but this is not intended to be limiting. As an exemplary use case, the controller 110 can render virtual content differently based on the determined line of sight direction of the user. For example, the controller 110 may generate virtual content at a higher resolution in the central visual region determined from the user's current line of sight direction than in the peripheral region. As another example, the controller may position or move virtual content within the view at least partially based on the user's current line of sight direction. As another example, the controller may display specific virtual content within the view at least partially based on the user's current line of sight direction. As another exemplary use case in an AR application, the controller 110 can capture the physical environment of the XR experience and direct the external camera to focus in the determined direction. The autofocus mechanism of the external camera can then focus on an object or surface within the environment that the user is currently viewing on the display 510. As another exemplary use case, the eyepiece 520 may be a focusable lens, and the line of sight tracking information is used by the controller to adjust the focus of the eyepiece 520 so that the virtual object the user is currently viewing has appropriate binocular convergence to match the convergence of the user's eyes 592. The controller 110 can utilize the line of sight tracking information to adjust the focus by directing the eyepiece 520 so that the nearby object the user is viewing appears at the correct distance.

[0154] In some embodiments, the eye-tracking device is part of a head-mounted device that includes a display (e.g., display 510), two eyepieces (e.g., eyepiece(s) 520), an eye-tracking camera (e.g., eye-tracking camera(s) 540), and a light source (e.g., light source 530 (e.g., IR LED or NIR LED)) attached to a wearable housing. The light source emits light (e.g., IR light or NIR light) towards the user's eye(s) 592. In some embodiments, the light source may be arranged in a ring or circularly around each lens, as shown in FIG. 5. In some embodiments, eight light sources 530 (e.g., LEDs) are arranged around each lens 520 as an example. However, more or fewer light sources 530 may be used, and other arrangements and locations of the light sources 530 may be employed.

[0155] In some embodiments, the display 510 emits light within the visible light range and does not emit light within the IR or NIR range, so as not to introduce noise into the gaze tracking system. Note that the location and angle of the eye-tracking camera(s) 540 are given as an example and are not intended to be limiting. In some embodiments, a single eye-tracking camera 540 is located on each side of the user's face. In some embodiments, two or more NIR cameras 540 can be used on each side of the user's face. In some embodiments, a camera 540 with a wider field of view (FOV) and a camera 540 with a narrower FOV may be used on each side of the user's face. In some embodiments, a camera 540 operating at one wavelength (e.g., 850 nm) and a camera 540 operating at a different wavelength (e.g., 940 nm) may be used on each side of the user's face.

[0156] An embodiment of a gaze tracking system as shown in FIG. 5 can be used, for example, in computer-generated reality, virtual reality, and / or mixed reality applications to provide a user with an experience of computer-generated reality, virtual reality, augmented reality, and / or augmented virtuality.

[0157] FIG. 6 shows a glint-assisted gaze tracking pipeline according to some embodiments. In some embodiments, the gaze tracking pipeline is implemented by a glint-assisted gaze tracking system (e.g., the eye tracking device 130 as shown in FIGS. 1 and 5). The glint-assisted gaze tracking system can maintain a tracking state. Initially, the tracking state is off or "no". When in the tracking state, the glint-assisted gaze tracking system uses prior information from the previous frame when analyzing the current frame to track the pupil contour and glint within the current frame. When not in the tracking state, the glint-assisted gaze tracking system attempts to detect the pupil and glint within the current frame, and if successful, initializes the tracking state to "yes" and continues to the next frame in the tracking state.

[0158] As shown in FIG. 6, the gaze tracking camera can capture left and right images of the user's left and right eyes. The captured images are then input into the gaze tracking pipeline for processing starting at 610. As indicated by the arrow returning to element 600, the gaze tracking system can continue to capture images of the user's eyes, for example, at a rate of 60 to 120 frames per second. In some embodiments, each set of captured images may be input into the pipeline for processing. However, in some embodiments, or under some conditions, not all captured frames are processed by the pipeline.

[0159] At 610, for the currently captured image, if the tracking state is yes, this method proceeds to element 640. At 610, if the tracking state is no, as shown at 620, the image is analyzed to detect the user's pupils and glints within the image. At 630, if the pupils and glints are detected successfully, the method proceeds to element 640. If not detected successfully, the method returns to element 610 to process the next image of the user's eyes.

[0160] At 640, when proceeding from element 610, the current frame is analyzed to track the pupils and glints based in part on previous information from the previous frame. At 640, when proceeding from element 630, the tracking state is initialized based on the detected pupils and glints within the current frame. The result of the processing at element 640 is checked to confirm that the tracking or detection result is reliable. For example, the result can be checked to determine whether a sufficient number of glints for performing pupil and gaze estimation are successfully tracked or detected in the current frame. At 650, if the result is not reliable, the tracking state is set to no at element 660 and the method returns to element 610 to process the next image of the user's eyes. At 650, if the result is reliable, the method proceeds to element 670. At 670, the tracking state is set to yes (if not already yes), and the pupil and glint information is passed to element 680 to estimate the user's viewpoint.

[0161] FIG. 6 is intended to function as an example of an eye-tracking technique that can be used in a particular embodiment. As will be recognized by those skilled in the art, other eye-tracking techniques that currently exist or may be developed in the future can be used in the computer system 101 to provide XR experiences to users according to various embodiments, instead of, or in combination with, the glint-assisted eye-tracking technique described herein.

[0162] In the present disclosure, various input methods are described with respect to interaction with a computer system. If one example is provided using one input device or input method and another example is provided using another input device or input method, it should be understood that each example may be compatible with and optionally utilize the input device or input method described in another example. Similarly, various output methods are described with respect to interaction with a computer system. If one example is provided using one output device or output method and another example is provided using another output device or output method, it should be understood that each example may be compatible with and optionally utilize the output device or output method described in another example. Similarly, various methods are described with respect to interaction with a virtual environment or a mixed reality environment via a computer system. If one example is provided using interaction with a virtual environment and another example is provided using a mixed reality environment, it should be understood that each example may be compatible with and optionally utilize the method described in another example. Thus, the present disclosure discloses embodiments that are combinations of features of multiple examples without comprehensively listing all features of one embodiment in the description of each exemplary embodiment. User Interface and Associated Processes

[0163] Attention is directed to embodiments of a user interface ("UI") and associated processes that may be implemented on a computer system, such as a portable multifunctional device or a head-mounted device, that communicates with one or more display generation components and (optionally) one or more audio output devices.

[0164] Figures 7A through 7T illustrate examples of generating and / or displaying a user's representation. FIG. 8 is a flowchart of an exemplary method 800 for providing guidance to a user during a process of generating a user's representation. FIG. 9 is a flowchart of an exemplary method 900 for displaying a preview of a user's representation. FIG. 10 is a flowchart of an exemplary method 1000 for providing guidance to a user prior to a process of generating a user's representation. FIGS. 11A and 11B are flowcharts of an exemplary method 1100 for providing guidance to a user for aligning a user's body part with a device. FIG. 12 is a flowchart of an exemplary method 1200 for providing guidance to a user for making an expression. FIG. 13 is a flowchart of an exemplary method 1300 for outputting audio guidance during a process of generating a user's representation. The user interfaces of FIGS. 7A through 7T are used to illustrate a process described below that includes the processes of FIGS. 8 through 13.

[0165] Figures 7A - 7T illustrate examples for capturing information used to generate a user's representation and / or examples of displaying a user's representation. In some embodiments, the user's representation is displayed for communication during a real - time communication session and / or used in other ways. In some embodiments, the real - time communication session includes real - time communication between a user of a computer system and a second user associated with a second computer system different from the computer system, and the real - time communication session includes displaying and / or otherwise communicating the user's facial and / or body expressions to the second user via the user's representation via the computer system and / or the second computer system. In some embodiments, the real - time communication session includes displaying the user's representation and / or outputting in real - time audio corresponding to the user's utterances. In some embodiments, the computer system and the second computer system communicate with each other (e.g., wirelessly and / or wired) to enable information indicating the user's representation and / or audio corresponding to the user's utterances to be transmitted between them. In some embodiments, the real - time communication session includes displaying the user's representation (and optionally, the second user's representation) within an extended reality environment via the display devices of the computer system and the second computer system.

[0166] Figures 7A - 7T show computer system 700 as a wristwatch, but in some embodiments, computer system 700 is a head - mounted device (HMD). The HMD is configured to be worn on the head 708b of user 708 and includes a first display on and / or within the HMD. The first display is visible to user 708 when user 708 wears the HMD on head 708b. For example, when the HMD is placed on head 708b of user 708 such that the first display is positioned above and / or in front of user 708's eyes, it at least partially covers user 708's eyes. In some embodiments, the first display is configured to display an extended reality environment during a real - time communication session in which the user of the HMD is participating. In some embodiments, the HMD also includes a second display positioned on and / or within the exterior of the HMD. In some embodiments, the second display is not visible to user 708 when the HMD is placed on head 708b of user 708. In some embodiments, the first display of the HMD is configured to display one or more tutorial indications (e.g., tutorial indications 702 and / or 724) regarding a process for capturing information about user 708 and / or one or more prompts (e.g., prompt 732 and / or other prompts) for instructing user 708 to remove the HMD from head 708b. The second display of the HMD is configured to display one or more visual indications (e.g., prompts 744 and / or 766) that provide guidance to user 708 for using the HMD to capture information about user 708 that is used to generate a representation of the user (e.g., representation 784) as described below.

[0167] FIG. 7A shows a computer system 700 (e.g., a wristwatch and / or a smartwatch) that displays a tutorial indication 702 on a display 704 of the computer system 700. Additionally, FIG. 7A shows a physical environment 706 of a user 708 who is using and / or associated with the computer system 700. In FIG. 7A, the computer system 700 is worn on the wrist 708a of the user 708 within the physical environment 706. The computer system 700 is a wearable device configured to be worn on the body of the user 708 (e.g., the wrist 708a and / or the head 708b of the user 708). In some embodiments, the computer system 700 is a headset, a helmet, goggles, glasses, or a handheld device disposed within a wearable frame. In some embodiments, the computer system 700 is configured to be primarily used when worn on the body of the user 708, but the computer system 700 can also be used when removed from the body of the user 708 (e.g., interacted with via the user 708 and / or used to capture information).

[0168] FIG. 7A shows a first portion 710 (e.g., a first face and / or a first side, a front side, and / or an interior of a head-mounted device (HMD)) of a computer system 700 that includes a display 704 and a sensor 712 (e.g., an image sensor such as a camera). When the computer system 700 is worn on a wrist 708a of a user 708 (or another part of the user 708's body such as a head 708b and / or a face 708c), the first portion 710 of the computer system 700 is visible and / or not blocked by a part of the user 708's body. In other words, the first portion 710 of the computer system 700 is configured to be positioned such that the display 704 is visible to the user 708 when the computer system 700 is positioned on the wrist 708a of the user 708 (or another part of the user 708's body such as a head 708b and / or a face 708c) (e.g., the display 704 faces in a direction opposite to the wrist 708a and / or the display 704 is positioned above and / or in front of the user 708's eyes). As described below, the computer system 700 also includes a second portion 714 (e.g., a second side and / or a second face, a back side, and / or an outer portion of the HMD) shown in FIG. 7D. When the computer system 700 is worn on a wrist 708a of a user 708 (or another part of the user 708's body such as a head 708b and / or a face 708c), the second portion 714 of the computer system 700 is blocked by the wrist 708a of the user 708 (e.g., rests on the wrist, contacts the wrist, and / or is positioned near the wrist in another way) (e.g., the second portion 714 of the HMD is not visible to the user because when the HMD is placed on the head 708b of the user 708, the first portion 710 covers and / or is in front of the user 708's eyes). In other words, the second portion 714 of the computer system 700 is positioned such that the surface of the second portion 714 faces in a direction towards the wrist 708a of the user 708 (e.g., a direction away from the face 708c of the user 708) while the computer system 700 is worn on the wrist 708a of the user 708.

[0169] In FIG. 7A, computer system 700 is worn on the body of user 708 (e.g., wrist 708a and / or another part of the body such as head 708b and / or face 708c), and computer system 700 is displaying tutorial indication 702 on display 704. In some embodiments, computer system 700 displays tutorial indication 702 before a process for capturing information about user 708 that is used to generate a representation of user 708, such as a virtual representation of user 708 (e.g., representation 784) and / or an avatar of user 708, that includes visual characteristics based on the captured information about user 708. In some embodiments, computer system 700 displays tutorial indication 702 after detecting a request to initiate a process for capturing information about user 708. In some embodiments, computer system 700 displays tutorial indication 702 as part of an initial setup process of computer system 700, where the initial setup process of computer system 700 begins when computer system 700 is first powered on and / or when user 708 first signs into an account associated with computer system 700. In some embodiments, computer system 700 displays tutorial indication 702 after receiving and / or detecting a request to launch a real-time communication application of computer system 700 for the first time (e.g., computer system 700 is configured to use and / or display a representation of user 708 during a real-time communication session associated with the real-time communication application, and if a representation of user 708 has not been generated, computer system 700 displays tutorial indication 702).

[0170] The tutorial indication 702 includes text 716 and visual indication 718 that provide guidance to the user 708 to perform the first step of a process for capturing information about the user 708. In FIG. 7A, the text 716 includes written guidance and / or instructions for completing a step (e.g., the first step) of a process for capturing information about the user 708. For example, the text 716 includes guidance for aiming a sensor (e.g., sensor 734) of the computer system 700 on a portion 714 of the computer system 700 at the head 708b of the user 708 and moving the head 708b to complete a step of a process for capturing information about the user 708. In FIG. 7A, the text 716 provides an explanation of and / or is otherwise associated with the visual indication 718. For example, the visual indication 718 includes a user representation 718a and a device representation 718b that indicate the first step of a process for capturing information about the user 708. The user representation 718a indicates the movement of the head representation 718c relative to the device representation 718b, as shown by the arrow 720 in FIG. 7A.

[0171] In some embodiments, the visual indication 718 is animated such that the user representation 718a and / or the device representation 718b move over time to indicate movement associated with steps for capturing information about the user 708. In some embodiments, the visual indication 718 is a recording (e.g., a video) of a person (e.g., represented by the user representation 718a) performing a first step for capturing information about the user 708. In some embodiments, the visual indication 718 is three-dimensional such that the user representation 718a and / or the device representation 718b appear to extend along three different and / or distinct axes with respect to the display 704. In some embodiments, the visual indication 718 is displayed within a three-dimensional environment that includes one or more representations of physical objects within the physical environment 706. In some embodiments, one or more representations of physical objects within the physical environment 706 are generated based on information captured by one or more sensors of the computer system 700 (e.g., sensor 712, sensor 734, and / or additional sensors of the computer system 700). In some embodiments, one or more representations of physical objects within the physical environment 706 are generated via spatial capture techniques and / or stereoscopically (e.g., based on information captured by one or more sensors of the computer system 700).

[0172] In FIG. 7A, computer system 700 outputs audio 722 while displaying tutorial indication 702. In some embodiments, audio 722 is audio (e.g., audio 748, audio 754, audio 758, audio 762, and / or audio 768) configured to be output by computer system 700 during steps of a process for capturing information about user 708 associated with tutorial indication 702. Thus, user 708 can listen to audio 722 while computer system 700 is displaying tutorial indication 702 and become familiar with audio prompts and / or other audio feedback output by computer system 700 during steps of a process for capturing information about user 708. Thus, by becoming familiar with audio 722, user 708 can complete steps of a process for capturing information about user 708 more quickly and efficiently. In some embodiments, audio 722 is not based on audio configured to be output by computer system 700 during steps of a process for capturing information about user 708.

[0173] As described above, in some embodiments, computer system 700 is an HMD and display 704 is an internal display of the HMD. In other words, display 704 is configured to be viewed by user 708 while the HMD is worn on user 708's head 708b and / or while first portion 710 covers user 708's eyes. In some embodiments, tutorial indication 702 is displayed on display 704 while computer system 700 detects that user 708 has the HMD worn on user 708's head 708b. In some embodiments, computer system 700 detects that user 708 is wearing computer system 700 based on detecting a biometric such as user 708's eyes or other facial features (e.g., detecting its presence).

[0174] In FIG. 7B, the computer system 700 continues to be worn on the body of the user 708 (e.g., the wrist 708a and / or another part of the body such as the head 708b and / or the face 708c), and the computer system 700 is displaying a second tutorial indication 724 on the display 704. In some embodiments, the computer system 700 displays the second tutorial indication 724 after (e.g., after ceasing to display) the tutorial indication 702. In some embodiments, the computer system 700 displays a transition (e.g., a transition animation) between the display of the tutorial indication 702 and the display of the second tutorial indication 724 to indicate that the tutorial indication 702 and the second tutorial indication 724 are associated with separate and different steps of a process for capturing information about the user 708.

[0175] In some embodiments, the computer system 700 displays a second tutorial indication 724 before a process for capturing information about the user 708, such as visual characteristics based on captured information about the user 708, for use in generating a representation of the user 708, such as a virtual representation of the user 708 and / or an avatar of the user 708. In some embodiments, the computer system 700 displays the second tutorial indication 724 after detecting a request to initiate a process for capturing information about the user 708. In some embodiments, the computer system 700 displays the second tutorial indication 724 as part of an initial setup process of the computer system 700, where the initial setup process of the computer system 700 begins when the computer system 700 is first powered on and / or when the user 708 first signs into an account associated with the computer system 700. In some embodiments, the computer system 700 displays the second tutorial indication 724 after receiving and / or detecting a request to initiate the computer system 700's real-time communication application for the first time (e.g., the computer system 700 is configured to use and / or display a representation of the user 708 during a real-time communication session associated with the real-time communication application, and if the representation of the user 708 has not been generated, the computer system 700 displays the second tutorial indication 724).

[0176] In FIG. 7B, the second tutorial indication 724 includes text 726 and a visual indication 728 that provide guidance to user 708 to perform a step (e.g., a second step) of a process for capturing information about user 708 that is different (e.g., separate and distinct) from the steps of the process for capturing information about user 708 associated with the first tutorial indication 702. The text 726 includes written guidance and / or instructions for completing the steps of the process for capturing information about user 708. For example, the text 726 includes guidance for orienting sensors of computer system 700 (e.g., sensor 734 and / or one or more additional sensors of computer system 700) on portion 714 of computer system 700 towards the head 708b of user 708 and for making facial expressions to complete the steps of the process for capturing information about user 708. In FIG. 7B, the text 726 provides an explanation of and / or is otherwise associated with the visual indication 728. For example, the visual indication 728 includes a user representation 728a and a device representation 728b that indicate a second step of the process for capturing information about user 708. The user representation 728a depicts a person making one or more facial expressions (e.g., an open-mouthed smile, a closed-mouthed smile, and / or a raised eyebrow expression).

[0177] In some embodiments, the visual indication 728 is animated such that the user representation 728a and / or the device representation 728b move over time to indicate one or more actions associated with steps for capturing information about the user 708. In some embodiments, the visual indication 728 is a recording (e.g., a video) of a person (e.g., represented by the user representation 728a) performing steps for capturing information about the user 708. In some embodiments, the visual indication 728 is three-dimensional such that the user representation 728a and / or the device representation 728b appear to extend along three different and / or distinct axes relative to the display 704. In some embodiments, the visual indication 728 is displayed within a three-dimensional environment that includes one or more representations of physical objects within the physical environment 706. In some embodiments, the one or more representations of physical objects within the physical environment 706 are generated based on information captured by one or more sensors of the computer system 700 (e.g., sensor 712, sensor 734, and / or one or more additional sensors of the computer system 700). In some embodiments, the one or more representations of physical objects within the physical environment 706 are generated via spatial capture techniques and / or stereoscopically (e.g., based on information captured by one or more sensors of the computer system 700).

[0178] In FIG. 7B, computer system 700 outputs audio 730 while displaying a second tutorial indication 724. In some embodiments, audio 730 is audio (e.g., audio 772, audio 774, audio 780, and / or audio 782) configured to be output by computer system 700 during steps of a process for capturing information about user 708 associated with the second tutorial indication 724. Accordingly, user 708 can listen to audio 730 while computer system 700 is displaying the second tutorial indication 724 and become familiar with audio prompts and / or other audio feedback output by computer system 700 during steps of a process for capturing information about user 708. Accordingly, by becoming familiar with audio 730, user 708 can more quickly and efficiently complete steps of a process for capturing information about user 708. In some embodiments, audio 730 is not based on audio configured to be output by computer system 700 during steps of a process for capturing information about user 708.

[0179] As described above, in some embodiments, computer system 700 is an HMD and display 704 is an internal display of the HMD. In other words, display 704 is configured to be viewed by user 708 while the HMD is worn on user 708's head 708b and portion 710 covers user 708's eyes. In some embodiments, the second tutorial indication 724 is displayed on display 704 while computer system 700 detects that user 708 has the HMD worn on user 708's head 708b. In some embodiments, computer system 700 detects that user 708 is wearing computer system 700 based on detecting a biometric, such as user 708's eyes or other facial features (e.g., detecting its presence).

[0180] In FIG. 7C, after the computer system 700 displays a tutorial indication 702 and / or a second tutorial indication 724 (and optionally additional tutorial indications associated with additional steps of a process for capturing information about the user 708), the computer system 700 displays a prompt 732. The prompt 732 includes a visual indication 732a (e.g., text and / or graphics) that instructs the user 708 to remove the computer system 700 from the user 708's body (e.g., remove the computer system 700 from the user 708's wrist 708a and / or remove the computer system 700 from another part of the user 708's body such as the user 708's head 708b and / or face 708c) as an action to perform to initiate and / or start the registration process (e.g., setup process) of the computer system 700.

[0181] In FIG. 7C, computer system 700 has not yet started a process that includes capturing information about user 708 to generate a representation of user 708 (e.g., a virtual representation such as an avatar that includes an appearance based on captured information about user 708). As described below, computer system 700 is inaccessible, blocked, and / or otherwise positioned such that sensors 734 (and optionally additional sensors) that are not suitable for capturing information about user 708 when computer system 700 is worn on user 708's body. For example, sensors 734 of the HMD (and optionally additional sensors) are not directed at individual body parts of user 708 when the HMD is worn on user 708's head 708b. Thus, computer system 700 outputs a prompt 732 that instructs user 708 to remove computer system 700 from user 708's body, so that sensors 734 (and optionally additional sensors) can be effectively used to capture at least some information about user 708. FIG. 7C shows prompt 732 as being displayed on display 704 of computer system 700, but in some embodiments, prompt 732 includes an audio output (e.g., via a speaker of computer system 700 and / or via a wireless headset / headphones) and / or a tactile output (e.g., via one or more tactile output devices of computer system 700) that commands user 708 to remove computer system 700 from user 708's body (e.g., wrist 708a and / or another part of the body such as head 708b and / or face 708c).

[0182] As described above, in some embodiments, computer system 700 is a head-mounted display (HMD), and display 704 is an internal display of the HMD. In other words, display 704 is configured to be viewable by user 708 while the HMD is worn on user 708's head 708b and / or while the first portion 710 covers user 708's eyes. In some embodiments, prompt 732 includes an instruction to remove the HMD from user 708's head 708b and direct a sensor of computer system 700 (e.g., sensor 734) towards user 708's head 708b and / or face 708c. In some embodiments, prompt 732 is displayed on display 704 while computer system 700 detects that user 708 is wearing the HMD on user 708's head 708b. In some embodiments, computer system 700 detects that user 708 is wearing computer system 700 based on detecting a biometric, such as user 708's eyes or other facial features (e.g., detecting its presence).

[0183] In some embodiments, computer system 700 initiates a registration process when computer system 700 detects that user 708 is no longer wearing computer system 700 on user 708's body, such as user 708's wrist 708a and / or head 708b. In some embodiments, computer system 700 detects that user 708 is not wearing computer system 700 based on detecting an absence of a biometric, such as user 708's eyes or other facial features.

[0184] In some embodiments, before or after displaying the prompt 732, the computer system 700 displays and / or outputs information indicating that information about the user 708 captured during at least a portion of the registration process is used to generate a representation of the user 708. In some embodiments, the computer system 700 displays and / or outputs information regarding the use of the representation of the user 708 in a real-time communication session with another user associated with an external computer system, which provides the user 708 with context regarding the purpose of capturing information about the user 708.

[0185] In some embodiments, before or after displaying the prompt 732, the computer system 700 displays and / or outputs a prompt that includes an indication (e.g., text and / or graphics) related to the state of the physical environment 706 in which the user 708 is located. For example, sensors 712 (and / or other sensors) of the computer system 700 capture information about the physical environment 706, and the computer system 700 determines whether the captured information indicates one or more conditions that may affect the capture of information about the user 708. In some embodiments, conditions that may affect the capture of information about the user 708 include low illumination (e.g., light emitted from one or more light sources such as a light bulb, lamp, and / or the sun does not reach the user in an amount sufficient to enable the computer system 700 to effectively capture information about the user 708), harsh illumination, objects positioned between the computer system 700 and the user 708 (e.g., an object that blocks an area where one or more sensors of the computer system 700 are configured to capture information), and / or objects and / or accessories positioned on an individual part of the user 708's body (e.g., glasses, face cover, head cover, and / or hat). In some embodiments, a prompt that includes an indication related to the state of the physical environment 706 includes suggestions and / or guidance to the user 708 regarding modifying a condition that may affect the capture of information about the user 708 (e.g., moving to an environment with different lighting conditions, adjusting the lighting conditions, and / or removing an object that blocks a part of the user 708's body). In some embodiments, the prompt specifies conditions that adversely affect capture (e.g., low illumination, strong illumination, an object positioned between the computer system 700 and the user 708).

[0186] In FIG. 7D, user 708 is removing computer system 700 from the body of user 708 within physical environment 706 (e.g., wrist 708a and / or another part of the body such as head 708b and / or face 708c). Additionally, FIG. 7D shows a second portion 714 (e.g., the back and / or outer portion of the HMD) of computer system 700 that is accessible and / or visible after user 708 has removed computer system 700 from the body of user 708 (e.g., wrist 708a and / or another part of the body such as head 708b and / or face 708c). The second portion 714 of computer system 700 includes sensors 734 configured to capture various information about user 708. In some embodiments, computer system 700 includes one or more sensors in addition to sensors 734. In some embodiments, sensors 734 and / or additional sensors on the second portion 714 of computer system 700 include one or more image sensors (e.g., IR camera, 3D camera, depth camera, color camera, RGB camera (e.g., having a complementary metal-oxide semiconductor (CMOS) image sensor or a charge-coupled device (CCD) image sensor), one or more infrared (IR) cameras, and / or one or more event-based cameras), an inertial measurement unit (IMU), an accelerometer, a gyroscope, a thermometer, one or more physiological sensors (e.g., a blood pressure monitor, a heart rate monitor, a blood oxygen sensor, and / or a blood glucose sensor), one or more microphones, one or more speakers, a tactile engine, one or more depth sensors (e.g., structured light, time-of-flight, and / or two or more cameras that determine depth based on the difference in perspective of two or more cameras), one or more light sensors, one or more tactile sensors, one or more orientation sensors, one or more proximity sensors, one or more location sensors, one or more motion sensors, and / or one or more velocity sensors.

[0187] In FIG. 7D, the second portion 714 includes a display 736 configured to provide instructions to the user 708 to use the computer system 700 to capture one or more physical characteristics of the user 708 (e.g., via the sensor 734 and / or one or more additional sensors of the computer system 700) and / or to otherwise induce the user 708 to display visual indications. In some embodiments, the display 736 is an external display on the outer portion of the HMD, such that the display 736 can be viewed by the user 708 when the computer system 700 is not worn by the user 708 (e.g., worn on the user 708's wrist 708a, head 708b, and / or face 708c). In some embodiments, the display 736 includes a non-zero amount of curvature. In some embodiments, the display 736 is a lenticular display configured to display one or more visual elements having a three-dimensional effect. In some embodiments, the display 736 is not a lenticular display.

[0188] In some embodiments, the computer system 700 detects that the computer system 700 has been removed from the user 708's body (e.g., the user 708's wrist 708a and / or another part of the body such as the head 708b and / or face 708c). In response to detecting that the computer system 700 has been removed from the user 708's body (e.g., the user 708's wrist 708a and / or another part of the body such as the head 708b and / or face 708c), the computer system 700 displays visual guidance 738 via the display, as shown in FIG. 7D.

[0189] In some embodiments, computer system 700 displays visual guidance 738 before the computer system 700 begins capturing information about user 708. As described below, visual guidance 738 prompts the user 708 to position the user's body and / or position the computer systems 700 relative to each other in a predetermined orientation. In some embodiments, the predetermined orientation of the bodies of user 708 and computer system 700 enables the computer system 700 to capture information about user 708 (e.g., via sensors 734 and / or additional sensors). In FIG. 7D, user 708 holds computer system 700 at location 706a within physical environment 706 (e.g., relative to the head 708b and / or face 708c of user 708). While the computer system 700 is positioned at location 706a, the computer system 700 (and sensors 734) is not oriented, directed, and / or positioned near the face 708c of user 708. Thus, visual guidance 738 prompts user 708 to move the body and / or move the computer system 700 so that the face 708c and the computer system 700 are aligned with each other such that sensors 734 (and optionally one or more additional sensors of computer system 700) can capture information about the head 708b and / or face 708c of user 708.

[0190] In FIG. 7D, the visual guidance 738 includes text 738a, a first position indicator 738b, and a second position indicator 738c. The text 738a includes written guidance and / or instructions for aligning the head 708b and / or face 708c of the user 708 with the computer system 700 (e.g., the sensor 734 of the computer system 700). For example, the text 738a includes guidance for positioning the head 708b of the user 708 such that, as indicated by the first position indicator 738b and / or the second position indicator 738c, the head 708b of the user 708 is within a target area and / or orientation with respect to the computer system 700. The first position indicator 738b represents the position of the head 708b of the user 708 within the physical environment 706 with respect to the sensor 734 of the computer system 700. In some embodiments, the second position indicator 738c represents the target position of the head 708b of the user 708 within the physical environment 706 with respect to the sensor 734 of the computer system 700 that enables the sensor 734 to capture information regarding the head 708b and / or face 708c of the user 708. In some embodiments, the second position indicator 738c represents the position of the sensor 734 within the physical environment 706 such that when the first position indicator 738b and the second position indicator 738c are aligned with each other (e.g., at least partially overlap each other on the display 736), the head 708b of the user 708 is in a target position and / or target orientation with respect to the sensor 734 and / or the computer system 700.

[0191] In some embodiments, the first position indicator 738b and the second position indicator 738c are displayed at different simulated depths. For example, the first position indicator 738b is displayed to appear to be at a first depth from the perspective of the user 708, and the second position indicator 738c is displayed to appear to be at a second depth different from the first depth from the perspective of the user 708. In some embodiments, the respective simulated depths of the first position indicator 738b and the second position indicator 738c are based on the orientation of the head 708b and / or face 708c of the user 708 relative to the computer system 700 (e.g., sensor 734 of the computer system 700). In some embodiments, the computer system 700 displays the first position indicator 738b and the second position indicator 738c at different simulated depths by displaying the first position indicator 738b and the second position indicator 738c with respective sizes, positions, and / or visual effects that create, generate, and / or otherwise make it appear as if the first position indicator 738b and the second position indicator 738c are each being displayed at their respective simulated depths.

[0192] In some embodiments, computer system 700 is configured to move first position indicator 738b and / or second position indicator 738c on display 736 using simulated parallax. In other words, computer system 700 is configured to display on display 736 the movement of first position indicator 738b and second position indicator 738c relative to each other such that user 708 perceives a displacement of first position indicator 738b relative to second position indicator 738c (or vice versa) based on a change in the viewpoint of user 708. In some embodiments, computer system 700 displays the movement of first position indicator 738b at a first speed on display 736 and displays the movement of second position indicator 738c at a second speed different from the first speed on display 736 to generate simulated parallax.

[0193] In FIG. 7D, computer system 700 detects the position of user 708's head 708b relative to the position of computer system 700 in physical environment 706 (via information captured via sensor 734 and / or one or more additional sensors of computer system 700). Computer system 700 uses information regarding the position of user 708's head 708b to display a first position indicator 738b at position 740a on display 736. In FIG. 7D, computer system 700 displays a second position indicator 738c at position 740b on display 736. In some embodiments, computer system 700 displays a second position indicator 738c at position 740b based on information regarding the position of user 708's head 708b relative to the position of computer system 700 in physical environment 706. In some embodiments, computer system 700 displays the second position indicator 738c at position 740b as a default position and does not change the position of the second position indicator 738c from position 740b based on information regarding the position of user 708's head 708b relative to the position of computer system 700 in physical environment 706. When the position of user 708's head 708b moves relative to the position of computer system 700 in physical environment 706, computer system 700 updates the display of the first position indicator 738b and / or the second position indicator 738c.

[0194] As described above, in some embodiments, computer system 700 is an HMD and display 736 is an external display of a different and / or separate HMD from display 704. In other words, display 736 is configured to be viewable by user 708 while the HMD is not worn on user 708's head 708b. In some embodiments, visual guidance 738 is displayed on display 736 while computer system 700 detects that user 708 is not wearing the HMD on user 708's head 708b. In some embodiments, computer system 700 detects that user 708 is not wearing computer system 700 based on detecting the absence of biometric features such as user 708's eyes or other facial features.

[0195] In FIG. 7E, user 708 holds computer system 700 at location 706b within physical environment 706. While computer system 700 is positioned at location 706b (e.g., relative to user 708's head 708b and / or face 708c), computer system 700 (and sensor 734) is positioned closer to user 708's head 708b and / or face 708c, but is still not oriented, aligned, and / or positioned towards user 708's face 708c. Computer system 700 detects the position of user 708's head 708b and / or face 708c relative to computer system 700 within physical environment 706 (e.g., via sensor 734). For example, computer system 700 receives information regarding the position of user's head 708b and / or face 708c relative to location 706b of computer system 700 within physical environment 706 from sensor 734 (and optionally, one or more additional sensors of computer system 700). Based on the information received from sensor 734, computer system 700 displays a first position indicator 738b (e.g., representing the position of user 708's head 708b and / or face 708c) at a position 740c closer to position 740b as compared to position 740a. Thus, computer system 700 provides a visual indication of where the head 708b, face 708c, and / or computer system 700 are oriented relative to each other with respect to a target orientation (e.g., an orientation that enables sensor 734 to capture information regarding user 708's head 708b and / or face 708c).

[0196] In some embodiments, computer system 700 moves the position of first position indicator 738b (e.g., from position 740a to position 740c) based on the inclination of computer system 700 with respect to user 708's head 708b and / or face 708c. In some embodiments, computer system 700 adjusts the color of first position indicator 738b when computer system 700 displays first position indicator 738b moving closer to position 740b of second position indicator 738c. In some embodiments, computer system 700 adjusts the visual effect of first position indicator 738b based on information received from sensor 734 (and optionally one or more additional sensors of computer system 700). For example, in some embodiments, computer system 700 reduces the amount of blur, increases the amount of colorfulness, and / or increases the brightness of first position indicator 738b as computer system 700 moves the position of first position indicator 738b closer to position 740b of second position indicator 738c. In some embodiments, computer system 700 increases the amount of blur, decreases the amount of colorfulness, and / or decreases the brightness of first position indicator 738b as computer system 700 moves the position of first position indicator 738b further away from position 740b of second position indicator 738c. In some embodiments, computer system 700 moves the position of first position indicator 738b based on the direction of movement of computer system 700 (e.g., sensor 734 of computer system 700) with respect to user 708's head 708b and / or face 708c, or vice versa.In some embodiments, computer system 700 moves the position of first position indicator 738b by an amount based on the amount of movement of computer system 700 (e.g., sensor 734 of computer system 700) relative to user 708's head 708b and / or face 708c, or vice versa. In some embodiments, computer system 700 adjusts the color of first position indicator 738b based on movement of computer system 700 relative to user 708's head 708b and / or face 708c, or vice versa, regardless of the direction of movement.

[0197] In FIG. 7E, computer system 700 maintains the display of second position indicator 738c at position 740b to provide a target to user 708 when positioning head 708b, face 708c, and / or computer system 700 relative to each other. In some embodiments, computer system 700 moves the position of second position indicator 738c from position 740b based on information received from sensor 734 and / or one or more additional sensors of computer system 700 (e.g., moving the position of second position indicator 738c relative to first position indicator 738b and / or relative to display 736).

[0198] In FIG. 7E, computer system 700 outputs audio 741 while displaying visual guidance 738 and before detecting that head 708b, face 708c, and / or computer system 700 are oriented in a target orientation relative to each other. In some embodiments, computer system 700 adjusts the output of the audio (e.g., adjusts one or more characteristics of the audio such as volume level and / or amount of reverberation) based on the respective positions of head 708b, face 708c, and / or computer system 700 relative to each other. For example, in some embodiments, computer system 700 increases the volume of the output of audio 741 as head 708b, face 708c, and / or computer system 700 approach a target orientation relative to each other.

[0199] In some embodiments, audio 741 includes different components and / or portions that facilitate guiding user 708 to align the respective positions of head 708b, face 708c, and / or computer system 700 with respect to each other. For example, in some embodiments, audio 741 includes a first portion 741a corresponding to the position of user 708's head 708b and / or face 708c relative to computer system 700 within physical environment 706, and a second portion 741b corresponding to the location and / or position of computer system 700 (e.g., sensor 734 and / or another sensor of computer system 700) within physical environment 706. In some embodiments, both the first portion 741a and the second portion 741b of audio 741 include repetitive audio effects such that the first portion 741a and the second portion 741b loop continuously for at least a predetermined amount of time (e.g., until the respective positions of head 708b, face 708c, and / or computer system 700 are aligned with each other and / or until they are in a target orientation relative to each other). In some embodiments, the first portion 741a includes one or more first notes, the second portion 741b includes one or more second notes, and the one or more first notes and the one or more second notes are spaced apart from each other by a harmonically significant amount, such as an integer octave. In some embodiments, computer system 700 adjusts the volume of the first portion 741a and / or the second portion 741b relative to each other based on the movement of head 708b, face 708c, and / or computer system 700 relative to each other within physical environment 706.

[0200] As described above, in some embodiments, computer system 700 is an HMD and display 736 is an external display of a different and / or separate HMD from display 704. In other words, display 736 is configured to be viewable by user 708 while the HMD is not worn on the head 708b of user 708. In some embodiments, visual guidance 738 is displayed on display 736 and computer system 700 displays movement of a first position indicator 738b and / or a second position indicator 738c based on detecting movement of user 708 and / or the HMD relative to each other.

[0201] In FIG. 7F, user 708 holds computer system 700 at location 706c within physical environment 706 (e.g., with respect to user 708's head 708b and / or face 708c). While computer system 700 is positioned at location 706c, computer system 700 (and sensor 734) is oriented, aligned, and / or positioned near user 708's face 708c. Computer system 700 detects the position of user 708's head 708b and / or face 708c relative to computer system 700 within physical environment 706 (e.g., via sensor 734). For example, computer system 700 receives information from sensor 734 (and optionally one or more additional sensors of computer system 700) regarding the position of the user's head 708b and / or face 708c relative to location 706c of computer system 700 within physical environment 706. Based on the information received from sensor 734, computer system 700 displays a first position indicator 738b (e.g., representing the position of user 708's head 708b and / or face 708c) at position 740d, which overlaps at least a portion of a second position indicator 738c at position 740b. Thus, computer system 700 provides a visual indication regarding where the head 708b, face 708c, and / or computer system 700 are oriented relative to each other in a target orientation (e.g., an orientation that enables sensor 734 to capture information regarding user 708's head 708b and / or face 708c).

[0202] In some embodiments, when the computer system 700 displays the first position indicator 738b at the position 740d on the display 736 such that the first position indicator 738b at least partially overlaps the second position indicator 738c, the computer system 700 detects that the head 708b, the face 708c, and / or the computer system 700 are oriented in a target orientation relative to each other. In some embodiments, in response to detecting that the head 708b, the face 708c, and / or the computer system 700 are oriented in a target orientation relative to each other, the computer system 700 outputs confirmation feedback to prompt the user 708 to stop moving the body and / or the computer system 700 and / or to maintain the respective positions of the head 708b, the face 708c, and / or the computer system 700. In FIG. 7F, the confirmation feedback includes audio 742. In some embodiments, the audio 742 includes an audio output that includes audio that confirms that the head 708b, the face 708c, and / or the computer system 700 are in a target orientation relative to each other. In some embodiments, the audio 742 includes audio having a first tone, pitch, frequency, wavelength, melody, and / or harmony.

[0203] In some embodiments, in response to detecting that the head 708b, the face 708c, and / or the computer system 700 are oriented in a target orientation relative to each other, the computer system 700 outputs audio 742 having a first portion 742a, a second portion 741b, and a third portion 741a. In some embodiments, the third portion 742a audibly confirms that the head 708b, the face 708c, and / or the computer system 700 are oriented in a target orientation relative to each other. In some embodiments, the third portion 742a includes one or more third notes that are separated by a harmonically significant amount, such as an integer number of octaves, from one or more first notes of the first portion 741a and one or more second notes of the second portion 741b.

[0204] In some embodiments, the confirmation feedback includes displaying visual feedback, such as checkmarks, text, etc. (e.g., in addition to or instead of the audio 742), on the display 736, and / or adjusting the appearance of the visual guidance 738 (e.g., animating the visual guidance 738 and / or displaying an animation that blinks on the display 736).

[0205] In FIGS. 7D - 7F, the visual guidance 738 includes text 738a, a first position indicator 738b, and / or a second position indicator 738c. In some embodiments, the visual guidance 738 includes an image of the user 708 (e.g., an image based on information captured via the sensor 734), and / or a user interface object of a target and / or frame configured such that the image of the user 708 is positioned when the head 708b, face 708c, and / or computer system 700 are in a target orientation relative to each other.

[0206] As described above, in some embodiments, the computer system 700 is an HMD, and the display 736 is an external display of a different and / or separate HMD from the display 704. In other words, the display 736 is configured to be viewable by the user 708 while the HMD is not worn on the head 708b of the user 708. In some embodiments, the visual guidance 738 is displayed on the display 736, and the computer system 700 displays the movement of the first position indicator 738b and / or the second position indicator 738c based on detecting the movement of the user 708 and / or the HMD relative to each other.

[0207] After the computer system 700 determines that the head 708b, face 708c, and / or the computer systems 700 are oriented in a target orientation relative to each other, the computer system 700 begins steps (e.g., a first step) to capture information regarding the head 708b and / or face 708c of the user 708, as shown in FIG. 7G.

[0208] In FIG. 7G, the computer system 700 displays a prompt 744 via the display 736 to guide the user 708 to move the head 708b in a predetermined direction within the physical environment 706. The illustrated axes 746a - 746c are provided for clarity and are not part of the user interface of the computer system 700. The prompt 744 includes text 744a that provides written guidance and / or instructions prompting the user 708 to move the head 708b in a direction along the axis 746a to the right of the user 708. In FIG. 7G, the prompt 744 includes an arrow 746a that points in a direction along the axis 744b to the right of the user 708 (e.g., from the perspective of the user 708 looking at the display 736). In some embodiments, the prompt 744 includes other visual elements in addition to, or instead of, the text 744a and / or the arrow 744b. For example, in some embodiments, the prompt 744 includes a representation of a person (e.g., an avatar) moving their head to the right to demonstrate the steps for capturing information regarding the head 708b and / or face 708c of the user 708 associated with the prompt 744. In some embodiments, the representation of the person moving their head is an animation, a series of images, and / or a video showing the person moving their head to the right over time.

[0209] In FIG. 7G, computer system 700 outputs audio 748 to further prompt user 708 to move head 708b in a direction along axis 746a to the right of user 708 within physical environment 706. In some embodiments, computer system 700 outputs audio 748 such that user 708 perceives audio 748 as being generated from a particular location within physical environment 706 (e.g., a location different from the location of computer system 700), such as by using a head-related transfer function (HRTF) filter and / or crosstalk cancellation techniques. For example, in some embodiments, computer system 700 outputs audio 748 such that user 708 perceives audio 748 as being generated from a direction to the right of user 708 and / or computer system 700 within physical environment 706. Thus, the attention of user 708 is drawn to a location within physical environment 706 associated with the direction in which prompt 744 induces user 708 to move head 708b. In some embodiments, audio 748 includes a continuous output of sounds that prompt user 708 to move head 708b in a direction to the right of user 708 and / or computer system 700. In some embodiments, audio 748 includes an audio burst and / or an intermittent output of sounds generated at predetermined time intervals. As described below, in some embodiments, computer system 700 is configured to adjust audio 748 based on movement of head 708b and / or face 708c of user 708 relative to computer system 700 (e.g., sensor 734 of computer system 700).

[0210] In some embodiments, computer system 700 adjusts one or more audio characteristics (e.g., volume level and / or amount of reverberation) of audio 748 based on detecting that the respective positions of head 708b, face 708c, and / or computer system 700 are not aligned with each other and / or not in the target orientation described above with reference to FIGS. 7D-7F (e.g., computer system 700 is not in location 706c with respect to head 708b and / or face 708c of user 708 within physical environment 706 and / or is no longer in location 706c). In some embodiments, in response to detecting that the respective positions of head 708b, face 708c, and / or computer system 700 are no longer aligned with each other and / or not in the target orientation described above, computer system 700 reduces the volume of audio 748 and / or stops the output of audio 748 to signal to user 708 that the respective positions of head 708b, face 708c, and / or computer system 700 are not in the appropriate orientation.

[0211] In some embodiments, the audio 748 includes different components and / or portions that facilitate guiding the user 708 to move the head 708b and / or face 708c relative to the computer system 700. For example, in some embodiments, the audio 748 includes a first portion 748a corresponding to the position of the user 708's head 708b and / or face 708c relative to the computer system 700 within the physical environment 706, and a second portion 748b corresponding to the location and / or position of the computer system 700 (e.g., the sensor 734 and / or another sensor of the computer system 700) within the physical environment 706. In some embodiments, both the first portion 748a and the second portion 748b of the audio 748 include repetitive audio effects such that the first portion 748a and the second portion 748b loop continuously for at least a predetermined amount of time (e.g., until the respective positions of the head 708b, face 708c, and / or computer system 700 are in a target orientation relative to each other). In some embodiments, the first portion 748a includes one or more first musical notes, the second portion 748b includes one or more second musical notes, and the one or more first musical notes and the one or more second musical notes are spaced apart from each other by a harmonically significant amount, such as an integer octave. In some embodiments, the computer system 700 adjusts the volume of the first portion 748a and / or the second portion 748b relative to each other based on the movement of the head 708b, face 708c, and / or computer system 700 relative to each other within the physical environment 706.

[0212] As described above, in some embodiments, the computer system 700 is an HMD, and the display 736 is an external display of a different and / or separate HMD from the display 704. In other words, the display 736 is configured to be viewable by the user 708 while the HMD is not worn on the user 708's head 708b. In some embodiments, the prompt 744 is displayed on the display 736 of the HMD.

[0213] In FIG. 7H, computer system 700 detects movement of user 708's head 708b and / or face 708c in a direction along axis 746a that is to the right of user 708. Based on the movement of user 708's head 708b and / or face 708c relative to computer system 700, computer system 700 displays prompt 744 and progress indicator 750. In FIG. 7H, computer system 700 maintains the display of prompt 744 and continues to guide user 708 to further move head 708b in a direction along axis 746a that is to the right of user 708. Progress indicator 750 provides a visual indication of the amount of progress toward a predetermined orientation (e.g., a predetermined orientation including head 708b moving to a position in a direction along axis 746a that faces to the right of user 708) of user 708's head 708b relative to computer system 700.

[0214] In FIG. 7H, the progress indicator 750 is displayed on the first portion 752a of the display 736 and not on the second portion 752b. The size of the first portion 752a (e.g., compared to the second portion 752b and / or compared to the size of the display 736) indicates the amount of progress towards the user 708 completing the movement of the head 708b in the direction associated with the prompt 744 (e.g., the direction along the axis 746a to the right of the user 708). In FIG. 7H, the progress indicator 750 includes a color different from the background color, the color of the prompt 744, and / or the color of the second portion 752b of the display 736. For example, the progress indicator 750 is shown as having a first hatching in FIG. 7H, indicating that the progress indicator 750 includes a color different from the background color, the color of the prompt 744, and / or the color of the second portion 752b of the display 736 (e.g., the second portion 752b of the display 736 does not include hatching). In some embodiments, the color of the progress indicator 750 (e.g., the color of the first portion 752a of the display 736) is based on one or more colors of the physical environment 706. For example, in some embodiments, the computer system 700 displays the color of the progress indicator 750 (e.g., the color of the first portion 752a of the display 736) based on information captured by a sensor 734 (and / or other sensors of the computer system 700) indicating one or more colors of one or more physical objects (e.g., walls, floors, ceilings, artworks, and / or physical objects) present within the physical environment 706.

[0215] Computer system 700 is configured to display the movement of progress indicator 750 over time based on detected movement of user 708's head 708b and / or face 708c relative to computer system 700. In some embodiments, computer system 700 animates progress indicator 750 such that the size of progress indicator 750 changes over time (e.g., the first portion 752a of display 736 increases or decreases relative to the second portion 752b of display 736) to indicate whether user 708 should continue to move head 708b in the current direction of movement, move head 708b in a different direction, and / or maintain the position of head 708b.

[0216] In some embodiments, the prompt 744 and / or the progress indicator 750 includes an image of the user 708 based on information captured by the sensor 734 (and / or other sensors of the computer system 700). For example, in some embodiments, the prompt 744 and / or the progress indicator 750 enables the user 708 to adjust their body and / or the position of the computer system 700 to align the user's head 708b and / or face 708c in a target orientation with respect to the computer system 700 (e.g., the sensor 734 of the computer system 700), and includes an image of the user 708. In some embodiments, the computer system 700 displays an image of the user 708 using offsets, skews, and / or shifts based on the orientation of the sensor 734 with respect to the display 736 of the computer system 700. In some embodiments, the computer system 700 applies adjustments to the image data received from the sensor 734 (and / or other sensors of the computer system 700) and displays an image of the user 708 having offsets, skews, and / or shifts that cause the user 708 to adjust the position of their head 708b and / or face 708c with respect to the computer system 700. By displaying an image of the user 708 having offsets, skews, and / or shifts, the user 708 moves their head 708b, face 708c, and / or the computer system 700 so that the sensor 734 (e.g., the sensing area of the sensor 734) is directed at the user's head 708b and / or face 708c. In other words, in some embodiments, the sensor 734 is positioned with an offset and / or at an angle relative to the display 736, and thus the computer system 700 adjusts how an image of the user 708 is displayed on the display 736 to prompt the user 708 to tilt the computer system 700 and / or adjust the position of their head 708b and / or face 708c so that the sensor 734 is directed at the user's head 708b and / or face 708c.

[0217] In some embodiments, the progress indicator 750 includes a user interface object that indicates the position of the user 708's head 708b and / or face 708c relative to the computer system 700 (e.g., the sensor 734 of the computer system 700) (in addition to, or instead of, the color occupying the first portion 752a of the display 736). For example, in some embodiments, the progress indicator 750 includes a ball and / or orb displayed at a position on the display 736 to visually indicate the physical position of the user 708's head 708b and / or face 708c relative to the computer system 700 within the physical environment 706. In some embodiments, the progress indicator 750 includes a countdown that starts at a predetermined number and counts down to zero in response to detected movement of the head 708b, face 708c, and / or computer system 700 relative to each other along the axis 746a in the right direction of the user 708.

[0218] In FIG. 7H, computer system 700 outputs audio 754 to indicate the progress towards moving user 708's head 708b to a target orientation relative to computer system 700 and / or further prompt user 708 to move head 708b in a direction along axis 746a which is to the right of user 708 within physical environment 706. In some embodiments, computer system 700 outputs audio 754 such that user 708 perceives audio 754 as being generated from a specific location within physical environment 706 (e.g., a location different from the location of computer system 700), such as by using HRTF filters and / or crosstalk cancellation techniques. For example, in some embodiments, computer system 700 outputs audio 754 such that user 708 perceives audio 754 as being generated from a direction to the right of user 708 and / or computer system 700 within physical environment 706. Thus, user 708's attention is drawn to a location within physical environment 706 associated with the direction in which prompt 744 induces user 708 to move head 708b. In some embodiments, audio 754 includes a continuous output of sounds that prompt user 708 to move head 708b in a direction to the right of user 708 and / or computer system 700. In some embodiments, audio 754 includes audio bursts and / or intermittent sound outputs generated at predetermined time intervals. In some embodiments, audio 754 includes different audio characteristics compared to audio 748 to indicate that user 708's head 708b has moved relative to computer system 700 and / or that user 708's head 708b and / or computer system 700 are oriented in a target orientation relative to each other. For example, in some embodiments, audio 754 includes increased volume and / or a different amount of reverberation compared to audio 748 to provide audible feedback that enables user 708 to confirm that the movement of head 708b (and / or computer system 700) matches the movement associated with prompt 744.In some embodiments, computer system 700 is configured to adjust audio 748 and / or audio 754 based on movement of user 708's head 708b and / or face 708c relative to computer system 700 along axis 746a, 746b, and / or axis 746c. In some embodiments, computer system 700 reduces the volume of audio 748 based on detection of movement of head 708b and / or face 708c along axis 746b and / or axis 746c because such movement is not in the direction of movement associated with prompt 744.

[0219] In some embodiments, the audio 754 includes different components and / or portions that facilitate guiding the user 708 to move the head 708b and / or the face 708c relative to the computer system 700. For example, in some embodiments, the audio 754 includes a first portion 754a corresponding to the position of the head 708b and / or the face 708c of the user 708 relative to the computer system 700 within the physical environment 706, and a second portion 754b corresponding to the location and / or position of the computer system 700 (e.g., the sensor 734 and / or another sensor of the computer system 700) within the physical environment 706. In some embodiments, both the first portion 754a and the second portion 754b of the audio 754 include repetitive audio effects such that the first portion 754a and the second portion 754b loop continuously for at least a predetermined amount of time (e.g., until the respective positions of the head 708b, the face 708c, and / or the computer system 700 are in a target orientation relative to each other). In some embodiments, the first portion 754a includes one or more first musical notes, the second portion 754b includes one or more second musical notes, and the one or more first musical notes and the one or more second musical notes are spaced apart from each other by a harmonically significant amount such as an integer octave. In some embodiments, the computer system 700 adjusts the volume of the first portion 754a and / or the second portion 754b relative to each other based on the movement of the head 708b, the face 708c, and / or the computer system 700 relative to each other within the physical environment 706.

[0220] In FIG. 7H, the computer system 700 outputs haptic feedback 755 to indicate the amount of progress towards moving the head 708b of the user 708 to a target orientation relative to the computer system 700 and / or to further prompt the user 708 to move the head 708b in a direction along the axis 746a to the right of the user 708 within the physical environment 706.

[0221] As described above, in some embodiments, computer system 700 is an HMD and display 736 is an external display of a different and / or separate HMD from display 704. In other words, display 736 is configured to be viewable by user 708 while the HMD is not worn on user 708's head 708b. In some embodiments, prompt 744 and / or progress indicator 750 are displayed on display 736 of the HMD.

[0222] In FIG. 7I, the computer system 700 detects that the head 708b and / or face 708c of the user 708 has moved further in the direction along the axis 746a. For example, the head 708b and / or face 708c of the user 708 is moving (e.g., rotating) relative to the computer system 700 within the physical environment 706 (e.g., the position of the computer system 700 is maintained at location 706c). Based on detecting additional movement of the head 708b and / or face 708c of the user 708 in the direction along the axis 746a, the computer system 700 increases the size of the progress indicator 750 such that the progress indicator 750 is displayed across the entire display area of the display 736 (e.g., the progress indicator 750 is displayed in the first portion 752a and the second portion 752b of the display 736). In some embodiments, when the computer system 700 detects that the head 708b and / or face 708c of the user 708 has moved in the wrong direction along the axis 746a, has moved along a different axis (e.g., axis 746b and / or axis 746c), and / or has not moved, the computer system 700 updates the display of the progress indicator 750 accordingly. For example, in some embodiments, when the computer system 700 detects that the head 708b and / or face 708c of the user 708 has moved in the wrong direction along the axis 746a, the computer system 700 reduces the size of the progress indicator 750 (e.g., reduces the size of the first portion 752a of the display 736 relative to the second portion 752b of the display 736). In some embodiments, when the computer system 700 detects that the head 708b and / or face 708c of the user 708 has moved along a different axis (e.g., axis 746b and / or axis 746c) and / or has not moved along the axis 746a, the computer system 700 maintains the size of the progress indicator 750 (e.g., maintains the display of the progress indicator 750 as shown in FIG. 7H).

[0223] In FIG. 7I, the computer system 700 displays a confirmation indicator 756 and does not display a prompt 744 (e.g., the computer system 700 replaces the display of the prompt 744 with the display of the confirmation indicator 756). The confirmation indicator 756 includes a checkmark that provides the user 708 with a visual confirmation that the user 708 has moved the head 708b, face 708c, and / or the computer system 700 relative to each other into a target orientation (e.g., the user 708 is satisfied with the execution of an action associated with the prompt 744 (e.g., movement of the head 708b)).

[0224] In FIG. 7I, based on detecting that the user 708 has moved the head 708b, face 708c, and / or the computer system 700 relative to each other into a target orientation, the computer system 700 outputs audio 758. In some embodiments, the audio 758 includes an audio output that includes audio that confirms that the head 708b, face 708c, and / or the computer system 700 are in a target orientation relative to each other. In some embodiments, the audio 758 includes audio having a first tone, pitch, frequency, wavelength, melody, and / or harmony. The audio 758 is configured to be output by the computer system 700 to provide the user 708 with a non-visual confirmation that the user 708 has completed a step of a process (e.g., a step associated with the prompt 744) for capturing information about the user 708. Thus, the audio 758 enables the user 708 to confirm that the user 708 no longer needs to move the user 708's head 708b when the user 708 cannot easily see and / or visually recognize the display 736 of the computer system 700.

[0225] In some embodiments, in response to detecting that the head 708b, the face 708c, and / or the computer system 700 are oriented in a target orientation relative to each other, the computer system 700 outputs audio 758 having a first portion 754a, a second portion 754b, and a third portion 758a. In some embodiments, the third portion 758a aurally confirms that the head 708b, the face 708c, and / or the computer system 700 are oriented in a target orientation relative to each other. In some embodiments, the third portion 758a includes one or more third notes that are separated from one or more first notes of the first portion 754a and one or more second notes of the second portion 754b by a harmonically significant amount, such as an integer number of octaves.

[0226] In some embodiments, the audio 758 is the same as the audio 742, such that the computer system 700 provides the same audio feedback after completion of different steps of a process for capturing information about the user 708. In some embodiments, the computer system 700 is configured to output a progression and / or confirmation audio melody and / or harmony sequence that changes upon completion of subsequent steps of a process for capturing information about the user 708. For example, in some embodiments, the audio 742 includes a first set of notes, the audio 758 includes a second set of notes, and the second set of notes includes the first set of notes and additional notes that are harmonically and / or melodically subsequent to the first set of notes.

[0227] In FIG. 7I, computer system 700 outputs haptic feedback 759 based on detecting that user 708 has moved head 708b, face 708c, and / or computer system 700 relative to each other into a target orientation. Haptic feedback 759 is output by computer system 700 and is configured to provide user 708 with a non-visual confirmation that user 708 has completed a step of a process for capturing information about user 708 (e.g., a step associated with prompt 744). Thus, haptic feedback 759 enables user 708 to confirm that user 708 no longer needs to move head 708b of user 708 when user 708 cannot easily see and / or view display 736 of computer system 700.

[0228] As described above, in some embodiments, computer system 700 is an HMD and display 736 is an external display of a different and / or separate HMD from display 704. In other words, display 736 is configured to be viewable by user 708 while the HMD is not worn on head 708b of user 708. In some embodiments, prompt 744, progress indicator 750, and / or confirmation indicator 756 are displayed on display 736 of the HMD.

[0229] In FIG. 7J, after the computer system 700 displays a progress indicator 750 that covers the entire display area of the display 736, it then displays a confirmation indicator 760. In FIG. 7J, the confirmation indicator 760 includes a color different from the color of the progress indicator 750, as indicated by the second hatching in FIG. 7J. In some embodiments, the confirmation indicator 760 includes a blinking animation output by the computer system 700. For example, in some embodiments, the confirmation indicator 760 includes an increased brightness compared to the progress indicator 750 and / or white that is displayed for a predetermined amount of time such that the display 736 appears to be blinking. The confirmation indicator 760 further provides the user 708 with confirmation that the step of the process for the computer system 700 to capture information about the user 708 has been completed, and enables the user 708 to prepare for the next step of the process for the computer system 700 to capture information about the user 708.

[0230] In FIG. 7J, the computer system 700 outputs audio 762. In some embodiments, the audio 762 is the same as the audio 758, and the computer system 700 maintains the output of the audio 758 while the confirmation indicator 760 is being displayed. In some embodiments, the audio 762 is different from the audio 758 and includes one or more different audio characteristics (e.g., different volume levels and / or different amounts of reverberation) compared to the audio 758. In FIG. 7J, the computer system 700 outputs a tactile feedback 764 to further provide the user 708 with a non-visual confirmation that the current step of the process for the computer system 700 to capture information about the user 708 has been completed.

[0231] As described above, in some embodiments, computer system 700 is an HMD, and display 736 is an external display of a different and / or separate HMD from display 704. In other words, display 736 is configured to be viewable by user 708 while the HMD is not worn on user 708's head 708b. In some embodiments, confirmation indicator 756 and / or confirmation indicator 760 are displayed on display 736 of the HMD.

[0232] After displaying confirmation indicator 760, outputting audio 762, and / or outputting haptic feedback 764, computer system 700 initiates the next step of the process for capturing information about user 708. In FIG. 7K, computer system 700 displays a prompt 766 that guides user 708 to move head 708b in a predetermined direction within physical environment 706. Prompt 766 includes text 766a that urges user 708 to move head 708b in a direction along axis 746a that is to the left of user 708, including written guidance and / or instructions. In FIG. 7K, prompt 766 includes an arrow 766b that points in the direction along axis 746a that is to the left of user 708 (e.g., from a perspective view of user 708 looking at display 736). In some embodiments, prompt 766 includes other visual elements in addition to or instead of text 766a and / or arrow 766b. For example, in some embodiments, prompt 766 includes a representation of a person (e.g., an avatar) moving their head to the left to demonstrate the step for capturing information about user 708's head 708b and / or face 708c associated with prompt 766. In some embodiments, the representation of the person moving their head is an animation, a series of images, and / or a video that shows the person moving their head to the left over time.

[0233] In FIG. 7K, computer system 700 further prompts user 708 to move head 708b in a direction along axis 746a to the left of user 708 within physical environment 706 by outputting audio 768. In some embodiments, computer system 700 outputs audio 768 such that user 708 perceives audio 768 as being generated from a particular location within physical environment 706 (e.g., a location different from the location of computer system 700), such as by using HRTF filters and / or crosstalk cancellation techniques. For example, in some embodiments, computer system 700 outputs audio 768 such that user 708 perceives audio 768 as being generated from a direction to the left of user 708 and / or computer system 700 within physical environment 706. Thus, the attention of user 708 is drawn to a location within physical environment 706 associated with the direction in which prompt 766 induces user 708 to move head 708b. In some embodiments, audio 768 includes a continuous output of sounds that prompt user 708 to move head 708b in a direction to the left of user 708 and / or computer system 700. In some embodiments, audio 768 includes an audio burst and / or an intermittent output of sounds generated at predetermined time intervals. As described above, in some embodiments, computer system 700 is configured to adjust audio 768 based on movement of head 708b and / or face 708c of user 708 relative to computer system 700 (e.g., sensor 734 of computer system 700).

[0234] In some embodiments, after the computer system 700 detects movement of the head 708b, face 708c, and / or the computer system 700 in a direction along axis 746a to the left of the user 708 such that the computer system 700 is in a target orientation relative to each other, the computer system 700 displays an additional prompt to guide the user 708 to complete additional steps of a process for capturing information about the user 708. In some embodiments, the computer system 700 displays and / or outputs a prompt to guide the user 708 to move the head 708b and / or face 708c of the user 708 along a second axis 746b and / or a third axis 746c so that the computer system 700 can capture additional information about the head 708b and / or face 708c of the user 708. For example, in some embodiments, the computer system 700 displays and / or outputs one or more prompts to guide the user 708 to move the head 708b and / or face 708c upward (e.g., along axis 746b), downward (e.g., along axis 746b), forward (e.g., along axis 746c), and / or backward (e.g., along axis 746c). In some embodiments, the computer system 700 displays and / or outputs one or more prompts to guide the user 708 to move the head 708b and / or face 708c in more than three directions relative to the computer system 700. In some embodiments, the computer system 700 outputs audio feedback based on movement of the head 708b and / or face 708c of the user along different axes and / or in different directions relative to the computer system 700. In some embodiments, the computer system 700 adjusts one or more audio characteristics of the audio feedback when the head 708b and / or face 708c moves along different axes and / or in different directions relative to the computer system 700 towards one or more target orientations relative to the computer system 700.

[0235] As described above, in some embodiments, computer system 700 is an HMD and display 736 is an external display of a different and / or separate HMD from display 704. In other words, display 736 is configured to be viewable by user 708 while the HMD is not worn on user 708's head 708b. In some embodiments, prompt 766 is displayed on display 736 of the HMD.

[0236] After computer system 700 displays prompt 766 (and, optionally, one or more additional prompts) and determines that the respective positions of head 708b, face 708c, and / or computer system 700 are in a target orientation relative to each other, computer system 700 begins the next step of the process for capturing information about user 708. For example, in FIG. 7L, computer system 700 displays prompt 770 that induces user 708 to perform one or more actions associated with another step of the process for capturing information about user 708. For example, in FIG. 7L, the steps of the process for capturing information about user 708 include capturing the expression of user 708.

[0237] In FIG. 7L, prompt 770 includes text 770a and countdown 770b. Text 770a provides visual written guidance for user 708 to create one or more faces and / or facial expressions so that computer system 700 can capture additional information about user 708's face 708c. In some embodiments, text 770a of prompt 770 includes general guidance for creating one or more expressions, and the general guidance does not prompt user 708 to create a specific expression. In some embodiments, text 770a of prompt 770 includes guidance for user 708 to create one or more specific and / or particular expressions, such as a closed-mouth smile, an open-mouth smile, and / or a raised-eyebrow expression.

[0238] In FIG. 7L, the prompt 770 includes a countdown 770b, which provides an indication regarding the time at which the computer system 700 (e.g., sensor 734) is configured to start capturing information regarding the features of the user 708's face (e.g., one or more physical features of face 708c). In some embodiments, the computer system 700 is configured to animate the countdown 770b such that the appearance of the countdown 770b changes over time. For example, the computer system 700 changes the appearance of the countdown 770b to count down from a predetermined time (e.g., 6 seconds) to zero remaining time. In some embodiments, the computer system 700 adjusts and / or updates the appearance of the visual indicator 770c of the countdown 770b to increase and / or decrease the fill amount as the countdown 770b counts down to zero remaining time. The countdown 770b enables the user 708 to prepare to make an expression before the computer system 700 starts capturing information regarding the user 708's face 708c. Thus, the computer system 700 can capture information regarding the user 708's face 708c more quickly and efficiently, thereby reducing battery usage.

[0239] In FIG. 7L, while displaying the prompt 770, the computer system 700 outputs audio 772. In some embodiments, the audio 772 includes one or more audio characteristics that induce the user 708 to make one or more expressions. In some embodiments, the audio 772 includes sounds having audio that instructs the user 708 to make one or more expressions and / or to make a particular predetermined expression. In some embodiments, the audio 772 includes an audio burst that occurs when the countdown 770b counts down from a predetermined amount of time to zero remaining time.

[0240] As described above, in some embodiments, computer system 700 is an HMD, and display 736 is an external display of a different and / or separate HMD from display 704. In other words, display 736 is configured to be viewable by user 708 while the HMD is not worn on user 708's head 708b. In some embodiments, prompt 770 is displayed on display 736 of the HMD.

[0241] In FIG. 7M, computer system 700 stops displaying countdown 770b and displays progress bar 770d on prompt 770 when countdown 770b reaches zero remaining time. Progress bar 770d provides a visual indication to user 708 of the amount of progress towards completing the capture of information regarding features of user 708's face (e.g., one or more physical features of face 708c). Computer system 700 is configured to adjust and / or update the appearance of progress bar 770d based on whether features of user 708's face (e.g., the expressions user 708 makes within physical environment 706) correspond and / or match one or more predetermined expressions.

[0242] In FIG. 7M, computer system 700 outputs audio 774. In some embodiments, audio 774 is the same as audio 772. In some embodiments, audio 774 includes sounds having audio that induces user 708 to make one or more predetermined and / or specific expressions. In some embodiments, audio 774 includes sounds indicative of the type of expression user 708 makes. For example, in some embodiments, computer system 700 outputs audio 774 that includes laughter, thereby prompting user 708 to make a smiling face and / or laugh.

[0243] In FIG. 7M, computer system 700 has not detected that the features of user 708's face (e.g., one or more physical features of face 708c) correspond to and / or match one or more expressions. Thus, computer system 700 displays progress bar 770d as unfilled (e.g., as shown without hatching within progress bar 770d in FIG. 7M) and / or as indicating that no progress has been made towards completing one or more expressions. In FIG. 7M, user 708 adjusts and / or moves face 708c such that user 708 is making a first expression within physical environment 706 (e.g., user 708 has opened mouth 708d and / or is making an open-mouth expression (e.g., an open-mouth smile)).

[0244] In response to detecting that user 708 is making a first expression within physical environment 706 (e.g., based on information received from sensor 734 and / or another sensor of computer system 700), computer system 700 displays (e.g., updates its display of) progress bar 770d with a first fill amount 770e as shown in FIG. 7N. In FIG. 7N, first fill amount 770e includes a first color as shown by first hatching. Additionally, in FIG. 7N, first fill amount 770e is included in first portion 776a of progress bar 770d but not in second portion 776b of progress bar 770d. In some embodiments, first fill amount 770e of progress bar 770d is an amount corresponding to completion of the first expression of one or more expressions. In some embodiments, computer system 700 animates and / or otherwise displays the filling of progress bar 770d when computer system 700 detects that user 708 is making a first expression within physical environment 706.

[0245] In some embodiments, the computer system 700 is configured to fill the progress bar 770d at different speeds (e.g., increase the amount of filling of the progress bar 770d over different amounts of time) based on whether what the first expression user 708 is doing within the physical environment 706 corresponds to and / or matches a predetermined expression. For example, in some embodiments, the computer system 700 displays the progress bar 770d as filling at a first speed when the first expression that the user 708 is doing within the physical environment 706 corresponds to and / or matches a first predetermined expression (e.g., the first expression among one or more expressions). In some embodiments, the computer system 700 displays the progress bar 770d as filling at a second speed (e.g., a non-zero filling speed) slower than the first speed when the first expression that the user 708 is doing within the physical environment 706 does not correspond to and / or match a predetermined expression (e.g., at least one expression among one or more expressions). The illustrated axes 778a - 778b are provided for clarity and are not part of the user interface of the computer system 700. In some embodiments, the progress bar 770d extends along the axis 778a based on the perspective view and / or viewpoint of the user 708 looking at the display 736. Thus, in some embodiments, the progress bar 770d includes one or more portions that are not visible to the user because one or more portions extend along the axis 778a. In some embodiments, the computer system 700 displays the progress bar 770d as filling the one or more portions that extend along the axis 778a at a slower speed compared to filling one or more additional portions of the progress bar 770d that do not extend along the axis 778a (e.g., extend along the axis 778b). In other words, the portions of the progress bar 770d that extend along the axis 778b are displayed as filling at a faster speed than the one or more portions that extend along the axis 778a.

[0246] As described above, in some embodiments, computer system 700 is an HMD, and display 736 is an external display of a different and / or separate HMD from display 704. In other words, display 736 is configured to be viewable by user 708 while the HMD is not worn on user 708's head 708b. In some embodiments, prompt 770 and / or progress bar 770d are displayed on display 736 of the HMD.

[0247] In FIG. 7N, computer system 700 outputs audio 780. In some embodiments, audio 780 is the same as audio 772 and / or audio 774. In some embodiments, audio 780 includes sounds having audio that induces user 708 to make one or more predetermined and / or specific expressions. In some embodiments, audio 780 includes sounds indicative of the type of expression user 708 makes. For example, in some embodiments, computer system 700 outputs audio 780 that includes laughter, thereby prompting user 708 to make a smiling face and / or laugh.

[0248] In FIG. 7N, computer system 700 detects that user 708 is making a second expression within physical environment 706 (e.g., via sensor 734 and / or one or more additional sensors of computer system 700). In response to detecting that user 708 is making a second expression within physical environment 706, computer system 700 displays (e.g., updates the display of) progress bar 770d with a second fill amount 770f to indicate the amount of progress that user 708 has made toward completing making one or more expressions, as shown in FIG. 7O. In FIG. 7O, second fill amount 770f includes a first color, as indicated by the first hatching. In some embodiments, computer system 700 is configured to change the color of the fill within progress bar 770d as progress bar 770d is filled over time. For example, in some embodiments, computer system 700 displays progress bar 770d with a fill of a first color when the progress bar includes a first fill amount 770e, and displays progress bar 770d with a fill of a second color when the progress bar includes a second fill amount 770f and / or a fill amount greater than second fill amount 770f.

[0249] As described above, in some embodiments, computer system 700 is an HMD and display 736 is an external display of a different and / or separate HMD from display 704. In other words, display 736 is configured to be viewable by user 708 while the HMD is not worn on user 708's head 708b. In some embodiments, prompt 770 and / or progress bar 770d are displayed on display 736 of the HMD.

[0250] In FIG. 7O, the second fill amount 770f is included in the third portion 776c of the progress bar 770d, but not in the fourth portion 776d of the progress bar 770d. The third portion 776c of the progress bar 770d is larger than the first portion 776a, and the fourth portion 776d of the progress bar 770d is smaller than the second portion 776b, thereby indicating that the second expression made by the user 708 within the physical environment 706 is generating progress towards completing performing one or more expressions. In some embodiments, the second fill amount 770f of the progress bar 770d is an amount corresponding to the completion of the first expression among one or more expressions and the second expression among one or more expressions. In some embodiments, when the computer system 700 detects that the user 708 is making a second expression within the physical environment 706, the computer system 700 animates and / or otherwise displays the filling of the progress bar 770d (e.g., the filling from the first fill amount 770e to the second fill amount 770f).

[0251] As described above, in some embodiments, the computer system 700 is configured to fill the progress bar 770d at various speeds based on detecting the facial features of the user 708. For example, in FIG. 7O, the difference between the second fill amount 770f and the first fill amount 770e is smaller than the difference between the first fill amount 770e and no filling within the progress bar 770d (as shown, for example, in FIG. 7M). Thus, in some embodiments, the computer system 700 detects that the second expression made by the user 708 within the physical environment 706 does not fully and / or entirely correspond to a predetermined expression among one or more expressions. Thus, in some embodiments, when the expression made by the user 708 does not fully and / or entirely correspond to a predetermined expression among one or more expressions, the computer system 700 displays the progress bar 770d as having less filling and / or filling at a slower speed.

[0252] In FIG. 7O, the computer system outputs audio 782. In some embodiments, audio 782 is the same as audio 772, audio 774, and / or audio 780. In some embodiments, audio 782 includes sounds having audio that induces user 708 to make one or more predetermined and / or specific expressions. In some embodiments, audio 782 includes sounds that indicate the type of expression made by user 708. For example, in some embodiments, computer system 700 outputs audio 782 that includes laughter, thereby prompting user 708 to make a smiling face and / or laugh. In some embodiments, audio 780 includes different audio characteristics compared to audio 772, audio 774, and / or audio 780. For example, in some embodiments, audio 782 includes an increased volume compared to audio 772, audio 774, and / or audio 780, indicating that user 708 is progressing towards completing making one or more expressions. In some embodiments, computer system 700 increases the volume of the audio output while displaying progress bar 770d at a rate proportional to the filling rate of progress bar 770d.

[0253] In some embodiments, computer system 700 is configured to display progress bar 770d as being fully filled (e.g., including all of progress bar 770d being filled) based on detecting that user 708 has made a predetermined number of expressions. In some embodiments, computer system 700 displays progress bar 770d as being fully filled when a threshold amount of information regarding one or more physical characteristics of user 708 has been captured while user 708 is making facial expressions within physical environment 706. In some embodiments, when computer system 700 displays progress bar 770d as being fully filled, computer system 700 outputs confirmation audio to provide user 708 with a non-visual indication that one or more expressions have been detected and / or that one or more physical characteristics of user 708's face 708c have been captured. In some embodiments, computer system 700 is configured to end and / or abort the process for capturing information regarding user 708 and / or to initiate another step of the process for capturing information regarding user 708 after displaying progress bar 770d as being full.

[0254] In some embodiments, even when the progress bar 770d is not shown as being fully filled (e.g., when the computer system 700 has not detected a predetermined number of facial expressions and / or has not captured a threshold amount of information regarding one or more physical characteristics of the user), the computer system 700 is configured to end and / or abort the process for capturing information regarding the user 708 and / or to initiate the next step of the process for capturing information regarding the user 708. For example, in some embodiments, after a predetermined amount of time has elapsed since the computer system 700 first displays the progress bar 770d, the computer system 700 ends and / or aborts the process for capturing information regarding the user 708 and / or initiates the next step of the process for capturing information regarding the user 708. In other words, when the computer system 700 determines that it is unlikely that the user 708 will complete making one or more expressions within a predetermined amount of time, the computer system 700 ends the process for capturing information regarding the user 708 and / or proceeds to the next step thereof. As described below, in some embodiments, after the computer system 700 has completed the process for capturing information regarding the user 708, the computer system 700 provides an option for the user 708 to resume the step for capturing information regarding the user 708's facial features.

[0255] As described above, in some embodiments, the computer system 700 is an HMD and the display 736 is an external display of the HMD that is different from and / or separate from the display 704. In other words, the display 736 is configured to be viewable by the user 708 while the HMD is not worn on the user 708's head 708b. In some embodiments, the prompt 770 and / or the progress bar 770d are displayed on the display 736 of the HMD.

[0256] In FIG. 7P, computer system 700 displays a representation 784 of user 708 as part of, and / or after completing, a process for capturing information about user 708. In some embodiments, representation 784 includes visual characteristics based on one or more physical characteristics of user 708 captured by computer system 700 (e.g., via sensor 734 and / or additional sensors of computer system 700). For example, in FIG. 7P, representation 784 includes a head representation 784b that includes visual characteristics based on one or more physical characteristics of head 708b of user 708 captured by computer system 700 (e.g., captured by computer system 700 while displaying prompt 744, prompt 766, and / or prompt 770). Representation 784 includes a face representation 784c that includes visual characteristics based on one or more physical characteristics of face 708c of user 708 captured by computer system 700 (e.g., captured while displaying prompt 744, prompt 766, and / or prompt 770). In other words, computer system 700 is configured to generate a representation 784 of user 708 based on one or more physical characteristics of user 708 captured during the process for capturing information about user 708 described above with reference to FIGS. 7D-7O.

[0257] In FIG. 7P, while displaying the representation 784 of user 708, computer system 700 displays confirm-selectable option 786a and redo-selectable option 786b. In some embodiments, computer system 700 is configured to confirm, set, and / or otherwise enable the representation 784 for use in a real-time communication session in response to detecting a user input (e.g., an air gesture, a tap gesture, and / or a press gesture on a hardware input device of computer system 700) that selects the confirm-selectable option 786a. In some embodiments, computer system 700 is configured to initiate (e.g., resume) a process for capturing information about user 708 in response to detecting a user input (e.g., an air gesture, a tap gesture, and / or a press gesture on a hardware input device of computer system 700) that selects the redo-selectable option 786b. Thus, computer system 700 enables user 708 to view a preview of representation 784 and determine whether the visual characteristics of representation 784 are acceptable to user 708 (e.g., whether the visual characteristics of representation 784 accurately reflect and / or resemble the physical characteristics of user 708). If user 708 determines that the visual characteristics of representation 784 are not acceptable to user 708, user 708 can cause computer system 700 to capture (e.g., recapture) information about user 708 and generate (e.g., regenerate) the representation of user 784 so that the representation of user 784 more accurately reflects and / or resembles the appearance of user 708.

[0258] In some embodiments, computer system 700 visually emphasizes confirm selectable option 786a and / or redo selectable option 786b as compared to representation 784 and displays them. For example, in some embodiments, computer system 700 displays confirm selectable option 786a and / or redo selectable option 786b such that they visually appear spaced apart in front of representation 784 (e.g., are displayed with a perceived depth less than the perceived depth of representation 784). As described above, in some embodiments, display 736 is a curved display and / or a lenticular display. Thus, in some embodiments, computer system 700 displays representation 784, confirm selectable option 786a, and / or redo selectable option 786b to appear three-dimensional with respect to the perspective of user 708 looking at display 736. Thus, in some embodiments, computer system 700 is configured to visually emphasize confirm selectable option 786a and / or redo selectable option 786b such that user 708 can easily determine whether to view the appearance of representation 784 and / or capture additional information about user 708 to adjust the visual characteristics of representation 784.

[0259] The computer system 700 is configured to animate and / or move the user 708's representation 784 over time so that the user 708 can view different portions of the representation 784 and can better determine whether the representation 784 is acceptable to the user 708. In some embodiments, the computer system 700 automatically (e.g., without user input and / or without detecting movement of the computer system 700 and / or the user 708 within the physical environment 706) displays the movement of the representation 784 over time. Thus, in some embodiments, the user 708 can view different portions of the representation 784 without moving and / or providing user input to the computer system 700.

[0260] In FIG. 7P, the computer system 700 displays a first portion 788a of the user 708's representation 784 based on the detected orientation of the user 708's head 708b, face 708c, and / or another part of the body relative to the computer system 700. For example, in FIG. 7P, the user 708 holds the computer system 700 in front of the user 708's face 708c, while the user 708's head 708b is positioned straight ahead and / or aligned with the computer system 700 within the physical environment 706. Based on detecting the orientation of the user 708's head 708b, face 708c, and / or another part of the body relative to the computer system 700, the computer system 700 displays a first portion 788a of the representation 784 (e.g., a front-facing perspective view of the representation 784) that includes a head representation 784b and a face representation 784c that are aligned and / or facing the display 736.

[0261] As described above, in some embodiments, computer system 700 is an HMD, and display 736 is an external display of a different and / or separate HMD from display 704. In other words, display 736 is configured to be viewable by user 708 while the HMD is not worn on the head 708b of user 708. In some embodiments, representation 784 is displayed on display 736 of the HMD.

[0262] In FIG. 7P, computer system 700 detects movement 790a of user 708 and / or computer system 700 relative to each other along axis 746a. In response to detecting movement 790a of user 708 and / or computer system 700, computer system 700 displays a second portion 788b of representation 784 as shown in FIG. 7Q.

[0263] In FIG. 7Q, the second portion 788b of the representation 784, unlike the first portion 788a of the representation 784, is based on the movement 790a of the user 708 and / or the computer system 700 relative to each other. As shown in FIG. 7Q, the head 708b of the user 708 is rotated to the right of the user 708 along the axis 746a within the physical environment 706 (e.g., as compared to the position of the head 708b of the user 708 shown in FIG. 7P). Based on the movement 790a of the user 708 and / or the computer system 700 relative to each other, the computer system 700 displays (e.g., updates its display) the representation 784 to include the second portion 788b. In FIG. 7Q, the second portion 788b is a three-quarter view of the representation 784 as compared to a front view of the first portion 788a of the representation 784. In some embodiments, the computer system 700 animates and / or displays the movement of the representation 784 to transition between the display of the first portion 788a of the representation and the display of the second portion 788b. In FIG. 7Q, the computer system 700 displays the second portion 788b as a mirror image representation of the user 708. In other words, the computer system 700 displays the movement of the representation 784 (e.g., the movement of the head representation 784b) in a direction 792 (e.g., the left of the representation 784) that reflects the movement 790a of the user 708 and / or the computer system 700 relative to each other.

[0264] As described above, in some embodiments, the computer system 700 is an HMD and the display 736 is an external display of a different and / or separate HMD from the display 704. In other words, the display 736 is configured to be viewable by the user 708 while the HMD is not worn on the head 708b of the user 708. In some embodiments, the representation 784 is displayed on the display 736 of the HMD.

[0265] In FIG. 7Q, computer system 700 detects movement 790b of user 708 and / or computer system 700 relative to each other along axis 746a. In response to detecting movement 790b of user 708 and / or computer system 700, computer system 700 displays a third portion 788c of representation 784, as shown in FIG. 7R.

[0266] In FIG. 7R, the third portion 788c of representation 784 is different from the first portion 788a of representation 784 and the second portion 788b of representation 784. The third portion 788c of representation 784 is based on movement 790b of user 708 and / or computer system 700 relative to each other. As shown in FIG. 7R, the head 708b of user 708 has rotated further to the right of user 708 along axis 746a within physical environment 706 (e.g., compared to the position of head 708b of user 708 shown in FIG. 7P and / or the position of head 708b of user 708 shown in FIG. 7Q). Based on movement 790b of user 708 and / or computer system 700 relative to each other, computer system 700 displays (e.g., updates its display of) representation 784 to include the third portion 788c. In FIG. 7R, the third portion 788c is a side view of representation 784 compared to a front view of the first portion 788a of representation 784 and / or a three-quarter view of the second portion 788b of representation 784. In some embodiments, computer system 700 animates and / or displays movement of representation 784 to transition between a display of the second portion 788b of representation 784 and a display of the third portion 788c. In FIG. 7R, computer system 700 displays the third portion 788c as a mirror image representation of user 708. In other words, computer system 700 further displays movement of representation 784 (e.g., movement of head representation 784b) in a direction 792 that reflects movement 790b of user 708 and / or computer system 700 relative to each other (e.g., to the left of representation 784).

[0267] In FIGS. 7P to 7R, the computer system 700 displays the representation 784 based on the amount of movement of the user 708 and / or the computer system 700 relative to each other. For example, the computer system 700 displays the first portion 788a (e.g., FIG. 7P) of the representation 784 based on the movement 790a, which is the first amount of movement of the user 708 and / or the computer system 700 relative to each other within the physical environment 706, and then transitions to displaying the second portion 788b (e.g., FIG. 7Q) of the representation. The computer system 700 displays the second portion 788b (e.g., FIG. 7Q) of the representation 784 based on the movement 790b, which is the second amount of movement of the user 708 and / or the computer system 700 relative to each other within the physical environment 706, and then transitions to displaying the third portion 788c (e.g., FIG. 7R) of the representation 784. Thus, the computer system 700 displays individual portions of the representation 784 based on the detected (e.g., detected via sensor 734 and / or another sensor of the computer system 700) amount of movement of the user 708 and / or the computer system 700 relative to each other within the physical environment 706.

[0268] As described above, in some embodiments, the computer system 700 is an HMD, and the display 736 is an external display of a different and / or separate HMD from the display 704. In other words, the display 736 is configured to be viewable by the user 708 while the HMD is not worn on the head 708b of the user 708. In some embodiments, the representation 784 is displayed on the display 736 of the HMD.

[0269] In FIG. 7R, the computer system 700 detects the movement 790c of the user 708 and / or the computer system 700 relative to each other along the axis 746a in a direction opposite to the movement 790a and / or the movement 790b. In response to detecting the movement 790c of the user 708 and / or the computer system 700, the computer system 700 displays the fourth portion 788d of the representation 784 as shown in FIG. 7S.

[0270] In FIG. 7S, the fourth portion 788d of the representation 784 is different from the first portion 788a, the second portion 788b, and the third portion 788c of the representation 784. The fourth portion 788d of the representation 784 is based on the movement 790c of the user 708 and / or the computer system 700 relative to each other. As shown in FIG. 7S, the head 708b of the user 708 is rotating to the left of the user 708 along the axis 746a within the physical environment 706 (e.g., when compared to the position of the head 708b of the user 708 shown in FIG. 7P, the position of the head 708b of the user 708 shown in FIG. 7Q, and / or the position of the head 708b of the user 708 shown in FIG. 7R). Based on the movement 790c of the user 708 and / or the computer system 700 relative to each other, the computer system 700 displays (e.g., updates its display) the representation 784 to include the fourth portion 788d. In FIG. 7S, the fourth portion 788d is a three-quarter view of the left side of the representation 784. In some embodiments, the computer system 700 animates and / or displays the movement of the representation 784 so as to transition between the display of the third portion 788c and the display of the fourth portion 788d of the representation 784. In FIG. 7S, the computer system 700 displays the fourth portion 788d as a mirror image representation of the user 708. In other words, the computer system 700 displays the movement (e.g., the movement of the head representation 784b) of the representation 784 in the direction 794 (e.g., the proxy 784) that reflects the movement 790c of the user 708 and / or the computer system 700 relative to each other.

[0271] As described above, in some embodiments, the computer system 700 is an HMD, and the display 736 is an external display of a different and / or separate HMD from the display 704. In other words, the display 736 is configured to be viewable by the user 708 while the HMD is not worn on the head 708b of the user 708. In some embodiments, the representation 784 is displayed on the display 736 of the HMD.

[0272] In FIG. 7S, computer system 700 detects a movement 790d of user 708 and / or computer system 700 relative to each other along axis 746a in the same direction as movement 790c (and opposite to the direction of movement 790a and / or movement 790b). In response to detecting the movement 790d of user 708 and / or computer system 700, computer system 700 displays a fifth portion 788e of representation 784, as shown in FIG. 7T.

[0273] In FIG. 7T, the fifth portion 788e of representation 784 is different from the first portion 788a of representation 784, the second portion 788b of representation 784, the third portion 788c of representation 784, and the fourth portion 788d of representation 784. The fifth portion 788e of representation 784 is based on the movement 790d of user 708 and / or computer system 700 relative to each other. As shown in FIG. 7T, the head 708b of user 708 is rotated further to the left of user 708 along axis 746a within the physical environment 706 (e.g., as compared to the position of the head 708b of user 708 shown in FIG. 7S). Based on the movement 790d of user 708 and / or computer system 700 relative to each other, computer system 700 displays (e.g., updates its display) representation 784 to include the fifth portion 788e. In FIG. 7T, the fifth portion 788e is a side view of the left side of representation 784. In some embodiments, computer system 700 animates and / or displays the movement of representation 784 to transition between the display of the fourth portion 788d of representation 784 and the display of the fifth portion 788e. In FIG. 7T, computer system 700 displays the fifth portion 788e as a mirror image representation of user 708. In other words, computer system 700 displays the movement of representation 784 (e.g., the movement of the head representation 784b) in a direction 794 that mirrors the movement 790d of user 708 and / or computer system 700 relative to each other (e.g., into the proxy 784).

[0274] In some embodiments, computer system 700 is configured to display movement of representation 784 that reflects movement of user 708 and / or computer system 700 relative to each other along axis 746a, axis 746b, and / or axis 746c. For example, in some embodiments, computer system 700 displays representation 784 that moves head representation 784b up and / or down based on movement of user 708's head 708b along axis 746b relative to computer system 700. In some embodiments, computer system 700 displays representation 784 that moves closer to and / or away from display 736 based on movement of user 708 along axis 746c relative to computer system 700. In some embodiments, computer system 700 is configured to display movement of representation 784 along multiple axes based on movement of user 708 along multiple axes (e.g., axes 746a, 746b, and / or 746c) relative to computer system 700.

[0275] As described above, in some embodiments, computer system 700 is an HMD and display 736 is an external display of a different and / or separate HMD from display 704. In other words, display 736 is configured to be viewable by user 708 while the HMD is not worn on user 708's head 708b. In some embodiments, representation 784 is displayed on display 736 of the HMD.

[0276] Additional explanations regarding FIGS. 7A - 7T are provided below with reference to methods 800, 900, 1000, 1100, 1200, and 1300 described with respect to FIGS. 7A - 7T.

[0277] FIG. 8 is a flow diagram of an exemplary method 800 for providing guidance to a user during a process for generating a user representation according to some embodiments. In some embodiments, method 800 is executed by a computer system (e.g., 101 and / or 700) (e.g., a smartphone, a tablet, a wristwatch, and / or a head-mounted device) that communicates with one or more display generation components (e.g., 120, 704, and / or 736) (e.g., a head-up display, a display, a touch screen, and / or a projector) (e.g., a visual output device, a 3D display, and / or a display having at least a portion that is transparent or translucent and capable of projecting an image (e.g., a see-through display), a projector, a head-up display, and / or a display controller), and optionally communicates with one or more cameras (e.g., an infrared camera, a depth camera, and / or a visible light camera). In some embodiments, method 800 is stored on a non-transitory (or transitory) computer-readable storage medium and is managed by instructions executed by one or more processors of a computer system, such as one or more processors 202 of computer system 101 (e.g., control unit 110 of FIG. 1). Some operations of method 800 are optionally combined and / or the order of some operations is optionally changed.

[0278] A registration process for generating a representation (e.g., 784) of a user (e.g., 708) (e.g., a process including capturing data (e.g., image data, sensor data, and / or depth data) indicating the size, shape, position, posture, color, depth, and / or other features of one or more body parts and / or features of the body parts of the user), (e.g., at least a partial avatar and / or virtual representation of the user), wherein the registration process includes information regarding one or more physical features of a user (e.g., 708) of a computer system (e.g., 101 and / or 700) (e.g., data representing the size, shape, position, posture, color, depth, and / or other features of one or more body parts and / or features of the body parts of the user) being captured (e.g., via one or more cameras) using a first sensor (e.g., 712 and / or 734) positioned on the same side (e.g., 710 and / or 714) of the computer system (e.g., 101 and / or 700) as a first display generation component of one or more display generation components (e.g., 120, 704, and / or 736) (e.g., the same outer surface of the computer system, the first display generation component is in a position on or within the computer system proximate to the first sensor, and / or the first display generation component is in a position on or within the computer system such that the first display generation component displays an image that appears on the outer surface of the computer system including the first sensor). During the registration process, the computer system (e.g., 101 and / or 700) prompts (802) the user (e.g., 708) of the computer system (e.g., 101 and / or 700) to move the position of the user's (e.g., 708) head (e.g., 708b) relative to the computer system (e.g., 101 and / or 700) (e.g., a visual prompt displayed by the first display generation component, an audio prompt output via a speaker of the computer system, and / or a tactile prompt) (e.g.,(A prompt that instructs and / or guides the user to move the user's head in a specific direction and / or along a specific axis with respect to the position and / or orientation of a computer system within the physical environment where the user is located). In some embodiments, the computer system (e.g., 101 and / or 700) is a head-mounted device, and the first display generation component (e.g., 120, 704, and / or 736) is a display generation component configured to be viewed by the user (e.g., 708) when the head-mounted device is not disposed on the head (e.g., 708b) of the user (e.g., 708) and / or above the eyes of the user (e.g., 708), and / or the first display generation component (e.g., 120, 704, and / or 736) is not configured to be viewed by the user (e.g., 708) when the head-mounted device is disposed on the head (e.g., 708b) of the user (e.g., 708) and / or above the eyes of the user (e.g., 708).

[0279] After prompting a user (e.g., 101) of a computer system (e.g., 101 and / or 700) to move the position of the user's (e.g., 708) head (e.g., 708b) relative to the orientation of the computer system (e.g., 708 and / or 700) (804), in accordance with a determination that information about a threshold amount of a first physical characteristic among one or more physical characteristics (e.g., a first portion of the user's face (e.g., left portion, right portion, upper portion, and / or lower portion)) has been captured using a first sensor (e.g., 712 and / or 734), the position of the user's (e.g., 708) head (e.g., 708b) moves relative to the orientation of the computer system (e.g., 101 and / or 700) (e.g., as the user moves the position of the user's head, a first sensor positioned on ...

Claims

**Claim 1** A method, in a computer system communicating with one or more display generation components, a registration process for generating a user representation, the registration process comprising using a first sensor positioned on the same side of the computer system as a first display generation component of the one or more display generation components to capture information regarding one or more physical characteristics of a user of the computer system, during the registration process, prompting the user of the computer system to move the position of the user's head relative to the orientation of the computer system; after prompting the user of the computer system to move the position of the user's head relative to the orientation of the computer system, outputting a non-visual indication confirming that information of a threshold amount regarding a first physical characteristic of the one or more physical characteristics has been captured, according to a determination that information of the threshold amount regarding the first physical characteristic has been captured using the first sensor and based on the fact that the position of the user's head has moved relative to the orientation of the computer system. **Claim 2** The method according to claim 1, wherein prompting the user of the computer system to move the position of the user's head relative to the computer system comprises displaying a text indication via the first display generation component. **Claim 3** The method according to claim 1 or 2, wherein prompting the user of the computer system to move the position of the user's head relative to the computer system comprises displaying an arrow via the first display generation component indicating the direction in which the position of the user's head is being prompted to move. **Claim 4** The method according to any one of claims 1 to 3, wherein prompting the user of the computer system to move the position of the user's head relative to the computer system comprises displaying an animated avatar via the first display generation component, the animated avatar including the head of the animated avatar that moves. **Claim 5** The method according to any one of claims 1 to 4, further comprising providing feedback indicating a detected movement of the position of the user's head relative to the orientation of the computer system towards the target position.

6. Providing the feedback indicating the detected movement of the position of the user's head relative to the orientation of the computer system towards the target position includes displaying, via the first display generation component, a portion of the first display generation component having a first color, The method according to claim 5, wherein the portion of the first display generation component increases in size as the position of the user's head relative to the orientation of the computer system approaches the target position.

7. The feedback indicating the detected movement of the position of the user's head relative to the orientation of the computer system towards the target position changes based on detecting the movement of the position of the user's head relative to the orientation of the computer system. The method according to claim 5 or 6.

8. After prompting the user of the computer system to move the position of the user's head relative to the orientation of the computer system, The method according to any one of claims 1 to 7, further comprising displaying an image of the user via the first display generation component.

9. Displaying the image of the user includes shifting the position of the image of the user via the first display generation component to prompt the user to orient the first sensor in a predetermined orientation with respect to the user. The method according to claim 8.

10. After prompting the user of the computer system to move the position of the user's head relative to the orientation of the computer system, The method according to any one of claims 1 to 9, further comprising displaying a visual indicator of the position of the user's head relative to the orientation of the computer system via the first display generation component, the visual indicator not including an image of the user.

11. The non-visual indication for confirming that information on the threshold amount regarding the first physical characteristic has been captured, the method according to any one of claims 1 to 10, includes audio feedback.

12. The audio feedback includes first audio feedback, and the method after prompting the user of the computer system to move the position of the head of the user relative to the orientation of the computer system, further includes outputting second audio feedback based on the position of the head of the user approaching a target position relative to the orientation of the computer system, the method according to claim 11.

13. after prompting the user of the computer system to move the position of the head of the user relative to the orientation of the computer system, in accordance with a determination that information on the threshold amount regarding the first physical characteristic among the one or more physical characteristics has been captured using the first sensor, and based on the position of the head of the user having moved relative to the orientation of the computer system, further includes displaying, via the first display generation component, visual feedback for confirming that information on the threshold amount regarding the first physical characteristic has been captured, the method according to any one of claims 1 to 12.

14. Displaying the visual feedback for confirming that information on the threshold amount regarding the first physical characteristic has been captured includes changing the color of at least a portion of a progress indicator, the method according to claim 13.

15. Displaying the visual feedback for confirming that information on the threshold amount regarding the first physical characteristic has been captured includes displaying a blinking animation via the first display generation component, the method according to claim 13.

16. After prompting the user of the computer system to move the position of the user's head relative to the orientation of the computer system, a progress indicator indicating the detected movement of the position of the user's head relative to the orientation of the computer system towards a target position is displayed via the first display generation component, wherein the color of the progress indicator is based on the color of the physical environment in which the computer system is located, and the method according to any one of claims 1 to 15 further includes displaying the progress indicator.

17. While capturing the first physical characteristic among the one or more physical characteristics of the user of the computer system using the first sensor, an indication of the amount of progress towards completion of the capture of information regarding the first physical characteristic among the one or more physical characteristics is displayed via the first display generation component, and the method according to any one of claims 1 to 16 further includes displaying the indication.

18. Prompting the user of the computer system to move the position of the user's head relative to the computer system includes prompting the user of the computer system to move the position of the user's head in a first direction relative to the computer system, and the method After outputting the non-visual indication confirming that the information of the threshold amount regarding the first physical characteristic has been captured, further prompting the user of the computer system to move the position of the user's head in a second direction different from the first direction relative to the computer system, and the method according to any one of claims 1 to 17 further includes prompting the user.

19. The computer system prompts the user of the computer system to move the position of the user's head in three or more directions, and the method according to claim 18.

20. After outputting the non-visual indication confirming that the information of the threshold amount regarding the first physical characteristic has been captured, further prompting the user of the computer system to make one or more facial expressions, and the method according to claim 18 or 19 further includes prompting the user.

21. Prompting the user of the computer system to make the one or more expressions includes outputting a countdown indicating the time for the computer system to capture information, according to the method of claim 20.

22. Prompting the user of the computer system to make the one or more expressions includes prompting the user to make one or more common expressions, according to the method of claim 20 or 21.

23. After capturing the information regarding the one or more physical characteristics of the user, further includes displaying a preview of the user's expression via the first display generation component, where the expression is based on at least a portion of the captured information, according to the method of any one of claims 1 to 22.

24. Prompting the user of the computer system to move the position of the user's head with respect to the computer system includes displaying, via the first display generation component, a visual indication associated with the movement of the position of the user's head with respect to the computer system, The first display generation component is positioned on an outer portion of the computer system, Among the one or more display generation components, a second display generation component different from the first display generation component is a primary display generation component of the computer system while the computer system is in a normal operating mode, according to the method of any one of claims 1 to 23.

25. The first display generation component and the first sensor are positioned on a first side of the computer system, the second display generation component is positioned on a second side different from the first side of the computer system, and the second display generation component is configured to display an augmented reality user interface, according to the method of claim 24.

26. During the registration process for generating the user's expression, further includes prompting the user of the computer system to perform one or more actions according to a determination that one or more sets of criteria are met, according to the method of any one of claims 1 to 25.

27. The method of claim 26, wherein the one or more actions include moving to a physical environment having at least a threshold amount of illumination.

28. The method of claim 26 or 27, wherein the one or more actions include moving the user's hair away from the user's face.

29. The method according to any one of claims 26 to 28, wherein the one or more actions include positioning the user's face in a predetermined orientation with respect to the computer system.

30. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system in communication with one or more display generation components, the one or more programs including instructions for performing the method according to any one of claims 1 to 29.

31. A computer system configured to communicate with one or more display generation components, the computer system comprising one or more processors, and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method according to any one of claims 1 to 29.

32. A computer system configured to communicate with one or more display generation components, the computer system comprising means for performing the method according to any one of claims 1 to 29.

33. A computer program product including one or more programs configured to be executed by one or more processors of a computer system in communication with one or more display generation components, the one or more programs including instructions for performing the method according to any one of claims 1 to 29.

34. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system in communication with one or more display generation components, the one or more programs A registration process for generating a user's representation, the registration process using a first display generation component among the one or more display generation components and a first sensor positioned on the same side of the computer system as the computer system to capture information regarding one or more physical characteristics of the user of the computer system, and during the registration process, prompting the user of the computer system to move the position of the user's head relative to the orientation of the computer system, After prompting the user of the computer system to move the position of the user's head relative to the orientation of the computer system, Outputting a non-visual indication to confirm that information regarding a threshold amount of a first physical characteristic among the one or more physical characteristics has been captured, according to a determination that the information regarding the threshold amount of the first physical characteristic has been captured using the first sensor and based on the fact that the position of the user's head has moved relative to the orientation of the computer system. A non-transitory computer-readable storage medium containing instructions.

35. A computer system configured to communicate with one or more display generation components, the computer system comprising: One or more processors; A memory storing one or more programs configured to be executed by the one or more processors, the one or more programs comprising: A registration process for generating a user's representation, the registration process using a first display generation component among the one or more display generation components and a first sensor positioned on the same side of the computer system as the computer system to capture information regarding one or more physical characteristics of the user of the computer system, and during the registration process, prompting the user of the computer system to move the position of the user's head relative to the orientation of the computer system, After prompting the user of the computer system to move the position of the user's head relative to the orientation of the computer system, A computer system including an instruction to output a non-visual indication to confirm that information on a threshold amount related to a first physical characteristic among the one or more physical characteristics has been captured, according to a determination that the information on the threshold amount related to the first physical characteristic has been captured using the first sensor, and based on the fact that the position of the user's head has moved relative to the orientation of the computer system.

36. A computer system configured to communicate with one or more display generation components, the computer system comprising: A registration process for generating a representation of a user, the registration process including, during the registration process, using a first sensor positioned on the same side of the computer system as a first display generation component among the one or more display generation components to capture information on one or more physical characteristics of the user of the computer system, and means for prompting the user of the computer system to move the position of the head relative to the orientation of the computer system; After prompting the user of the computer system to move the position of the head relative to the orientation of the computer system, Means for outputting a non-visual indication to confirm that information on the threshold amount related to the first physical characteristic has been captured, according to a determination that information on the threshold amount related to the first physical characteristic has been captured using the first sensor, and based on the fact that the position of the user's head has moved relative to the orientation of the computer system.

37. A computer program product including one or more programs configured to be executed by one or more processors of a computer system communicating with one or more display generation components, the one or more programs comprising: A registration process for generating a user representation, the registration process including using a first display generation component among the one or more display generation components and a first sensor positioned on the same side of the computer system as the user to capture information regarding one or more physical characteristics of the user of the computer system, and during the registration process, prompting the user of the computer system to move the position of the user's head relative to the orientation of the computer system, After prompting the user of the computer system to move the position of the user's head relative to the orientation of the computer system, Outputting a non-visual indication to confirm that information of a threshold amount regarding a first physical characteristic among the one or more physical characteristics has been captured, according to a determination that information of the threshold amount regarding the first physical characteristic has been captured using the first sensor and based on the fact that the position of the user's head has moved relative to the orientation of the computer system, the computer program product including an instruction. [

38. ] A method, In a computer system communicating with one or more display generation components, Capturing information regarding one or more physical characteristics of a user of the computer system; and After capturing the information regarding the one or more physical characteristics of the user of the computer system, displaying a first portion of the user representation, wherein the one or more physical characteristics of the user representation are based on the information regarding the one or more physical characteristics of the user, without displaying a second portion of the user representation via a first display generation component among the one or more display generation components; and Detecting a change in the orientation of the computer system with respect to the user of the computer system while displaying the first portion of the user representation without displaying the second portion of the user representation via the first display generation component. In response to detecting the change in the orientation of the computer system with respect to the user of the computer system, displaying, via the first display generation component among the one or more display generation components, a second portion of the user's expression that is different from the first portion of the user's expression, a method.

39. The method according to claim 38, further comprising displaying an animation of a transition between displaying the first portion of the user's expression and displaying the second portion of the user's expression via the first display generation component in response to detecting the change in the orientation of the computer system with respect to the user of the computer system.

40. In response to detecting the change in the orientation of the computer system with respect to the user of the computer system, In accordance with a determination that the change in the orientation of the computer system with respect to the user of the computer system includes a rotation along a first axis, displaying, via the first display generation component, the user's expression moving in a first direction; The method according to claim 38 or 39, further comprising displaying, via the first display generation component, the user's expression moving in a second direction different from the first direction in accordance with a determination that the change in the orientation of the computer system with respect to the user of the computer system includes a rotation along a second axis different from the first axis.

41. In response to detecting the change in the orientation of the computer system with respect to the user of the computer system, In accordance with a determination that the change in the orientation of the computer system with respect to the user of the computer system includes a rotation in a third direction along a third axis, displaying, via the first display generation component, the user's expression moving in a fourth direction. In accordance with the determination that the change in the orientation of the computer system with respect to the user of the computer system includes a rotation in a fifth direction along the third axis, displaying, via the first display generation component, the representation of the user moving in a sixth direction different from the fourth direction, the method according to any one of claims 38 to 40, further comprising.

42. In response to detecting the change in the orientation of the computer system with respect to the user of the computer system, In accordance with the determination that the change in the orientation of the computer system with respect to the user of the computer system includes a first amount of movement, displaying, via the first display generation component, the representation of the user moving by a first amount, In accordance with the determination that the change in the orientation of the computer system with respect to the user of the computer system includes a second amount of movement different from the first amount of movement, displaying, via the first display generation component, the representation of the user moving by a second amount different from the first amount, the method according to any one of claims 38 to 41, further comprising.

43. Detecting a first user input corresponding to a selection of a first selectable option for viewing the appearance of the representation of the user while displaying the first portion of the representation of the user without displaying the second portion of the representation of the user, In response to detecting the first user input corresponding to the selection of the first selectable option, viewing the appearance of the representation of the user, the method according to any one of claims 38 to 42, further comprising.

44. The method according to claim 43, wherein the first user input corresponds to a hardware input device that communicates with the computer system.

45. Detecting a second user input corresponding to a selection of a second selectable option for capturing second information regarding one or more physical characteristics of the user of the computer system while displaying the first portion of the representation of the user without displaying the second portion of the representation of the user, In response to detecting the second user input corresponding to the selection of the second selectable option, starting a process for capturing second information regarding the one or more physical characteristics of the user of the computer system, the method according to any one of claims 38 to 44, further comprising.

46. The method according to claim 45, wherein the second user input corresponds to a hardware input device that communicates with the computer system.

47. Displaying the first portion of the user's expression without displaying the second portion of the user's expression includes displaying one or more selectable options associated with constructing the user's expression, The method according to any one of claims 38 to 46, wherein the one or more selectable options are displayed so as to appear to be positioned in front of the user's expression.

48. Displaying the first portion of the user's expression without displaying the second portion of the user's expression includes displaying text associated with the user's expression, The method according to any one of claims 38 to 47, wherein the text is displayed so as to appear to be positioned in front of the user's expression.

49. The method according to any one of claims 38 to 48, wherein the first display generation component is a lenticular display configured to display the user's expression having a three-dimensional effect.

50. The method according to claim 49, wherein the first display generation component is a curved surface display.

51. Capturing the information regarding the one or more physical characteristics of the user of the computer system includes capturing the information regarding the one or more physical characteristics of the user of the computer system via one or more sensors that communicate with the computer system, The method according to any one of claims 38 to 50, wherein the one or more sensors are configured to capture the information regarding the one or more physical characteristics of the user of the computer system while the first display generation component is visible to the user of the computer system.

52. After displaying the first part of the user's expression without displaying the second part of the user's expression, and without detecting the change in the orientation of the computer system with respect to the user of the computer system, via the first display generation component, further comprising displaying a third part of the user's expression that is different from the first part of the user's expression, the method according to any one of claims 38 to 51.

53. While displaying the second part of the user's expression without displaying the fourth part of the user's expression via the first display generation component, detecting a change in the orientation of the head and / or face of the user of the computer system with respect to the computer system; In response to detecting the change in the orientation of the head and / or face of the user of the computer system with respect to the computer system, displaying a fourth part of the user's expression that is different from the second part of the user's expression via the display generation component, the method according to any one of claims 38 to 52.

54. While displaying the second part of the user's expression without displaying the fifth part of the user's expression via the first display generation component, detecting a change in the posture of one or more facial features of the user of the computer system; In response to detecting the change in the posture of one or more facial features of the user of the computer system, displaying a fifth part of the user's expression that is different from the second part of the user's expression via the display generation component, the method according to any one of claims 38 to 53.

55. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system communicating with one or more display generation components, the one or more programs including instructions for performing the method according to any one of claims 38 to 54.

56. A computer system configured to communicate with one or more display generation components, the computer system comprising One or more processors and, a memory storing one or more programs configured to be executed by the one or more processors, wherein the one or more programs include instructions for performing the method according to any one of claims 38 to 54, a computer system.

57. A computer system configured to communicate with one or more display generation components, the computer system comprising means for performing the method according to any one of claims 38 to 54, a computer system.

58. Including one or more programs configured to be executed by one or more processors of a computer system communicating with one or more display generation components, the one or more programs including instructions for performing the method according to any one of claims 38 to 54, a computer program product.

59. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system communicating with one or more display generation components, the one or more programs capturing information regarding one or more physical characteristics of a user of the computer system, after capturing the information regarding the one or more physical characteristics of the user of the computer system, displaying, via a first display generation component of the one or more display generation components, a first portion of the user's representation without displaying a second portion of the user's representation, wherein the one or more physical characteristics of the user's representation are based on the information regarding the one or more physical characteristics of the user, detecting a change in the orientation of the computer system with respect to the user of the computer system while displaying the first portion of the user's representation without displaying the second portion of the user's representation via the first display generation component, A non - transitory computer - readable storage medium including instructions that, in response to detecting a change in the orientation of the computer system with respect to the user of the computer system, display, via the first display - generation component of the one or more display - generation components, a second portion of the user's expression that is different from the first portion of the user's expression.

60. A computer system configured to communicate with one or more display - generation components, the computer system comprising: one or more processors; a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs: capture information regarding one or more physical characteristics of a user of the computer system; after capturing the information regarding the one or more physical characteristics of the user of the computer system, display, via a first display - generation component of the one or more display - generation components, a first portion of the user's expression, without displaying a second portion of the user's expression, where the one or more physical characteristics of the user's expression are based on the information regarding the one or more physical characteristics of the user; while displaying the first portion of the user's expression without displaying the second portion of the user's expression via the first display - generation component, detect a change in the orientation of the computer system with respect to the user of the computer system; A computer system including instructions that, in response to detecting a change in the orientation of the computer system with respect to the user of the computer system, display, via the first display - generation component of the one or more display - generation components, a second portion of the user's expression that is different from the first portion of the user's expression.

61. A computer system configured to communicate with one or more display - generation components, the computer system comprising: means for capturing information regarding one or more physical characteristics of a user of the computer system; After capturing information regarding one or more physical characteristics of the user of the computer system, via a first display generation component among the one or more display generation components, without displaying a second portion of the user's representation, a means for displaying a first portion of the user's representation, wherein one or more physical characteristics of the user's representation are based on the information regarding the one or more physical characteristics of the user; A means for detecting a change in the orientation of the computer system with respect to the user of the computer system while displaying the first portion of the user's representation without displaying the second portion of the user's representation via the first display generation component; A means for displaying a second portion of the user's representation different from the first portion of the user's representation via the first display generation component among the one or more display generation components in response to detecting the change in the orientation of the computer system with respect to the user of the computer system. A computer system comprising:

62. A computer program product including one or more programs configured to be executed by one or more processors of a computer system communicating with one or more display generation components, the one or more programs comprising: Capturing information regarding one or more physical characteristics of a user of the computer system; After capturing information regarding one or more physical characteristics of the user of the computer system, via a first display generation component among the one or more display generation components, without displaying a second portion of the user's representation, a means for displaying a first portion of the user's representation, wherein one or more physical characteristics of the user's representation are based on the information regarding the one or more physical characteristics of the user; Detecting a change in the orientation of the computer system with respect to the user of the computer system while displaying the first portion of the user's representation without displaying the second portion of the user's representation via the first display generation component; A computer program product including instructions to display, via the first display generation component among the one or more display generation components, a second portion of the user's representation that is different from the first portion of the user's representation, in response to detecting a change in the orientation of the computer system with respect to the user of the computer system. [

63. ] A method comprising: In a computer system communicating with one or more display generation components, A registration process for generating a user representation, the registration process including capturing information regarding one or more physical characteristics of a user of the computer system, and prior to the registration process, outputting a plurality of indications for guiding the user of the computer system to capture information regarding one or more physical characteristics of the user of the computer system, wherein outputting the plurality of indications includes: Outputting a first indication corresponding to a first step of a process including capturing the information regarding the one or more physical characteristics of the user of the computer system, the first indication including displaying, via a first display generation component among the one or more display generation components, first three-dimensional content associated with the first step; After outputting the first indication, outputting a second indication corresponding to a second step of the process for capturing the information regarding the one or more physical characteristics of the user of the computer system, the second step being different from the first step, the second indication including displaying, via the first display generation component among the one or more display generation components, second three-dimensional content associated with the second step, the second step being performed after the first step in the registration process. [

64. ] The method according to claim 63, wherein the first three-dimensional content and / or the second three-dimensional content includes spatially captured content. [

65. ] The method according to claim 63 or 64, wherein the first three-dimensional content and / or the second three-dimensional content includes content captured three-dimensionally. **Claim 66** The method according to any one of claims 63 to 65, wherein the first three-dimensional content and / or the second three-dimensional content includes a recording of a person demonstrating the registration process. **Claim 67** Outputting the plurality of indications for providing guidance to the user of the computer system to capture information regarding one or more physical characteristics of the user of the computer system includes outputting a first audio that is substantially the same as a second audio configured to be output during the registration process. The method according to any one of claims 63 to 66. **Claim 68** The first audio includes a first portion associated with the first step and a second portion associated with the second step. The first portion and the second portion of the first audio are different from each other. The second audio includes a third portion that is substantially the same as the first portion and a fourth portion that is substantially the same as the second portion. The method according to claim 67. **Claim 69** The computer system is a wearable device, and the method further includes prompting the user of the computer system to remove the computer system from the user's body after outputting the plurality of indications for providing guidance to the user of the computer system to capture information regarding one or more physical characteristics of the user of the computer system. The method according to any one of claims 63 to 68. **Claim 70** The first display generation component is an internal display generation component of the computer system. A second display generation component among the one or more display generation components is an external display generation component of the computer system. The method according to any one of claims 63 to 69, wherein the second display generation component is configured to display one or more prompts during the registration process. **Claim 71** The first three-dimensional content associated with the first step represents the first stage of the registration process. ​ The method according to any one of claims 63 to 70, wherein the second three-dimensional content associated with the second step represents a second stage of the registration process, which is different from the first stage of the registration process.

72. The plurality of indications for providing the user of the computer system with guidance for capturing information regarding one or more physical characteristics of the user of the computer system are output during a setup process of the computer system, the method according to any one of claims 63 to 71.

73. The plurality of indications for providing the user of the computer system with guidance for capturing information regarding one or more physical characteristics of the user of the computer system are output after starting a communication session application for the first time after the computer system is set up, the method according to any one of claims 63 to 72.

74. After outputting the second indication corresponding to the second step, which is different from the first step of the process for capturing the information regarding the one or more physical characteristics of the user of the computer system, detecting the occurrence of an event; And starting the registration process in response to detecting the occurrence of the event, the method according to any one of claims 63 to 73.

75. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system communicating with one or more display generation components, the one or more programs including instructions for performing the method according to any one of claims 63 to 74.

76. A computer system configured to communicate with one or more display generation components, the computer system comprising: One or more processors; A memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method according to any one of claims 63 to 74.

77. A computer system configured to communicate with one or more display generation components, the computer system comprising A computer system comprising means for executing the method according to any one of claims 63 to 74. **Claim 78** A computer program product including one or more programs configured to be executed by one or more processors of a computer system communicating with one or more display generation components, the one or more programs including instructions for executing the method according to any one of claims 63 to 74. **Claim 79** A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system communicating with one or more display generation components, the one or more programs including A registration process for generating a user representation, the registration process including capturing information regarding one or more physical characteristics of a user of the computer system, and prior to the registration process, outputting a plurality of indications for guiding the user of the computer system to capture information regarding one or more physical characteristics of the user of the computer system, the non-transitory computer-readable storage medium, outputting the plurality of indications including A first indication corresponding to a first step of a process including capturing the information regarding the one or more physical characteristics of the user of the computer system, the first indication including displaying first three-dimensional content associated with the first step via a first display generation component of the one or more display generation components, outputting the first indication A second indication corresponding to a second step different from the first step of the process for capturing information regarding the one or more physical characteristics of the user of the computer system after outputting the first indication, the second indication being output via the first display generation component of the one or more display generation components, the second step being a second step that is performed after the first step in the registration process and includes displaying second three-dimensional content associated with the second step. A non-transitory computer-readable storage medium including outputting the second indication.

80. A computer system configured to communicate with one or more display generation components, the computer system comprising: one or more processors; a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including: a registration process for generating a representation of a user, the registration process including capturing information regarding one or more physical characteristics of the user of the computer system, and prior to the registration process, outputting a plurality of indications for guiding the user of the computer system to capture information regarding one or more physical characteristics of the user of the computer system, wherein outputting the plurality of indications includes: outputting a first indication corresponding to a first step of a process including capturing the information regarding the one or more physical characteristics of the user of the computer system, the first indication including displaying first three-dimensional content associated with the first step via a first display generation component of the one or more display generation components. A second indication corresponding to a second step different from the first step of the process for capturing information regarding the one or more physical characteristics of the user of the computer system after outputting the first indication, wherein the second indication is, via the first display generation component of the one or more display generation components, the second step, the second step being performed after the first step in the registration process, and including displaying second three-dimensional content associated with the second step, and outputting the second indication. A computer system comprising.

81. A computer system configured to communicate with one or more display generation components, the computer system comprising A registration process for generating a representation of a user, the registration process comprising capturing information regarding one or more physical characteristics of the user of the computer system, and prior to the registration process, means for outputting a plurality of indications for guiding the user of the computer system to capture information regarding one or more physical characteristics of the user of the computer system, wherein outputting the plurality of indications comprises A first indication corresponding to a first step of a process including capturing the information regarding the one or more physical characteristics of the user of the computer system, the first indication including displaying first three-dimensional content associated with the first step via a first display generation component of the one or more display generation components, and outputting the first indication. A second indication corresponding to a second step different from the first step of the process for capturing information regarding the one or more physical characteristics of the user of the computer system after outputting the first indication, the second indication being output via the first display generation component of the one or more display generation components, the second step being a second step that is performed after the first step in the registration process and includes displaying second three-dimensional content associated with the second step, and a computer system including outputting the second indication. **Claim 82** A computer program product including one or more programs configured to be executed by one or more processors of a computer system communicating with one or more display generation components, the one or more programs A registration process for generating a representation of a user, the registration process including capturing information regarding one or more physical characteristics of the user of the computer system, and prior to the registration process, outputting a plurality of indications for guiding the user of the computer system to capture information regarding the one or more physical characteristics of the user of the computer system, the computer program product including instructions, and outputting the plurality of indications A first indication corresponding to a first step of a process including capturing the information regarding the one or more physical characteristics of the user of the computer system, the first indication including outputting the first indication via a first display generation component of the one or more display generation components and displaying first three-dimensional content associated with the first step. A second indication corresponding to a second step different from the first step of the process for capturing information regarding the one or more physical characteristics of the user of the computer system after outputting the first indication, the second indication being, via the first display generation component of the one or more display generation components, the second step, the second step being performed after the first step in the registration process, and including displaying second three-dimensional content associated with the second step, and outputting the second indication. A computer program product comprising: [

83. ] A method, in a computer system communicating with one or more display generation components, a registration process for generating a representation of a user, the registration process including capturing information regarding one or more physical characteristics of the user of the computer system via one or more sensors, during the registration process, via a display generation component of the one or more display generation components, a first visual indication indicating a target orientation of a body part of the user with respect to the computer system, the first visual indication having a first simulated depth, a second visual indication indicating the orientation of the body part of the user with respect to the computer system, the second visual indication having a second simulated depth different from the first simulated depth, and displaying the second visual indication, receiving an indication of a change in the posture of the body part of the user with respect to the one or more sensors while the first visual indication and the second visual indication are being displayed, In response to receiving the indication of the change in the posture of the body part of the user with respect to the one or more sensors, using the change in the posture of the body part of the user with respect to the one or more sensors and the simulated parallax based on the difference between the first simulated depth of the first visual indication and the second simulated depth of the second visual indication, shifting the relative positions of the first visual indication and the second visual indication, the method comprising, the shifting comprising: In accordance with a determination that the body part of the user has moved closer to a target range of postures with respect to the one or more sensors, shifting the relative positions of the first visual indication and the second visual indication, the shifting the relative positions of the first visual indication and the second visual indication comprising shifting the relative positions of the first visual indication and the second visual indication towards the individual spatial arrangements of the first visual indication and the second visual indication; In accordance with a determination that the body part of the user has moved further away from the target range of postures with respect to the one or more sensors, shifting the relative positions of the first visual indication and the second visual indication, the shifting the relative positions of the first visual indication and the second visual indication comprising shifting the relative positions of the first visual indication and the second visual indication away from the individual spatial arrangements of the first visual indication and the second visual indication.

84. The method according to claim 83, wherein the body part of the user includes the face of the user, and the relative positions of the first visual indication and the second visual indication are based on the orientation of the face of the user with respect to the one or more sensors of the computer system.

85. The method according to claim 83 or 84, wherein the first visual indication or the second visual indication moves based on the inclination of the computer system with respect to the face of the user.

86. The method according to any one of claims 83 to 85, wherein the first visual indication or the second visual indication changes color based on an inclination of the computer system with respect to the face of the user.

87. The method according to any one of claims 83 to 86, wherein the first visual indication or the second visual indication changes appearance based on a distance between the face of the user and the computer system.

88. The method according to any one of claims 83 to 87, wherein the first visual indication is a first ring and the second visual indication is a second ring.

89. The method according to any one of claims 83 to 88, wherein the display generation component among the one or more display generation components is a lenticular display.

90. The change in the posture of the body part of the user includes movement of the body part of the user in a first direction with respect to the computer system, and shifting the relative positions of the first visual indication and the second visual indication is based on the movement of the body part of the user in the first direction with respect to the computer system. The method according to any one of claims 83 to 89.

91. The change in the posture of the body part of the user includes movement of the body part of the user with respect to the computer system, and shifting the relative positions of the first visual indication and the second visual indication is based on the amount of movement of the body part of the user with respect to the computer system. The method according to any one of claims 83 to 90.

92. The first visual indication and / or the second visual indication transitions from a first color to a second color based on the change in the posture of the body part of the user with respect to the one or more sensors of the computer system, regardless of the direction of movement associated with the change in the posture of the body part of the user with respect to the one or more sensors. Shifting the relative position of the first visual indication and the second visual indication includes shifting the relative position of the first visual indication and the second visual indication in different directions based on the direction of movement associated with the change in the posture of the body part of the user with respect to the one or more sensors, according to any one of claims 83 to 91.

93. After shifting the relative position of the first visual indication and the second visual indication to the individual spatial arrangements of the first visual indication and the second visual indication, further including starting a process for capturing one or more facial features among the one or more physical features of the user of the computer system, according to any one of claims 83 to 92.

94. After starting the process for capturing the one or more facial features of the user of the computer system, further including prompting the user of the computer system to move the position of the user's head with respect to the computer system, according to claim 93.

95. After prompting the user of the computer system to move the position of the user's head with respect to the computer system, further including displaying, via the display generation component of the one or more display generation components, feedback indicating the movement of the position of the user's head with respect to the computer system, according to claim 94.

96. After shifting the relative position of the first visual indication and the second visual indication to the individual spatial arrangements of the first visual indication and the second visual indication, further including starting a process for capturing one or more facial expression features of the user of the computer system, according to any one of claims 83 to 95.

97. After shifting the relative position of the first visual indication and the second visual indication to the individual spatial arrangements of the first visual indication and the second visual indication, displaying, via the display generation component among the one or more display generation components, a visual indication for verifying that the body part of the user is in the target orientation with respect to the computer system. The method according to any one of claims 83 to 96 further includes this step.

98. The method according to claim 97, wherein the visual indication is displayed after completion of at least two steps of the registration process.

99. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system communicating with one or more display generation components, wherein the one or more programs include instructions for executing the method according to any one of claims 83 to 98.

100. A computer system configured to communicate with one or more display generation components, the computer system comprising: one or more processors; a memory storing one or more programs configured to be executed by the one or more processors, wherein the one or more programs include instructions for executing the method according to any one of claims 83 to 98.

101. A computer system configured to communicate with one or more display generation components, the computer system comprising: means for executing the method according to any one of claims 83 to 98.

102. A computer program product including one or more programs configured to be executed by one or more processors of a computer system communicating with one or more display generation components, wherein the one or more programs include instructions for executing the method according to any one of claims 83 to 98.

103. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system communicating with one or more display generation components, the one or more programs comprising: A registration process for generating a user representation, the registration process including capturing information regarding one or more physical characteristics of a user of the computer system via one or more sensors, during the registration process, via a display generation component of the one or more display generation components, A first visual indication indicating a target orientation of a body part of the user with respect to the computer system, the first visual indication having a first simulated depth, the first visual indication, and A second visual indication indicating the orientation of the body part of the user with respect to the computer system, the second visual indication having a second simulated depth different from the first simulated depth, the second visual indication, and displaying, Receiving an indication of a change in the posture of the body part of the user with respect to the one or more sensors while the first visual indication and the second visual indication are being displayed, In response to receiving the indication of the change in the posture of the body part of the user with respect to the one or more sensors, using the change in the posture of the body part of the user with respect to the one or more sensors and the simulated parallax based on the difference between the first simulated depth of the first visual indication and the second simulated depth of the second visual indication, shifting the relative positions of the first visual indication and the second visual indication, a non-transitory computer-readable storage medium comprising instructions, shifting comprising: In accordance with a determination that the body part of the user has moved closer to a target range posture with respect to the one or more sensors, shifting the relative positions of the first visual indication and the second visual indication includes shifting the relative positions of the first visual indication and the second visual indication toward the individual spatial arrangements of the first visual indication and the second visual indication. In accordance with a determination that the body part of the user has moved further away from the target range posture with respect to the one or more sensors, shifting the relative positions of the first visual indication and the second visual indication includes shifting the relative positions of the first visual indication and the second visual indication away from the individual spatial arrangements of the first visual indication and the second visual indication. A non-transitory computer-readable storage medium. [

104. ] A computer system configured to communicate with one or more display generation components, the computer system comprising: One or more processors; A memory storing one or more programs configured to be executed by the one or more processors, the one or more programs comprising: A registration process for generating a user representation, the registration process including capturing information regarding one or more physical characteristics of a user of the computer system via one or more sensors, during the registration process, via a display generation component of the one or more display generation components. A first visual indication indicating a target orientation of a body part of the user with respect to the computer system, the first visual indication having a first simulated depth. A second visual indication indicating the orientation of the body part of the user with respect to the computer system, the second visual indication having a second simulated depth different from the first simulated depth. While displaying the first visual indication and the second visual indication, receive an indication of a change in the posture of the user's body part with respect to the one or more sensors, In response to receiving the indication of the change in the posture of the user's body part with respect to the one or more sensors, use the change in the posture of the user's body part with respect to the one or more sensors and the simulated parallax based on the difference between the first simulated depth of the first visual indication and the second simulated depth of the second visual indication to shift the relative positions of the first visual indication and the second visual indication, a computer system comprising the shifting comprising: According to a determination that the user's body part has moved closer to a posture within a target range with respect to the one or more sensors, shifting the relative positions of the first visual indication and the second visual indication, which includes shifting the relative positions of the first visual indication and the second visual indication towards the individual spatial arrangements of the first visual indication and the second visual indication, According to a determination that the user's body part has moved further away from the posture within the target range with respect to the one or more sensors, shifting the relative positions of the first visual indication and the second visual indication, which includes shifting the relative positions of the first visual indication and the second visual indication away from the individual spatial arrangements of the first visual indication and the second visual indication, a computer system.

105. A computer system configured to communicate with one or more display generation components, the computer system comprising: A registration process for generating a user's expression, the registration process including capturing information regarding one or more physical characteristics of a user of the computer system via one or more sensors, during the registration process, via a display generation component among the one or more display generation components, A first visual indication indicating a target orientation of a body part of the user with respect to the computer system, the first visual indication having a first simulated depth, the first visual indication, and A second visual indication indicating the orientation of the body part of the user with respect to the computer system, the second visual indication having a second simulated depth different from the first simulated depth, the second visual indication, and means for displaying; Means for receiving an indication of a change in the posture of the body part of the user with respect to the one or more sensors while the first visual indication and the second visual indication are being displayed; In response to receiving the indication of the change in the posture of the body part of the user with respect to the one or more sensors, using the change in the posture of the body part of the user with respect to the one or more sensors and the simulated parallax based on the difference between the first simulated depth of the first visual indication and the second simulated depth of the second visual indication, means for shifting the relative positions of the first visual indication and the second visual indication, the computer system comprising shifting, Shifting the relative positions of the first visual indication and the second visual indication according to a determination that the body part of the user has moved closer to a target range of postures with respect to the one or more sensors, the shifting of the relative positions of the first visual indication and the second visual indication including shifting the relative positions of the first visual indication and the second visual indication towards the individual spatial arrangements of the first visual indication and the second visual indication, A computer system, according to a determination that the user's body part has moved further away from the target range posture with respect to the one or more sensors, shifting the relative position of the first visual indication and the second visual indication, includes shifting the relative position of the first visual indication and the second visual indication away from the individual spatial arrangements of the first visual indication and the second visual indication.

106. A computer program product including one or more programs configured to be executed by one or more processors of a computer system in communication with one or more display generation components, the one or more programs comprising: A registration process for generating a user representation, the registration process including capturing information regarding one or more physical characteristics of a user of the computer system via one or more sensors, during the registration process, via a display generation component of the one or more display generation components; A first visual indication indicating a target orientation of a body part of the user with respect to the computer system, the first visual indication having a first simulated depth; A second visual indication indicating the orientation of the body part of the user with respect to the computer system, the second visual indication having a second simulated depth different from the first simulated depth, and displaying the second visual indication; Receiving an indication of a change in the posture of the body part of the user with respect to the one or more sensors while displaying the first visual indication and the second visual indication; In response to receiving an indication of the change in the posture of the body part of the user with respect to the one or more sensors, using the change in the posture of the body part of the user with respect to the one or more sensors and the simulated parallax based on the difference between the first simulated depth of the first visual indication and the second simulated depth of the second visual indication, to shift the relative positions of the first visual indication and the second visual indication, a computer program product including an instruction, and shifting includes According to a determination that the body part of the user has moved closer to a posture within a target range with respect to the one or more sensors, shifting the relative positions of the first visual indication and the second visual indication includes shifting the relative positions of the first visual indication and the second visual indication toward the individual spatial arrangements of the first visual indication and the second visual indication, According to a determination that the body part of the user has moved further away from the posture within the target range with respect to the one or more sensors, shifting the relative positions of the first visual indication and the second visual indication includes shifting the relative positions of the first visual indication and the second visual indication away from the individual spatial arrangements of the first visual indication and the second visual indication, a computer program product.

107. A method, In a computer system communicating with one or more display generation components, A registration process for generating a representation of a user, the registration process including capturing information regarding one or more physical characteristics of the user of the computer system, during the registration process, prompting the user to make one or more facial expressions, and After prompting the user to make the one or more facial expressions, Detecting information regarding the facial features of the user via one or more sensors, Displaying a progress indication based on the information regarding the characteristics of the user's face via a display generation component among the one or more display generation components, the method comprising, wherein displaying the progress indicator is displaying the progress indicator having a first appearance indicating the first degree of progress according to a determination that the information regarding the characteristics of the user's face indicates a first degree of progress towards making the one or more expressions displaying the progress indicator having a second appearance different from the first appearance and indicating the second degree of progress according to a determination that the information regarding the characteristics of the user's face indicates a second degree of progress towards making the one or more expressions, which is different from the first degree of progress, the method comprising.

108. The method according to claim 107, wherein the progress indicator is a progress bar.

109. The method according to claim 108, wherein the progress bar is three-dimensional.

110. One or more first portions of the progress bar associated with making each of the one or more expressions extend along a first axis based on the perspective of the user of the computer system, the method according to claim 109.

111. Displaying the progress indicator is changing the appearance of the progress bar at a first speed in one or more second portions of the progress bar that are between the one or more first portions of the progress bar changing the appearance of the progress bar at a second speed slower than the first speed in the one or more first portions, the method according to claim 110, the method comprising.

112. The first appearance indicating the first degree of progress includes a first color, and the method is detecting second information regarding the characteristics of the user's face via the one or more sensors while displaying the progress indicator having the first appearance indicating the first degree of progress In response to detecting the second information regarding the characteristics of the user's face, a third appearance indicating a third degree of progress towards creating the one or more expressions is displayed via the display generation component among the one or more display generation components, the third appearance including a second color different from the first color, and the method according to any one of claims 107 to 111 further includes displaying the progress indication having the third appearance.

113. Prompting the user to create one or more expressions includes outputting audio that prompts the user to create a first expression among the one or more expressions, and the method according to any one of claims 107 to 112.

114. Displaying the progress indicator displaying the progress indicator that changes the appearance at a first speed according to a determination that the information regarding the characteristics of the user's face satisfies a set of one or more criteria; displaying the progress indicator that changes the appearance at a second speed slower than the first speed according to a determination that the information regarding the characteristics of the user's face does not satisfy the set of one or more criteria, and the method according to any one of claims 107 to 113.

115. The expression of the user is based on the information regarding the characteristics of the user's face, and the method according to any one of claims 107 to 114.

116. After displaying the progress indication for a predetermined amount of time based on the information regarding the characteristics of the user's face, regardless of whether the information regarding the characteristics of the user's face corresponds to the one or more expressions, the method according to any one of claims 107 to 115 further includes starting the next step of the registration process.

117. After starting the next step of the registration process, via the display generation component among the one or more display generation components, the expression of the user and a selectable option for capturing second information regarding the characteristics of the user's face are further displayed, and the method according to claim 116.

118. The one or more expressions include two or more of a closed-mouth smile, an open-mouth smile, and raised eyebrows, and the method according to any one of claims 107 to 117.

119. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system communicating with one or more display generation components, wherein the one or more programs include instructions for performing the method according to any one of claims 107 to 118, the non-transitory computer-readable storage medium.

120. A computer system configured to communicate with one or more display generation components, the computer system comprising: one or more processors; a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method according to any one of claims 107 to 118, the computer system.

121. A computer system configured to communicate with one or more display generation components, the computer system comprising: means for performing the method according to any one of claims 107 to 118, the computer system.

122. A computer program product including one or more programs configured to be executed by one or more processors of a computer system communicating with one or more display generation components, the one or more programs including instructions for performing the method according to any one of claims 107 to 118.

123. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system communicating with one or more display generation components, the one or more programs including: a registration process for generating a user representation, the registration process including capturing information regarding one or more physical characteristics of a user of the computer system, and prompting the user to make one or more facial expressions during the registration process; after prompting the user to make the one or more facial expressions; detecting information regarding the facial features of the user via one or more sensors. A non-transitory computer-readable storage medium including instructions to display a progress indicator based on the information regarding the characteristics of the user's face via a display generation component among the one or more display generation components, wherein displaying the progress indicator includes displaying the progress indicator having a first appearance indicating the first degree of progress according to a determination that the information regarding the characteristics of the user's face indicates a first degree of progress towards making the one or more expressions; displaying the progress indicator having a second appearance different from the first appearance indicating the second degree of progress according to a determination that the information regarding the characteristics of the user's face indicates a second degree of progress towards making the one or more expressions, the second degree of progress being different from the first degree of progress. A non-transitory computer-readable storage medium.

124. A computer system configured to communicate with one or more display generation components, the computer system comprising one or more processors; a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs comprising a registration process for generating a user representation, the registration process including capturing information regarding one or more physical characteristics of a user of the computer system and prompting the user to make one or more expressions during the registration process; after prompting the user to make the one or more expressions, detecting information regarding the characteristics of the user's face via one or more sensors; a computer system including instructions to display a progress indicator based on the information regarding the characteristics of the user's face via a display generation component among the one or more display generation components, wherein displaying the progress indicator includes displaying the progress indicator having a first appearance indicating the first degree of progress according to a determination that the information regarding the characteristics of the user's face indicates a first degree of progress towards making the one or more expressions; In accordance with a determination that the information regarding the characteristics of the user's face indicates a second degree of progress toward making the one or more expressions, which is different from the first degree of progress, display the progress indicator having a second appearance different from the first appearance that indicates the second degree of progress. A computer system including this.

125. A computer system configured to communicate with one or more display generation components, the computer system comprising: A registration process for generating a user representation, the registration process including capturing information regarding one or more physical characteristics of a user of the computer system, and during the registration process, means for prompting the user to make one or more expressions; After prompting the user to make the one or more expressions, Means for detecting information regarding the characteristics of the user's face via one or more sensors; Means for displaying a progress indication based on the information regarding the characteristics of the user's face via a display generation component among the one or more display generation components. A computer system comprising this, and displaying the progress indicator In accordance with a determination that the information regarding the characteristics of the user's face indicates a first degree of progress toward making the one or more expressions, display the progress indicator having a first appearance that indicates the first degree of progress; In accordance with a determination that the information regarding the characteristics of the user's face indicates a second degree of progress toward making the one or more expressions, which is different from the first degree of progress, display the progress indicator having a second appearance different from the first appearance that indicates the second degree of progress. A computer system including this.

126. A computer program product including one or more programs configured to be executed by one or more processors of a computer system communicating with one or more display generation components, the one or more programs A registration process for generating a user representation, the registration process including capturing information regarding one or more physical characteristics of a user of the computer system, and during the registration process, prompting the user to make one or more expressions; After prompting the user to make the one or more expressions, Detect information regarding the characteristics of the user's face via one or more sensors, A computer program product including instructions to display a progress indicator based on the information regarding the characteristics of the user's face via a display generation component among the one or more display generation components, wherein displaying the progress indicator According to a determination that the information about the characteristics of the user's face indicates a first degree of progress towards making the one or more expressions, display the progress indicator having a first appearance indicating the first degree of progress; According to a determination that the information regarding the characteristics of the user's face indicates a second degree of progress towards making the one or more expressions, which is different from the first degree of progress, display the progress indicator having a second appearance different from the first appearance and indicating the second degree of progress.

127. A method, In a computer system communicating with one or more audio output devices, A registration process for generating a user representation, the registration process including capturing information regarding one or more physical characteristics of the user of the computer system, and outputting a first type of dynamic audio output via the one or more audio output devices during the registration process; Receiving an indication of a change in the posture of the user's biological characteristics with respect to one or more biosensors of the computer system while outputting the first type of dynamic audio output; Adjusting the first type of dynamic audio output based on the change in the posture of the user's biological characteristics of the computer system in order to indicate an amount of progress towards meeting a set of one or more criteria in response to receiving the indication of the change in the posture of the user's biological characteristics with respect to the one or more biosensors.

128. In accordance with the determination that the change in the posture of the user's biometric characteristics with respect to the one or more biometric sensors by the computer system includes rotation of the user's biometric characteristics with respect to the one or more biometric sensors about a first axis, adjust a first audio characteristic of the dynamic audio output, The method according to claim 127, wherein in accordance with the determination that the change in the posture of the user's biometric characteristics with respect to the one or more biometric sensors by the computer system includes rotation of the user's biometric characteristics with respect to the one or more biometric sensors about a second axis different from the first axis, adjust a second audio characteristic of the dynamic audio output, wherein the first audio characteristic is different from the second audio characteristic. **Claim 129** The method according to claim 127 or 128, further comprising displaying a visual indication associated with the registration process via a display generation component communicating with the computer system while outputting the first type of the dynamic audio output. **Claim 130** The method according to any one of claims 127 to 129, wherein the first type of the dynamic audio output includes a first component indicating the posture of the user's biometric characteristics of the computer system and a second component indicating the location of the one or more biometric sensors. **Claim 131** While outputting the first type of the dynamic audio output, via a display generation component communicating with the computer system, display a first visual indication indicating the posture of the user's biometric characteristics with respect to the one or more biometric sensors, and The method according to claim 130, further comprising displaying a second visual indication indicating the location of the one or more biometric sensors. **Claim 132** The method according to claim 130 or 131, wherein the first component of the first type of the dynamic audio output includes a first repetitive audio component, and the second component of the first type of the dynamic audio output includes a second repetitive audio component. **Claim 133** The method according to claim 132, wherein the first repetitive audio component and the second repetitive audio component are harmonically separated by a first harmonically significant interval. **Claim 134** The method according to claim 133, further comprising outputting, in accordance with a determination that the change in the posture of the biometric of the user of the computer system indicates that the posture of the biometric of the user of the computer system is in a target posture, a third audio component of the first type of dynamic audio output, wherein the third audio component is harmonically separated from the first component and the second component by a second harmonically significant interval. **Claim 135** Adjusting the first type of dynamic audio output based on the change in the posture of the biometric of the user of the computer system with respect to the one or more biometric sensors of the computer system includes outputting the first type of dynamic audio output so as to simulate audio generated from a first location based on the change in the posture of the biometric of the user of the computer system with respect to the one or more biometric sensors of the computer system, the method according to any one of claims 127 to 134. **Claim 136** Adjusting the first type of dynamic audio output based on the change in the posture of the biometric of the user of the computer system with respect to the one or more biometric sensors of the computer system includes adjusting the volume of the first type of dynamic audio output based on the change in the posture of the biometric of the user of the computer system with respect to the one or more biometric sensors of the computer system, the method according to any one of claims 127 to 135. **Claim 137** Adjusting the volume of the dynamic audio output of the first type based on the change in the posture of the user's biometric characteristics with respect to the one or more biometric sensors of the computer system includes adjusting the first volume level of the first component of the dynamic audio output of the first type indicating the posture of the user's biometric characteristics of the computer system with respect to the second volume level of the second component of the dynamic audio output of the first type indicating the location of the one or more biometric sensors. The method according to claim 136.

138. After adjusting the dynamic audio output of the first type based on the change in the posture of the user's biometric characteristics of the computer system, further including outputting, via the one or more audio output devices, a second audio output indicating that the progress amount has met a set of the one or more criteria. The method according to any one of claims 127 to 137.

139. The dynamic audio output of the first type is output during the first step of the registration process, and the method After receiving a second indication that the second step of the registration process has been completed, further including outputting a third audio output indicating that the second step of the registration process has been completed. The method according to claim 138.

140. The second audio output and the third audio output are the same audio output. The method according to claim 139.

141. The second audio output includes a first harmonic sequence, and the third audio output includes a second harmonic sequence sequentially associated with the first harmonic sequence. The method according to claim 139.

142. The dynamic audio output of the first type is output during the first step of the registration process, and the method After adjusting the dynamic audio output of the first type based on the change in the posture of the user's biometric characteristics of the computer system, detecting the occurrence of an event indicating the progress amount towards meeting the set of the one or more criteria, and In response to detecting the occurrence of the event, output, via the one or more audio output devices, a second type of dynamic audio output that is different from the first type of dynamic audio output, wherein the second type of dynamic audio output is associated with a second step of the registration process that is different from the first step of the registration process, the method according to any one of claims 127 to 141, further comprising.

143. While outputting the first type of dynamic audio output, display, via a display generation component communicating with the computer system, a first visual indication associated with the first step of the registration process. While outputting the second type of dynamic audio output, display, via the display generation component communicating with the computer system, a second visual indication that is different from the first visual indication and is associated with the second step of the registration process, the method according to claim 142, further comprising.

144. The second type of dynamic audio output includes a dynamic component that is adjusted based on a second progress amount towards meeting a second set of one or more criteria associated with the second step of the registration process, the method according to claim 142 or 143.

145. After outputting the second type of dynamic audio output, further comprising outputting a fourth audio output that prompts the user of the computer system to move the biometric feature to a predetermined posture with respect to the one or more biometric sensors, the method according to any one of claims 142 to 144.

146. After outputting the second type of dynamic audio output, detect the occurrence of an event indicating a third progress amount towards meeting a third set of one or more criteria associated with the second step of the registration process. In response to detecting the occurrence of the event, via the one or more audio output devices, output a third type of dynamic audio output, wherein the third type of dynamic audio output is associated with a third step of the registration process, which is different from the first step and the second step of the registration process, the method according to any one of claims 142 to 145, further comprising.

147. After outputting the second type of dynamic audio output, detecting the occurrence of an event indicating that the progress amount does not meet the set of one or more criteria; In response to detecting the occurrence of the event, adjusting the second type of dynamic audio output, the method according to any one of claims 142 to 146, further comprising.

148. Adjusting the first type of dynamic audio output includes adjusting the reverberation amount of the first type of dynamic audio output based on the change in the posture of the user's biometric characteristics of the computer system with respect to the one or more biometric sensors, the method according to any one of claims 127 to 147.

149. Adjusting the first type of dynamic audio output includes adjusting the volume level of the first type of dynamic audio output based on the change in the posture of the user's biometric characteristics of the computer system with respect to the one or more biometric sensors, the method according to any one of claims 127 to 148.

150. The set of one or more criteria includes aligning the user's biometric characteristics of the computer system with respect to the one or more biometric sensors of the computer system in a predetermined posture, the method according to any one of claims 127 to 149.

151. The set of one or more criteria includes detecting a predetermined amount of movement of the position of the user's head of the computer system with respect to the one or more biometric sensors of the computer system, the method according to any one of claims 127 to 150.

152. The method according to any one of claims 127 to 151, wherein the set of one or more criteria includes at least one criterion satisfied based on detecting that the user of the computer system is making one or more expressions.

153. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system communicating with one or more audio output devices, wherein the one or more programs include instructions for performing the method according to any one of claims 127 to 152.

154. A computer system configured to communicate with one or more audio output devices, the computer system comprising: one or more processors; a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method according to any one of claims 127 to 152.

155. A computer system configured to communicate with one or more audio output devices, the computer system comprising: means for performing the method according to any one of claims 127 to 152.

156. A computer program product including one or more programs configured to be executed by one or more processors of a computer system communicating with one or more audio output devices, the one or more programs including instructions for performing the method according to any one of claims 127 to 152.

157. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system communicating with one or more audio output devices, the one or more programs including: a registration process for generating a user representation, the registration process including capturing information regarding one or more physical characteristics of the user of the computer system, and outputting a first type of dynamic audio output via the one or more audio output devices during the registration process. While outputting the dynamic audio output of the first type, receive an indication of a change in the posture of the user's biometric characteristics with respect to one or more biometric sensors of the computer system. A non-transitory computer-readable storage medium including instructions to adjust the dynamic audio output of the first type based on the change in the posture of the user's biometric characteristics of the computer system in order to indicate an amount of progress towards meeting a set of one or more criteria in response to receiving the indication of the change in the posture of the user's biometric characteristics with respect to the one or more biometric sensors. **Claim 158** A computer system configured to communicate with one or more audio output devices, the computer system comprising: One or more processors; A memory storing one or more programs configured to be executed by the one or more processors, the one or more programs comprising: A registration process for generating a user representation, the registration process including capturing information regarding one or more physical characteristics of the user of the computer system, and outputting a dynamic audio output of a first type via the one or more audio output devices during the registration process. While outputting the dynamic audio output of the first type, receive an indication of a change in the posture of the user's biometric characteristics with respect to one or more biometric sensors of the computer system. A computer system including instructions to adjust the dynamic audio output of the first type based on the change in the posture of the user's biometric characteristics of the computer system in order to indicate an amount of progress towards meeting a set of one or more criteria in response to receiving the indication of the change in the posture of the user's biometric characteristics with respect to the one or more biometric sensors. **Claim 159** A computer system configured to communicate with one or more audio output devices, the computer system comprising: A registration process for generating a user representation, the registration process including capturing information regarding one or more physical characteristics of the user of the computer system, during the registration process, means for outputting a first type of dynamic audio output via the one or more audio output devices, means for receiving an indication of a change in the posture of the user's biological characteristics of the computer system with respect to one or more biosensors of the computer system while the first type of dynamic audio output is being output, means for adjusting the first type of dynamic audio output based on the change in the posture of the user's biological characteristics of the computer system in response to receiving the indication of the change in the posture of the user's biological characteristics with respect to the one or more biosensors, in order to indicate an amount of progress towards meeting a set of one or more criteria, a computer system comprising.

160. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system communicating with one or more audio output devices, the one or more programs comprising A registration process for generating a user representation, the registration process including capturing information regarding one or more physical characteristics of the user of the computer system, during the registration process, outputting a first type of dynamic audio output via the one or more audio output devices, receiving an indication of a change in the posture of the user's biological characteristics of the computer system with respect to one or more biosensors of the computer system while the first type of dynamic audio output is being output, A computer program product comprising instructions for adjusting the first type of dynamic audio output based on the change in the posture of the user's biological characteristics of the computer system in response to receiving the indication of the change in the posture of the user's biological characteristics with respect to the one or more biosensors, in order to indicate an amount of progress towards meeting a set of one or more criteria.

161. A method comprising In a computer system communicating with one or more display generation components, while a representation of a hand of a user of the computer system is visible in an extended reality environment, prompting the user of the computer system to move the position of the hand of the user to a first posture; after prompting the user of the computer system to move the position of the hand of the user to the first posture, detecting that the position of the hand of the user is in the first posture; after detecting that the position of the hand of the user is in the first posture, prompting the user of the computer system to move the position of the hand of the user to a second posture; after prompting the user of the computer system to move the position of the hand of the user to the second posture, detecting that the position of the hand of the user is in the second posture; responding to detecting that the position of the hand of the user is in the second posture, outputting a confirmation that the position of the hand of the user has been detected in the second posture, a method.

162. The method according to claim 161, further comprising outputting a confirmation that the position of the hand of the user has been detected in the first posture in response to detecting that the position of the hand of the user is in the first posture.

163. The first information about the hand of the user collected while in the first posture and the second posture is used to generate a virtual avatar of the user, and the method further comprising, separate from collecting the first information about the hand of the user while in the first posture and the second posture, providing guidance used to position one or more hands of the user to enable collection of second information via one or more output devices, the method according to claim 161 or 162.

164. The method according to claim 163, wherein the computer system collects the second information before collecting the first information.

165. Before prompting the user of the computer system to move the position of the user's hand to the first posture, further capturing third information regarding the user's face, where the third information is used to generate a virtual representation of the user, the method according to any one of claims 161 to 164.

166. Capturing the third information regarding the user's face includes capturing the third information regarding the user's face while the computer system is not disposed on the user's body. Prompting the user of the computer system to move the position of the user's hand to the first posture includes prompting the user of the computer system to move the position of the user's hand to the first posture while the computer system is disposed on the user's body, the method according to claim 165.

167. After detecting that the position of the user's hand is in the first posture, outputting first feedback indicating that a first portion of the user's hand has been detected; After detecting that the position of the user's hand is in the second posture, where the second posture is different from the first posture, outputting second feedback indicating that the first portion of the user's hand has been detected, the method according to any one of claims 161 to 166.

168. The first portion of the user's hand includes one or more fingertips of the user's hand, the method according to claim 167.

169. The first posture includes the user's hand facing away from the user's body. The second posture includes the user's hand facing towards the user's body, the method according to any one of claims 161 to 168.

170. Prompting the user of the computer system to move the position of the user's hand to the second posture includes displaying a visual indication for changing the position of the user's hand from the first posture to the second posture via a display generation component among the one or more display generation components. The method according to any one of claims 161 to 169.

171. Prompting the user of the computer system to move the position of the user's hand to the second posture includes outputting an audio prompt for changing the position of the user's hand from the first posture to the second posture via an audio output device communicating with the computer system. The method according to any one of claims 161 to 170.

172. After outputting a confirmation that the position of the user's hand has been detected in the second posture, further providing an option for adjusting the appearance of a virtual representation of the user, wherein the virtual representation of the user is generated via the computer system. The method according to any one of claims 161 to 171.

173. The option for adjusting the appearance of the virtual representation of the user includes a first option for adjusting the appearance of a virtual hand of the virtual representation of the user. The method according to claim 172.

174. The option for adjusting the appearance of the virtual representation of the user includes a second option for adjusting the skin color of the virtual skin of the virtual representation of the user. The method according to claim 172.

175. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system communicating with one or more display generation components, wherein the one or more programs include instructions for performing the method according to any one of claims 161 to 174. Non-transitory computer-readable storage medium.

176. A computer system configured to communicate with one or more display generation components, the computer system comprising: One or more processors; A computer system comprising: a memory storing one or more programs configured to be executed by the one or more processors, wherein the one or more programs include instructions for performing the method according to any one of claims 161 to 174.

177. A computer system configured to communicate with one or more display generation components, the computer system comprising: Means for performing the method according to any one of claims 161 to 174.

178. A computer program product including one or more programs configured to be executed by one or more processors of a computer system communicating with one or more display generation components, wherein the one or more programs include instructions for performing the method according to any one of claims 161 to 174.

179. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system communicating with one or more display generation components, the one or more programs comprising: Prompting the user of the computer system to move the position of the user's hand to a first posture while the representation of the user's hand is visible in an extended reality environment; After prompting the user of the computer system to move the position of the user's hand to the first posture, detecting that the position of the user's hand is in the first posture; After detecting that the position of the user's hand is in the first posture, prompting the user of the computer system to move the position of the user's hand to a second posture; After prompting the user of the computer system to move the position of the user's hand to the second posture, detecting that the position of the user's hand is in the second posture; Instructions for outputting a confirmation that the position of the user's hand has been detected in the second posture in response to detecting that the position of the user's hand is in the second posture.

180. A computer system configured to communicate with one or more display generation components, the computer system comprising: one or more processors; a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs comprising: prompting the user of the computer system to move the position of the user's hand to a first posture while a representation of the user's hand is visible in an extended reality environment; detecting that the position of the user's hand is in the first posture after prompting the user of the computer system to move the position of the user's hand to the first posture; prompting the user of the computer system to move the position of the user's hand to a second posture after detecting that the position of the user's hand is in the first posture; detecting that the position of the user's hand is in the second posture after prompting the user of the computer system to move the position of the user's hand to the second posture; outputting a confirmation that the position of the user's hand has been detected in the second posture in response to detecting that the position of the user's hand is in the second posture, a computer system comprising instructions.

181. A computer system configured to communicate with one or more display generation components, the computer system comprising: means for prompting the user of the computer system to move the position of the user's hand to a first posture while a representation of the user's hand is visible in an extended reality environment; means for detecting that the position of the user's hand is in the first posture after prompting the user of the computer system to move the position of the user's hand to the first posture; means for prompting the user of the computer system to move the position of the user's hand to a second posture after detecting that the position of the user's hand is in the first posture; After prompting the user of the computer system to move the position of the user's hand to the second posture, means for detecting that the position of the user's hand is in the second posture; Means for outputting a confirmation that the position of the user's hand has been detected in the second posture in response to detecting that the position of the user's hand is in the second posture, a computer system.

182. A computer program product including one or more programs configured to be executed by one or more processors of a computer system communicating with one or more display generation components, the one or more programs comprising: While the representation of the user's hand of the computer system is visible in an extended reality environment, prompting the user of the computer system to move the position of the user's hand to a first posture; After prompting the user of the computer system to move the position of the user's hand to the first posture, detecting that the position of the user's hand is in the first posture; After detecting that the position of the user's hand is in the first posture, prompting the user of the computer system to move the position of the user's hand to a second posture; After prompting the user of the computer system to move the position of the user's hand to the second posture, detecting that the position of the user's hand is in the second posture; A computer program product including instructions for outputting a confirmation that the position of the user's hand has been detected in the second posture in response to detecting that the position of the user's hand is in the second posture.

183. A method, comprising: In a computer system communicating with one or more display generation components, After capturing information regarding one or more physical characteristics of a user of the computer system, via a first display generation component of the one or more display generation components; The expression of the user, wherein one or more visual characteristics of the expression of the user are based on the captured information regarding the one or more physical characteristics of the user, and the expression of the user, A control user interface object for adjusting the appearance of the expression of the user based on lighting characteristics associated with the expression of the user, and simultaneously displaying the control user interface object, Receiving an input corresponding to the control user interface object while simultaneously displaying the expression of the user and the control user interface object, Adjusting the appearance of the expression of the user based on the lighting characteristics associated with the expression of the user in response to receiving the input corresponding to the control user interface object. A method comprising:

184. Adjusting the appearance of the expression of the user based on the lighting characteristics associated with the expression of the user, Adjusting the appearance of the expression of the user by a first amount according to a determination that the input corresponding to the control user interface object has a first magnitude, Adjusting the appearance of the expression of the user by a second amount different from the first amount according to a determination that the input corresponding to the control user interface object has a second magnitude different from the first magnitude. The method according to claim 183, comprising:

185. Adjusting the appearance of the expression of the user based on the lighting characteristics associated with the expression of the user, Adjusting the appearance of the expression of the user in a corresponding first adjustment direction according to a determination that the input corresponding to the control user interface object has a first input direction, Adjusting the appearance of the expression of the user in a corresponding second adjustment direction different from the first adjustment direction according to a determination that the input corresponding to the control user interface object has a second input direction different from the first input direction. The method according to claim 183 or 184, comprising:

186. The lighting characteristics associated with the user's expression include adjustment to the appearance of the user's expression based on the lighting conditions of the physical environment in which the information regarding the one or more physical characteristics of the user of the computer system was captured, the method according to any one of claims 183 to 185.

187. The lighting characteristics associated with the user's expression include adjustment to the appearance of the user's expression based on simulated lighting for displaying the user's expression, the method according to any one of claims 183 to 186.

188. The lighting characteristics include color temperature, the method according to any one of claims 183 to 187.

189. The lighting characteristics include exposure, the method according to any one of claims 183 to 188.

190. The control user interface object includes a slider user interface object, the method according to any one of claims 183 to 189.

191. The control user interface object is a first control user interface object, the lighting characteristics are first lighting characteristics, and the method is to further display, via the first display generation component among the one or more display generation components, a second control user interface object for adjusting the appearance of the user's expression based on second lighting characteristics associated with the user's expression, simultaneously with the user's expression and the first control user interface object, wherein the first control user interface object is configured to adjust the appearance of the user's expression based on the first lighting characteristics independently of the second lighting characteristics, and the second control user interface object is configured to adjust the appearance of the user's expression based on the second lighting characteristics independently of the first lighting characteristics, the method according to any one of claims 183 to 190.

192. in response to receiving a second input requesting adjustment of the appearance of the user's expression In accordance with the determination that the second input corresponds to the first control user interface object, adjusting the appearance of the user's expression based on the first lighting characteristic associated with the user's expression without adjusting the appearance of the user's expression based on the second lighting characteristic associated with the user's expression; In accordance with the determination that the second input corresponds to the second control user interface object, adjusting the appearance of the user's expression based on the second lighting characteristic associated with the user's expression without adjusting the appearance of the user's expression based on the first lighting characteristic associated with the user's expression, the method according to claim 191, further comprising:

193. Simultaneously displaying the user's expression and the control user interface object includes animating the user's expression based on the movement of the user relative to at least a portion of the computer system, the method according to any one of claims 183 to 192.

194. Animating the user's expression includes displaying the movement of the user's expression that is reversed compared to the movement of the user relative to the at least a portion of the computer system, the method according to claim 193.

195. Detecting the movement of the user relative to at least a portion of the computer system while simultaneously displaying the user's expression and the control user interface object; In response to detecting the movement of the user relative to at least a portion of the computer system; In accordance with the determination that the movement of the user relative to at least a portion of the computer system is towards the at least a portion of the computer system, displaying the user's expression in a first size via the first display generation component among the one or more display generation components; According to the determination that the movement of the user with respect to at least a part of the computer system is away from at least a part of the computer system, displaying the representation of the user in a second size different from the first size via the first display generation component among the one or more display generation components. The method according to any one of claims 183 to 194, further comprising.

196. While simultaneously displaying the representation of the user and the control user interface object, displaying a first selectable option for editing the eyewear of the representation of the user via the first display generation component among the one or more display generation components. The method according to any one of claims 183 to 195, further comprising.

197. Detecting a third input directed to the first selectable option. In response to detecting the third input directed to the first selectable option, displaying a first eyewear category option and a second eyewear category option via the first display generation component among the one or more display generation components. The method according to claim 196, further comprising.

198. While simultaneously displaying the representation of the user and the control user interface object, displaying a second selectable option for editing the visual characteristics of the representation of the user via the first display generation component among the one or more display generation components. The method according to any one of claims 183 to 197, further comprising.

199. The visual characteristics of the representation of the user include an eye patch of the representation of the user. The method according to claim 198.

200. The visual characteristics of the representation of the user include a prosthetic hand of the representation of the user. The method according to claim 198 or 199.

201. The visual characteristics of the representation of the user include a hearing aid of the representation of the user. The method according to any one of claims 198 to 200.

202. The visual characteristics of the representation of the user include a wheelchair of the representation of the user. The method according to any one of claims 198 to 201.

203. While simultaneously displaying the expression of the user and the control user interface object, when selected via the first display generation component among the one or more display generation components, further including displaying, on the computer system, a third selectable option for initiating a process for capturing information regarding the one or more physical characteristics of the user, the method according to any one of claims 183 to 202.

204. Receiving a request to adjust the appearance of the expression of the user while displaying a communication user interface via the first display generation component among the one or more display generation components; In response to receiving the request to adjust the appearance of the expression of the user, via the first display generation component of the one or more display generation components, the expression of the user and simultaneously displaying the control user interface object for adjusting the appearance of the expression of the user based on lighting characteristics, the method according to any one of claims 183 to 203.

205. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system communicating with one or more display generation components, the one or more programs including instructions for performing the method according to any one of claims 183 to 204.

206. A computer system configured to communicate with one or more display generation components, the computer system comprising one or more processors and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method according to any one of claims 183 to 204.

207. A computer system configured to communicate with one or more display generation components, the computer system comprising means for performing the method according to any one of claims 183 to 204.

208. A computer program product including one or more programs configured to be executed by one or more processors of a computer system communicating with one or more display generation components, the one or more programs including instructions for performing the method according to any one of claims 183 to 204.

209. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system communicating with one or more display generation components, the one or more programs After capturing information regarding one or more physical characteristics of a user of the computer system, via a first display generation component among the one or more display generation components, A representation of the user, wherein one or more visual characteristics of the representation of the user are based on the captured information regarding the one or more physical characteristics of the user, the representation of the user, and A control user interface object for adjusting an appearance of the representation of the user based on illumination characteristics associated with the representation of the user, are simultaneously displayed, While simultaneously displaying the representation of the user and the control user interface object, receiving an input corresponding to the control user interface object, In response to receiving the input corresponding to the control user interface object, adjusting the appearance of the representation of the user based on the illumination characteristics associated with the representation of the user, instructions are included, a non-transitory computer-readable storage medium.

210. A computer system configured to communicate with one or more display generation components, the computer system One or more processors and A memory storing one or more programs configured to be executed by the one or more processors, the one or more programs After capturing information regarding one or more physical characteristics of a user of the computer system, via a first display generation component among the one or more display generation components, A representation of the user, wherein one or more visual characteristics of the representation of the user are based on the captured information regarding the one or more physical characteristics of the user, the representation of the user, and A control user interface object for adjusting the appearance of the user's expression based on lighting characteristics associated with the user's expression, and display them simultaneously, While simultaneously displaying the user's expression and the control user interface object, receive an input corresponding to the control user interface object, A computer system including instructions to adjust the appearance of the user's expression based on the lighting characteristics associated with the user's expression in response to receiving the input corresponding to the control user interface object.

211. A computer system configured to communicate with one or more display generation components, the computer system comprising: After capturing information regarding one or more physical characteristics of a user of the computer system, via a first display generation component of the one or more display generation components, The user's expression, wherein one or more visual characteristics of the user's expression are based on the captured information regarding the one or more physical characteristics of the user, and the user's expression, Means for simultaneously displaying a control user interface object for adjusting the appearance of the user's expression based on lighting characteristics associated with the user's expression; Means for receiving an input corresponding to the control user interface object while simultaneously displaying the user's expression and the control user interface object; Means for adjusting the appearance of the user's expression based on the lighting characteristics associated with the user's expression in response to receiving the input corresponding to the control user interface object. A computer system comprising:

212. A computer program product including one or more programs configured to be executed by one or more processors of a computer system communicating with one or more display generation components, the one or more programs comprising: After capturing information regarding one or more physical characteristics of a user of the computer system, via a first display generation component of the one or more display generation components, The user's expression, wherein one or more visual characteristics of the user's expression are based on the captured information regarding the one or more physical characteristics of the user, the user's expression, and A control user interface object for adjusting the appearance of the user's expression based on lighting characteristics associated with the user's expression, are simultaneously displayed, While simultaneously displaying the user's expression and the control user interface object, receive an input corresponding to the control user interface object, A computer program product including instructions for adjusting the appearance of the user's expression based on the lighting characteristics associated with the user's expression in response to receiving the input corresponding to the control user interface object.

Images