System and method for presenting content in shared computer-generated environment of multi-user communication session

Abstract

The present disclosure generally relates to systems and methods for presenting content in a shared computer-generated environment of a multi-user communication session. Some examples of the present disclosure relate to systems and methods for presenting content in a shared computer-generated environment of a multi-user communication session. In some examples, an electronic device displays an indication in the shared computer-generated environment that a location corresponding to the electronic device is farther than a threshold distance from a respective location associated with the multi-user communication session. In some examples, an electronic device presents a representation that a user of a multi-user communication session moves away from a reference point of the multi-user communication session. In some examples, the electronic device presents content associated with a user of a multi-user communication session moving away from a reference point of the multi-user communication session.

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims the benefit of U.S. Provisional Application No. 63 / 515,114 filed on July 23, 2023, U.S. Provisional Application No. 63 / 668,107 filed on July 5, 2024, and U.S. Patent Application No. 18 / 777,296 filed on July 18, 2024, the contents of which are incorporated herein by reference in their entirety for all purposes. Technical Field

[0003] The present invention generally relates to systems and methods for presenting content in a shared computer-generated environment of a multi-user communication session. Background Art

[0004] Some computer graphics environments provide two-dimensional and / or three-dimensional environments in which at least some of the objects displayed for user observation are virtual and computer-generated. In some examples, the three-dimensional environment is presented by multiple devices communicating in a multi-user communication session. In some examples, an avatar (e.g., a representation) of each user participating in the multi-user communication session (e.g., via a computing device) is displayed in the three-dimensional environment of the multi-user communication session. In some examples, content can be shared in the three-dimensional environment for viewing and interaction by multiple users participating in the multi-user communication session. Summary of the invention

[0005] Some examples of the present disclosure relate to systems and methods for presenting content in a shared computer-generated environment of a multi-user communication session. In some examples, a first user of a first electronic device and a second user of a second electronic device are linked in a communication manner in a multi-user communication session. In some examples, the first electronic device displays a first representation corresponding to the second user of the second electronic device at a first position in the computer-generated environment. In some examples, when displaying a computer-generated environment including a first representation corresponding to the second user of the second electronic device at a first position, the first electronic device determines that one or more criteria are met, including a criterion that is met when the distance between the second position corresponding to the first electronic device in the computer-generated environment and the corresponding position associated with the communication session is greater than a threshold distance. In some examples, in response to determining that one or more criteria are met, the first electronic device displays the second position corresponding to the first electronic device in the computer-generated environment as being farther from the corresponding position associated with the communication session than the threshold distance.

[0006] A comprehensive description of these examples is provided in the drawings and detailed description, and it should be understood that this summary does not limit the scope of the present disclosure in any way. BRIEF DESCRIPTION OF THE DRAWINGS

[0007] For a better understanding of the various examples described herein, reference should be made to the following detailed description and the following drawings. Throughout the drawings, like reference numerals generally refer to corresponding parts.

[0008] Figure 1 An electronic device presenting an extended reality environment according to some examples of the present disclosure is shown.

[0009] Figure 2 A block diagram illustrating an exemplary architecture of a device according to some examples of the present disclosure.

[0010] FIG. 3A to FIG. 3I Exemplary spatial relationships between electronic devices and reference points in a multi-user communication session according to some examples of the present disclosure are shown.

[0011] Figure 4 A flow chart illustrating an exemplary process for presenting content in a shared computer-generated environment of a multi-user communication session is shown, according to some examples of the present disclosure.

[0012] FIG. 5A to FIG. 5H Exemplary techniques for presenting representations of users of a multi-user communication session moving away from a reference point of the multi-user communication session in accordance with some examples of the present disclosure are illustrated.

[0013] Figure 6 A flow chart illustrating an exemplary process for presenting a representation of a user of a multi-user communication session moving away from a reference point of the multi-user communication session is shown in accordance with some examples of the present disclosure.

[0014] FIG. 7A to FIG. 7G Exemplary techniques for presenting content associated with a reference point where a user of a multi-user communication session moves away from the multi-user communication session in accordance with some examples of the present disclosure are illustrated.

[0015] Figure 8 A flow chart illustrating an exemplary process for presenting content associated with a reference point where a user of a multi-user communication session moves away from the multi-user communication session according to some examples of the present disclosure. DETAILED DESCRIPTION

[0016] Some examples of the present disclosure relate to systems and methods for presenting content in a shared computer-generated environment of a multi-user communication session. In some examples, a first user of a first electronic device and a second user of a second electronic device are linked in a communication manner in a multi-user communication session. In some examples, the first electronic device displays a first representation corresponding to the second user of the second electronic device at a first position in the computer-generated environment. In some examples, when displaying a computer-generated environment including a first representation corresponding to the second user of the second electronic device at a first position, the first electronic device determines that one or more criteria are met, including a criterion met when the distance between the second position corresponding to the first electronic device in the computer-generated environment relative to the corresponding position associated with the communication session is greater than a threshold distance. In some examples, in response to determining that one or more criteria are met, the first electronic device displays the second position corresponding to the first electronic device in the computer-generated environment as being farther from the corresponding position associated with the communication session than the threshold distance.

[0017] Some examples of the present disclosure relate to systems and methods for presenting representations of users of a multi-user communication session moving away from a reference point of the multi-user communication session. In some examples, when a first electronic device is conducting a communication session with a second electronic device, and wherein the communication session includes a first user of the first electronic device and a second user of the second electronic device, the first electronic device presents a first representation corresponding to the second user of the second electronic device at a first location in a three-dimensional environment. In some examples, when the three-dimensional environment including the first representation corresponding to the second user of the second electronic device is presented at the first location, the first electronic device obtains information corresponding to the movement of the first representation corresponding to the second user away from the first location in the three-dimensional environment. In some examples, in response to obtaining the information corresponding to the movement of the first representation corresponding to the second user away from the first position in the three-dimensional environment, and based on a determination that the movement of the first representation corresponding to the second user corresponds to movement of the first representation corresponding to the second user to a second position in the three-dimensional environment that is farther than a threshold distance from a corresponding position associated with the communication session, the first electronic device moves the first representation corresponding to the second user away from the first position in the three-dimensional environment and changes the presentation of the first representation corresponding to the second user in the three-dimensional environment to a second representation corresponding to the second user that is different from the first representation. In some examples, in response to obtaining the information corresponding to the movement of the first representation corresponding to the second user away from the first position in the three-dimensional environment, and based on a determination that the movement of the first representation corresponding to the second user corresponds to movement of the first representation corresponding to the second user to a third position in the three-dimensional environment within the threshold distance from the corresponding position associated with the communication session, the first electronic device moves the first representation corresponding to the second user away from the first position in the three-dimensional environment and maintains presentation of the first representation corresponding to the second user in the three-dimensional environment.

[0018] Some examples of the present disclosure relate to systems and methods for presenting content associated with a user of a multi-user communication session moving away from a reference point of the multi-user communication session. In some examples, when the first electronic device is in a communication session with the second electronic device, the communication session includes the first user of the first electronic device and the second user of the second electronic device, and wherein the viewpoint of the first user has a first position in the three-dimensional environment and the viewpoint of the second user has a second position in the three-dimensional environment, the first electronic device presents the first representation corresponding to the second user of the second electronic device at the second position in the three-dimensional environment. In some examples, when the three-dimensional environment including the first representation corresponding to the second user of the second electronic device is presented at the second position, the first electronic device detects a first input corresponding to the movement of the viewpoint of the first user away from the first position in the three-dimensional environment. In some examples, in response to detecting the movement of the viewpoint of the first user away from the first position in the three-dimensional environment and when the second position of the first representation corresponding to the second user of the second electronic device is within the viewport of one or more displays of the first user in the three-dimensional environment, and based on a determination that the movement of the viewpoint of the first user corresponds to movement of the viewpoint of the first user to a third position in the three-dimensional environment that is farther than a threshold distance from a corresponding position associated with the communication session, the first electronic device presents the three-dimensional environment from the viewpoint of the first user at the third position without presenting the first representation corresponding to the second user at the second position in the three-dimensional environment. In some examples, in response to detecting the movement of the viewpoint of the first user away from the first position in the three-dimensional environment and when the second position of the first representation corresponding to the second user of the second electronic device is within the viewport of one or more displays of the first user in the three-dimensional environment, and based on a determination that the movement of the viewpoint of the first user corresponds to movement of the viewpoint of the first user to a fourth position in the three-dimensional environment that is within the threshold distance from the corresponding position associated with the communication session, the first electronic device presents the three-dimensional environment from the viewpoint of the first user at the fourth position, including presenting the first representation corresponding to the second user at the second position in the three-dimensional environment.

[0019] Figure 1 An electronic device 101 is shown presenting an extended reality (XR) environment (e.g., a computer-generated environment that optionally includes representations of physical and / or virtual objects) according to some examples of the present disclosure. In some examples, such as Figure 1 As shown, the electronic device 101 is a head mounted display or other head mounted device configured to be worn on the head of the user of the electronic device 101. Figure 2 An example of an electronic device 101 is described by using an architectural block diagram of FIG. Figure 1 As shown, electronic device 101 and table 106 are located in a physical environment. The physical environment may include physical features, such as physical surfaces (e.g., floors, walls) or physical objects (e.g., tables, lights, etc.). In some examples, electronic device 101 may be configured to detect and / or capture an image of the physical environment including table 106 (shown in the field of view of electronic device 101).

[0020] In some examples, such as Figure 1 As shown, the electronic device 101 includes one or more internal image sensors 114a (eg, as described below with reference to FIG. 1 ) oriented toward the user's face. Figure 2 101 ). In some examples, internal image sensor 114a is used for eye tracking (e.g., detecting the gaze of a user). Internal image sensor 114a is optionally arranged on the left and right portions of display 120 to enable eye tracking of the left and right eyes of the user. In some examples, electronic device 101 also includes external image sensors 114b and 114c facing outward from the user to detect and / or capture the physical environment of electronic device 101 and / or movement of the user's hands or other body parts.

[0021] In some examples, the display 120 has a field of view visible to the user (e.g., it may or may not correspond to the field of view of the external image sensors 114b and 114c). Because the display 120 is optionally part of the head-mounted device, the field of view of the display 120 is optionally the same as or similar to the field of view of the user's eyes. In other examples, the field of view of the display 120 may be smaller than the field of view of the user's eyes. In some examples, the electronic device 101 may be an optical see-through device, in which the display 120 is a transparent or translucent display through which parts of the physical environment can be directly viewed. In some examples, the display 120 may be included in a transparent lens and may overlap with all or only a portion of the transparent lens. In other examples, the electronic device may be a video pass-through device, in which the display 120 is an opaque display configured to display an image of the physical environment captured by the external image sensors 114b and 114c.

[0022] In some examples, in response to a trigger, the electronic device 101 may be configured to display in the XR environment Figure 1 , which does not exist in the physical environment but is displayed in the XR environment on top of the real-world table 106 (or its representation). Optionally, in response to detecting the plane of the table 106 in the physical environment 100, the virtual object 104 can be displayed on the surface of the table 106 in the XR environment displayed via the display 120 of the electronic device 101.

[0023] It should be understood that virtual object 104 is a representative virtual object and may include and render one or more different virtual objects (e.g., virtual objects with various dimensions, such as two-dimensional or other three-dimensional virtual objects) in a three-dimensional XR environment. For example, a virtual object may represent an application or user interface displayed in an XR environment. In some examples, a virtual object may represent content corresponding to an application and / or displayed via a user interface in an XR environment. In some examples, virtual object 104 is optionally configured to be interactive and responsive to user input (e.g., air gestures, such as air pinch gestures, air tap gestures, and / or air touch gestures), so that a user can virtually touch, tap, move, rotate, or otherwise interact with virtual object 104.

[0024] In some examples, displaying an object in a three-dimensional environment may include interaction with one or more user interface objects in the three-dimensional environment. For example, initiation of display of an object in a three-dimensional environment may include interaction with one or more virtual options / indicators displayed in the three-dimensional environment. In some examples, when display of an object is initiated in a three-dimensional environment, an electronic device may track the user's gaze as an input for identifying one or more virtual options / indicators as targets for selection. For example, gaze may be used to identify one or more virtual options / indicators as targets for selection using another selection input. In some examples, a virtual option / indicator may be selected using hand tracking input detected via an input device that communicates with the electronic device. In some examples, an object displayed in a three-dimensional environment may be moved and / or reoriented in the three-dimensional environment based on movement input detected via an input device.

[0025] In the following discussion, an electronic device that communicates with a display generation component and one or more input devices is described. It should be understood that the electronic device optionally communicates with one or more other physical user interface devices, such as a touch-sensitive surface, a physical keyboard, a mouse, a joystick, a hand tracking device, an eye tracking device, a stylus, etc. In addition, as described above, it should be understood that the described electronic device, display, and touch-sensitive surface are optionally distributed between two or more devices. Therefore, as used in the present disclosure, information displayed on or by an electronic device is optionally used to describe information output by the electronic device to be displayed on an independent display device (touch-sensitive or non-touch-sensitive). Similarly, as used in the present disclosure, input received on an electronic device (e.g., touch input received on a touch-sensitive surface of an electronic device, or touch input received on the surface of a stylus) is optionally used to describe input received on an independent input device, and the electronic device receives input information from the independent input device.

[0026] The device typically supports a variety of applications, such as one or more of the following applications: a drawing application, a presentation application, a word processing application, a website creation application, a disk editing application, a spreadsheet application, a gaming application, a telephony application, a video conferencing application, an email application, an instant messaging application, a fitness support application, a photo management application, a digital camera application, a digital video camera application, a web browsing application, a digital music player application, a television channel browsing application, and / or a digital video player application.

[0027] Figure 2 A block diagram of an exemplary architecture of a device 201 according to some examples of the present disclosure is shown. In some examples, the device 201 includes one or more electronic devices. For example, the electronic device 201 can be a portable device, an auxiliary device that communicates with another device, a head-mounted display, etc. In some examples, the electronic device 201 corresponds to the device described above with reference to Figure 1 An electronic device 101 is described.

[0028] like Figure 2 As shown, the electronic device 201 optionally includes various sensors, such as one or more hand tracking sensors 202, one or more position sensors 204, one or more image sensors 206 (optionally corresponding to Figure 1 114a and / or external image sensors 114b and 114c in the embodiment of the present invention), one or more touch-sensitive surfaces 209, one or more motion and / or orientation sensors 210, one or more eye tracking sensors 212, one or more microphones 213 or other audio sensors, one or more body tracking sensors (e.g., torso and / or head tracking sensors), one or more display generation components 214 (optionally corresponding to Figure 1 The display 120 in the electronic device 201, one or more speakers 216, one or more processors 218, one or more memories 220 and / or communication circuits 222. One or more communication buses 208 are optionally used for communication between the above components of the electronic device 201.

[0029] The communication circuit 222 optionally includes circuits for communicating with electronic devices, networks such as the Internet, intranets, wired networks and / or wireless networks, cellular networks, and wireless local area networks (LANs). The communication circuit 222 optionally includes circuits for using near field communication (NFC) and / or short-range communication such as A circuit for communicating.

[0030] Processor 218 includes one or more general purpose processors, one or more graphics processors, and / or one or more digital signal processors. In some examples, memory 220 is a non-transitory computer-readable storage medium (e.g., flash memory, random access memory, or other volatile or non-volatile memory or storage device) storing computer-readable instructions, which are configured to be executed by processor 218 to perform the techniques, processes, and / or methods described below. In some examples, memory 220 may include more than one non-transitory computer-readable storage medium. A non-transitory computer-readable storage medium may be any medium (e.g., excluding signals) that can tangibly contain or store computer-executable instructions for use by or in combination with an instruction execution system, device, and apparatus. In some examples, the storage medium is a transient computer-readable storage medium. In some examples, the storage medium is a non-transitory computer-readable storage medium. A non-transitory computer-readable storage medium may include, but is not limited to, a magnetic storage device, an optical storage device, and / or a semiconductor storage device. Examples of such storage devices include magnetic disks, optical disks based on compact disc (CD), digital versatile disc (DVD) or Blu-ray technology, and persistent solid-state memory (such as flash memory, solid-state drives, etc.).

[0031] In some examples, display generation component 214 includes a single display (e.g., a liquid crystal display (LCD), an organic light emitting diode (OLED), or other type of display). In some examples, display generation component 214 includes multiple displays. In some examples, display generation component 214 may include a display with touch capabilities (e.g., a touch screen), a projector, a holographic projector, a retinal projector, a transparent or translucent display, etc. In some examples, electronic device 201 includes a touch-sensitive surface 209 for receiving user inputs such as tap inputs and swipe inputs or other gestures, respectively. In some examples, display generation component 214 and touch-sensitive surface 209 form a touch-sensitive display (e.g., a touch screen integrated with electronic device 201 or a touch screen outside electronic device 201 that communicates with electronic device 201).

[0032] The electronic device 201 optionally includes an image sensor 206. The image sensor 206 optionally includes one or more visible light image sensors (such as a charge coupled device (CCD) sensor) and / or a complementary metal oxide semiconductor (CMOS) sensor operable to obtain an image of a physical object from a real-world environment. The image sensor 206 also optionally includes one or more infrared (IR) sensors, such as a passive IR sensor or an active IR sensor, for detecting infrared light from the real-world environment. For example, an active IR sensor includes an IR emitter for emitting infrared light into the real-world environment. The image sensor 206 also optionally includes one or more cameras configured to capture the movement of physical objects in the real-world environment. The image sensor 206 also optionally includes one or more depth sensors configured to detect the distance of the physical object from the electronic device 201. In some examples, information from the one or more depth sensors may allow the device to identify an object in the real-world environment and distinguish it from other objects in the real-world environment. In some examples, the one or more depth sensors may allow the device to determine the texture and / or topography of an object in the real-world environment.

[0033] In some examples, the electronic device 201 uses a combination of a CCD sensor, an event camera, and a depth sensor to detect the physical environment around the electronic device 201. In some examples, the image sensor 206 includes a first image sensor and a second image sensor. The first image sensor and the second image sensor work in tandem and are optionally configured to capture different information of physical objects in the real-world environment. In some examples, the first image sensor is a visible light image sensor and the second image sensor is a depth sensor. In some examples, the electronic device 201 uses the image sensor 206 to detect the positioning and orientation of the electronic device 201 and / or the display generation component 214 in the real-world environment. For example, the electronic device 201 uses the image sensor 206 to track the positioning and orientation of the display generation component 214 relative to one or more fixed objects in the real-world environment.

[0034] In some examples, the electronic device 201 includes a microphone 213 or other audio sensor. The electronic device 201 optionally uses the microphone 213 to detect sounds from the user and / or the user's real-world environment. In some examples, the microphone 213 includes a microphone array (multiple microphones) that optionally operate in conjunction to identify ambient noise or locate a sound source in the space of the real-world environment.

[0035] Electronic device 201 includes a location sensor 204 for detecting the location of electronic device 201 and / or display generating component 214. For example, location sensor 204 may include a GPS receiver that receives data from one or more satellites and allows electronic device 201 to determine the absolute location of the device in the physical world.

[0036] The electronic device 201 includes an orientation sensor 210 for detecting the orientation and / or movement of the electronic device 201 and / or the display generation component 214. For example, the electronic device 201 uses the orientation sensor 210 to track changes in the position and / or orientation of the electronic device 201 and / or the display generation component 214, such as relative to physical objects in the real world environment. The orientation sensor 210 optionally includes one or more gyroscopes and / or one or more accelerometers.

[0037] In some examples, the electronic device 201 includes a hand tracking sensor 202 and / or an eye tracking sensor 212 and / or other body tracking sensors, such as leg, torso, and / or head tracking sensors. The hand tracking sensor 202 is configured to track the position / location of one or more parts of the user's hand, and / or the movement of one or more parts of the user's hand relative to the extended reality environment, relative to the display generation component 214, and / or relative to another defined coordinate system. The eye tracking sensor 212 is configured to track the position and movement of the user's gaze (more generally, eyes, face, or head) relative to the real world or extended reality environment and / or relative to the display generation component 214. In some examples, the hand tracking sensor 202 and / or the eye tracking sensor 212 are implemented together with the display generation component 214. In some examples, the hand tracking sensor 202 and / or the eye tracking sensor 212 are implemented separately from the display generation component 214.

[0038] In some examples, hand tracking sensors 202 (and / or other body tracking sensors, such as leg, torso, and / or head tracking sensors) may use image sensors 206 (e.g., one or more IR cameras, 3D cameras, depth cameras, etc.) that capture three-dimensional information from the real world including one or more hands (e.g., hands of a human user). In some examples, the hands may be resolved with sufficient resolution to distinguish fingers and their respective positioning. In some examples, one or more image sensors 206 are positioned relative to the user to define a field of view and interaction space of the image sensor 206 in which finger / hand positions, orientations, and / or movements captured by the image sensor are used as input (e.g., to distinguish from the user's resting hands or other hands of other people in the real-world environment). Tracking fingers / hands for input (e.g., gestures, touches, taps, etc.) may be advantageous because it does not require the user to touch, hold, or wear any type of beacon, sensor, or other marker.

[0039] In some examples, eye tracking sensor 212 includes at least one eye tracking camera (e.g., an infrared (IR) camera) and / or an illumination source (e.g., an IR light source such as an LED) that emits light toward the user's eyes. The eye tracking camera can be pointed at the user's eyes to receive reflected IR light from the light source directly or indirectly from the eyes. In some examples, both eyes are tracked separately by corresponding eye tracking cameras and illumination sources, and focus / gaze can be determined by tracking both eyes. In some examples, one eye (e.g., the dominant eye) is tracked by one or more corresponding eye tracking cameras / illumination sources.

[0040] The electronic device 201 is not limited to Figure 2 Rather than having components and configurations, the electronic device 201 may include fewer components, other components, or additional components in a variety of configurations. In some examples, the electronic device 201 may be implemented between two electronic devices (e.g., as a system). In some such examples, each (or more) electronic device may each include one or more of the same components discussed above, such as various sensors, one or more display generating components, one or more speakers, one or more processors, one or more memories, and / or communication circuits. One or more people using the electronic device 201 are optionally referred to herein as one or more users of the device.

[0041] Attention is now directed to an exemplary display of a three-dimensional environment on a first electronic device (e.g., corresponding to electronic device 201). As described below, a first electronic device may communicate with a second electronic device in a multi-user communication session. In some examples, an avatar (e.g., representation) of a first user of the first electronic device may be displayed in a three-dimensional environment at a second electronic device, and an avatar of a second user of the second electronic device may be displayed in a three-dimensional environment at the first electronic device. In some examples, when an avatar of a second user of a second electronic device is displayed in a three-dimensional environment at a first electronic device, the first electronic device determines that a location in the three-dimensional environment corresponding to the first electronic device is greater than a threshold distance from a corresponding location associated with the communication session (e.g., the location of the avatar of the second user of the second electronic device). In some examples, in response to determining that a location in the three-dimensional environment corresponding to the first electronic device is farther from a corresponding location associated with the communication session than a threshold distance, the first electronic device presents a notification (e.g., visual and / or audio) to the first user of the first electronic device for use as a warning or alert: a location in the three-dimensional environment corresponding to the first electronic device is farther from a corresponding location associated with the communication session than a threshold distance may result in an imminent consequence (e.g., a delay or loss in real-time communication with the second user of the second electronic device), unless a more recentering input is received, as will be referred to in the example of FIG. FIG. 3A to FIG. 3I More detailed description. The notification can also serve as a warning to the first user of the first electronic device: the first user of the first electronic device is still participating in the communication session even when the location associated with the first electronic device is farther than a threshold distance from the corresponding location associated with the communication session. For example, although the first user of the first electronic device is associated with a location far away from the corresponding location associated with the communication session, the first user of the first electronic device can still send audio data and / or video data to the communication session including the second user of the second electronic device, and / or receive audio data and / or video data from the second user of the second electronic device in the communication session.

[0042] In some examples, and as will be referred to below FIG. 3A to FIG. 3IAs described, the first electronic device 101 determines the distance between the position corresponding to the first electronic device in the computer-generated environment and the corresponding position associated with the communication session. In some examples, the corresponding position associated with the communication session is the position of the avatar of the second user of the second electronic device. In some examples, the corresponding position associated with the communication session is the position corresponding to the shared content in the three-dimensional environment. In some examples, the corresponding position associated with the communication session is the position corresponding to the virtual object in the three-dimensional environment. In some examples, the corresponding position associated with the communication session is a predetermined (e.g., fixed latitude / longitude) position in the three-dimensional environment. In some examples, the corresponding position associated with the communication session is movable. In some examples, the first electronic device 101 determines the corresponding position associated with the communication session based on the type of the communication session, the participants in the communication session, and / or one or more virtual objects included in the three-dimensional environment associated with the communication session.

[0043] FIG. 3A to FIG. 3I Exemplary spatial relationships between electronic devices and reference points in a multi-user communication session according to some examples of the present disclosure are shown. FIG. 3A to FIG. 3I Used to illustrate the process described below, these processes include Figure 4 process.

[0044] Figure 3A 1 shows a situation where the first electronic device 101 is conducting a communication session (eg, a multi-user communication session) with a second electronic device different from the first electronic device 101. The first electronic device 101 and the second electronic device may be similar to Figure 1 Device 101 in, or similar to Figure 2 , and / or may be a head-mounted system / device and / or a projection-based system / device (including a hologram-based system / device) configured to generate and present a three-dimensional environment, such as a head-up display (HUD), a head-mounted display (HMD), a window with integrated display capabilities, a display formed as a lens designed to be placed on a person's eye (e.g., similar to a contact lens). In some examples, a first user of the first electronic device 101 and a second user of the second electronic device are participants in a real-time or near real-time communication session involving the transmission of audio and / or video content captured from one or more corresponding sensors and / or one or more corresponding cameras from the first electronic device and / or the second electronic device. In some examples, the communication session includes displaying and / or otherwise transmitting the body movements and / or facial expressions of the corresponding user via the corresponding avatar of the user in real time via the first electronic device and / or the second electronic device. In some examples, the communication session includes displaying the user's avatar in real time and / or outputting audio corresponding to the user's speech and / or outputting audio as if it were emitted from the corresponding position of the avatar in the three-dimensional environment.

[0045] In some examples, a first user of the first electronic device 101 and a second user of the second electronic device are associated in a spatial arrangement (e.g., orientation and / or position) relative to each other in a three-dimensional environment. For example, the first electronic device 101 controls the virtual position (e.g., avatars / representations of the respective users) of the first user of the first electronic device 101 and the second user of the second electronic device based on a predefined template that takes into account the number of users and / or virtual objects in the communication session when identifying the positions of the respective users. For example, when the first user of the first electronic device 101 and the second user of the second electronic device initially join a communication session, the first user of the first electronic device 101 and the second user of the second electronic device are automatically spatially arranged / positioned in the three-dimensional environment of the communication session according to the predefined template. Examples of different spatial arrangements and / or predefined templates are shown and will be referenced. FIG. 3A to FIG. 3I Give a description.

[0046] In some examples, participants in the communication session are non-spatial participants. Representations of non-spatial participants are not spatially arranged / positioned according to a predefined template, but are displayed within a virtual canvas that includes visible or invisible boundaries in a three-dimensional environment (optionally together with other representations of other non-spatial participants). In some examples, the virtual canvas is positioned and / or oriented to face the spatial participants, as described in more detail below. In some examples, the non-spatial participants correspond to users of videophone devices who join the communication session via a videophone call, voice call, phone call, VoIP call, etc. In some examples, the communication session includes shared virtual content, such as media content (e.g., movies, maps, games, and / or images), application windows, or other content that is accessible and / or interactive with participants in the communication session, as described in reference to Figure 3H and Fig. 3I Described in more detail.

[0047] As mentioned earlier, Figure 3AA situation is shown in which a first user of a first electronic device 101 conducts a communication session with a second user of a second electronic device. The communication session includes the first electronic device 101 in a physical environment that includes a window 346. Therefore, the first electronic device 101 optionally displays a computer-generated environment 344 via the display 120, which includes a captured portion of the physical environment surrounding the first electronic device 101, such as a representation of the window 346. In some examples, the first electronic device 101 and the second electronic device (e.g., via the communication circuit 222) are configured to present a shared three-dimensional environment (e.g., the computer-generated environment 344) including one or more shared virtual objects (e.g., content such as images, videos, audio, etc., a representation of a user interface of an application, etc.) via respective displays (e.g., the display 120), as will be referenced below. Figure 3H and Fig. 3I As used herein, the term "shared three-dimensional environment" refers to a three-dimensional environment that is independently presented, displayed, and / or visible at two or more electronic devices (e.g., a first electronic device 101 and a second electronic device), through which content, applications, data, etc. can be shared and / or presented to users of the two or more electronic devices. In some examples, when the first electronic device 101 is in a communication session with the second electronic device, an avatar corresponding to a user of one electronic device is optionally displayed in the three-dimensional environment displayed via another electronic device. For example, Figure 3A As shown, at the first electronic device 101, an avatar 304 corresponding to the second user of the second electronic device is displayed in the computer-generated environment 344. Similarly, at the second electronic device, an avatar corresponding to the first user of the first electronic device 101 is displayed in the computer-generated environment of the second electronic device. Figure 3A , the first user optionally wears the first electronic device 101 so that the computer-generated environment 344 can be defined by X, Y, and Z axes viewed from the first electronic device 101 (e.g., a viewpoint associated with the first electronic device 101, which can be, for example, a head-mounted display).

[0048] In some examples, an avatar (such as Figure 3A The avatar 304 in the first electronic device 101 and / or the virtual character are optionally created and / or customized by the corresponding user (such as, for example, the corresponding user of the corresponding electronic device (e.g., the first electronic device 101)) and / or correspond to one or more visual characteristics of the corresponding user. In some examples, the first electronic device 101 displays the avatar 304 representing the corresponding user via the display 120. In some examples, the avatar 304 is spatially or non-spatially presented by the first electronic device 101. In some examples, and as described in more detail below (e.g., with reference to FIGS. 3 to 4), the avatar 304 may be displayed in a non-spatially manner. Figure 8), the communication session includes one or more spatial participants and / or non-spatial participants. In some examples, the spatial participants are optionally referred to as three-dimensional representations of the respective users, and the non-spatial participants are optionally referred to as two-dimensional representations of the respective users. In some examples, the avatar 304 (or optionally referred to as a three-dimensional avatar and / or three-dimensional representation of the respective user) is spatial and is optionally based on an electronic device associated with the respective user and provided with XR capabilities (e.g., Figure 1 The three-dimensional spatial data detected by the electronic device 101 configured to present an XR environment including representations of respective participants in the communication session is presented via the display 120.

[0049] In some examples, the respective user is represented by a different representation than avatar 304 (such as, for example, as described below with reference to Figure 5B The second representation 504b is represented by a second representation 504b described in more detail, or a virtual canvas 316 in 3E, or other (e.g., two-dimensional) representation described below. In some examples, the second representation 504b is non-spatial. In some examples, a non-spatial participant optionally joins the communication session using an electronic device without XR capabilities, such as used as a video messaging or video calling application on a cellular phone or tablet, and is optionally represented by a two-dimensional representation based on two-dimensional data (e.g., video data) associated with the respective participant and detected by the electronic device without XR capabilities. In some examples, the respective electronic device (e.g., electronic device 101) changes the respective representation of the respective user from spatial to non-spatial. Thus, in some examples, the respective participant initially joins the communication session using an electronic device with XR capabilities, and is optionally presented based on three-dimensional spatial data. In some examples, when the representation of the respective participant is presented based on three-dimensional spatial data, the spatial data indicates movement outside of the communication session area (e.g., described in more detail below), and in response to the movement outside of the communication session area, the respective electronic device does not transmit the three-dimensional spatial data to the communication session and does not remove the three-dimensional spatial data from the communication session as a spatial participant (e.g., Figure 3A 304) in the present embodiment changes to a non-spatial participant (e.g., Figure 5BIn some examples, the non-spatial representation of the user is displayed within a two-dimensional (or nearly two-dimensional) canvas that is moveable (e.g., relative to other virtual objects and / or users shared in the communication session) by a user of a computer system that is displaying the non-spatial representation (e.g., in response to movement input detected by the computer system). In some examples, in contrast, the spatial representation of the user is not displayed within a two-dimensional (or nearly two-dimensional) canvas, and the spatial representation of the user cannot be moved (e.g., relative to other virtual objects and / or users shared in the communication session) by a user of a computer system that is displaying the spatial representation (e.g., in response to movement input detected by the computer system)—instead, the spatial representation of the user is moved, optionally based on movement input provided by a user corresponding to the spatial representation (e.g., movement of the user in his or her physical environment).

[0050] In some examples, multiple representations (e.g., avatar 304, second representation 504b, virtual canvas 316, and / or other representations of the respective user described herein) are optionally displayed at different distances (e.g., at different depths) relative to the respective user's current viewpoint in a three-dimensional environment. In some examples, multiple representations are two-dimensional virtual elements (e.g., virtual windows and / or containers are two-dimensional). In some examples, one or more virtual windows are arranged in a pattern (or optionally, referred to as a predefined template) in a three-dimensional environment (e.g., the virtual windows are arranged linearly (e.g., aligned at the same height and / or distance relative to the current viewpoint of the first user), or arranged non-linearly (e.g., arranged at different heights and / or distances (e.g., alternating heights and / or distances) relative to the current viewpoint of the corresponding user). In some examples, multiple representations are included in a virtual object associated with the communication session. For example, the virtual object includes one or more virtual windows (e.g., the virtual object has a volume that includes one or more locations of the one or more virtual windows). The virtual object optionally does not include a virtual border and / or perimeter (e.g., a border around the multiple representations is not displayed). In some examples, multiple representations (e.g., and / or virtual objects in which the multiple representations are included) are selectable to move (e.g., collectively) in response to user input. For example, the virtual object and / or multiple representations are displayed together with a selectable option (e.g., an affordance) that, when selected, causes the corresponding electronic device to move the multiple representations (and / or virtual objects) in the three-dimensional environment.

[0051] In some examples, the user's viewpoint determines what is visible in the viewport (e.g., a view of a three-dimensional environment visible to the user via one or more display generation components, a display, or a pair of display modules that provide stereoscopic content to different eyes of the same user). In some examples, the (virtual) viewport has a function that defines the user's viewport via one or more display generation components (e.g., FIG. 3A to FIG. 3IThe viewport boundaries of the range of the three-dimensional environment visible to the display 120 in the display 120. In some examples, the area defined by the viewport boundaries is smaller than the user's visual range in one or more dimensions (e.g., based on the user's visual range, the size, optical properties or other physical characteristics of one or more display generating components, and / or the position and / or orientation of one or more display generating components relative to the user's eyes). In some examples, the area defined by the viewport boundaries is larger than the user's visual range in one or more dimensions (e.g., based on the user's visual range, the size, optical properties or other physical characteristics of one or more display generating components, and / or the position and / or orientation of one or more display generating components relative to the user's eyes). The viewport and viewport boundaries typically move with the movement of one or more display generating components (e.g., with the user's head for a head-mounted device, or with the user's hand for a handheld device such as a tablet or smart phone). The user's viewpoint determines what is visible in the viewport, the viewpoint generally specifies a position and orientation relative to the three-dimensional environment, and as the viewpoint moves, the view of the three-dimensional environment will also move in the viewport. For head-mounted devices, the viewpoint is typically based on the position and orientation of the user's head, face, and / or eyes to provide a view of a three-dimensional environment that is perceptually accurate and provides an immersive experience when the user is using the head-mounted device. For handheld or fixed devices, the viewpoint moves with the movement of the handheld or fixed device and / or with the change of the user's position relative to the handheld or fixed device (e.g., the user moves toward, away from, up, down, right, and / or left). For devices including display generation components with virtual pass-through, the portion of the physical environment visible (e.g., displayed and / or projected) via one or more display generation components is based on the field of view of one or more cameras communicating with the display generation component, and the one or more cameras typically move with the movement of the display generation component (e.g., for head-mounted devices, it moves with the movement of the user's head, or for handheld devices such as tablets or smart phones, it moves with the movement of the user's hands), because the user's viewpoint moves with the movement of the field of view of the one or more cameras (and the appearance of one or more virtual objects displayed via one or more display generation components is updated based on the user's viewpoint (e.g., the display position and posture of the virtual object is updated based on the movement of the user's viewpoint)).For display generating components with optical transmittance, the portion of the physical environment that is visible via one or more display generating components (e.g., optically visible through one or more partially or fully transparent portions of the display generating components) is based on the user's field of view through the partially or fully transparent portions of the display generating components (e.g., moves as the user's head moves for a head-mounted device, or moves as the user's hands move for a handheld device such as a tablet or smart phone) because the user's viewpoint moves as the user moves through the field of view of the partially or fully transparent portions of the display generating components (and the appearance of one or more virtual objects is updated based on the user's viewpoint).

[0052] FIG. 3A to FIG. 3I Also shown is a schematic diagram of a computer-generated environment 344 (such as Figure 3A an overhead view 348) to illustrate the spatial relationship between representations and / or participants' viewpoints (e.g., representations and / or participants' viewpoints within the three-dimensional environment 310 relative to the viewpoint of the first user of the first electronic device 101 and relative to the virtual positions of virtual objects within the three-dimensional environment 310).

[0053] Figure 3A The top view 348 shows a spatial arrangement in which the viewpoint of the first user of the first electronic device 101 (e.g., representation 300) is located at a first virtual position in the three-dimensional environment 310, and the avatar 304 corresponding to the second user of the second electronic device is displayed with an orientation facing the viewpoint of the first user of the first electronic device 101 (e.g., representation 300). In some examples, the avatar 304 corresponding to the second user of the second electronic device is associated with a threshold 308-1 having a radius of a predetermined distance (e.g., 0.1m, 0.3m, 0.5m, 0.7m, 1m, 1.3m, 1.5m, or 2m) and centered at the corresponding position of the avatar 304 corresponding to the second user of the second electronic device. Figure 3A As shown in the top view 348 of the three-dimensional environment 310, the first virtual position corresponding to the first user of the first electronic device 101 is located within the threshold distance 308-1 of the avatar 304 corresponding to the second user of the second electronic device.

[0054] In some examples, the first electronic device 101 determines that one or more criteria are satisfied, including a criterion that is satisfied when a distance between a location in the computer-generated environment corresponding to the first electronic device and a corresponding location associated with the communication session is greater than a threshold distance. In some examples, the first electronic device 101 determines that the viewpoint of the three-dimensional environment 310 changes based on the movement of the first electronic device 101. For example, in Figure 3BIn the example, the first electronic device 101 has moved away from the avatar 304 corresponding to the second user of the second electronic device (e.g., the first user of the first electronic device 101 has moved backward in the physical environment around the first electronic device 101). In response to determining that the viewpoint of the three-dimensional environment 310 has changed based on the movement of the first electronic device 101, the first electronic device determines that a distance between a virtual position corresponding to the first electronic device in the three-dimensional environment 310 and a corresponding position associated with the communication session 306-1 is greater than a threshold distance (e.g., relative to the corresponding position of the second user of the second electronic device). Figure 3B As shown in the top view 348 in FIG. 3 , the virtual location (eg, representation 300 ) corresponding to the first user of the first electronic device 101 is at a distance greater than a threshold distance 308 - 1 from the avatar 304 corresponding to the second user of the second electronic device.

[0055] In some examples, the viewpoint of the three-dimensional environment 310 will change accordingly, so that the first electronic device 101 displays the same Figure 3A The first electronic device 101 receives audio data associated with the second user from the second electronic device. In some examples, in response to obtaining the audio data associated with the second user, the first electronic device outputs audio as if emanating from the corresponding position of the avatar 304 corresponding to the second user of the second electronic device, regardless of whether the distance between the second position in the computer-generated environment corresponding to the first electronic device and the corresponding position associated with the communication session is greater than a threshold distance 308-1, such as Figure 3B as shown in .

[0056] In some examples, in response to determining that one or more criteria are satisfied, including a criterion satisfied when the distance between the location in the computer-generated environment corresponding to the first electronic device and the corresponding location associated with the communication session is greater than a threshold distance, first electronic device 101 displays an indication (e.g., notification 312) via display 120 that the location in the computer-generated environment corresponding to the first electronic device is farther than the threshold distance from the corresponding location associated with the communication session. In some examples and as described herein, the corresponding location associated with the communication session is a corresponding location of a second user of the second electronic device in the communication session.

[0057] In some examples, notification 312 includes notifying a first user of a first electronic device that the first user is too far from a corresponding location associated with the communication session and needs to get closer (e.g., updating a virtual object including an avatar 304 corresponding to a second user of a second electronic device of the communication session relative to a current viewpoint of the first user of the first electronic device (such as Figure 3A As referred to herein, "get closer", "get closer input" and / or "get closer" refers to updating the spatial arrangement of virtual objects of a communication session to improve visibility and / or interactivity of such virtual objects, in some examples, such virtual objects are arranged relative to the current viewpoint of the user of the corresponding electronic device (such as the center of the user's viewpoint). For example, in response to detecting a get closer input corresponding to a request to get closer (e.g., a user's gaze, a finger touching a physical button of the first electronic device 101, contact on a touch-sensitive surface, actuation of a physical input device, a predefined gesture (such as a pinch gesture or an air tap gesture), and / or a voice input from a first user of the first electronic device), the first electronic device 101 moves the virtual object including the representation of the participant relative to the first user of the viewpoint of the first electronic device (e.g., moves the virtual object closer to the viewpoint of the first user). In this case, the first electronic device 101 can change the position and / or orientation of the virtual object in the three-dimensional environment relative to the first user of the first electronic device 101.

[0058] In some examples, notification 312 is optionally configured to be selectable and responsive to user input so that the user can virtually touch, tap, move, rotate or otherwise interact with notification 312 to perform the operation of getting closer described above. In some examples, notification 312 includes audible feedback that notifies the first user of the first electronic device that the first user is too far from the corresponding location associated with the communication session and needs to get closer. In some examples, the first electronic device 101 stops displaying notification 312 after a predetermined time period (e.g., 0.5 minutes, 1 minute, 5 minutes, 10 minutes, 20 minutes, or 30 minutes). In some examples, the first electronic device 101 waits until a threshold amount of time (e.g., 1 second, 2.5 seconds, 5 seconds, 10 seconds, 15 seconds, 30 seconds, 60 seconds, 100 seconds, 200 seconds, or 300 seconds) has passed since one or more criteria were previously met before displaying notification 312. Waiting the threshold amount of time avoids repeatedly displaying and removing notification 312 in response to determining whether a distance between a location in the computer-generated environment corresponding to the first electronic device relative to a corresponding location associated with the communication session is greater than a threshold distance.

[0059] Figure 3C and 3DAn example is depicted in which three users are participating in a communication session. For example, as described above, a first user of a first electronic device 101 is in a communication session (e.g., a multi-user communication session) with a second user of a second electronic device and a third user of a third electronic device, where the third electronic device is different from the first electronic device and the second electronic device. Figure 3C In the embodiment, the electronic device 101 displays the first avatar 304 corresponding to the second user of the second electronic device and the second avatar 314 corresponding to the third user of the third electronic device in the computer-generated environment 344 via the display 120. Similarly, at the third electronic device, the avatar corresponding to the first user of the first electronic device 101 and the first avatar corresponding to the second user of the second electronic device are displayed in the computer-generated environment of the third electronic device.

[0060] Figure 3C The top view 348 shows a spatial arrangement in which the viewpoint of a first user of the first electronic device 101 (e.g., representation 300) is located at a first virtual position in the three-dimensional environment 310, and a first avatar 304 corresponding to a second user of the second electronic device is displayed with an orientation facing the viewpoint of the first user of the first electronic device 101 (e.g., representation 300). A second avatar 314 corresponding to a third user of a third electronic device is to the right of the first virtual position (e.g., representation 300) of the first user of the first electronic device 101. In some examples, the first electronic device selects a corresponding position associated with the communication session to determine whether a distance of a position corresponding to the first electronic device 101 in the computer-generated environment relative to the corresponding position is greater than a threshold distance based on various criteria, which optionally include whether participants are sharing content with each other, the corresponding positions of the participants in the communication session, and / or whether the participants are associated with a virtual object (such as a virtual canvas). For example, one or more criteria include when Figure 3C and Figure 3D In some examples, based on determining that the communication session satisfies one or more criteria, the first electronic device 101 selects a corresponding location associated with the communication session based on a participant closest to the first virtual location and / or viewpoint of the first user of the first electronic device. For example, based on determining that the second user of the second electronic device (e.g., Figure 3D 304 in the overhead view 348 in FIG. 1 ) compared to a third user of a third electronic device in the communication session (eg, Figure 3D The corresponding position of the avatar 314 in the top view 348 in the three-dimensional environment is closer to the current position corresponding to the first electronic device (for example, Figure 3D 300 in the top view 348 in FIG. 300 ), a corresponding location associated with the communication session (e.g., Figure 3DThe representation 306-1 in the top view 348 in FIG. 1 corresponds to the corresponding position of the second user of the second electronic device in the communication session (eg, Figure 3D In another example, based on determining a corresponding position of a third user of a third electronic device (e.g., Figure 3C 314 in the overhead view 348 in the communication session) compared to a corresponding position of a second user of a second electronic device in the communication session (e.g., Figure 3C The avatar 304 in the top view 348 in the three-dimensional environment is closer to the current position corresponding to the first electronic device (e.g., Figure 3C 300 in the top view 348 in FIG. 300 ), a corresponding location associated with the communication session (e.g., Figure 3C The representation 306-1 in the top view 348 in FIG. 1 corresponds to a corresponding position of a third user of a third electronic device in the communication session (eg, Figure 3C avatar 314 in top view 348 in FIG.

[0061] In some examples and as Figure 3C As shown in , the avatar 314 corresponding to the third user of the third electronic device is associated with a threshold 308-2 having a radius of a predetermined distance (e.g., 0.1m, 0.3m, 0.5m, 0.7m, 1m, 1.3m, 1.5m, or 2m) and centered at the corresponding position of the avatar 314 corresponding to the third user of the third electronic device. Figure 3C As shown in the top view 348 of , a first virtual position (eg, representation 300) in the three-dimensional environment 310 corresponding to a first user of the first electronic device 101 is within a threshold distance 308-2 of an avatar 314 corresponding to a third user of the third electronic device.

[0062] In some examples, the first electronic device 101 detects that a first user (eg, representation 300) corresponding to the first electronic device 101 has logged in from Figure 3C The first virtual position in Figure 3D The movement of the second virtual position in Figure 3D , the second location associated with the first user of the first electronic device 101 is farther away than the threshold distance 308-2 associated with the third user of the third electronic device. In some examples, in response to the first electronic device 101 detecting that the first user corresponding to the first electronic device 101 (e.g., representation 300) has moved away from Figure 3C The first virtual position in Figure 3D The first electronic device 101 selects a corresponding position of the second user of the second electronic device in the communication session (eg, Figure 3D304 in the overhead view 348 in FIG. 304 ) as a corresponding location associated with the communication session (e.g., Figure 3D In some examples, the first electronic device 101 selects the corresponding location of the second user of the second electronic device in the communication session as the corresponding location associated with the communication session because the one or more criteria include criteria that are satisfied when the three-dimensional environment does not include shared content in the communication session. In some examples, the first electronic device 101 selects the corresponding location of the second user of the second electronic device in the communication session as the corresponding location associated with the communication session because the one or more criteria include criteria that are satisfied when the three-dimensional environment includes only spatial users in the communication session. In some examples, the first electronic device 101 forgoes displaying the notification 312 because Figure 3D The second virtual location corresponding to the first electronic device in the communication session is relative to the corresponding location associated with the communication session (e.g., Figure 3D The distance between the representation 306-1 in the top view 348 in FIG. 306-1 does not meet one or more criteria (e.g., Figure 3D The distance between the second virtual position corresponding to the first electronic device and the corresponding position of the second user of the second electronic device is within the threshold distance 308-1 associated with the second electronic device).

[0063] FIG. 3E to FIG. 3F An example is depicted in which three users are participating in a communication session, wherein one of the users is a non-spatial user. For example, as described above, a first user of a first electronic device 101 is in a communication session (e.g., a multi-user communication session) with a second user of a second electronic device and a fourth user of a fourth electronic device, wherein the fourth electronic device is different from the first electronic device and the second electronic device. Figure 3E In the embodiment, the electronic device 101 displays, via the display 120, a first avatar 304 corresponding to a second user of the second electronic device and a two-dimensional representation of a fourth user of the fourth electronic device displayed within a virtual canvas 316 corresponding to a fourth user of the fourth electronic device in a computer-generated environment 344. Similarly, at the fourth electronic device, an avatar or other representation corresponding to the first user of the first electronic device 101 and a first avatar or other representation corresponding to the second user of the second electronic device are displayed in the computer-generated environment of the fourth electronic device.

[0064] Figure 3E The top view 348 of illustrative embodiment shows a spatial arrangement in which spatial participants in the communication session (e.g., a first user of a first electronic device 101 represented by representation 300 and a second user of a second electronic device represented by avatar 304) are facing at an angle toward a virtual canvas 316 in which non-spatial participants are displayed. Figure 3EIn the example, the viewpoint (e.g., representation 300) of the first user of the first electronic device 101 is located at a first virtual position in the three-dimensional environment 310, and the first avatar 304 corresponding to the second user of the second electronic device is displayed with an orientation facing the virtual canvas 316 and to the left of the viewpoint of the first user of the first electronic device. The canvas 316 corresponding to the non-spatial participant (e.g., the fourth user of the fourth electronic device) is to the right of the first virtual position (e.g., representation 300) of the first user of the first electronic device 101. In some examples, the first electronic device 101 selects the corresponding position of the non-spatial participant (e.g., the fourth user of the fourth electronic device) as the corresponding position associated with the communication session for determining whether the distance of the position corresponding to the first electronic device 101 relative to the corresponding position in the computer-generated environment is greater than a threshold distance. For example, the one or more criteria include a criterion satisfied when the representation corresponding to the fourth user of the fourth electronic device includes a two-dimensional representation of the fourth user displayed within the virtual canvas 316. In some examples, based on determining that the communication session satisfies the one or more criteria, the first electronic device 101 selects the corresponding position associated with the communication session 306-3 corresponding to the center of the virtual canvas 316.

[0065] In some examples, the first electronic device 101 determines that the viewpoint of the three-dimensional environment 310 changes according to the movement of the first electronic device 101. FIG. 3E to FIG. 3F , the first electronic device 101 has moved away from the corresponding position of the virtual canvas 316 corresponding to the fourth user of the fourth electronic device (e.g., the first user of the first electronic device 101 moves backward in the physical environment around the first electronic device 101). In response to determining that the viewpoint of the three-dimensional environment 310 changes according to the movement of the first electronic device 101, the first electronic device determines that the distance between the virtual position corresponding to the first electronic device in the three-dimensional environment 310 and the corresponding position associated with the canvas 316 is greater than the threshold distance 308-3 associated with the canvas 316. Figure 3F As shown in the top view 348 in FIG. 1 , the distance between the virtual position (eg, representation 300 ) corresponding to the first user of the first electronic device 101 and the virtual canvas 316 corresponding to the fourth user of the fourth electronic device is greater than a threshold distance 308 - 3 .

[0066] In some examples, in response to determining that one or more criteria are satisfied (including a criterion that is satisfied when the distance between the location in the computer-generated environment corresponding to the first electronic device and the corresponding location associated with the communication session is greater than a threshold distance 308-3), the first electronic device 101 displays, via the display 120, an indication (e.g., notification 312) that the distance between the location in the computer-generated environment corresponding to the first electronic device and the corresponding location associated with the communication session 306-3 (e.g., the center of the virtual canvas 316) is greater than the threshold distance. In some examples and as described herein, the corresponding location associated with the communication session is a corresponding location of the virtual canvas corresponding to a fourth user of a fourth electronic device. In some examples, the viewpoint of the three-dimensional environment 310 will change accordingly, causing the first electronic device 101 to display, via the display 120, the corresponding location associated with the communication session. Figure 3E The avatar 304 and the virtual canvas 316 have a smaller appearance than the appearance of the avatar 304 and the virtual canvas 316 in the computer-generated environment (for example, before the first electronic device determines that a distance between a location corresponding to the first electronic device in the computer-generated environment relative to a corresponding location associated with a communication session corresponding to the corresponding location of the virtual canvas 316 is greater than a threshold distance).

[0067] In some examples, when non-spatial participants join the communication session, the first electronic device 101 can group the non-spatial participants together within the virtual canvas. Figure 3G An example is shown in which four non-spatial users (e.g., representations 320, 322, 324, and 326) are participating in a communication session and are presented within a virtual canvas 318 via display 120. In some examples, the virtual canvas 318 is associated with a threshold 308-4 having a radius of a predetermined distance (e.g., 0.1 m, 0.3 m, 0.5 m, 0.7 m, 1 m, 1.3 m, 1.5 m, or 2 m) and centered at a corresponding location of the virtual canvas 318. Figure 3G As shown in the top view 348 of the 3D environment 310, the first virtual position corresponding to the first user of the first electronic device 101 is within the threshold distance 308-4 of the virtual canvas 318 corresponding to four non-spatial participants (e.g., representations 320, 322, 324, and 326). In some examples, representations 320, 322, 324, and 326 are two-dimensional representations of non-spatial participants.

[0068] In some examples, participants in a communication session can share virtual objects (e.g., virtual content such as images, video, audio, media content, etc., representations of user interfaces of applications, etc.) with participants in the communication session. Figure 3H and Fig. 3IAn exemplary communication session is shown in which a shared virtual object 338 (e.g., a representation of a map) can be viewed and / or interacted with by participants in the communication session. Figure 3H In the embodiment, the electronic device 101 displays via the display 120 a first avatar 328 corresponding to a second user of a second electronic device, a second avatar 330 corresponding to a third user of a third electronic device, a first two-dimensional representation of a fourth user of a fourth electronic device, and a second two-dimensional representation of a fifth user of a fifth device, which are displayed together within a virtual canvas 332 in a computer-generated environment 344.

[0069] Figure 3H The top view 348 of the electronic device 101 is shown located in a physical environment (eg, representation 300). The physical environment includes physical features, such as a physical structure (eg, stairs 340 leading to a second floor loft 342). Figure 3H The top view 348 also shows a spatial arrangement in which a viewpoint (e.g., representation 300) of a first user of a first electronic device 101 is located at a first virtual position in a three-dimensional environment 310 of a physical environment, a first avatar 328 corresponding to a second user of a second electronic device is displayed in an orientation facing a shared virtual object 338, a second avatar 330 corresponding to a third user of a third electronic device is displayed in an orientation also facing the shared virtual object 338, and a virtual canvas 332 including two-dimensional representations 334 and two-dimensional representations 336 of a fourth user and a fifth user, respectively, also faces the shared virtual object 338, as well as the viewpoint (e.g., representation 300) of the first user of the first electronic device 101.

[0070] In some examples, the first electronic device 101 selects a corresponding location associated with the communication session to determine whether a location in the computer-generated environment corresponding to the first electronic device 101 is greater than a threshold distance relative to the corresponding location based on various criteria, optionally including whether the participants are sharing content with each other. For example, one or more criteria include when Figure 3H and Fig. 3I In some examples, based on determining that the communication session satisfies one or more criteria, the first electronic device 101 selects a corresponding location associated with the communication session as a center area corresponding to the shared virtual object 338 (e.g., Figure 3H Representation 306-5 shown in the top view 348 in FIG.

[0071] In some examples and as Figure 3H and Fig. 3IAs shown in , the shared virtual object 338 is associated with a threshold 308-5 having a radius of a predetermined distance (e.g., 0.1m, 0.3m, 0.5m, 0.7m, 1m, 1.3m, 1.5m, or 2m) and centered on a central area of ​​an area in the three-dimensional environment 310 corresponding to the shared virtual object 338. Figure 3H As shown in the top view 348 of , a first virtual position (eg, representation 300 ) in the three-dimensional environment 310 corresponding to a first user of the first electronic device 101 is within a threshold distance 308 - 5 of the shared virtual object 338 .

[0072] In some examples, the first electronic device 101 detects a first user (eg, representation 300) of the first electronic device 101. Figure 3H The first virtual position in Fig. 3I 342 of the second floor of the physical environment). Fig. 3I , the second location associated with the first user of the first electronic device 101 is farther away than the threshold distance 308-5 associated with the shared virtual object 338. In some examples, in response to the first electronic device 101 detecting that the first user corresponding to the first electronic device 101 (e.g., representation 300) has moved away from Figure 3H The first virtual position in Fig. 3I The first electronic device 101 determines the movement of the second virtual position corresponding to the first electronic device. Figure 3H The second virtual location in is relative to a corresponding location associated with the communication session (e.g., Fig. 3I The distance between the representation 306-5 in the top view 348 in FIG. 3 satisfies one or more criteria (e.g., Fig. 3I In some examples, the threshold distance from the corresponding location associated with the communication session includes a threshold horizontal distance between the second location corresponding to the first electronic device in the computer-generated environment and the corresponding location associated with the communication session. In some examples, the threshold distance from the corresponding location associated with the communication session includes a threshold vertical distance between the second location corresponding to the first electronic device in the computer-generated environment and the corresponding location associated with the communication session.

[0073] In some examples, the viewpoint of the three-dimensional environment 310 will change accordingly, so that the first electronic device 101 displays the same Figure 3H328 and 330, canvas 332, and shared virtual object 338 in the computer-generated environment as compared to the appearance of the representations of avatars 328 and 330, canvas 332, and shared virtual object 338 having a smaller appearance (e.g., before the first electronic device determines that the distance between the location corresponding to the first electronic device in the computer-generated environment relative to the corresponding location associated with the communication session is greater than a threshold distance). In some examples, in response to determining that one or more criteria are satisfied, including a criterion satisfied when the distance between the location corresponding to the first electronic device in the computer-generated environment relative to the corresponding location associated with the communication session is greater than a threshold distance, the first electronic device 101 displays, via display 120, an indication (e.g., notification 312) that the location corresponding to the first electronic device in the computer-generated environment is farther from the corresponding location associated with the communication session than the threshold distance. In some examples and as described herein, the corresponding location associated with the communication session corresponds to the center of the area in the three-dimensional environment corresponding to the shared content.

[0074] Figure 4 A flowchart illustrating an exemplary process for presenting content in a shared computer-generated environment for a multi-user communication session according to some examples of the present disclosure is shown. In some examples, process 400 begins at an electronic device in communication with a display and one or more input devices. In some examples, the electronic device is optionally similar to or corresponding to Figure 2 The head mounted display of the device 201. Figure 4 As shown in , in some examples, during a communication session with a second electronic device, the first electronic device displays (402a) via a display at a first location in a computer-generated environment a first representation (such as Figure 3A 304 in the representation), wherein the communication session includes a first electronic device (such as Figure 3A A first user of a first electronic device 101) and a second user of a second electronic device.

[0075] In some examples, when displaying a computer-generated environment that includes a first representation corresponding to a second user of a second electronic device at a first location, the first electronic device determines (402b) that one or more criteria are satisfied, including a criterion that is satisfied when a distance between a second location in the computer-generated environment corresponding to the first electronic device relative to a corresponding location associated with the communication session is greater than a threshold distance, such as when Figure 3B The representation 300 corresponding to the first user of the first electronic device 101 is shown at a virtual location in the top view 348 of FIG. 1 , the distance of the virtual location being greater than the threshold distance 308 - 1 associated with the corresponding location associated with the communication session.

[0076] In some examples, in response to determining that one or more criteria are met (402c), the electronic device displays (402d) via the display a computer-generated indication that a second location in the environment corresponding to the first electronic device is farther than a threshold distance from a corresponding location associated with the communication session, such as Figure 3B Instructions 312.

[0077] It should be understood that process 400 is an example and more, fewer or different operations may be performed in the same or different order. In addition, the operations in process 400 described above are optionally performed by running an information processing device such as a general-purpose processor (e.g., as described in relation to Figure 2 or one or more functional modules in a dedicated chip and / or through Figure 2 to be implemented by other components.

[0078] Thus, in accordance with the foregoing, some examples of the present disclosure relate to a method comprising displaying a three-dimensional avatar of a second user in a three-dimensional environment, regardless of whether a distance between a second location corresponding to a first electronic device in the computer-generated environment and a corresponding location associated with a communication session is greater than a threshold distance, such as Fig. 3I In some examples, the first representation corresponding to the second user includes a three-dimensional avatar of the second user, such as Figure 3A In some examples, the method includes obtaining information corresponding to audio associated with the second user from the second electronic device. In some examples, in response to obtaining information corresponding to audio associated with the second user, the method includes presenting the audio as if it were emanating from a corresponding location of the first representation corresponding to the second user of the second electronic device, regardless of whether a distance between the second location corresponding to the first electronic device in the computer-generated environment relative to the corresponding location associated with the communication session is greater than a threshold distance, such as a distance between the representation 300 corresponding to the first user of the first electronic device relative to the corresponding location associated with the communication session. Figure 3B The distance of the corresponding location associated with the communication session 306-1.

[0079] In some examples, the first representation corresponding to the second user includes a three-dimensional avatar of the second user, such as Figure 3C In some examples, the method further includes, when displaying the three-dimensional avatar of the second user in the three-dimensional environment, determining that one or more second criteria are satisfied, including when a second distance between a third position of the three-dimensional avatar corresponding to the second electronic device and a corresponding second position associated with the communication session is greater than a threshold distance (such as Figure 3DIn some examples, in response to determining that one or more second criteria are met, the method further includes displaying the three-dimensional avatar of the second user in the three-dimensional environment, regardless of whether a second distance between a third location in the computer-generated environment corresponding to the second electronic device and a corresponding second location associated with the communication session is greater than a threshold distance, such as when Figure 3B , the display 120 still includes the avatar 304 even though the first electronic device 101 is located at a virtual position corresponding to a corresponding position of the first user of the first electronic device at a distance greater than the threshold distance 308-1.

[0080] In some examples, the one or more criteria include when the three-dimensional environment includes shared content in a communication session (such as Figure 3H In some examples, the corresponding location associated with the communication session corresponds to the center of the area in the three-dimensional environment corresponding to the shared content, such as the area indicated by Figure 3H This is shown as representation 306-5 in top view 348 of FIG.

[0081] In some examples, the one or more criteria include criteria that are satisfied when the three-dimensional environment does not include shared content in the communication session, such as Figure 3C In some examples, based on determining that the corresponding position of the second user of the second electronic device is closer to the current position corresponding to the first electronic device in the three-dimensional environment than the corresponding position of the third user of the third electronic device in the communication session, such as by being closer to Figure 3C The corresponding position associated with the communication session corresponds to the corresponding position of the second user of the second electronic device in the communication session, such as shown by the avatar 314 representing the position of the first user of the first electronic device 101 in the communication session. Figure 3C In some examples, the corresponding position of the third user of the third electronic device is closer to the current position corresponding to the first electronic device in the three-dimensional environment than the corresponding position of the second user of the second electronic device in the communication session, such as by being closer to Figure 3D The corresponding position associated with the communication session corresponds to the corresponding position of the third user of the third electronic device in the communication session, such as shown by the avatar 304 representing the position of the first user of the first electronic device 101 in the communication session. Figure 3D As indicated by representation 306-1 in .

[0082] In some examples, the one or more criteria include when a first representation corresponding to a second user of a second electronic device is included in a virtual canvas (such as Figure 3E In some examples, the corresponding position associated with the communication session corresponds to the center of the virtual canvas, such as by Figure 3E As shown in representation 306-3.

[0083] In some examples, the threshold distance from the corresponding location associated with the communication session includes a threshold horizontal distance between a second location corresponding to the first electronic device in the computer-generated environment relative to the corresponding location associated with the communication session, such as a threshold horizontal distance between a second location corresponding to the first electronic device in the computer-generated environment and the corresponding location associated with the communication session. FIG. 3E to FIG. 3F The horizontal distance shown in .

[0084] In some examples, the threshold distance from the corresponding location associated with the communication session includes a threshold vertical distance between a second location corresponding to the first electronic device in the computer-generated environment relative to the corresponding location associated with the communication session, such as a threshold vertical distance between the second location corresponding to the first electronic device in the computer-generated environment and the corresponding location associated with the communication session. FIG. 3H to FIG. 3I The vertical distances shown in .

[0085] In some examples, determining that one or more criteria are satisfied includes detecting that a first representation of a second user of the second electronic device moves to a location in the three-dimensional environment that is farther than a threshold distance from a corresponding location associated with the communication session, for example, when detecting that the representation 300 moves from Figure 3A Move to the first position in Figure 3B When the second position in .

[0086] In some examples, determining that one or more criteria are satisfied includes detecting movement of a location corresponding to the first electronic device to a location in the three-dimensional environment that is farther than a threshold distance from a corresponding location associated with the communication session, such as when detecting that the representation 300 moves from Figure 3E Move to the first position in Figure 3F When the second position in .

[0087] In some examples, displaying the indication includes stopping displaying the indication after a predetermined period of time, such as stopping displaying the indication after a predetermined period of time. Figure 3F Notification 312 in. In some examples, the one or more criteria include a criterion that is met when more than a threshold amount of time has passed since the one or more criteria were previously met.

[0088] FIG. 5A to FIG. 5H Exemplary techniques for presenting representations of users of a multi-user communication session moving away from a reference point of the multi-user communication session in accordance with some examples of the present disclosure are illustrated. FIG. 5A to FIG. 5H Used to illustrate the process described below, these processes include Figure 6process.

[0089] Figure 5A A first electronic device 101 is shown, which is optionally similar to and / or includes the above reference FIG. 3A to FIG. 3I and Figure 4 One or more characteristics of the first electronic device 101 described. For example, Figure 5A In the embodiment, the first electronic device 101 presents the computer-generated environment 544 via the display 120. In some examples, the computer-generated environment 544 is similar to and / or includes the above reference FIG. 3A to FIG. 3I and / or Figure 4 One or more characteristics of the computer-generated environment 344 are shown. In some examples, the computer-generated environment 544 is visible from the viewpoint of a first user of the first electronic device 101 located within the three-dimensional environment 510 shown in the top view 548 (e.g., facing the back wall of the physical environment in which the first electronic device 101 is located, as represented by the representation 500). Figure 5A As shown, the first electronic device 101 (eg, representation 500) and the window 546 are located in a three-dimensional environment 510. In some examples, and as described above with reference to FIG. 3A to FIG. 3I and / or Figure 4 As described in more detail in the three-dimensional environment 310 in FIG. 5 , the three-dimensional environment 510 is an XR environment, such as a VR environment, an MR environment, or an AR environment, in which a portion of a physical environment can be viewed. For example, the first electronic device 101 can be configured to capture an area of ​​the physical environment that includes the window 546. In some examples, the viewpoint of the first user of the first electronic device 101 determines what content is visible in the viewport (e.g., a view of the three-dimensional environment 510 visible to the user via one or more displays or a pair of display modules that provide stereoscopic content to different eyes of the same user), as described above with reference to FIG. FIG. 3A to FIG. 3I and / or Figure 4 Described in more detail.

[0090] like Figure 5A As shown, in some examples, a first user of the first electronic device 101 conducts a communication session with a second user of the second electronic device (or optionally, referred to as a multi-user communication session). In some examples, facilitating and / or providing a communication session between the first electronic device 101 and the second electronic device (or optionally, one or more third electronic devices) is optionally similar to and / or includes the above reference FIG. 3A to FIG. 3I and Figure 4In some examples, and as described in more detail above, a first user of the first electronic device 101 and a second user of the second electronic device are associated with a spatial arrangement (e.g., orientation and / or position) relative to each other in the three-dimensional environment 510, the spatial arrangement being optionally based on a configuration such as that described in reference to FIG. FIG. 3A to FIG. 3I and / or Figure 4 For example, the one or more predefined templates are optionally based on one or more characteristics or factors (such as the number of participants or users in the communication session, the type of representation used to represent the participants (e.g., avatars, canvases, characters, emoticons, three-dimensional models, or other types of graphical representations or virtual objects), the type of communication (e.g., conversation, presentation, game, or other type of communication), the content being shared or presented in the communication session, and / or the above reference FIG. 3A to FIG. 3I and Figure 4 The predefined templates may be used to define the relative positions and / or orientations of representations of users and / or content included in the communication session.

[0091] In some examples, the first electronic device 101 is configured to determine a communication session area associated with the communication session. In some examples, the electronic device 101 uses the communication session area to indicate where representations of participants that are located within the communication session area (e.g., within a threshold distance from a corresponding location associated with the communication session) may be located (e.g., the electronic device 101 may obtain image data that optionally mimics the real-world appearance of the participants). For example, and as described by Figure 5A As shown in the top view 548 in FIG. 1 , when the first user of the first electronic device 101 and the second user of the second electronic device initially join the communication session, the first user of the first electronic device 101 and the second user of the second electronic device are automatically spatially arranged / positioned in the three-dimensional environment 510 of the communication session according to the predefined template. Examples of different spatial arrangements and / or predefined templates are shown and will be described in the following and / or referenced FIG. 3A to FIG. 3I is described in the accompanying drawings.

[0092] Figure 5AA spatial arrangement is shown in which a viewpoint of a first user of a first electronic device 101 (e.g., representation 500) is located at a first virtual position in a three-dimensional environment 510, and an avatar 504a corresponding to a second user of a second electronic device is located at a second virtual position 506-1 relative to the first position of the first electronic device 101, as shown by a top view 548. In some examples, the avatar 504a is presented in the computer-generated environment 544 via the display 120 with an orientation facing the viewpoint of the first user of the first electronic device 101 (e.g., representation 500). In some examples, the electronic device 101 displays the avatar 504a at the second virtual position 506-1 and / or with an orientation facing the viewpoint of the first user of the first electronic device 101 based on a predefined spatial template of the positions of representations corresponding to users in a communication session described in more detail with reference to methods 400, 600, and / or 800. In some examples, the second virtual position 506-1 of the avatar 504a is associated with a threshold 508-1 having a radius of a predetermined distance (e.g., 0.1 meters, 0.3 meters, 0.5 meters, 0.7 meters, 1 meter, 1.3 meters, 1.5 meters, or 2 meters) and centered at the second virtual position 506-1 of the avatar 504a (e.g., the position of the avatar 504a defined by the predefined spatial template of the current context of the communication session). In some examples, the first electronic device 101 obtains a distance from the avatar 504a that is far away from the second virtual position 506-1 (e.g., to a distance from the avatar 504a that is close to the second virtual position 506-1). Figure 5B In some examples, the first electronic device 101 determines that the movement of the avatar 504a to the third virtual position is farther than the threshold 508-1, such as by Figure 5B In some examples, based on the determination that the movement of avatar 504a to the third position is farther than threshold 508-1, electronic device 101 Figure 5A The presentation of avatar 504a shown in FIG. 5 is changed to a second representation (or optionally referred to as a placeholder representation or space coin) that is different from avatar 504a. Figure 5B , the first electronic device 101 presents the second representation 504 b in the computer-generated environment 544 via the display 120 .

[0093] In some examples, the electronic device 101 presents the second representation 504b and stops displaying the avatar 504a, while the first user of the first electronic device 101 remains part of the communication session. This is achieved when protecting the privacy of the second user, because at the third virtual position (e.g., it is outside the communication session area), sensitive information about the second user is not presented in the communication session, but the second representation 504b is presented in the communication session. Therefore, in some examples, the second electronic device continues to be part of the communication session, and optionally, continues to provide the second user with information from the communication session (e.g., views of corresponding representations of other participants and / or shared content), while protecting the privacy of the second user. In some examples, presenting the second representation 504b avoids speculation about the current physical location and / or context of the second user. In some examples, the second representation 504b includes a circle (e.g., a coin), an oval, a square, a diamond, a triangle, a sphere, a cylinder, a cube, a cone, a cuboid, or other virtual objects or volumes. In some examples, the second representation 504b includes identification information (e.g., a text label), such as the name of the second user. In some examples, the placeholders represent one or more characteristics described below with reference to method 600. In some examples, electronic device 101 Figure 5B 508-1, the fourth virtual position in the three-dimensional environment 510 is the position where the avatar 504a was when the avatar 504a reached the threshold 508-1. In some examples, the electronic device 101 presents the second representation 504b at the last visible position (e.g., the fourth virtual position) within the threshold 508-1 before the avatar 504a moved to the third virtual position that is farther than the threshold 508-1, as shown by Figure 5B In some examples, when the electronic device 101 is as shown in FIG. Figure 5BAs shown in the overhead view 548 in FIG. 1 , when presenting the second representation 504b at the fourth virtual position, the electronic device 101 obtains second information corresponding to the further movement of the avatar 504a away from the third virtual position. In some examples, in response to obtaining the second information, the first electronic device 101 determines that the movement is to a fifth virtual position that is farther than the threshold distance 508-1 from the corresponding position 506-1 associated with the communication session. In some examples, in response to a determination that the fifth virtual position is farther than the threshold distance 508-1, the first electronic device 101 continues to present the second representation 504b at the fourth virtual position (e.g., the first electronic device 101 does not change the position and / or orientation of the second representation 504b based on the movement to the fifth virtual position). In some examples, the first electronic device 101 determines that the movement is to a sixth virtual position within the threshold distance 508-1 from the corresponding position 506-1 associated with the communication session. In some examples, in response to a determination that the sixth virtual location is within the threshold distance 508-1, the first electronic device 101 presents the avatar 504a at the sixth virtual location (e.g., or at a corresponding virtual location corresponding to the sixth virtual location based on a predefined template) via the display 120. Thus, in some examples, the first electronic device 101 does not change the representation of the second user unless (e.g., and / or until) the first electronic device 101 determines to move from the corresponding location 506-1 associated with the communication session to the corresponding location within the threshold distance 508-1. In some examples, when presenting the second representation 504b at the fourth virtual location, the electronic device 101 presents the audio associated with the second user as if emanating from the fourth virtual location (e.g., if the avatar 504a is still displayed, then not from the actual location of the avatar 504a).

[0094] Figure 5C An example is depicted in which three users are participating in a communication session. For example, as described above, a first user of a first electronic device 101 is in a communication session (e.g., a multi-user communication session) with a second user of a second electronic device and a third user of a third electronic device, where the third electronic device is different from the first electronic device and the second electronic device. Figure 5C In the embodiment, the electronic device 101 displays a second avatar 504a corresponding to a second user of the second electronic device and a third avatar 514 corresponding to a third user of the third electronic device in a computer-generated environment 544 via the display 120. Similarly, at the third electronic device, an avatar corresponding to the first user of the first electronic device 101 and a second avatar 504a corresponding to the second user of the second electronic device are displayed in the computer-generated environment of the third electronic device.

[0095] Figure 5CThe top view 548 of shows a spatial arrangement in which the viewpoint of a first user of a first electronic device 101 (e.g., representation 500) is located at a first virtual position in a three-dimensional environment 510, and a second avatar 504a corresponding to a second user of a second electronic device is displayed in an orientation facing the viewpoint of the first user of the first electronic device 101 (e.g., representation 500). A third avatar 514 corresponding to a third user of a third electronic device is to the right of the first virtual position of the first user of the first electronic device 101 (e.g., representation 500). In some examples, the first electronic device 101 selects a corresponding position associated with the communication session (e.g., as optionally defined by a predefined spatial template) based on one or more criteria described in more detail with reference to method 400 for determining whether corresponding movement information associated with the second avatar 504a and the third avatar 514 indicates corresponding movement farther than a threshold distance. For example, the one or more criteria may optionally include whether the participants are sharing content with each other, the corresponding positions of the participants in the communication session, and / or whether the participants are in contact with a virtual object such as a reference. FIG. 3A to FIG. 3I and / or the virtual canvas described in more detail in method 400. Figure 5C As shown, the communication session does not include shared content or a virtual canvas. Therefore, in some examples, the first electronic device 101 selects a corresponding location associated with the communication session based on the participant closest to the first virtual location and / or viewpoint of the first user of the first electronic device 101. For example, the first electronic device 101 determines that a third user of a third electronic device (e.g., Figure 5C 548 in the overhead view 548 of the communication session is closer to the first virtual position corresponding to the first electronic device 101 (e.g., representation 500) in the three-dimensional environment than the corresponding virtual position of the second user of the second electronic device (e.g., avatar 504a) in the communication session, and therefore, in some examples, the electronic device 101 selects the corresponding virtual position of the avatar 514 as the corresponding position associated with the communication session (e.g., Figure 5C506-1 in the overhead view 548 in the figure) for determining whether the corresponding movement information associated with the second avatar 504a and the third avatar 514 indicates a corresponding movement farther than a threshold distance 508-2, the threshold distance having a radius of a predetermined distance (e.g., 0.1 meters, 0.3 meters, 0.5 meters, 0.7 meters, 1 meter, 1.3 meters, 1.5 meters, or 2 meters) and centered on the corresponding virtual position 506-1 of the avatar 514. In some examples, the electronic device 101 obtains information corresponding to the movement of the second avatar 514 away from the corresponding virtual position 506-1 associated with the communication session that is farther than the threshold distance 508-2. In some examples, in response to a determination that the corresponding virtual position is farther than the threshold distance 508-2, the first electronic device 101 presents, via the display 120, a second representation of a third user of the third electronic device at the last position of the avatar 514 within the threshold distance 508-2 before moving to the corresponding virtual position that is farther than the threshold distance 508-2 from the corresponding position 506-1 associated with the communication session. In some examples, presenting the second representation of the third user is similar to and / or includes the above reference Figure 5B The description presents one or more characteristics of the second representation 504b.

[0096] In some examples, the electronic device 101 obtains information corresponding to the movement of the second avatar 514 to the corresponding virtual position within the threshold distance 508-2 from the corresponding position 506-1 associated with the communication session. In some examples, in response to a determination that the corresponding virtual position is within the threshold distance 508-2, the first electronic device 101 presents the second avatar at the corresponding virtual position (or, optionally, at a virtual position corresponding to the corresponding virtual position set by the predefined template). In some examples, the electronic device 101 changes the second avatar 514 according to the movement of the second avatar 514 to the corresponding virtual position, such as, for example, changing the orientation of the second avatar 514.

[0097] Figure 5D An example is depicted in which three users participate in a communication session, wherein one of the users is as described above with reference to FIG. 3A to FIG. 3I For example, as described above, a first user of the first electronic device 101 is in a communication session (e.g., a multi-user communication session) with a second user of a second electronic device and a fourth user of a fourth electronic device, where the fourth electronic device is different from the first electronic device and the second electronic device. Figure 5DIn the embodiment of the present invention, the electronic device 101 displays a second avatar 504a corresponding to a second user of a second electronic device and a two-dimensional representation of a fourth user of a fourth electronic device displayed in a virtual canvas 516 corresponding to a fourth user of a fourth electronic device in a computer-generated environment 544 via the display 120. In some examples, the fourth user is a non-spatial user. For example, the non-spatial user is not spatially arranged / positioned according to a predefined spatial template. In some examples, the virtual canvas 516 (or, optionally, a representation of a non-spatial user or participant) is not presented at a virtual position corresponding to a predefined position in a predefined template, and is optionally presented as a two-dimensional window in a three-dimensional environment, such as a user interface window, around which the avatars, representations and / or viewpoints of the spatial participants (such as the second avatar 504a and the corresponding avatars corresponding to the first user of the first electronic device 101) are arranged. In some examples, the first electronic device 101 presents the non-spatial user being represented by the virtual canvas 516 at a position (or, optionally, referred to as a slot) in a predefined template optionally specified for the spatial user. Thus, in some examples, the electronic device 101 positions and / or orients the non-spatial user in a manner similar to the spatial user, such as by presenting an avatar 504a or FIG. 5A to FIG. 5H One or more characteristics of any of the other incarnations in .

[0098] exist Figure 5D , top view 548 shows a spatial arrangement in which spatial participants including a first user of a first electronic device 101 represented by representation 500 and a second user of a second electronic device represented by avatar 504a in a communication session are positioned (e.g., have corresponding orientations) to face a virtual canvas 516 in which non-spatial participants are displayed. Figure 5D, a viewpoint of a first user of a first electronic device 101 (e.g., representation 500) is located at a first virtual position in a three-dimensional environment 510, and a first avatar 504a corresponding to a second user of a second electronic device is displayed with an orientation facing a virtual canvas 516 and to the left of the viewpoint of the first user of the first electronic device 101. A virtual canvas 516 corresponding to a non-spatial participant (e.g., a fourth user of a fourth electronic device) is to the right of the first virtual position of the first user of the first electronic device 101 (e.g., representation 500). In some examples, the first electronic device 101 selects a corresponding position of a non-spatial participant (e.g., a fourth user of a fourth electronic device) as the corresponding position associated with the communication session for determining whether corresponding movement information associated with the second avatar 504a and the virtual canvas 516 indicates a corresponding movement farther than a threshold distance 508-3, the threshold distance having a radius of a predetermined distance (e.g., 0.1 meters, 0.3 meters, 0.5 meters, 0.7 meters, 1 meter, 1.3 meters, 1.5 meters, or 2 meters) and centered on the corresponding virtual position 506-3 of the virtual canvas 516. In some examples, based on a determination that the communication session includes at least one spatial user and at least one non-spatial user, the electronic device 101 determines that the corresponding position associated with the communication corresponds to the corresponding virtual position of the non-spatial user.

[0099] In some examples, the first electronic device 101 is separated from the avatar 504a. Figure 5D The corresponding virtual position shown in the top view 548 in FIG. Figure 5E In some examples, the first electronic device 101 determines that the avatar 504a is at a position corresponding to the virtual position of the dotted avatar 504a. Figure 5E The movement of the position shown in the top view 548 in FIG. 5 is further than the threshold 508-3, as shown by the corresponding position of the dashed avatar 504a. In some examples, based on the determination that the movement of the avatar 504a to the virtual position is further than the threshold 508-3, the electronic device 101 Figure 5D The presentation of avatar 504a shown in FIG. 5 is changed to a second representation (or optionally referred to as a placeholder representation or space coin) that is different from avatar 504a. Figure 5E In the embodiment, the first electronic device 101 presents the second representation 504b in the computer-generated environment 544 via the display 120. In some examples, presenting the second representation 504b is similar to and / or includes presenting Figure 5B In some examples, the electronic device 101 may be configured to include one or more characteristics of the second representation 504b in the embodiment of the present invention. Figure 5E508-3, the virtual position in the three-dimensional environment 510 is the position where the avatar 504a was when the avatar 504a reached the threshold 508-3. In some examples, the electronic device 101 presents the second representation 504b at the last visible position within the threshold 508-3 before the avatar 504a moved to the corresponding virtual position farther than the threshold 508-3, as shown by Figure 5E 548 in the top view 548. In some examples, when the second representation 504b is presented at the corresponding virtual position, the electronic device 101 presents the audio associated with the second user as if it were emitted from the corresponding virtual position.

[0100] In some examples, participants in a communication session can share virtual objects (e.g., virtual content such as images, video, audio, media content, etc., representations of user interfaces of applications, etc.) with participants in the communication session. FIG. 5F to FIG. 5H An example communication session is shown in which a shared virtual object 538 (e.g., a representation of a map) can be viewed and / or interacted with by participants in the communication session. Fig. 5F In the embodiment, the electronic device 101 displays via the display 120 a first avatar 528a corresponding to a second user of a second electronic device, a second avatar 530a corresponding to a third user of a third electronic device, a first two-dimensional representation 534 of a fourth user of a fourth electronic device, and a second two-dimensional representation 536 of a fifth user of a fifth device, and the first two-dimensional representation and the second two-dimensional representation are displayed together in a virtual canvas 532 in a computer-generated environment 544.

[0101] Fig. 5F Top view 548 of shows electronic device 101 (eg, representation 500 ) located in a physical environment. Fig. 5F The top view 548 shows a spatial arrangement in which a viewpoint of a first user of a first electronic device 101 (e.g., representation 500) is located at a first virtual position in the three-dimensional environment 510 of the physical environment, a first avatar 528a corresponding to a second user of a second electronic device is displayed in an orientation facing a shared virtual object 538, a second avatar 530a corresponding to a third user of a third electronic device is displayed in an orientation also facing the shared virtual object 538, and a virtual canvas 532 including a two-dimensional representation 534 and a two-dimensional representation 536 of a fourth user and a fifth user, respectively, is also facing the shared virtual object 538, as well as the viewpoint of the first user of the first electronic device 101 (e.g., representation 500).

[0102] In some examples, the first electronic device 101 selects the corresponding virtual position 506-5 of the shared virtual object 538 as the corresponding position associated with the communication session for determining whether the corresponding movement information associated with the first avatar 528a, the second avatar 530a, and the virtual canvas 532 indicates a corresponding movement farther than a threshold distance 508-5, the threshold distance having a radius of a predetermined distance (e.g., 0.1 meters, 0.3 meters, 0.5 meters, 0.7 meters, 1 meter, 1.3 meters, 1.5 meters, or 2 meters) and centered on the corresponding virtual position 506-5 of the shared virtual object 538. In some examples, based on a determination that the communication session includes content (such as the shared virtual object 538) being shared within the communication session, the electronic device 101 determines that the corresponding position associated with the communication corresponds to the corresponding virtual position of the shared virtual object 538. Fig. 5F As shown in the top view 548 of , the respective virtual positions of the first avatar 528a, the second avatar 530a, and the virtual canvas 532 are within the threshold distance 508-5 of the shared virtual object 538.

[0103] In some examples, the first electronic device 101 obtains a distance from the avatar 528a. Fig. 5F The corresponding virtual position shown in the top view 548 in FIG. Figure 5G In some examples, the first electronic device 101 determines that the avatar 528a is at a position corresponding to the virtual position of the dotted avatar 528a. Figure 5G The movement of the position shown in the top view 548 in FIG. 5 is further than the threshold 508-5, as shown by the corresponding position of the dashed avatar 528a. In some examples, based on the determination that the movement of the avatar 528a to the virtual position is further than the threshold 508-5, the electronic device 101 Fig. 5F The presentation of avatar 528a shown in FIG. 5 changes to a second representation (or optionally referred to as a placeholder representation or space coin) that is different from avatar 528a. Figure 5G In the embodiment, the first electronic device 101 presents the second representation 528b in the computer-generated environment 544 via the display 120. In some examples, presenting the second representation 528b is similar to and / or includes presenting Figure 5B In some examples, the electronic device 101 may be configured to include one or more characteristics of the second representation 504b in the embodiment of the present invention. Figure 5G508-5. In some examples, the electronic device 101 presents the second representation 504b at a virtual location shown in the top view 548 in the three-dimensional environment 510 that is different from the corresponding virtual location as shown by the corresponding location of the dashed avatar 528a. In some examples, the virtual location in the three-dimensional environment 510 is the location where the avatar 528a was when the avatar 528a reached the threshold 508-5. In some examples, the electronic device 101 presents the second representation 504b at the last visible location within the threshold 508-5 before the avatar 528a moved to the corresponding virtual location farther than the threshold 508-5, as shown by Figure 5G 548 in the top view 548. In some examples, when the second representation 528b is presented at the corresponding virtual position, the electronic device 101 presents the audio associated with the second user as if it were emitted from the corresponding virtual position (e.g., if the avatar 528a is still displayed, it is not emitted from the actual position of the avatar 528a).

[0104] In another example, the first electronic device 101 is away from the avatar 530a. Fig. 5F The corresponding virtual position shown in the top view 548 in FIG. Figure 5G In some examples, the first electronic device 101 determines that the avatar 530a is at a position corresponding to the virtual position of the dotted avatar 530a. Figure 5G The movement of the position shown in the top view 548 in FIG. 5 is further than the threshold 508-5, as shown by the corresponding position of the dashed avatar 530a. In some examples, based on the determination that the movement of the avatar 530a to the virtual position is further than the threshold 508-5, the electronic device 101 Fig. 5F The presentation of avatar 530a shown in FIG. 5 is changed to a second representation (or optionally referred to as a placeholder representation or space coin) that is different from avatar 530a. Figure 5G In the embodiment, the first electronic device 101 presents the second representation 530b in the computer-generated environment 544 via the display 120. In some examples, presenting the second representation 530b is similar to and / or includes presenting Figure 5B In some examples, the electronic device 101 may be configured to include one or more characteristics of the second representation 504b in the embodiment of the present invention. Figure 5G 508-5. In some examples, the electronic device 101 presents the second representation 530b at a virtual location shown in the top view 548 in the three-dimensional environment 510 that is different from the corresponding virtual location as shown by the corresponding location of the dashed avatar 530a. In some examples, the virtual location in the three-dimensional environment 510 is the location where the avatar 530a was when the avatar 530a reached the threshold 508-5. In some examples, the electronic device 101 presents the second representation 530b at the last visible location within the threshold 508-5 before the avatar 530a moved to the corresponding virtual location farther than the threshold 508-5, as shown by Figure 5G548 in the top view 548. In some examples, when presenting the second representation 528b at the corresponding virtual position, the electronic device 101 presents the audio associated with the second user as if it were emitted from the corresponding virtual position (e.g., if the avatar 530a is still displayed, it is not emitted from the actual position of the avatar 530a).

[0105] In some examples, when the electronic device 101 is in a Figure 5G 508-5, the first electronic device 101 continues to present the second representation 520b and the second representation 530b at the corresponding virtual positions shown in the overhead view 548 in FIG. 1 . In some examples, in response to a determination that the second corresponding virtual position is farther than the threshold distance 508-5, the first electronic device 101 continues to present the second representation 520b and the second representation 530b at the corresponding virtual positions (e.g., the first electronic device 101 does not change the corresponding positions and / or orientations of the second representation 520b and the second representation 530b according to the corresponding movement to the second corresponding virtual position). In some examples, the first electronic device 101 determines that the corresponding movement is to a third corresponding virtual position within the threshold distance 508-5 from the corresponding position 506-5 corresponding to the shared virtual object 538. In some examples, in response to a determination that the third corresponding virtual position is within the threshold distance 508-5, the first electronic device 101 presents the avatar 528a and the avatar 530a at the corresponding fourth virtual position (e.g., or at the corresponding virtual position corresponding to the corresponding third virtual position based on the predefined template) via the display 120. Thus, in some examples, the first electronic device 101 does not change the corresponding representation of the corresponding user unless (e.g., and / or until) the first electronic device 101 determines a movement from the corresponding position 506-5 corresponding to the shared virtual object 538 to within the threshold distance 508-5, as described in more detail below.

[0106] In some examples, the first electronic device 101 obtains information corresponding to the movement of the avatar 528a and the avatar 530a back to the corresponding positions within the threshold distance 508-5 of the shared virtual object 538. For example, the electronic device 101 determines that the avatar 528a moves from Figure 5G The first virtual position shown in the top view 548 in FIG. Figure 5H In some examples, based on a determination that the movement of avatar 528a to the second virtual location is within threshold 508-5, electronic device 101 may Figure 5G The second representation 528b of the second user of the second electronic device shown in FIG. 5 is changed to an avatar 528a. Figure 5H , the first electronic device 101 presents the avatar 528a in the computer-generated environment 544 via the display 120. In some examples, the electronic device 101 presents the avatar 528a and stops presenting the second representation 528b because, at the second virtual location, the first electronic device 101 obtains image data to present the avatar 528a that optionally mimics the real-world appearance of the second user. In some examples, the second virtual location is different from the first virtual location and Fig. 5F 532. For example, the second virtual position is next to the virtual canvas 532, with an orientation toward the shared content 538 and the viewpoint of the first user of the first electronic device (e.g., representation 500). In some examples, when the avatar 528a is presented at the second virtual position, the electronic device 101 presents the audio associated with the second user as if it were emanating from the second virtual position.

[0107] In another example, the electronic device 101 determines that the avatar 530a is from Figure 5G The third virtual position shown in the top view 548 in FIG. Figure 5H In some examples, based on a determination that the movement of avatar 530a to the fourth virtual location is within threshold 508-5, electronic device 101 may Figure 5G The second representation 530b of the third user of the third electronic device shown in FIG. 5 is changed to an avatar 530a. Figure 5H , the first electronic device 101 presents the avatar 530a in the computer-generated environment 544 via the display 120. In some examples, the electronic device 101 presents the avatar 530a and stops presenting the second representation 530b because, at the fourth virtual location, the first electronic device 101 obtains image data to present the avatar 530a that optionally mimics the real-world appearance of the third user. In some examples, the fourth virtual location is different from the third virtual location and Fig. 5F For example, the fourth virtual position is to the right of the viewpoint of the first user of the first electronic device (e.g., representation 500). In some examples, when presenting avatar 530a at the fourth virtual position, electronic device 101 presents the audio associated with the second user as if it were emanating from the fourth virtual position.

[0108] Figure 6 A flowchart illustrating an exemplary process for presenting a representation of a user of a multi-user communication session moving away from a reference point of the multi-user communication session according to some examples of the present disclosure is shown. In some examples, process 600 begins at an electronic device in communication with a display and one or more input devices. In some examples, the electronic device is optionally similar to or corresponding to Figure 2 The head mounted display of the device 201. Figure 6 As shown, in some examples, when a communication session is conducted with a second electronic device, the communication session includes a first electronic device (such as Figure 5A In the embodiment of the present invention, a first user of a first electronic device 101 and a second user of a second electronic device are presented (e.g., 602a) by the first electronic device via one or more displays (e.g., display 12) at a first position in a three-dimensional environment and a first representation corresponding to the second user of the second electronic device, such as Figure 5A Avatar 504a at a first virtual position is shown in overhead view 548 in FIG.

[0109] In some examples, when presenting a three-dimensional environment including a first representation corresponding to a second user of a second electronic device at a first location, the first electronic device obtains (e.g., 602b) via one or more input devices information corresponding to movement of the first representation corresponding to the second user away from the first location in the three-dimensional environment, such as avatar 504a moving from the first location to the second location. Figure 5A The first virtual position shown in the top view 548 in FIG. Figure 5B Movement of the second virtual position corresponding to the dashed avatar 504a shown in the overhead view 548 in FIG.

[0110] In some examples, in response to obtaining information corresponding to movement of a first representation corresponding to a second user away from a first location in the three-dimensional environment (e.g., 602c), and based on the movement of the first representation corresponding to the second user corresponding to the first representation corresponding to the second user moving closer to a corresponding location in the three-dimensional environment than a threshold distance (such as 602c) associated with the communication session, Figure 5B The first electronic device moves the first representation corresponding to the second user away from the first position in the three-dimensional environment (e.g., 602e), such as to a position closer to the first position in the three-dimensional environment than the threshold 508-1 in the three-dimensional environment (e.g., 602d). Figure 5B 548 in the top view 548, and changing (e.g., 602f) the presentation of the first representation corresponding to the second user in the three-dimensional environment to a second representation corresponding to the second user that is different from the first representation, such as Figure 5B A second representation 504b is presented via the display 120 in a computer-generated environment 544 in FIG.

[0111] In some examples, in response to obtaining information corresponding to movement of a first representation corresponding to a second user away from a first location in the three-dimensional environment (e.g., 602c), and based on the movement of the first representation corresponding to the second user, moving the first representation corresponding to the second user to a position in the three-dimensional environment within a threshold distance (such as 602c) from a corresponding location associated with the communication session. Figure 5A The first electronic device moves (e.g., 602h) the first representation corresponding to the second user away from the first position in the three-dimensional environment, such as the corresponding virtual position within the threshold 508-1, and maintains (e.g., 602i) the presentation of the first representation corresponding to the second user in the three-dimensional environment, such as maintaining Figure 5A Display of avatar 504a is shown.

[0112] It should be understood that process 600 is an example, and more, fewer, or different operations may be performed in the same or different order. In addition, the operations in the above process 600 are optionally performed by running an information processing device such as a general-purpose processor (e.g., as described in relation to Figure 2 The one or more functional modules in the dedicated chip and / or Figure 2 other components to achieve this.

[0113] Therefore, according to the above, in some examples of the present disclosure, the first representation corresponding to the second user includes a three-dimensional representation of the second user, such as Figure 5A Some examples of the present disclosure relate to a method that includes, when presenting a first representation corresponding to a second user in a three-dimensional environment within a threshold distance from a corresponding location associated with a communication session, a first electronic device obtaining information corresponding to audio associated with the second user from a second electronic device. In some examples, in response to obtaining the information corresponding to the audio associated with the second user, the electronic device presents the audio as emanating from a corresponding location of the first representation corresponding to the second user of the second electronic device, such as, for example, from Figure 5A The corresponding position of avatar 504a in overhead view 548 is shown in FIG.

[0114] In some examples, the corresponding location associated with the communication session corresponds to the corresponding location of the first representation corresponding to the second user of the second electronic device defined by a predefined spatial template of locations of representations corresponding to users in the communication session, such as Figure 5A The corresponding position 506-1 shown in the top view 548 in FIG. In some examples, the corresponding position associated with the communication session corresponds to the center position of a predefined spatial template of the positions of the representations corresponding to the users in the communication session, such as, for example, Fig. 5F506-5 shown in the overhead view 548 of FIG. In some examples, the threshold distance from the corresponding location associated with the communication session includes a threshold horizontal distance between the first representation corresponding to the second user and the corresponding location associated with the communication session, such as, for example Figure 5A In some examples, the threshold distance from the corresponding location associated with the communication session includes a threshold vertical distance between the first representation corresponding to the second user and the corresponding location associated with the communication session, such as, for example, as shown in reference Fig. 3I Threshold vertical distance 308-5 is shown and described.

[0115] Some examples of the present disclosure relate to a method, the method comprising, when presenting a second representation corresponding to a second user at a fourth position in a three-dimensional environment, wherein the fourth position corresponds to a second corresponding position at a threshold distance from a corresponding position associated with a communication session, the electronic device obtaining, via one or more input devices, second information corresponding to a further movement associated with the second user, the further movement corresponding to a position farther than the threshold distance from the corresponding position associated with the communication session, such as, for example, corresponding to Figure 5E In some examples, in response to obtaining the second information, the electronic device maintains presentation of a second representation corresponding to the second user at a fourth position in the three-dimensional environment, such as, for example, Figure 5E In some examples, the fourth position in the three-dimensional environment is the position of the first representation corresponding to the second user when the first representation reaches a threshold distance from the corresponding position associated with the communication session, such as, for example, Figure 5G Some examples of the present disclosure relate to a method, the method comprising, when presenting a second representation corresponding to a second user at a fourth position in a three-dimensional environment, a first electronic device obtaining information corresponding to audio associated with the second user from the second electronic device, and in response to obtaining the information corresponding to the audio associated with the second user, the first electronic device presents the audio as if it were emanating from the fourth position in the three-dimensional environment, such as, for example, presenting the audio as if it were emanating from such a fourth position. Figure 5G In some examples, the fourth position of the second representation corresponding to the second user is at a threshold distance from the corresponding position associated with the communication session, such as, for example, Figure 5GIn some examples, moving the first representation corresponding to the second user away from the first position in the three-dimensional environment includes presenting an animation of the first representation corresponding to the second user moving to a third position in the three-dimensional environment that is within a threshold distance from the corresponding position associated with the communication session, such as, for example, moving avatar 528a to a position within a threshold distance from the corresponding position associated with the communication session. Figure 5H The corresponding positions shown in the top view 548 in FIG.

[0116] Some examples of the present disclosure relate to a method that includes, when presenting a second representation corresponding to a second user, obtaining, via one or more input devices, second information corresponding to a movement associated with the second user, the movement corresponding to a position in the three-dimensional environment within a threshold distance of a corresponding position associated with the communication session, such as, for example, moving avatar 530a to a position within threshold distance 608-5, such as from Figure 5G to Figure 5H In some examples, in response to obtaining the second information, the electronic device changes the presentation of the second representation corresponding to the second user to the first representation corresponding to the second user in the three-dimensional environment, such as displaying Figure 5H The first electronic device presents a first representation corresponding to the second user in the three-dimensional environment at a location within a threshold distance of the corresponding location associated with the communication session and corresponding to the second information, such as at Figure 5H Avatar 530a within threshold distance 508-5.

[0117] FIG. 7A to FIG. 7G Exemplary techniques for presenting content associated with a reference point where a user of a multi-user communication session moves away from the multi-user communication session in accordance with some examples of the present disclosure are illustrated. FIG. 7A to FIG. 7G Used to illustrate the process described below, these processes include Figure 8 In some examples, determining a reference point for a multi-user communication session is similar to and / or includes the process described above with reference to FIG. 3A to FIG. 3I and / or FIG. 5A to FIG. 5H And / or the electronic device described in methods 4 and / or 6 determines one or more characteristics of a reference point (or optionally a corresponding position of a predefined template in a communication session).

[0118] Fig. 7A A first electronic device 101 is shown, which is optionally similar to and / or includes the above reference FIG. 3A to FIG. 3I and Figure 4 One or more characteristics of the first electronic device 101 described. For example, Fig. 7A In the embodiment, the first electronic device 101 presents a computer-generated environment 744 via the display 120 (eg, as described in more detail above), such as the one described above with reference to FIG. FIG. 3A to FIG. 3I and / or Figure 4 In some examples, the computer-generated environment 744 is visible from the viewpoint of a first user of the first electronic device 101 located within the three-dimensional environment 710 shown in the top view 748 (e.g., facing the back wall of the physical environment in which the first electronic device 101 is located). Fig. 7A As shown, the first electronic device 101 and the window 746 are located in a three-dimensional environment 710. In some examples, and as described in more detail above, the three-dimensional environment 710 is an XR environment, such as a VR environment, an MR environment, or an AR environment, in which portions of a physical environment can be viewed. For example, the first electronic device 101 may be configured to capture an area of ​​the physical environment that includes the window 746. In some examples, the viewpoint of the first user of the first electronic device 101 determines what content is visible in the viewport (e.g., a view of the three-dimensional environment 710 visible to the user via one or more displays or a pair of display modules that provide stereoscopic content to different eyes of the same user), as described in more detail above.

[0119] like Fig. 7A As shown, in some examples, a first user of the first electronic device 101 conducts a communication session with a second user of the second electronic device (or optionally, referred to as a multi-user communication session). In some examples, facilitating and / or providing a communication session between the first electronic device 101 and the second electronic device (or optionally, one or more third electronic devices) is optionally similar to and / or includes the above reference FIG. 3A to FIG. 3I and Figure 4 One or more characteristics of facilitating and / or providing a communication session between the first electronic device 101 and the second electronic device are described. In some examples, and as described in more detail above, a first user of the first electronic device 101 and a second user of the second electronic device are associated in a spatial arrangement (e.g., orientation and / or position) relative to each other in the three-dimensional environment 710. For example, the first electronic device 101 controls the respective virtual positions (e.g., avatars or representations of the respective users) of the first user of the first electronic device 101 and the second user of the second electronic device based on a predefined template that takes into account the number of users and / or virtual objects in the communication session when identifying the positions of the respective avatars (or, optionally, representations) of the respective users. For example, and as described by Fig. 7A As shown in the top view 748 in FIG. 1 , when the first user of the first electronic device 101 and the second user of the second electronic device initially join the communication session, the first user of the first electronic device 101 and the second user of the second electronic device are automatically spatially arranged / positioned in the three-dimensional environment 710 of the communication session according to the predefined template. Examples of different spatial arrangements and / or predefined templates are shown and will be described in the following and / or referenced FIG. 3A to FIG. 3Iis described in the accompanying drawings.

[0120] Fig. 7A A spatial arrangement is shown in which a viewpoint of a first user of a first electronic device 101 (e.g., representation 700) is located at a first virtual position in a three-dimensional environment 710, and an avatar 704 corresponding to a second user of a second electronic device is located at a second virtual position 706-1 relative to the first position of the first electronic device 101, as shown by a top view 748. In some examples, the avatar 704 is presented in the computer-generated environment 744 via the display 120 with an orientation facing the viewpoint of the first user of the first electronic device 101 (e.g., representation 700). In some examples, the electronic device 101 displays the avatar 704 at the second virtual position 706-1 and / or with an orientation facing the viewpoint of the first user of the first electronic device 101 based on a predefined spatial template of the positions of representations corresponding to users in a communication session described in more detail with reference to methods 400, 600, and / or 800. In some examples, the second virtual position 706-1 of the avatar 704 is associated with a threshold 708-1 having a radius of a predetermined distance (e.g., 0.1 meters, 0.3 meters, 0.5 meters, 0.7 meters, 1 meter, 1.3 meters, 1.5 meters, or 2 meters) and centered at the second virtual position 706-1 of the avatar 704.

[0121] In some examples, the first electronic device 101 determines that the viewpoint of the three-dimensional environment 710 changes according to the movement of the first electronic device 101. Figure 7B In the embodiment of the present invention, the first electronic device 101 has moved away from the avatar 704 corresponding to the second user of the second electronic device (e.g., the first user of the first electronic device 101 has moved backward in the physical environment around the first electronic device 101), as shown by the top view 748. In response to determining that the viewpoint of the three-dimensional environment 710 has changed based on the movement of the first electronic device 101, the first electronic device 101 determines that a distance between a virtual position corresponding to the first electronic device in the three-dimensional environment 710 relative to a corresponding position associated with the communication session 706-1 is greater than a threshold distance (e.g., relative to the corresponding position of the second user of the second electronic device). Figure 7B As shown in the top view 748 in FIG. 7 , the virtual position corresponding to the first user of the first electronic device 101 (eg, representation 700 ) is greater than a threshold distance 708 - 1 from the avatar 704 corresponding to the second user of the second electronic device.

[0122] In some examples, based on a determination that a virtual location corresponding to a first user of the first electronic device 101 (e.g., representation 700) is farther from a corresponding location associated with the communication (e.g., a corresponding virtual location of avatar 704) than a threshold distance 708-1, the first electronic device 101 presents a three-dimensional environment from the viewpoint of the first user at the virtual location without presenting an avatar 704 corresponding to a second user of the second electronic device, such as Figure 7B As shown (e.g., the avatar 704 is not presented within the viewport of the display 120 of the first user in the three-dimensional environment 710, even if the position of the avatar is otherwise within the field of view and / or viewport of the first user). In some examples, the electronic device 101 displays an indication (e.g., notification 712) via the display 120 that the position corresponding to the first electronic device 101 in the computer-generated environment is farther from the corresponding position associated with the communication session than the threshold distance 708-1. In some examples, the notification 712 includes content requesting the first user to move closer or optionally reposition itself to a position corresponding to the virtual position, which is within the threshold distance 708-1 from the corresponding position associated with the communication session. In some examples, the notification 712 includes navigation instructions, which include directions to reposition itself within the threshold distance 708-1. In some examples, the notification 712 includes a prompt asking the user whether to stop presenting the audio associated with the first user. For example, the notification 712 includes a first option, which, when selected, causes the first electronic device 101 to disable the audio from the first user (e.g., mute the audio). In some examples, notification 712 includes a second option that, when selected, causes the first electronic device 101 to continue providing audio from the first user (and / or optionally, suppress ambient noise).

[0123] Figure 7C An example is depicted in which three users participate in a communication session, wherein one of the users is as described above with reference to FIG. 3A to FIG. 3I For example, as described above, a first user of the first electronic device 101 is in a communication session (e.g., a multi-user communication session) with a second user of a second electronic device and a fourth user of a fourth electronic device, where the fourth electronic device is different from the first electronic device and the second electronic device. Figure 7C In the example, the electronic device 101 displays a second avatar 704 corresponding to a second user of the second electronic device and a two-dimensional representation of a fourth user of the fourth electronic device displayed in a virtual canvas 716 corresponding to a fourth user of the fourth electronic device in a computer-generated environment 744 via the display 120. In some examples, the fourth user is a non-spatial user, as described above with reference to Figure 5D For example, presenting a non-spatial user within the virtual canvas 716 is similar to and / or includes the above reference Figure 5Dand Figure 5E One or more characteristics of the non-spatial user are described as being presented within the virtual canvas 516 .

[0124] In some examples, the first electronic device 101 determines that the viewpoint of the three-dimensional environment 710 changes according to the movement of the first electronic device 101. FIG. 7C to FIG. 7D , the first electronic device 101 has moved away from the corresponding position 706-3 of the virtual canvas 716 corresponding to the fourth user of the fourth electronic device (e.g., the first user of the first electronic device 101 moves backward in the physical environment around the first electronic device 101). In response to determining that the viewpoint of the three-dimensional environment 710 has changed according to the movement of the first electronic device 101, the first electronic device 101 determines that the distance between the virtual position corresponding to the first electronic device in the three-dimensional environment 710 and the corresponding position 706-3 associated with the canvas 716 is greater than the threshold distance 708-3 associated with the canvas 716. Fig.7D As shown in the top view 748 in FIG. 1 , the virtual position corresponding to the first user of the first electronic device 101 (e.g., representation 700) is greater than the threshold distance 708-3 from the virtual canvas 716 corresponding to the fourth user of the fourth electronic device. In some examples, determining and / or selecting the corresponding position 706-3 is similar to and / or includes the above reference FIG. 3A to FIG. 3I and / or FIG. 5A to FIG. 5H And / or the electronic device 101 described in methods 4 and / or 6 determines one or more characteristics of a reference point (or optionally a corresponding position of a predefined template in a communication session).

[0125] In some examples, based on a determination that a virtual location corresponding to a first user of the first electronic device 101 (e.g., representation 700) is farther from a corresponding location 706-3 associated with the communication than a threshold distance 708-3, the first electronic device 101 presents a three-dimensional environment from the viewpoint of the first user at the virtual location without presenting an avatar 704 corresponding to a second user of the second electronic device and without presenting a virtual canvas 716, as shown in FIG. Fig.7D In some examples, electronic device 101 displays, via display 120, an indication (e.g., notification 712) that a location in a computer-generated environment corresponding to first electronic device 101 is farther from a corresponding location associated with the communication session than threshold distance 708-3. In some examples, notification 712 includes a prompt asking the user whether to stop presenting audio associated with the first user.

[0126] In some examples, participants in a communication session may share virtual objects with participants in the communication session, as described above with reference to FIG. 5F to FIG. 5H For example, FIG. 7E to FIG. 7GAn example communication session is shown in which a shared virtual object 738 (e.g., a representation of a map) can be viewed and / or interacted with by participants in the communication session. Fig. 7E In the embodiment, the electronic device 101 displays via the display 120 a first avatar 728 corresponding to a second user of a second electronic device, a second avatar 730 corresponding to a third user of a third electronic device, a first two-dimensional representation 734 of a fourth user of a fourth electronic device, and a second two-dimensional representation 736 of a fifth user of a fifth device, and the first two-dimensional representation and the second two-dimensional representation are displayed together in a virtual canvas 732 in a computer-generated environment 744.

[0127] Fig. 7E The top view 748 shows the electronic device 101 (eg, representation 700 ) located in a physical environment. Fig. 7E The top view 748 shows a spatial arrangement in which a viewpoint of a first user of a first electronic device 101 (e.g., representation 700) is located at a first virtual position in a three-dimensional environment 710 of a physical environment, a first avatar 728 corresponding to a second user of a second electronic device is displayed in an orientation facing a shared virtual object 738, a second avatar 730 corresponding to a third user of a third electronic device is displayed in an orientation also facing the shared virtual object 738, and a virtual canvas 732 including a two-dimensional representation 734 and a two-dimensional representation 736 of a fourth user and a fifth user, respectively, is also facing the shared virtual object 738, as well as the viewpoint of the first user of the first electronic device 101 (e.g., representation 700).

[0128] In some examples, the first electronic device 101 determines that the viewpoint of the three-dimensional environment 710 changes according to the movement of the first electronic device 101. FIG. 7E to FIG. 7F , the first electronic device 101 has moved away from the corresponding position 706-5 of the shared virtual object 738 corresponding to the fourth user of the fourth electronic device (for example, the first user of the first electronic device 101 moves backward in the physical environment around the first electronic device 101). In response to determining that the viewpoint of the three-dimensional environment 710 changes according to the movement of the first electronic device 101, the first electronic device 101 determines that the distance between the virtual position corresponding to the first electronic device in the three-dimensional environment 710 and the corresponding position 706-5 associated with the shared virtual object 738 is greater than the threshold distance 708-5 associated with the shared virtual object 738. Figure 7F As shown in the top view 748 in FIG. 7 , the virtual position corresponding to the first user of the first electronic device 101 (eg, representation 700 ) is greater than a threshold distance 708 - 5 from the shared virtual object 738 .

[0129] In some examples, based on a determination that a virtual location corresponding to a first user of the first electronic device 101 (e.g., representation 700) is farther from a corresponding location 706-5 associated with the communication than a threshold distance 708-5, the first electronic device 101 presents a three-dimensional environment from the viewpoint of the first user at the virtual location without presenting avatars 728, 730 and virtual canvas 732, as shown in FIG. Figure 7F As shown. In some examples, electronic device 101 displays, via display 120, an indication (e.g., notification 712) that a location in a computer-generated environment corresponding to first electronic device 101 is farther from a corresponding location associated with the communication session than threshold distance 708-3. In some examples, notification 712 includes content indicating that audio associated with the first user is presented to participants in the communication session regardless of a location associated with the viewpoint of the first user in the three-dimensional environment of the second electronic device. For example, audio associated with the first user is presented as being from the last virtual location within threshold distance 708-5 before moving beyond threshold distance 708-5 (e.g., such as reference figures 5 and Figure 6 In some examples, notification 712 includes an indication that a placeholder representation (e.g., similar to and / or including) corresponding to the first user of first electronic device 101 is displayed at the corresponding device of the participant in the communication session. Figure 5B In some examples, notification 712 includes one or more prompts requesting whether to continue displaying the placeholder representation and / or whether to stop presenting the audio associated with the first user. For example, in Figure 7F In some examples, the first prompt includes a request to enable or disable presentation of a placeholder representation for a first user of the electronic device. In some examples, the first electronic device 101 detects input directed to the first user interface element (e.g., switching the user interface element), and in response to detecting the input, the first electronic device 101 continues to present a placeholder representation representing the first user of the first electronic device 101 in the communication session. In some examples, when the first electronic device 101 does not detect input directed to the first user interface element (e.g., after a predetermined time such as 1 second, 2 seconds, 5 seconds, 10 seconds, 15 seconds, 20 seconds, or 30 seconds), the first electronic device 101 stops displaying the placeholder representation in the communication session. In some examples, and as Figure 7FAs shown, notification 712 includes a second prompt requesting a first user of first electronic device 101 to enable or disable spatial audio from the first user. In some examples, first electronic device 101 detects input directed to a second user interface element (e.g., a second switching user interface element), and in response to detecting the input, first electronic device 101 continues to present the spatial audio as emanating from the first user of first electronic device 101. In some examples, when first electronic device 101 does not detect input directed to the second user interface element (e.g., after a predetermined time), first electronic device 101 stops presenting the spatial audio from the first user (e.g., mutes the spatial audio).

[0130] In some examples, the first electronic device 101 determines that the viewpoint of the three-dimensional environment 710 changes according to the movement of the first electronic device 101. FIG. 7F to FIG. 7G , the first electronic device 101 has moved toward the corresponding position 706-5 of the shared virtual object 738 (e.g., the first user of the first electronic device 101 moves forward and left in the physical environment around the first electronic device 101). In response to determining that the viewpoint of the three-dimensional environment 710 changes according to the movement of the first electronic device 101, the first electronic device 101 determines that the distance between the virtual position corresponding to the first electronic device in the three-dimensional environment 710 and the corresponding position 706-5 associated with the shared virtual object 738 is less than the threshold distance 708-5 associated with the shared virtual object 738. Figure 7G As shown in the overhead view 748 in FIG. 7 , the virtual location corresponding to the first user of the first electronic device 101 (e.g., representation 700) is within a threshold distance 708-5 from the corresponding location 706-5 of the shared virtual object 738. In some examples, based on a determination that the virtual location corresponding to the first user of the first electronic device 101 (e.g., representation 700) is within the threshold distance 708-5 from the corresponding location 706-5 associated with the communication session, the first electronic device 101 presents the three-dimensional environment from the viewpoint of the first user at the virtual location and presents the avatars 728, 730, and the virtual canvas 732, as shown in FIG. Figure 7G In some examples, such as Figure 7G The first user's viewpoint is shown to be different from Figure 7FThe viewpoint shown is different because the corresponding virtual position of the first electronic device 101 is different. In some examples, when the electronic device 101 determines a change in the virtual position and / or orientation of the first user, the electronic device 101 presents the avatars 728, 730, the virtual canvas 732, and / or the shared virtual object 738 from a corresponding viewpoint corresponding to the changed virtual position and / or orientation. In some examples, when the first electronic device 101 determines that the electronic device 101 is at a corresponding virtual position within a threshold distance, the electronic device 101 presents the three-dimensional environment from a corresponding viewpoint corresponding to the position and / or orientation defined by the predefined template (e.g., from a viewpoint centered on the shared virtual object 738 while the avatars 728, 730 and the virtual canvas 732 are also presented within the viewport).

[0131] Figure 8 A flowchart of an exemplary process for presenting content associated with a reference point at which a user of a multi-user communication session moves away from the multi-user communication session according to some examples of the present disclosure is shown. In some examples, process 800 begins at a first electronic device in communication with a display and one or more input devices. In some examples, the first electronic device is optionally connected to Figure 2 The device 201 is similar to or corresponds to a head mounted display. Figure 6 As shown, in some examples, when a communication session is conducted with a second electronic device, the communication session includes a first electronic device (such as Figure 5A A first user of a first electronic device 101 in a three-dimensional environment and a second user of a second electronic device, wherein a viewpoint of the first user has a first position in a three-dimensional environment and a viewpoint of the second user has a second position in the three-dimensional environment, the first electronic device presents (e.g., 802a) a first representation corresponding to the second user of the second electronic device at the second position in the three-dimensional environment via one or more displays (e.g., display 120), such as Fig. 7A Avatar 704 in.

[0132] In some examples, when presenting a three-dimensional environment including a first representation corresponding to a second user of a second electronic device at a second location, the first electronic device detects (e.g., 802b) via one or more input devices a movement of the first user's viewpoint away from the first location in the three-dimensional environment (such as a movement of the representation 700 of the first user of the first electronic device 101 to the first location as indicated by the first electronic device 102). Figure 7BIn some examples, in response to detecting movement of the first user's viewpoint away from the first location in the three-dimensional environment and when the second location of the first representation corresponding to the second user of the second electronic device is within the viewport of one or more displays of the first user in the three-dimensional environment (e.g., 802c), and based on a determination that the movement of the first user's viewpoint corresponds to movement of the first user's viewpoint to a third location in the three-dimensional environment that is farther than a threshold distance from the corresponding location associated with the communication session (e.g., 802d), the first electronic device presents (e.g., 802e) the three-dimensional environment from the viewpoint of the first user at the third location without presenting the first representation corresponding to the second user at the second location in the three-dimensional environment, such as Figure 7B As shown via display 120 .

[0133] In some examples, in response to detecting movement of a first user's viewpoint away from a first location in a three-dimensional environment and when a second location of a first representation corresponding to a second user of a second electronic device is within a viewport of one or more displays of the first user in the three-dimensional environment (e.g., 802c), and based on a determination that the movement of the first user's viewpoint corresponds to movement of the first user's viewpoint to a fourth location in the three-dimensional environment that is within a threshold distance from a corresponding location associated with the communication session (e.g., 802f), the first electronic device presents (e.g., 802g) the three-dimensional environment from the viewpoint of the first user at the fourth location, including presenting a first representation corresponding to the second user at the second location in the three-dimensional environment, such as Fig. 7A As shown via display 120 .

[0134] It should be understood that process 800 is an example, and more, fewer, or different operations may be performed in the same or different order. In addition, the operations in the above process 800 are optionally performed by running an information processing device such as a general-purpose processor (e.g., as described in relation to Figure 2 The one or more functional modules in the dedicated chip and / or Figure 2 other components to achieve this.

[0135] Therefore, according to the above, some examples of the present disclosure relate to a method, the method comprising, when presenting a three-dimensional environment from a viewpoint of a first user at a third position, a first electronic device obtaining information corresponding to audio associated with the second user from a second electronic device, and in response to obtaining the information corresponding to the audio associated with the second user, the first electronic device presents the audio regardless of the second position of the viewpoint of the second user, such as, for example, presenting the audio regardless of Figure 7BSome examples of the present disclosure relate to a method that includes, when presenting a three-dimensional environment from a viewpoint of a first user at a fourth position, a first electronic device obtaining information corresponding to audio associated with the second user from a second electronic device, and in response to obtaining the information corresponding to the audio associated with the second user, the first electronic device presents the audio as if it were emitted from a second position corresponding to the viewpoint of the second user of the second electronic device, such as, for example, presenting the audio as if it were emitted from a second position corresponding to the viewpoint of the second user of the second electronic device. Fig. 7A The corresponding virtual position of the avatar 704 in the image is emitted as shown.

[0136] In some examples, the corresponding location associated with the communication session corresponds to the center location of a predefined spatial template of the locations of the representations corresponding to the users in the communication session, such as, for example, Fig. 7E 706-5 corresponding to the shared virtual content 738 shown in the top view 748 in FIG. In some examples, the threshold distance from the corresponding location associated with the communication session includes a threshold horizontal distance between the viewpoint of the first user and the corresponding location associated with the communication session, such as, for example, Figure 7F In some examples, the threshold distance from the corresponding location associated with the communication session includes a threshold vertical distance between the first user's viewpoint and the corresponding location associated with the communication session, such as, for example, Fig. 3I Some examples of the present disclosure relate to a method that includes, when presenting a three-dimensional environment from a viewpoint of a first user at a third location, a first electronic device presenting, via one or more displays, audio associated with the first user being presented at a second electronic device regardless of an indication of a location associated with the viewpoint of the first user in the three-dimensional environment of the second electronic device, such as Figure 7F Notification 712 in.

[0137] Some examples of the present disclosure relate to a method comprising, when presenting a three-dimensional environment from a viewpoint of a first user at a third location, a first electronic device presenting, via one or more displays, an indication that a placeholder virtual object representing a pose of a viewpoint of the first user at the third location is presented at a second electronic device, such as Figure 7F Some examples of the present disclosure relate to a method that includes, when presenting a three-dimensional environment from a viewpoint of a first user at a third location, presenting an option via one or more displays that, when selected, causes a second electronic device to stop presenting audio associated with the first user as emanating from a location corresponding to the viewpoint of the first user and to stop presenting a representation corresponding to the first user of the first electronic device at a location corresponding to the viewpoint of the first user, such as Figure 7FNotification 712 in. Some examples of the present disclosure relate to a method that includes, when presenting a three-dimensional environment from a viewpoint of a first user at a third location, a first electronic device detecting, via one or more input devices, a second input corresponding to a movement of the viewpoint of the first user away from the third location, and in response to detecting the movement of the viewpoint of the first user away from the third location when a corresponding location of a first representation corresponding to a second user of the second electronic device is within a viewport of one or more displays of the first user in the three-dimensional environment, and based on a determination that the movement of the viewpoint of the first user corresponds to a movement of the viewpoint of the first user to a fifth location in the three-dimensional environment within a threshold distance from the corresponding location associated with a communication session, the first electronic device presenting the three-dimensional environment from the viewpoint of the first user at the fifth location, including presenting a first representation corresponding to the second user at a corresponding location in the three-dimensional environment corresponding to the second user, such as at a Fig. 7E Avatars 728 , 730 and a virtual canvas 732 are presented via display 120 .

[0138] Some examples of the present disclosure relate to a method that includes, in response to detecting movement of a viewpoint of the first user away from a third location when a corresponding location of a first representation corresponding to a second user of a second electronic device is within a viewport of one or more displays of the first user in a three-dimensional environment, and based on a determination that the movement of the viewpoint of the first user corresponds to movement of the viewpoint of the first user to a sixth location in the three-dimensional environment that is farther than a threshold distance from the corresponding location associated with a communication session, the first electronic device presenting the three-dimensional environment from the viewpoint of the first user at the sixth location without presenting the first representation corresponding to the second user in the three-dimensional environment, such as Figure 7F Some examples of the present disclosure relate to a method that includes, in response to detecting movement of a first user's viewpoint away from a first location in a three-dimensional environment, presenting, by a first electronic device, via one or more displays, an indication that movement of the first user's viewpoint to a corresponding location in the three-dimensional environment that is farther than a threshold distance from the corresponding location associated with a communication session will cause a change in the visual appearance of a representation corresponding to the first user of the first electronic device presented by a second electronic device, such as Figure 7F Notification 712 in.

[0139] Some examples of the present disclosure relate to an electronic device comprising: one or more processors; a memory; and one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for executing any of the above methods.

[0140] Some examples of the present disclosure relate to a non-transitory computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by one or more processors of an electronic device, cause the electronic device to perform any of the above methods.

[0141] Some examples of the present disclosure relate to an electronic device comprising one or more processors, a memory, and a component for performing any of the above methods.

[0142] Some examples of the present disclosure relate to an information processing apparatus used in an electronic device, the information processing apparatus including a component for executing any one of the above methods.

[0143] For the purpose of explanation, the foregoing description is described by reference to specific embodiments. However, the above illustrative discussion is not intended to be exhaustive or to limit the invention to the precise form disclosed. Many modifications and variations are possible based on the above teachings. The examples are selected and described in order to best illustrate the principles of the invention and its practical application, so that other persons skilled in the art can best use the invention and the various described examples with various modifications suitable for the specific purposes contemplated.

Claims

1. A method, comprising: At a first electronic device in communication with a display and one or more input devices: When conducting a communication session with a second electronic device, the communication session includes a first user of the first electronic device and a second user of the second electronic device, displaying, via the display, a first representation corresponding to the second user of the second electronic device at a first location in a computer-generated environment; while displaying the computer-generated environment including the first representation corresponding to the second user of the second electronic device at the first location, determining that one or more criteria are satisfied, including a criterion that is satisfied when a distance between a second location in the computer-generated environment corresponding to the first electronic device and a corresponding location associated with the communication session is greater than a threshold distance; In response to determining that the one or more criteria are met: An indication is displayed via the display that the second location in the computer-generated environment corresponding to the first electronic device is farther than the threshold distance from the corresponding location associated with the communication session.

2. The method of claim 1, wherein the first representation corresponding to the second user comprises a three-dimensional avatar of the second user, the method further comprising: displaying the three-dimensional avatar of the second user in the computer-generated environment regardless of whether the distance between the second location in the computer-generated environment corresponding to the first electronic device and the corresponding location associated with the communication session is greater than the threshold distance; obtaining, from the second electronic device, information corresponding to audio associated with the second user; as well as In response to obtaining the information corresponding to the audio associated with the second user, presenting the audio as emanating from a corresponding location of the first representation corresponding to the second user of the second electronic device, regardless of whether the distance between the second location corresponding to the first electronic device and the corresponding location associated with the communication session in the computer-generated environment is greater than the threshold distance.

3. The method of any one of claims 1 to 2, wherein the first representation corresponding to the second user comprises a three-dimensional avatar of the second user, the method further comprising: determining, while displaying the three-dimensional avatar of the second user in the computer-generated environment, that one or more second criteria are satisfied, including a criterion that is satisfied when a second distance between a third position of the three-dimensional avatar corresponding to the second electronic device and a corresponding second position associated with the communication session is greater than the threshold distance; and In response to determining that the one or more second criteria are satisfied: The three-dimensional avatar of the second user is displayed in the computer-generated environment regardless of whether the second distance between the third position corresponding to the second electronic device in the computer-generated environment and the corresponding second position associated with the communication session is farther than the threshold distance.

4. The method according to any one of claims 1 to 3, wherein: The one or more criteria include criteria that are satisfied when the computer-generated environment includes shared content in the communication session; and The corresponding location associated with the communication session corresponds to a center of an area in the computer-generated environment that corresponds to the shared content.

5. The method according to any one of claims 1 to 4, wherein: The one or more criteria include criteria that are satisfied when the computer-generated environment does not include shared content in the communication session; and ： the corresponding location associated with the communication session corresponding to the corresponding location of the second user of the second electronic device in the communication session based on determining that the corresponding location of the second user of the second electronic device is closer to a current location corresponding to the first electronic device in the computer-generated environment than the corresponding location of the third user of the third electronic device in the communication session; as well as Based on determining that the corresponding position of the third user of the third electronic device is closer to the current position corresponding to the first electronic device in the computer-generated environment than the corresponding position of the second user of the second electronic device in the communication session, the corresponding position associated with the communication session corresponds to the corresponding position of the third user of the third electronic device in the communication session.

6. The method according to any one of claims 1 to 5, wherein: The one or more criteria include a criterion that is satisfied when the first representation corresponding to the second user of the second electronic device includes a two-dimensional representation of the second user displayed within a virtual canvas; and The corresponding location associated with the communication session corresponds to a center of the virtual canvas.

7. A method according to any one of claims 1 to 6, wherein the threshold distance from the corresponding location associated with the communication session includes a threshold horizontal distance between the second location corresponding to the first electronic device in the computer-generated environment and the corresponding location associated with the communication session.

8. A method according to any one of claims 1 to 7, wherein the threshold distance from the corresponding location associated with the communication session includes a threshold vertical distance between the second location corresponding to the first electronic device in the computer-generated environment and the corresponding location associated with the communication session.

9. A method according to any one of claims 1 to 8, wherein determining that the one or more criteria are satisfied includes detecting that the first representation of the second user of the second electronic device moves to a location in the computer-generated environment that is farther than the threshold distance from the corresponding location associated with the communication session.

10. A method according to any one of claims 1 to 9, wherein determining that the one or more criteria are satisfied includes detecting that a location corresponding to the first electronic device moves to a location in the computer-generated environment that is farther than the threshold distance from the corresponding location associated with the communication session.

11. The method of any one of claims 1 to 10, wherein displaying the indication comprises ceasing to display the indication after a predetermined period of time.

12. The method of any one of claims 1 to 11, wherein the one or more criteria include a criterion that is satisfied when more than a threshold amount of time has elapsed since a previous satisfaction of the one or more criteria.

13. An electronic device, comprising: one or more processors; Memory; and One or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising instructions for executing the method according to any one of claims 1 to 12.

14. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions that, when executed by one or more processors of an electronic device, cause the electronic device to perform the method according to any one of claims 1 to 12.

15. An electronic device, comprising: one or more processors; Memory; and A component for carrying out the method according to any one of claims 1 to 12.

16. An information processing device used in an electronic device, the information processing device comprising: A component for carrying out the method according to any one of claims 1 to 12.

17. A method comprising: At a first electronic device in communication with one or more displays and one or more input devices: while engaging in a communication session with a second electronic device, the communication session including a first user of the first electronic device and a second user of the second electronic device, presenting, via the one or more displays, a first representation corresponding to the second user of the second electronic device at a first location in a three-dimensional environment; while presenting the three-dimensional environment including the first representation corresponding to the second user of the second electronic device at the first location, obtaining, via the one or more input devices, information corresponding to movement of the first representation corresponding to the second user away from the first location in the three-dimensional environment; as well as In response to obtaining the information corresponding to the movement of the first representation corresponding to the second user away from the first location in the three-dimensional environment: Based on determining that the movement of the first representation corresponding to the second user corresponds to movement of the first representation corresponding to the second user to a second location in the three-dimensional environment that is further than a threshold distance from a corresponding location associated with the communication session: moving the first representation corresponding to the second user away from the first location in the three-dimensional environment; and changing the presentation of the first representation corresponding to the second user in the three-dimensional environment to a second representation corresponding to the second user that is different from the first representation; as well as Based on determining that the movement of the first representation corresponding to the second user corresponds to movement of the first representation corresponding to the second user to a third location in the three-dimensional environment that is within the threshold distance from the corresponding location associated with the communication session: moving the first representation corresponding to the second user away from the first location in the three-dimensional environment; and A presentation of the first representation corresponding to the second user is maintained in the three-dimensional environment.

18. The method of claim 17, wherein the first representation corresponding to the second user comprises a three-dimensional representation of the second user, the method further comprising: obtaining, from the second electronic device, information corresponding to audio associated with the second user when the first representation corresponding to the second user is presented in the three-dimensional environment within the threshold distance from the corresponding location associated with the communication session; as well as In response to obtaining the information corresponding to the audio associated with the second user, the audio is rendered as if emanating from a corresponding location of the first representation corresponding to the second user of the second electronic device.

19. A method according to any one of claims 17 to 18, wherein the corresponding position associated with the communication session corresponds to the corresponding position of the first representation corresponding to the second user of the second electronic device defined by a predefined spatial template of the positions of the representations corresponding to the users in the communication session.

20. The method of any one of claims 17 to 19, wherein the corresponding location associated with the communication session corresponds to a center location of a predefined spatial template of locations of representations corresponding to users in the communication session.

21. The method of any one of claims 17 to 20, wherein the threshold distance from the corresponding location associated with the communication session comprises a threshold horizontal distance between the first representation corresponding to the second user and the corresponding location associated with the communication session.

22. The method of any one of claims 17 to 21, wherein the threshold distance from the corresponding location associated with the communication session comprises a threshold vertical distance between the first representation corresponding to the second user and the corresponding location associated with the communication session.

23. The method according to any one of claims 17 to 22, further comprising: when presenting the second representation corresponding to the second user at a fourth location in the three-dimensional environment, wherein the fourth location corresponds to a second corresponding location at the threshold distance from the corresponding location associated with the communication session, obtaining, via the one or more input devices, second information corresponding to a further movement associated with the second user, the further movement corresponding to a location further than the threshold distance from the corresponding location associated with the communication session; as well as In response to obtaining the second information, the second representation corresponding to the second user in the three-dimensional environment is maintained presented at the fourth position in the three-dimensional environment.

24. The method of claim 23, wherein the fourth location in the three-dimensional environment is a location of the first representation corresponding to the second user when the first representation reaches the threshold distance from the corresponding location associated with the communication session, the method further comprising: obtaining, from the second electronic device, information corresponding to audio associated with the second user while the second representation corresponding to the second user is presented in the three-dimensional environment at the fourth location; as well as In response to obtaining the information corresponding to audio associated with the second user, the audio is rendered as if emanating from the fourth location in the three-dimensional environment.

25. The method of any one of claims 23 to 24, wherein the fourth location of the second representation corresponding to the second user and the corresponding location associated with the communication session are separated by the threshold distance.

26. A method according to any one of claims 17 to 25, wherein moving the first representation corresponding to the second user away from the first position in the three-dimensional environment includes presenting an animation of moving the first representation corresponding to the second user to the third position in the three-dimensional environment, the third position being within the threshold distance from the corresponding position associated with the communication session.

27. The method according to any one of claims 17 to 26, further comprising: while presenting the second representation corresponding to the second user, obtaining, via the one or more input devices, second information corresponding to movement associated with the second user, the movement corresponding to a location in the three-dimensional environment within the threshold distance of the corresponding location associated with the communication session; as well as In response to obtaining the second information: changing the presentation of the second representation corresponding to the second user to the first representation corresponding to the second user in the three-dimensional environment; as well as The first representation corresponding to the second user is presented in the three-dimensional environment at a location in the three-dimensional environment that is within the threshold distance of the corresponding location associated with the communication session and that corresponds to the second information.

28. An electronic device, comprising: one or more processors; Memory; and One or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising instructions for performing the method according to any one of claims 17 to 27.

29. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions that, when executed by one or more processors of an electronic device, cause the electronic device to perform the method according to any one of claims 17 to 27.

30. An electronic device, comprising: one or more processors; Memory; and A component for carrying out the method according to any one of claims 17 to 27.

31. An information processing device used in an electronic device, the information processing device comprising: A component for carrying out the method according to any one of claims 17 to 27.

32. A method comprising: At a first electronic device in communication with one or more displays and one or more input devices: When conducting a communication session with a second electronic device, the communication session includes a first user of the first electronic device and a second user of the second electronic device, wherein a viewpoint of the first user has a first position in a three-dimensional environment and a viewpoint of the second user has a second position in the three-dimensional environment, presenting a first representation corresponding to the second user of the second electronic device at the second position in the three-dimensional environment via the one or more displays; while presenting the three-dimensional environment including the first representation corresponding to the second user of the second electronic device at the second location, detecting, via the one or more input devices, a first input corresponding to movement of the viewpoint of the first user away from the first location in the three-dimensional environment; as well as In response to detecting the movement of the viewpoint of the first user away from the first location in the three-dimensional environment, and when the second location of the first representation corresponding to the second user of the second electronic device in the three-dimensional environment is within a viewport of the one or more displays of the first user: Based on determining that the movement of the viewpoint of the first user corresponds to a movement of the viewpoint of the first user to a third location in the three-dimensional environment that is farther than a threshold distance from a corresponding location associated with the communication session: presenting the three-dimensional environment from the viewpoint of the first user at the third location without presenting the first representation corresponding to the second user at the second location in the three-dimensional environment; as well as Based on determining that the movement of the viewpoint of the first user corresponds to a movement of the viewpoint of the first user to a fourth location in the three-dimensional environment that is within the threshold distance from the corresponding location associated with the communication session: Rendering the three-dimensional environment from the viewpoint of the first user at the fourth location includes rendering the first representation corresponding to the second user at the second location in the three-dimensional environment.

33. The method according to claim 32, further comprising: obtaining, from the second electronic device, information corresponding to audio associated with the second user while the three-dimensional environment is presented from the viewpoint of the first user at the third location; as well as In response to obtaining the information corresponding to the audio associated with the second user, presenting the audio regardless of the second position of the viewpoint of the second user.

34. The method according to any one of claims 32 to 33, further comprising: obtaining, from the second electronic device, information corresponding to audio associated with the second user while the three-dimensional environment is presented from the viewpoint of the first user at the fourth location; as well as In response to obtaining the information corresponding to the audio associated with the second user, the audio is rendered as if emanating from the second location corresponding to the viewpoint of the second user of the second electronic device.

35. A method according to any one of claims 32 to 34, wherein the corresponding position associated with the communication session corresponds to the corresponding position of the viewpoint of the first user of the first electronic device defined by a predefined spatial template of represented positions corresponding to users in the communication session.

36. A method according to any one of claims 32 to 35, wherein the corresponding position associated with the communication session corresponds to a centre position of a predefined spatial template of positions of representations corresponding to users in the communication session.

37. The method of any one of claims 32 to 36, wherein the threshold distance from the corresponding location associated with the communication session comprises a threshold horizontal distance between the viewpoint of the first user and the corresponding location associated with the communication session.

38. The method of any one of claims 32 to 37, wherein the threshold distance from the corresponding location associated with the communication session comprises a threshold vertical distance between the viewpoint of the first user and the corresponding location associated with the communication session.

39. The method according to any one of claims 32 to 38, further comprising: When the three-dimensional environment is presented from the viewpoint of the first user at the third location, an indication that audio associated with the first user is presented at the second electronic device is presented via the one or more displays, regardless of the location in the three-dimensional environment of the second electronic device associated with the viewpoint of the first user.

40. The method of claim 39, further comprising: When presenting the three-dimensional environment from the viewpoint of the first user at the third location, presenting via the one or more displays an indication that a placeholder virtual object representing a pose of the viewpoint of the first user at the third location is presented at the second electronic device.

41. The method according to any one of claims 32 to 40, further comprising: When presenting the three-dimensional environment from the viewpoint of the first user at the third location, presenting via the one or more displays an option that, when selected, causes the second electronic device to: ceasing to render audio associated with the first user as emanating from a location corresponding to the viewpoint of the first user; as well as Presentation of a representation corresponding to the first user of the first electronic device at a location corresponding to the viewpoint of the first user is ceased.

42. The method according to any one of claims 32 to 41, further comprising: detecting, via the one or more input devices, a second input corresponding to movement of the viewpoint of the first user away from the third location while the three-dimensional environment is presented from the viewpoint of the first user at the third location; as well as In response to detecting the movement of the viewpoint of the first user away from the third location when the corresponding location of the first representation corresponding to the second user of the second electronic device in the three-dimensional environment is within the viewport of the one or more displays of the first user: Based on determining that the movement of the viewpoint of the first user corresponds to a movement of the viewpoint of the first user to a fifth location in the three-dimensional environment that is within the threshold distance from the corresponding location associated with the communication session: presenting the three-dimensional environment from the viewpoint of the first user at the fifth location, including presenting the first representation corresponding to the second user in the three-dimensional environment at the corresponding location corresponding to the second user in the three-dimensional environment; as well as Based on determining that the movement of the viewpoint of the first user corresponds to a movement of the viewpoint of the first user to a sixth location in the three-dimensional environment that is farther than the threshold distance from the corresponding location associated with the communication session: The three-dimensional environment is presented from the viewpoint of the first user at the sixth location without presenting the first representation corresponding to the second user in the three-dimensional environment.

43. The method according to any one of claims 32 to 42, further comprising: In response to detecting the movement of the viewpoint of the first user away from the first position in the three-dimensional environment, presenting the following indication via the one or more displays: movement of the viewpoint of the first user to a corresponding position in the three-dimensional environment that is farther than the threshold distance from the corresponding position associated with the communication session will cause a change in the visual appearance of a representation corresponding to the first user of the first electronic device presented by the second electronic device.

44. An electronic device, comprising: one or more processors; Memory; and One or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising instructions for performing the method according to any one of claims 32 to 43.

45. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions that, when executed by one or more processors of an electronic device, cause the electronic device to perform the method of any one of claims 32 to 43.

46. ​​An electronic device, comprising: one or more processors; Memory; and A component for carrying out the method according to any one of claims 32 to 43.

47. An information processing device used in an electronic device, the information processing device comprising: A component for carrying out the method according to any one of claims 32 to 43.

Images