Interaction within hybrid space group in multi-user communication session

Abstract

The invention relates to interaction within a hybrid space group in a multi-user communication session. Some examples of the present disclosure relate to systems and methods for facilitating interaction, including movement, of content shared in a multi-user communication session based on whether participants in the multi-user communication session are collocated or non-collocated. In some examples, a first electronic device presents a three-dimensional environment that includes a first object of a first type and a visual representation of a user of a second electronic device. In some examples, the first electronic device receives a request to move the first object. In some examples, in response, in accordance with a determination that the second electronic device and the first electronic device are placed in a first physical environment, the first electronic device moves the first object of the first type in the three-dimensional environment in accordance with a first input without updating the presentation of the visual representation of the user of the second electronic device.

Description

[0001] Cross - reference to related applications

[0002] This application claims the benefit of U.S. Provisional Application No. 63 / 614,489, filed on December 22, 2023, U.S. Provisional Application No. 63 / 698,248, filed on September 24, 2024, and U.S. Patent Application No. 18 / 978,798, filed on December 12, 2024, the entire contents of which are incorporated herein by reference for all purposes. Technical field

[0003] The present disclosure generally relates to systems and methods for establishing multi - user communication sessions, where at least one subset of the participants within the multi - user communication session are co - located in a physical environment. Background art

[0004] Some computer - graphics environments provide two - dimensional and / or three - dimensional environments in which at least some of the objects displayed for a user to view are virtual and computer - generated. In some examples, the three - dimensional environment is presented by multiple devices communicating in a multi - user communication session. In some examples, an avatar (e.g., representation) of each non - co - located user participating in a multi - user communication session (e.g., via a computing device) is displayed in the three - dimensional environment of the multi - user communication session. In some examples, content can be shared in the three - dimensional environment for multiple users participating in the multi - user communication session to view and interact with. Summary of the invention

[0005] Some examples of the present disclosure relate to systems and methods for facilitating interaction (including movement) of content shared in a multi-user communication session based on whether participants in the multi-user communication session are collocated or non-collocated. In some examples, a method is performed at a first electronic device in communication with one or more displays, one or more input devices, and a second electronic device, where the first electronic device is in a communication session with the second electronic device. In some examples, the first electronic device presents, via the one or more displays, a three-dimensional environment including a first object of a first type (e.g., a shared virtual object) and a visual representation of a user of the second electronic device. In some examples, while presenting the three-dimensional environment including the first object of the first type and the visual representation of the user of the second electronic device, the first electronic device receives, via the one or more input devices, a first input corresponding to a request to move the first object within the three-dimensional environment. In some examples, in response to receiving the first input, based on a determination that one or more criteria are satisfied, including criteria that are satisfied when the second electronic device is collocated with the first electronic device in a first physical environment, the first electronic device moves the first object of the first type within the three-dimensional environment relative to the viewpoint of the first electronic device according to the first input without updating the presentation of the visual representation of the user of the second electronic device. In some examples, based on a determination that the one or more criteria are not satisfied because the second electronic device is not collocated with the first electronic device in the first physical environment, the first electronic device moves the first object of the first type and the visual representation of the user of the second electronic device within the three-dimensional environment relative to the viewpoint of the first electronic device according to the first input.

[0006] A comprehensive description of these examples is provided in the accompanying drawings and the detailed description, and it should be understood that the present invention content does not limit the scope of the present disclosure in any way. BRIEF DESCRIPTION OF THE DRAWINGS

[0007] To better understand the various examples described herein, reference should be made to the following detailed description and the following drawings. Throughout the drawings, like reference numerals generally refer to corresponding parts.

[0008] Figure 1 An electronic device presenting an extended reality environment according to some examples of the present disclosure is shown.

[0009] Figure 2 A block diagram of an example architecture of a system according to some examples of the present disclosure is shown.

[0010] Figure 3 An example of a spatial group in a multi-user communication session including a first electronic device and a second electronic device according to some examples of the present disclosure is shown.

[0011] Figures 4A to 4AAIllustrates example interactions within a multi - user communication session that includes co - located and non - co - located users, according to some examples of the present disclosure.

[0012] Figures 5A to 5E Illustrates example interactions within a multi - user communication session that includes co - located and non - co - located users, according to some examples of the present disclosure.

[0013] Figure 6 Illustrates a flowchart of an example process for moving an object in a three - dimensional environment within a multi - user communication session based on whether the multi - user communication session includes co - located users or non - co - located users, according to some examples of the present disclosure.

[0014] Figures 7A to 7G Illustrates example interactions within a multi - user communication session that includes co - located users, according to some examples of the present disclosure. Detailed Description

[0015] Some examples of the present disclosure relate to systems and methods for facilitating interactions (including movement) of content shared within a multi - user communication session based on whether participants in the multi - user communication session are co - located or non - co - located. In some examples, a method is executed at a first electronic device that communicates with one or more displays, one or more input devices, and a second electronic device, where the first electronic device is in a communication session with the second electronic device. In some examples, the first electronic device presents, via one or more displays, a three - dimensional environment that includes a first object of a first type (e.g., a shared virtual object) and a visual representation of a user of the second electronic device. In some examples, while presenting the three - dimensional environment that includes the first object of the first type and the visual representation of the user of the second electronic device, the first electronic device receives, via one or more input devices, a first input corresponding to a request to move the first object within the three - dimensional environment. In some examples, in response to receiving the first input, based on a determination that meets one or more criteria including criteria that are met when the second electronic device is co - located with the first electronic device in a first physical environment, the first electronic device moves the first object of the first type within the three - dimensional environment relative to the viewpoint of the first electronic device according to the first input without updating the presentation of the visual representation of the user of the second electronic device. In some examples, based on a determination that one or more criteria are not met because the second electronic device is not co - located with the first electronic device in the first physical environment, the first electronic device moves the first object of the first type and the visual representation of the user of the second electronic device within the three - dimensional environment relative to the viewpoint of the first electronic device according to the first input.

[0016] As used herein, a spatial group corresponds to one or more participants (e.g., users) in a multi-user communication session. In some examples, a spatial group in a multi-user communication session has a spatial arrangement that indicates the locations of the users and content within the spatial group. In some examples, users within the same spatial group in a multi-user communication session experience a spatial reality according to the spatial arrangement of the spatial group. In some examples, when a user of a first electronic device is in a first spatial group in a multi-user communication session and a user of a second electronic device is in a second spatial group in the multi-user communication session, the users experience a spatial reality that is localized to their respective spatial groups. In some examples, when a user of a first electronic device and a user of a second electronic device are grouped into separate spatial groups within a multi-user communication session, if the first electronic device and the second electronic device return to the same operating state, the user of the first electronic device and the user of the second electronic device are re-grouped into the same spatial group within the multi-user communication session.

[0017] As used herein, a mixed spatial group corresponds to one or more participants (e.g., users) in a multi-user communication session in which at least one subset of the participants is non-collocated in a physical environment. For example, as described by way of one or more examples in the present disclosure, a mixed spatial group includes at least two participants collocated in a first physical environment and at least one participant that is not collocated with the at least two participants in the first physical environment (e.g., the at least one participant is located in a second physical environment different from the first physical environment). In some examples, a mixed spatial group in a multi-user communication session has a spatial arrangement that determines the locations of the users and content within the spatial group. In some examples, users within the same mixed spatial group in a multi-user communication session experience a spatial reality according to the spatial arrangement of the spatial group, as similarly discussed above.

[0018] In some examples, initiating a multi-user communication session can include interacting with one or more user interface elements. In some examples, an electronic device tracks a user's gaze as an input for targeting selectable options / enablement representations within a corresponding user interface element displayed in a three-dimensional environment. For example, gaze can be used to identify one or more options / enablement representations that are selected as targets using another selection input. In some examples, a hand-tracking input detected via an input device communicatively coupled to the electronic device can be used to select a corresponding option / enablement representation. In some examples, an object displayed in a three-dimensional environment can be moved and / or re-oriented in the three-dimensional environment according to a movement input detected via the input device.

[0019] Figure 1 An electronic device 101 is shown presenting an extended reality (XR) environment (e.g., a computer-generated environment optionally including representations of physical and / or virtual objects) according to some examples of the present disclosure. In some examples, asFigure 1 As shown, the electronic device 101 is a head-mounted display or other head-mounted device configured to be worn on the head of a user of the electronic device 101. The following describes an example of the electronic device 101 with reference to Figure 2 the architecture block diagram. As Figure 1 shown, the electronic device 101 and the table 106 are located in a physical environment. The physical environment may include physical features such as physical surfaces (e.g., floors, walls) or physical objects (e.g., tables, lights, etc.). In some examples, the electronic device 101 may be configured to detect and / or capture an image of the physical environment including the table 106 (shown in the field of view of the electronic device 101).

[0020] In some examples, as Figure 1 shown, the electronic device 101 includes one or more internal image sensors 114a oriented towards the user's face (e.g., the eye-tracking camera described below with reference to Figure 2 ). In some examples, the internal image sensor 114a is used for eye tracking (e.g., detecting the user's gaze). The internal image sensor 114a is optionally arranged on the left and right portions of the display 120 such that eye tracking of the user's left and right eyes can be performed. In some examples, the electronic device 101 further includes external image sensors 114b and 114c facing outward from the user to detect and / or capture the physical environment of the electronic device 101 and / or the movement of the user's hand or other body parts.

[0021] In some examples, the display 120 has a field of view visible to the user (e.g., it may or may not correspond to the field of view of the external image sensors 114b and 114c). Since the display 120 is optionally part of a head-mounted device, the field of view of the display 120 is optionally the same as or similar to the field of view of the user's eyes. In other examples, the field of view of the display 120 may be smaller than the field of view of the user's eyes. In some examples, the electronic device 101 may be an optical see-through device, where the display 120 is a transparent or semi-transparent display through which parts of the physical environment can be directly viewed. In some examples, the display 120 may be included within a transparent lens and may overlap all or only a portion of the transparent lens. In other examples, the electronic device may be a video see-through device, where the display 120 is an opaque display configured to display an image of the physical environment captured by the external image sensors 114b and 114c. Although a single display 120 is shown, it should be understood that the display 120 may include a stereoscopic display pair.

[0022] In some examples, in response to a trigger, the electronic device 101 may be configured to display in an XR environment by Figure 1The virtual object 104 represented by the cube shown is not present in the physical environment but is displayed in an XR environment located on top of the real-world table 106 (or its representation). Optionally, in response to detecting the plane of the table 106 in the physical environment 100, the virtual object 104 can be displayed on the surface of the table 106 in the XR environment displayed via the display 120 of the electronic device 101.

[0023] It should be understood that the virtual object 104 is a representative virtual object and can include and render one or more different virtual objects in a three-dimensional XR environment (e.g., virtual objects having various dimensions such as two-dimensional or other three-dimensional virtual objects). For example, the virtual object can represent an application or a user interface displayed in the XR environment. In some examples, the virtual object can represent content corresponding to an application and / or displayed via the user interface in the XR environment. In some examples, the virtual object 104 is optionally configured to be interactive and responsive to user input (e.g., air gestures such as air pinch gestures, air tap gestures, and / or air touch gestures) such that the user can virtually touch, tap, move, rotate, or otherwise interact with the virtual object 104.

[0024] In some examples, displaying an object in a three-dimensional environment can include interacting with one or more user interface objects in the three-dimensional environment. For example, the initiation of the display of an object in a three-dimensional environment can include interacting with one or more virtual options / enablement representations displayed in the three-dimensional environment. In some examples, when initiating the display of an object in a three-dimensional environment, the electronic device can track the user's gaze as an input for identifying one or more virtual options / enablement representations as targets for selection. For example, the gaze can be used to identify one or more virtual options / enablement representations as targets for selection using another selection input. In some examples, a hand tracking input detected via an input device communicatively coupled to the electronic device can be used to select the virtual options / enablement representations. In some examples, an object displayed in a three-dimensional environment can move and / or reorient in the three-dimensional environment based on a movement input detected via the input device.

[0025] In the following discussion, an electronic device that communicates with a display generation component and one or more input devices is described. It should be understood that the electronic device optionally communicates with one or more other physical user interface devices, such as a touch-sensitive surface, a physical keyboard, a mouse, a joystick, a hand-tracking device, an eye-tracking device, a stylus, etc. Additionally, as described above, it should be understood that the described electronic device, display, and touch-sensitive surface are optionally distributed among two or more devices. Thus, as used in this disclosure, information displayed on or by the electronic device is optionally used to describe information output by the electronic device for display on a separate display device (touch-sensitive or non-touch-sensitive). Similarly, as used in this disclosure, an input received on the electronic device (e.g., a touch input received on the touch-sensitive surface of the electronic device, or a touch input received on the surface of a stylus) is optionally used to describe an input received on a separate input device from which the electronic device receives input information.

[0026] The device generally supports a variety of applications, such as one or more of the following: a drawing application, a presentation application, a word processing application, a website creation application, a disk editing application, a spreadsheet application, a gaming application, a telephone application, a video conferencing application, an email application, an instant messaging application, a fitness support application, a photo management application, a digital camera application, a digital video camera application, a web browsing application, a digital music player application, a television channel browsing application, and / or a digital video player application.

[0027] Figure 2 A block diagram of an example architecture of a system 201 in accordance with some examples of the present disclosure is shown. In some examples, the system 201 includes multiple devices. For example, the system 201 includes a first electronic device 260 and a second electronic device 270, where the first electronic device 260 and the second electronic device 270 communicate with each other. In some examples, the first electronic device 260 and the second electronic device 270 are each a portable device, such as a mobile phone, a smartphone, a tablet computer, a laptop computer, an accessory device that communicates with another device, a head-mounted display, etc. In some examples, the first electronic device 260 and the second electronic device 270 correspond to the electronic device 101 described above with reference to Figure 1 the electronic device described.

[0028] As Figure 2As shown, the first electronic device 260 optionally includes various sensors (e.g., one or more hand tracking sensors 202A, one or more position sensors 204A, one or more image sensors 206A, one or more touch-sensitive surfaces 209A, one or more motion and / or orientation sensors 210A, one or more eye tracking sensors 212A, one or more microphones 213A or other audio sensors, one or more body tracking sensors (e.g., torso and / or head tracking sensors), one or more display generation components 214A, one or more speakers 216A, one or more processors 218A, one or more memories 220A, and / or communication circuitry 222A. In some examples, the second electronic device 270 optionally includes various sensors (e.g., one or more hand tracking sensors 202B, one or more position sensors 204B, one or more image sensors 206B, one or more touch-sensitive surfaces 209B, one or more motion and / or orientation sensors 210B, one or more eye tracking sensors 212B, one or more microphones 213B or other audio sensors, one or more body tracking sensors (e.g., torso and / or head tracking sensors), one or more display generation components 214B, one or more speakers 216, one or more processors 218B, one or more memories 220B, and / or communication circuitry 222B. In some examples, one or more display generation components 214A, 214B correspond to Figure 1 the display 120 in

[0029] One or more communication buses 208A and 208B are optionally used for communication between the above components of the electronic devices 260 and 270, respectively. The first electronic device 260 and the second electronic device 270 optionally communicate via a wired or wireless connection between the two devices (e.g., via the communication circuitry 222A, 222B). The communication circuitry 222A, 222B optionally includes circuitry for communicating with electronic devices, networks (such as the Internet, intranet, wired network, and / or wireless network, cellular network, and wireless local area network (LAN)). The communication circuitry 222A, 222B optionally includes circuitry for communicating using near field communication (NFC) and / or short-range communication such as

[0030] Processors 218A, 218B include one or more general-purpose processors, one or more graphics processors, and / or one or more digital signal processors. In some examples, memories 220A, 220B are non-transitory computer-readable storage media (e.g., flash memory, random access memory, or other volatile or non-volatile memory or storage devices) storing computer-readable instructions configured to be executed by processors 218A, 218B to perform the techniques, processes, and / or methods described below. In some examples, memories 220A, 220B may include more than one non-transitory computer-readable storage media. A non-transitory computer-readable storage medium can be any medium (e.g., excluding signals) that can tangibly contain or store computer-executable instructions for use by or in connection with an instruction execution system, apparatus, and device. In some examples, the storage medium is a transitory computer-readable storage medium. In some examples, the storage medium is a non-transitory computer-readable storage medium. Non-transitory computer-readable storage media can include, but are not limited to, magnetic storage devices, optical storage devices, and / or semiconductor storage devices. Examples of such storage devices include magnetic disks, optical disks based on compact disc (CD), digital versatile disc (DVD), or Blu-ray technology, and persistent solid-state memories (such as flash memory, solid-state drives, etc.).

[0031] In some examples, display generation components 214A, 214B include a single display (e.g., a liquid crystal display (LCD), an organic light-emitting diode (OLED), or other type of display). In some examples, display generation components 214A, 214B include multiple displays. In some examples, display generation components 214A, 214B may include a display with touch capabilities (e.g., a touch screen), a projector, a holographic projector, a retinal projector, a transparent or semi-transparent display, etc. In some examples, electronic devices 260 and 270 respectively include touch-sensitive surfaces 209A and 209B for receiving user inputs such as tap inputs and swipe inputs or other gestures. In some examples, display generation components 214A, 214B and touch-sensitive surfaces 209A, 209B form a touch-sensitive display (e.g., a touch screen integrated with electronic devices 260 and 270 respectively or a touch screen external to electronic devices 260 and 270 and communicating with electronic devices 260 and 270).

[0032] The electronic devices 260 and 270 optionally include image sensors 206A and 206B, respectively. The image sensors 206A / 206B optionally include one or more visible light image sensors (such as charge-coupled device (CCD) sensors) and / or complementary metal oxide semiconductor (CMOS) sensors operable to obtain an image of a physical object from a real-world environment. The image sensors 206A / 206B also optionally include one or more infrared (IR) sensors, such as passive IR sensors or active IR sensors, for detecting infrared light from the real-world environment. For example, an active IR sensor includes an IR emitter for emitting infrared light into the real-world environment. The image sensors 206A / 206B also optionally include one or more cameras configured to capture the movement of a physical object in a real-world environment. The image sensors 206A / 206B also optionally include one or more depth sensors configured to detect the distance of a physical object from the electronic devices 260 / 270. In some examples, information from one or more depth sensors may allow the device to identify an object in the real-world environment and distinguish it from other objects in the real-world environment. In some examples, one or more depth sensors may allow the device to determine the texture and / or topography of an object in the real-world environment.

[0033] In some examples, the electronic devices 260 and 270 use a CCD sensor, an event camera, and a depth sensor in combination to detect the physical environment around the electronic devices 260 and 270. In some examples, the image sensors 206A / 206B include a first image sensor and a second image sensor. The first image sensor and the second image sensor work together and are optionally configured to capture different information about a physical object in the real-world environment. In some examples, the first image sensor is a visible light image sensor and the second image sensor is a depth sensor. In some examples, the electronic devices 260 / 270 use the image sensors 206A / 206B to detect the position and orientation of the electronic devices 260 / 270 and / or the display generation components 214A / 214B in the real-world environment. For example, the electronic devices 260 / 270 use the image sensors 206A / 206B to track the position and orientation of the display generation components 214A / 214B relative to one or more fixed objects in the real-world environment.

[0034] In some examples, the electronic device 260 / 270 includes a microphone 213A / 213B or other audio sensors. The device 260 / 270 uses the microphone 213A / 213B to detect sounds from the user and / or the user's real-world environment. In some examples, the microphone 213A / 213B includes a microphone array (multiple microphones) that optionally operate cooperatively to identify ambient noise or to locate a sound source in the space of the real-world environment.

[0035] In some examples, the device 260 / 270 includes a position sensor 204A / 204B for detecting the position of the device 260 / 270 and / or the display generation component 214A / 214B. For example, the position sensor 204A / 204B may include a Global Positioning System (GPS) receiver that receives data from one or more satellites and allows the electronic device 260 / 270 to determine its absolute position in the physical world.

[0036] In some examples, the electronic device 260 / 270 includes an orientation sensor 210A / 210B for detecting the orientation and / or movement of the electronic device 260 / 270 and / or the display generation component 214A / 214B. For example, the electronic device 260 / 270 uses the orientation sensor 210A / 210B to track changes in the position and / or orientation of the electronic device 260 / 270 and / or the display generation component 214A / 214B, such as changes relative to physical objects in the real-world environment. The orientation sensor 210A / 210B optionally includes one or more gyroscopes and / or one or more accelerometers.

[0037] In some examples, the electronic device 260 / 270 includes a hand tracking sensor 202A / 202B and / or an eye tracking sensor 212A / 212B (and / or other body tracking sensors, such as leg, torso, and / or head tracking sensors). The hand tracking sensor 202A / 202B is configured to track the position / location of one or more parts of the user's hand and / or the movement of one or more parts of the user's hand relative to the extended reality environment, relative to the display generation component 214A / 214B, and / or relative to another defined coordinate system. The eye tracking sensor 212A / 212B is configured to track the position and movement of the user's gaze (more generally, the eyes, face, or head) relative to the real world or the extended reality environment and / or relative to the display generation component 214A / 214B. In some examples, the hand tracking sensor 202A / 202B and / or the eye tracking sensor 212A / 212B are implemented together with the display generation component 214A / 214B. In some examples, the hand tracking sensor 202A / 202B and / or the eye tracking sensor 212A / 212B are implemented separately from the display generation component 214A / 214B.

[0038] In some examples, the hand tracking sensors 202A / 202B (and / or other body tracking sensors such as leg, torso, and / or head tracking sensors) may use image sensors 206A / 206B (e.g., one or more IR cameras, 3D cameras, depth cameras, etc.) that capture three-dimensional information from the real world including one or more body parts (e.g., the hands, legs, torso of a human user). In some examples, there is sufficient resolution to distinguish the hand to differentiate the fingers and their respective positioning. In some examples, one or more image sensors 206A / 206B are positioned relative to the user to define the field of view and interaction space of the image sensors 206A / 206B, in which the finger / hand positions, orientations, and / or movements captured by the image sensors are used as input (e.g., to distinguish from the user's idle hand or the hands of others in the real-world environment). Tracking the finger / hand used for input (e.g., gestures, touches, taps, etc.) may be advantageous as this does not require the user to touch, hold, or wear any type of beacon, sensor, or other marker.

[0039] In some examples, the eye tracking sensors 212A / 212B include at least one eye tracking camera (e.g., an infrared (IR) camera) and / or illumination source (e.g., an IR light source such as an LED) that emits light towards the user's eyes. The eye tracking camera may be pointed at the user's eyes to directly or indirectly receive reflected IR light from the light source from the eyes. In some examples, both eyes are tracked separately by respective eye tracking cameras and illumination sources, and the focus / gaze may be determined by tracking both eyes. In some examples, one eye (e.g., the dominant eye) is tracked by one or more respective eye tracking cameras / illumination sources.

[0040] The electronic devices 260 / 270 and the system 201 are not limited to Figure 2Rather than the components and configurations thereof, it may include fewer components, other components, or additional components in various configurations. In some examples, system 201 may be implemented in a single device. One or more persons using system 201 are optionally referred to herein as one or more users of the device. Attention is now turned to an exemplary simultaneous display of a three-dimensional environment on a first electronic device (e.g., corresponding to electronic device 260) and a second electronic device (e.g., corresponding to electronic device 270). As discussed below, the first electronic device may communicate with the second electronic device in a multi-user communication session. In some examples, an avatar of a user of the first electronic device (e.g., representation) may be displayed in the three-dimensional environment at the second electronic device, and an avatar of a user of the second electronic device may be displayed in the three-dimensional environment at the first electronic device. In some examples, a user of the first electronic device and a user of the second electronic device may be associated with a spatial group in a multi-user communication session. In some examples, interaction with the content in the three-dimensional environment when the first electronic device and the second electronic device are in a multi-user communication session may cause the user of the first electronic device and the user of the second electronic device to become associated with different spatial groups in the multi-user communication session.

[0041] Figure 3 An example of a spatial group 340 in a multi-user communication session including a first electronic device 360 and a second electronic device 370 is shown according to some examples of the present disclosure. In some examples, the first electronic device 360 may present a three-dimensional environment 350A, and the second electronic device 370 may present a three-dimensional environment 350B. The first electronic device 360 and the second electronic device 370 may be similar to electronic device 101 or 260 / 270, and / or may be head-mounted systems / devices and / or projection-based systems / devices (including hologram-based systems / devices) configured to generate and present a three-dimensional environment, such as a head-up display (HUD), a head-mounted display (HMD), a window with integrated display capabilities, a display formed as a lens designed to be placed on a person's eye (e.g., similar to a contact lens), respectively. In Figure 3 an example, the first user optionally wears the first electronic device 360 and the second user optionally wears the second electronic device 370, such that the three-dimensional environments 350A / 350B may be defined by the X, Y, and Z axes viewed from the perspective of the electronic device (e.g., the viewpoints associated with the electronic devices 360 / 370, which may be head-mounted displays, for example).

[0042] As Figure 3As shown, the first electronic device 360 may be in a first physical environment including a table 306 and a window 309. Thus, the three-dimensional environment 350A presented using the first electronic device 360 optionally includes a captured portion of the physical environment surrounding the first electronic device 360, such as a representation 306' of the table and a representation 309' of the window. Similarly, the second electronic device 370 may be in a second physical environment different from the first physical environment (e.g., separate from the first physical environment), the second physical environment including a floor lamp 307 and a coffee table 308. Thus, the three-dimensional environment 350B presented using the second electronic device 370 optionally includes a captured portion of the physical environment surrounding the second electronic device 370, such as a representation 307' of the floor lamp and a representation 308' of the coffee table. Additionally, the three-dimensional environments 350A and 350B may include representations of the floor, ceiling, and walls of the room in which the first electronic device 360 and the second electronic device 370 are respectively located.

[0043] As described above, in some examples, the first electronic device 360 is optionally in a multi-user communication session with the second electronic device 370. For example, the first electronic device 360 and the second electronic device 370 (e.g., via communication circuitry 222A / 222B) are configured to present a shared three-dimensional environment 350A / 350B including one or more shared virtual objects (e.g., content such as images, videos, audio, etc., representations of user interfaces of applications, etc.). As used herein, the term "shared three-dimensional environment" refers to a three-dimensional environment that is independently presented, displayed, and / or visible at two or more electronic devices, via which content, applications, data, etc. can be shared and / or presented to the users of the two or more electronic devices. In some examples, when the first electronic device 360 is in a multi-user communication session with the second electronic device 370, an avatar corresponding to a user of one electronic device is optionally displayed in the three-dimensional environment displayed via the other electronic device. For example, as Figure 3 shown, at the first electronic device 360, an avatar 315 corresponding to the user of the second electronic device 370 is displayed in the three-dimensional environment 350A. Similarly, at the second electronic device 370, an avatar 317 corresponding to the user of the first electronic device 360 is displayed in the three-dimensional environment 350B.

[0044] In some examples, the rendering of the avatars 315 / 317 as part of a shared three-dimensional environment is optionally accompanied by audio effects corresponding to the speech of the user of the electronic device 370 / 360. For example, the avatar 315 displayed in the three-dimensional environment 350A using the first electronic device 360 is optionally accompanied by audio effects corresponding to the speech of the user of the second electronic device 370. In some such examples, when the user of the second electronic device 370 speaks, the user's speech can be detected by the second electronic device 370 (e.g., via the microphone 213B) and transmitted to the first electronic device 360 (e.g., via the communication circuitry 222B / 222A), such that the detected speech of the user of the second electronic device 370 can be presented as audio (e.g., using the speaker 216A) to the user of the first electronic device 360 in the three-dimensional environment 350A. In some examples, the audio effects corresponding to the speech of the user of the second electronic device 370 can be spatialized such that they appear to the user of the first electronic device 360 to emanate from the location of the avatar 315 in the shared three-dimensional environment 350A (e.g., even though output from the speaker of the first electronic device 360). Similarly, the avatar 317 displayed in the three-dimensional environment 350B using the second electronic device 370 is optionally accompanied by audio effects corresponding to the speech of the user of the first electronic device 360. In some such examples, when the user of the first electronic device 360 speaks, the user's speech can be detected by the first electronic device 360 (e.g., via the microphone 213A) and transmitted to the second electronic device 370 (e.g., via the communication circuitry 222A / 222B), such that the detected speech of the user of the first electronic device 360 can be presented as audio (e.g., using the speaker 216B) to the user of the second electronic device 370 in the three-dimensional environment 350B. In some examples, the audio effects corresponding to the speech of the user of the first electronic device 360 can be spatialized such that they appear to the user of the second electronic device 370 to emanate from the location of the avatar 317 in the shared three-dimensional environment 350B (e.g., even though output from the speaker of the first electronic device 360).

[0045] In some examples, when in a multi-user communication session, the avatars 315 / 317 are displayed in the three-dimensional environments 350A / 350B in respective orientations corresponding to and / or based on the orientation of the electronic devices 360 / 370 (and / or the users of the electronic devices 360 / 370) in the physical environment surrounding the electronic devices 360 / 370. For example, as Figure 3As shown, in the three-dimensional environment 350A, the avatar 315 optionally faces the viewpoint of the user of the first electronic device 360, and in the three-dimensional environment 350B, the avatar 317 optionally faces the viewpoint of the user of the second electronic device 370. When a particular user moves the electronic device (and / or themselves) in the physical environment, the user's viewpoint changes according to the movement, which can thus also change the orientation of the user's avatar in the three-dimensional environment. For example, referring to Figure 3 , if the user of the first electronic device 360 looks left in the three-dimensional environment 350A such that the first electronic device 360 rotates left (e.g., counterclockwise) (e.g., by a corresponding amount), the user of the second electronic device 370 will see the avatar 317 corresponding to the user of the first electronic device 360 rotate right (e.g., clockwise) relative to the viewpoint of the user of the second electronic device 370 according to the movement of the first electronic device 360.

[0046] Additionally, in some examples, when in a multi-user communication session, the viewpoint of the three-dimensional environment 350A / 350B and / or the position of the viewpoint of the three-dimensional environment 350A / 350B optionally change according to the movement of the electronic devices 360 / 370 (e.g., made by the users of the electronic devices 360 / 370). For example, when in a communication session, if the first electronic device 360 moves closer to the representation 306' of the table and / or the avatar 315 (e.g., because the user of the first electronic device 360 moves forward in the physical environment around the first electronic device 360), the viewpoint of the three-dimensional environment 350A will change accordingly such that the representation 306' of the table, the representation 309' of the window, and the avatar 315 appear larger in the field of view. In some examples, each user can independently interact with the three-dimensional environment 350A / 350B such that the change in the viewpoint of the three-dimensional environment 350A and / or the interaction of the first electronic device 360 with the virtual objects in the three-dimensional environment 350A optionally do not affect the content shown in the three-dimensional environment 350B at the second electronic device 370, and vice versa.

[0047] In some examples, the avatars 315 / 317 are representations of the users of the electronic devices 370 / 360 (e.g., full-body renderings). In some examples, the avatars 315 / 317 are representations of a part of the users of the electronic devices 370 / 360 (e.g., renderings of the head, face, head and torso, etc.). In some examples, the avatars 315 / 317 are user-personalized, user-selected, and / or user-created representations displayed in the three-dimensional environments 350A / 350B that represent the users of the electronic devices 370 / 360. It should be understood that although Figure 3 the avatars 315 / 317 shown therein respectively correspond to full-body representations of the users of the electronic devices 370 / 360, alternative avatars such as those described above may be provided.

[0048] As described above, when the first electronic device 360 and the second electronic device 370 are in a multi-user communication session, the three-dimensional environment 350A / 350B can be a shared three-dimensional environment presented using the electronic devices 360 / 370. In some examples, in a multi-user communication session, the content viewed by a user at one electronic device can be shared with another user at another electronic device. In some such examples, the content can be experienced (e.g., viewed and / or interacted with) by two users (e.g., via their respective electronic devices) in the shared three-dimensional environment. For example, as Figure 3 shown, the three-dimensional environment 350A / 350B includes a shared virtual object 310 (e.g., which is optionally a three-dimensional virtual sculpture) that can be viewed and interacted with by two users. As Figure 3 shown, the shared virtual object 310 can be displayed together with a grabber affordance (e.g., a manipulation bar) 335 that can be selected to initiate movement of the shared virtual object 310 within the three-dimensional environment 350A / 350B.

[0049] In some examples, the three-dimensional environment 350A / 350B includes non-shared content that is private to a user in the multi-user communication session. For example, in Figure 3 , the first electronic device 360 is displaying a private application window 330 in the three-dimensional environment 350A, which is optionally an object that is not shared between the first electronic device 360 and the second electronic device 370 in the multi-user communication session. In some examples, the private application window 330 can be associated with a corresponding application operating on the first electronic device 360 (e.g., such as a media player application, a web browsing application, a messaging application, etc.). Since the private application window 330 is not shared with the second electronic device 370, the second electronic device 370 optionally displays a representation 330” of the private application window in the three-dimensional environment 350B. As Figure 3 shown, in some examples, the representation 330” of the private application window can be a faded, occluded, color-changed, and / or translucent representation of the private application window 330 that prevents the user of the second electronic device 370 from viewing the content of the private application window 330.

[0050] As previously mentioned above, in some examples, the user of the first electronic device 360 and the user of the second electronic device 370 are in the spatial group 340 within a multi-user communication session. In some examples, the spatial group 340 can be the baseline (e.g., first or default) spatial group within a multi-user communication session. For example, when the user of the first electronic device 360 and the user of the second electronic device 370 initially join a multi-user communication session, the user of the first electronic device 360 and the user of the second electronic device 370 are automatically (and initially, as discussed in more detail below) associated with (e.g., grouped into) the spatial group 340 within the multi-user communication session. In some examples, when the users are in the spatial group 340 as Figure 3 shown, the users of the first electronic device 360 and the second electronic device 370 have a first spatial arrangement (e.g., first spatial template) within the shared three-dimensional environment. For example, the users of the first electronic device 360 and the second electronic device 370 (including the objects displayed in the shared three-dimensional environment) have a spatial live within the spatial group 340. In some examples, the spatial live requires a consistent spatial arrangement between the user (or their representation) and the virtual object. For example, the distance between the viewpoint of the user of the first electronic device 360 and the avatar 315 corresponding to the user of the second electronic device 360 can be the same as the distance between the viewpoint of the user of the second electronic device 370 and the avatar 317 corresponding to the user of the first electronic device 370. As described herein, if the position of the viewpoint of the user of the first electronic device 360 moves, the avatar 317 corresponding to the user of the first electronic device 360 moves in the three-dimensional environment 350B according to the movement of the position of the user's viewpoint relative to the viewpoint of the user of the second electronic device 370. Additionally, if the user of the first electronic device 360 performs an interaction with the shared virtual object 310 (e.g., moves the virtual object 310 in the three-dimensional environment 350A), the second electronic device 370 changes the display of the shared virtual object 310 in the three-dimensional environment 350B according to the interaction (e.g., moves the virtual object 310 in the three-dimensional environment 350B).

[0051] It should be understood that in some examples, more than two electronic devices can be communicatively linked in a multi-user communication session. For example, in a case where three electronic devices are communicatively linked in a multi-user communication session, the first electronic device will display two avatars corresponding to the users of the other two electronic devices, rather than just one avatar. Therefore, it should be understood that the various processes and exemplary interactions described herein with reference to the first electronic device 360 and the second electronic device 370 in a multi-user communication session optionally apply to cases where more than two electronic devices are communicatively linked in a multi-user communication session.

[0052] In some examples, it may be advantageous to provide mechanisms for moving virtual objects shared in a multi-user communication session that includes collocated and non-collocated users (e.g., collocated and non-collocated electronic devices associated with the users). For example, it may be desirable to enable a user collocated in a first physical environment and participating in a multi-user communication session with one or more users not collocated in the first physical environment to coordinately move and / or reposition virtual content shared and presented in a three-dimensional environment, which virtual content is optionally viewable and / or interactable by collocated and non-collocated users in the multi-user communication session. As used herein, a collocated user corresponds to a local user relative to a first electronic device, and a non-collocated user corresponds to a remote user. As similarly discussed above, the three-dimensional environment optionally includes avatars corresponding to users of non-collocated electronic devices in the multi-user communication session. In some examples, as discussed below, the repositioning of virtual objects (e.g., avatars and / or shared virtual content) in a three-dimensional environment within a multi-user communication session is based on whether the multi-user communication session includes collocated users, non-collocated users (e.g., relative to the first electronic device), or both.

[0053] Figures 4A to 4AA An example interaction within a multi-user communication session including collocated and non-collocated users is shown in accordance with some examples of the present disclosure.

[0054] Figures 4A to 4C An example interaction within a multi-user communication session including collocated users is shown. In some examples, when a first electronic device 101a is in a multi-user communication session with a second electronic device 101b, a three-dimensional environment 450A is presented using the first electronic device 101a (e.g., via a display 120a), and a three-dimensional environment 450B is presented using the second electronic device 101b (e.g., via a display 120b). In some examples, the electronic devices 101a / 101b optionally correspond to or are similar to the electronic devices 360 / 370 discussed above and / or Figure 2 the electronic devices 260 / 270 in. In some examples, as Figure 4A shown, the first electronic device 101a is being used by a first user 402 (e.g., worn on their head), and the second electronic device 101b is being used by a second user 404 (e.g., worn on their head).

[0055] In Figure 4AIn, as indicated by the top view 410, the first electronic device 101a and the second electronic device 101b are juxtaposed in the physical environment 400. For example, both the first electronic device 101a and the second electronic device 101b are located in the same room including the indoor plant 408 and the window 409. In some examples, the determination that the first electronic device 101a and the second electronic device 101b are juxtaposed in the physical environment 400 is based on the distance between the first electronic device 101a and the second electronic device 101b. For example, in Figure 4A , because the first electronic device 101a is within the threshold distance (e.g., 0.1 meter, 0.5 meter, 1 meter, 2 meters, 3 meters, 5 meters, 10 meters, 15 meters, 20 meters, etc.) of the second electronic device 101b, the first electronic device 101a and the second electronic device 101b are juxtaposed in the physical environment 400. In some examples, the determination that the first electronic device 101a and the second electronic device 101b are juxtaposed in the physical environment 400 is based on the communication between the first electronic device 101a and the second electronic device 101b. For example, in Figure 4A the first electronic device 101a and the second electronic device 101b are configured to communicate (e.g., wirelessly, such as via Bluetooth, Wi-Fi, or a server (e.g., a wireless communication terminal)). In some examples, the first electronic device 101a and the second electronic device 101b are connected to the same wireless network in the physical environment 400. In some examples, the determination that the first electronic device 101a and the second electronic device 101b are juxtaposed in the physical environment 400 is based on the strength of the wireless signals transmitted between the electronic devices 101a and 101b. For example, in Figure 4A because the strength of the Bluetooth signal (or other wireless signal) transmitted between the electronic devices 101a and 101b is greater than the threshold strength, the first electronic device 101a and the second electronic device 101b are juxtaposed in the physical environment 400. In some examples, the determination that the first electronic device 101a and the second electronic device 101b are juxtaposed in the physical environment 400 is based on the visual detection of the electronic devices 101a and 101b in the physical environment 400. For example, as Figure 4A shown, the second electronic device 101b is positioned within the field of view of the first electronic device 101a (e.g., because the second user 404 is standing within the field of view of the first electronic device 101a), which enables the first electronic device 101a to visually detect (e.g., identify or scan, such as via object detection or other image processing techniques) the second electronic device 101b (e.g., in one or more images captured by the first electronic device 101a via external image sensors 114b-i and 114c-i). Similarly, as Figure 4AAs shown, the first electronic device 101a is optionally positioned within the field of view of the second electronic device 101b (e.g., because the first user 402 is standing within the field of view of the second electronic device 101b), which enables the second electronic device 101b to visually detect the first electronic device 101a (e.g., in one or more images captured by the second electronic device 101b such as via external image sensors 11b-ii and 114c-ii).

[0056] In some examples, the three-dimensional environment 450A / 450B includes a captured portion of the physical environment 400 in which the electronic devices 460 / 470 are located. For example, because the first electronic device 101a and the second electronic device 101b are juxtaposed within the physical environment 400, the three-dimensional environments 450A and 450B include, based on the viewpoints of the first electronic device 101a and the second electronic device 101b, indoor plants 408 (e.g., a representation of an indoor plant) or a window 409 (e.g., a representation of a window), as Figure 4A shown. In some examples, these representations may include portions of the physical environment 400 viewed through the transparent or translucent displays of the electronic devices 101a and 101b. In some examples, the three-dimensional environment 450A / 450B has one or more characteristics of the three-dimensional environments 350A / 350B described above with reference to Figure 3 ...

[0057] As described above with reference to Figure 3 ... when the electronic devices are communicatively linked in a multi-user communication session, the users may be represented by avatars corresponding to the users of the electronic devices. In Figure 4A ... because the first electronic device 101a and the second electronic device 101b are juxtaposed within the physical environment 400, the users of the electronic devices 101a and 101b are represented in the multi-user communication session by their physical persons (e.g., bodies) visible in the passthrough of the physical environment 400 (e.g., rather than via virtual avatars). For example, as Figure 4A shown, when the first electronic device 101a and the second electronic device 101b are in a multi-user communication session, the second user 404 is visible within the field of view of the first electronic device 101a, and the first user 402 is visible within the field of view of the second electronic device 101b. As discussed in more detail below, if a third user (e.g., a remote user) who is not juxtaposed within the physical environment 400 joins the multi-user communication session, the third user is represented via an avatar in the three-dimensional environments 450A and 450B.

[0058] As described above with reference to Figure 3Similarly described, when the first user 402 of the first electronic device 101a and the second user 404 of the second electronic device 101b are juxtaposed in the physical environment 400 and the first electronic device 101a is in a multi-user communication session with the second electronic device 101b, the first user 402 and the second user 404 can be in a first spatial group within the multi-user communication session. In some examples, the first spatial group has one or more characteristics of the spatial group 340 discussed above with reference to Figure 3 As similarly described above, when the first user 402 and the second user 404 are in the first spatial group within the multi-user communication session, the users have a first spatial arrangement in the shared three-dimensional environment (e.g., represented by the positions of the users 402 and 404 in the top view 410 of Figure 4A and / or the distance between the users), and this first spatial arrangement is determined by the physical positions of the electronic devices 101a and 101b in the physical environment 440. In particular, the first electronic device 101a and the second electronic device 101b experience spatial reality within the first spatial group, as determined by the physical positions and / or orientations of the first user 402 and the second user 404 respectively.

[0059] In some examples, as similarly described above with reference to Figure 3 When the first electronic device 101a and the second electronic device 101b are in a multi-user communication session, content can be shared, and this content can be viewed and / or interacted with by the first user 402 (e.g., via the first electronic device 101a) and the second user 404 (e.g., via the second electronic device 101b). For example, in Figure 4A , the shared three-dimensional environment includes virtual objects 430 corresponding to a game user interface associated with a game application. In some examples, the virtual object 430 is a shared virtual object, such that as Figure 4A shows, the virtual object 430 is displayed in both the three-dimensional environment 450A and the three-dimensional environment 450B and is interactive within the two three-dimensional environments. In some examples, as Figure 4A shows, the virtual object 430 is displayed together with a grabber bar 435, and this grabber bar can be selected to initiate the movement of the virtual object 430 within the three-dimensional environment 450A / 450B. In some examples, the virtual object 430 has one or more characteristics of the shared virtual object 310 described above with reference to Figure 3 .

[0060] In Figure 4BIn this case, when the first electronic device 101a and the second electronic device 101b are juxtaposed in the physical environment 400 (e.g., and optionally when the first electronic device 101a is in a multi-user communication session with the second electronic device 110b), the first electronic device 101a detects an input corresponding to a request to move the virtual object 430 within the three-dimensional environment 450A. For example, as Figure 4B shown, the first electronic device 101a detects that the hand 403 of the first user 402 performs an air pinching gesture (e.g., where the index finger and thumb of the hand 403 come together to form a pinched hand shape), optionally when the gaze 425 of the first user 402 points to the gripper bar 435 in the three-dimensional environment 450A, followed by the movement of the hand 403 in space (e.g., to the right relative to the body of the first user 402). It should be understood that additional or alternative inputs may be provided to cause the movement of the virtual object 430 within the three-dimensional environment 450A, such as air tapping gestures, gaze dwell, verbal commands, etc. Additionally, it should be understood that although such inputs (e.g., air gestures) performed by the first user 402 are not shown as visible in the three-dimensional environment 450B presented at the second electronic device 101b in Figure 4B , in some examples, from the viewpoint of the second electronic device 101b, these inputs are visible in the three-dimensional environment 450B (e.g., because the first user 402 is positioned within the field of view of the second electronic device 101b, as previously discussed).

[0061] In some examples, as Figure 4C shown, in response to detecting the input provided by the hand 403 discussed above, the first electronic device 101a moves the virtual object 430 in the three-dimensional environment 450A according to the input. For example, as Figure 4C shown in the top view 410 in

[0062] , the first electronic device 101a moves the virtual object 430 to the right relative to the viewpoint of the first electronic device 101a according to the rightward movement of the hand 403 of the first user 402. Figures 4A to 4C In some examples, as described above, the movement of the virtual object 430 (which is a shared virtual object) within the shared three-dimensional environment is based on whether the multi-user communication session includes co-located users, non-co-located users, or both. As previously discussed, in the example of Figures 4A to 4C , the first user 402 of the first electronic device 101a and the second user 404 of the second electronic device 101b are co-located in the physical environment 400. In cases where all participants in the multi-user communication session are co-located users, such as in Figure 4CAs shown, when the first electronic device 101a moves the virtual object 430 based on the input provided by the hand 403, the second electronic device 101b also moves the virtual object 430. For example, as Figure 4C shown, the second electronic device 101b moves the virtual object 430 to the left in the three-dimensional environment 450B with respect to the viewpoint of the second electronic device 101b, which reflects the rightward movement of the virtual object 430 in the three-dimensional environment 450A at the first electronic device 101a. Additionally, as Figure 4C shown, the first electronic device 101a and the second electronic device 101b move the virtual object 430 within the three-dimensional environments 450A / 450B based on the input discussed above, without updating the rendering of the passthrough representations of the first user 402 and the second user 404. For example, as Figure 4C shown, since neither the first user 402 nor the second user 404 physically moves in the physical environment 400 when the input provided by the first user 402 is detected, the representation of the second user 404 visible in the three-dimensional environment 450A is optionally not updated, and the representation of the first user 402 visible in the three-dimensional environment 450B is optionally not updated.

[0063] Figures 4D to 4F illustrates an example interaction within a multi-user communication session including non-collocated users. In some examples, the first user 402 of the first electronic device 101a and the second user 404 of the second electronic device 101b may not be collocated, rather than being collocated in the physical environment 400 as discussed above. For example, in Figure 4D the first user 402 of the first electronic device 101a is located in the physical environment 400 (e.g., corresponding to the physical environment 400 discussed above), and the second user 404 of the second electronic device 101b is located in the physical environment 440 (e.g., including the table 405), which is different from the physical environment 400 in which the first electronic device 101a is located. In some examples, when the second electronic device 101b is in the physical environment 440, the second electronic device 101b is at a distance greater than (e.g., as discussed above) a threshold distance from the first electronic device 101a. Additionally, in some examples, as Figure 4D shown, the second electronic device 101b is not within the field of view of the first electronic device 101a (and vice versa).

[0064] In some examples, when the first electronic device 101a and the second electronic device 101b are in a multi-user communication session, the first user 402 and the second user 404 can be visually represented using avatars in a shared three-dimensional environment, as similarly discussed above Figure 3 since the first user 402 and the second user 404 are not collocated. For example, as Figure 4DAs shown, the first electronic device 101a is displaying an avatar 411 corresponding to a second user 404 of the second electronic device 101b in a three-dimensional environment 450A, and the second electronic device 101b is displaying an avatar 413 corresponding to a first user 402 of the first electronic device 101a in a three-dimensional environment 450B. In some examples, the avatars 411 and 413 have one or more characteristics of the avatars 315 and 317 discussed above with reference to Figure 3 The avatars 315 and 317 discussed above.

[0065] Additionally, in some examples, as Figure 4D shown, when the first electronic device 101a and the second electronic device 101b are in a multi-user communication session, the three-dimensional environments 450A and 450B include the virtual object 430 discussed above. In Figure 4D this case, the virtual object 430 corresponds to a shared virtual object, as previously discussed above.

[0066] In Figure 4E this case, when the first electronic device 101a and the second electronic device 101b are in a multi-user communication session, the first electronic device 101a detects an input corresponding to a request to move the virtual object 430 in the three-dimensional environment 450A. For example, as similarly discussed above, the first electronic device 101a detects that the hand 403 of the first user 402 performs an air pinch gesture, optionally when the gaze 425 of the first user 402 points to the grabber bar 435, followed by a rightward movement of the hand 403 in space.

[0067] In some examples, when the electronic devices are in a multi-user communication session and the electronic devices are not collocated, such as the first electronic device 101a and the second electronic device 101b, the movement of a shared virtual object (e.g., the virtual object 430) triggers spatial refinement in the shared three-dimensional environment of the multi-user communication session. In some examples, the spatial refinement corresponds to enabling the movement and / or repositioning of the avatars and / or shared objects that can maintain the spatial reality within the first spatial group of the first user 402 and the second user 404 (e.g., triggered by the movement of the shared object). In Figure 4E this case, because the first electronic device 101a and the second electronic device 101b are not collocated, the input provided by the first user 402 pointing to the virtual object 430 optionally triggers spatial refinement at the first electronic device 101a. Thus, as Figure 4F shown, in response to detecting the input discussed above, the first electronic device 101a not only moves the virtual object 430 in the three-dimensional environment 450A according to the input, but also moves the avatar 411 corresponding to the second user 404 in the three-dimensional environment 450A according to the input. For example, as Figure 4FAs shown, the first electronic device 101a moves the virtual object 430 and the avatar 411 (e.g., by an equal amount) to the right in the three-dimensional environment 450A relative to the viewing point of the first electronic device 101a according to the rightward movement of the hand 403 of the first user 402.

[0068] In some examples, when spatial refinement is triggered at the first electronic device 101a, the movement of the virtual object 430 and the avatar 411 in the three-dimensional environment 450A is only applied to the avatar 413 corresponding to the first user 402 in the three-dimensional environment 450B at the second electronic device 101b. For example, as Figure 4F shown, the second electronic device 101b moves the avatar 413 to the right in the three-dimensional environment 450B relative to the viewing point of the second electronic device 101b according to the input provided by the first user 402 at the first electronic device 101a, without moving the virtual object 430, as reflected in the top view 412. Thus, as shown in the top views 410 and 412 in Figure 4F , the spatial reality as viewed from the viewing points of the first electronic device 101a and the second electronic device 101b is maintained after the input provided by the first user 402 (e.g., the first user 402 sees the avatar 411 corresponding to the second user 404 on its right via the first electronic device 101a, and the second user 404 sees the avatar 413 corresponding to the first user 402 on its right via the second electronic device 101b).

[0069] Figures 4G to 4J Examples of interactions within a multi-user communication session including co-located and non-co-located users are shown. In Figure 4G , the first electronic device 101a is in a multi-user communication session with the second electronic device 101b and the third electronic device 101c. In some examples, as shown in the top view 410 in Figure 4G , the first electronic device 101a is co-located with the third electronic device 101c in the physical environment 400 discussed above. Additionally, in Figure 4G , the second electronic device 101b is not co-located with the first electronic device 101a and the third electronic device 101c in the physical environment 400. For example, as shown in the top view 412, the second electronic device is located in a physical environment 440 that is different from (e.g., the one discussed above) the physical environment 400.

[0070] In some examples, when the first electronic device 101a, the second electronic device 101b, and the third electronic device 101c are in a multi-user communication session, as previously discussed, co-located users are represented via the physical bodies of the co-located users in a shared three-dimensional environment (e.g., relative to the respective electronic devices), and as previously discussed, non-co-located users are represented via virtual representations (e.g., avatars) in the shared three-dimensional environment (e.g., relative to the respective electronic devices). For example, in Figure 4G , since the second electronic device 101b is not co-located with the first electronic device 101a and the third electronic device 101c in the physical environment 400, the first electronic device 101a is displaying an avatar 411 corresponding to the second user 404 of the second electronic device 101b, and the third user 406 of the third electronic device 101c is visible in the three-dimensional environment 450A (e.g., in passthrough or via a computer-generated representation). Accordingly, the second electronic device 101b optionally is displaying an avatar 413 corresponding to the first user 402 of the first electronic device 101a and an avatar 415 corresponding to the third user 406 of the third electronic device 101c in the three-dimensional environment 450B (e.g., since the second user 404 of the second electronic device 101b is itself located in the physical environment 440), as Figure 4G shown in the top view 412 of Figure 4G . Additionally, as similarly discussed above, the shared three-dimensional environment includes a virtual object 430 corresponding to a shared virtual object, as

[0071] shown in Figure 4H . In Figure 4H , when the first electronic device 101a, the second electronic device 101b, and the third electronic device 101c are in a multi-user communication session, the first electronic device 101a detects an input corresponding to a request to move the virtual object 430 in the three-dimensional environment 450A. For example, as similarly discussed above, the first electronic device 101a detects that the hand 403 of the first user 402 performs an air pinching gesture, optionally when the gaze 425 of the first user 402 is directed at the grabber bar 435 in the three-dimensional environment 450A, followed by a leftward movement of the hand 403 in space, as Figure 4H shown in

[0072] In some examples, when the electronic devices 101a, 101b, and 101c are in a multi-user communication session, it may be advantageous to provide a method for compensating for a lag (e.g., reducing and / or preventing a delay) between detecting an input at one of the electronic devices and performing one or more corresponding operations at the other electronic devices. For example, when the first electronic device 101a detects Figure 4HWhen the input is performed by the hand 403 during input, the second electronic device 101b and the third electronic device 101c rely on data corresponding to the input to be transmitted by the first electronic device 101a (e.g., directly or indirectly via a server (e.g., a wireless communication terminal)) to perform one or more operations based on the input detected by the first electronic device 101a. Optionally, a delay is generated between when the first electronic device 101a responds to the input performed by the hand 403 of the first user 402 and when the second electronic device 101b and the third electronic device 101c perform one or more operations based on the input detected by the first electronic device 101a (e.g., this further generates a delay in each user's perception of the interaction).

[0073] To reduce the delay discussed above, in addition to the data transmitted by the first electronic device 101a, one or more of the other electronic devices (e.g., the second electronic device 101b and / or the third electronic device 101c) can also utilize computer vision techniques (e.g., object detection and / or tracking) to infer and / or predict the result of the input detected by the first electronic device 101a. For example, as Figure 4H shown, when the first electronic device 101a is detecting an air pinch gesture performed by the hand 403 of the first user 402, the third electronic device 101c also detects (e.g., using external image sensors 114b-iii and 114c-iii) the first user 402 performing an air pinch gesture with the hand 403 in the three-dimensional environment 450C presented on the display 120c of the third electronic device 101c. Additionally, the third electronic device 101c can detect the hand 403 of the first user 402 moving left relative to the first user 402's body in the three-dimensional environment 450C (e.g., corresponding to the hand 403 moving away from the viewpoint of the third electronic device 101c). In some examples, the third electronic device 101c (e.g., and / or the second electronic device 101b) can thus utilize the detected movement of the hand 403 to anticipate and / or infer the result of the input detected by the first electronic device 101a, as discussed in more detail below. In some examples, since the second electronic device 101b is not co-located with the first electronic device 101a and the third electronic device 101c in the physical environment 400, the third electronic device 101c can transmit data corresponding to the detected movement of the hand 403 to the second electronic device 101b, which enables the second electronic device 101b to anticipate and / or infer the result of the input detected by the first electronic device 101a.

[0074] In some examples, as Figure 4I shown, in response to detecting an input performed by the hand 403 of the first user 402, the first electronic device 101a triggers spatial refinement, as discussed similarly above. For example, asFigure 4I As shown, the first electronic device 101a moves the virtual object 430 and the avatar 411 corresponding to the second user 404 (e.g., by an equal amount) to the left in the three-dimensional environment 450A relative to the viewpoint of the first electronic device 101a according to the leftward movement of the hand 403 in Figure 4H . Additionally, as shown in Figure 4I , the first electronic device 101a abandons updating the rendering of the third user 406 in the three-dimensional environment 450A (e.g., because spatial refinement is only applied to virtual content displayed in the shared three-dimensional environment).

[0075] In some examples, when spatial refinement is triggered at the first electronic device 101a, the movement of the virtual object 430 and the avatar 411 in the three-dimensional environment 450A is only applied to the avatar 413 corresponding to the first user 402 and the avatar 415 corresponding to the third user 406 in the three-dimensional environment 450B at the second electronic device 101b. For example, as shown in Figure 4I , the second electronic device 101b moves the avatars 413 and 415 to the left in the three-dimensional environment 450B relative to the viewpoint of the second electronic device 101b (e.g., by an equal amount) according to the input provided by the first user 402 at the first electronic device 101a, without moving the virtual object 430, as reflected in the top view 412. Thus, as shown in the top views 410 and 412 via Figure 4I , the spatial reality seen from the viewpoints of the first electronic device 101a, the second electronic device 101b, and the third electronic device 101c is maintained after the input provided by the first user 402 (e.g., the first user 402 sees the avatar 411 corresponding to the second user 404 on its left via the first electronic device 101a, and the second user 404 sees the avatar 413 corresponding to the first user 402 and the avatar 415 corresponding to the third user 406 on its left via the second electronic device 101b).

[0076] Alternatively, in some examples, as shown in Figure 4J , in response to detecting the input performed by the hand 403 of the first user 402 in Figure 4H , the first electronic device 101a moves the virtual object 430 in the three-dimensional environment 450A according to the input (e.g., but without triggering spatial refinement, which is different from the above). For example, as shown in Figure 4J , the first electronic device 101a moves the virtual object 430 to the left in the three-dimensional environment 450A relative to the viewpoint of the first electronic device 101a according to the leftward movement of the hand 403 in Figure 4H , without moving the avatar 411 and without updating the rendering of the third user 406 in the three-dimensional environment 450A, as shown in the top view 410. Additionally, as shown in Figure 4JAs shown, when the first electronic device 101a moves the virtual object 430 based on the input provided by the hand 403, the second electronic device 101b also moves the virtual object 430. For example, as Figure 4J shown, the second electronic device 101b moves the virtual object 430 to the right in the three-dimensional environment 450B with respect to the view point of the second electronic device 101b, which reflects the leftward movement of the virtual object 430 in the three-dimensional environment 450A at the first electronic device 101a. In addition, the second electronic device 101b abandons moving the avatar 413 corresponding to the first user 402 and the avatar 415 corresponding to the third user 406 in the three-dimensional environment 450B. As shown in the top views 410 and 412, Figure 4J The alternative response shown also enables maintaining spatial reality from the perspectives of the first electronic device 101a, the second electronic device 101b, and the third electronic device 101c after the input provided by the first user 402 (e.g., the first user 402 continues to see the avatar 411 corresponding to the second user 404 opposite it and the third user 406 on its right via the first electronic device 101a, and the second user 404 continues to see the avatar 413 corresponding to the first user 402 opposite it and the avatar 415 corresponding to the third user 406 on its left via the second electronic device 101b).

[0077] Thus, as outlined above, facilitating the movement of a shared virtual object in a shared three-dimensional environment based on whether the users in a multi-user communication session are collocated or non-collocated enables maintaining spatial reality among the viewpoints of the users in the multi-user communication session, which improves the user interaction and experience with the shared virtual object. Attention will now be turned to an example of moving and / or repositioning a shared virtual object in a shared three-dimensional environment based on the activation of one or more modes for controlling the movement of the shared virtual object in the shared three-dimensional environment.

[0078] In some examples, the movement of the virtual object 430 in the shared three-dimensional environment is defined according to one or more (e.g., user-selected) modes. In some examples, one or more modes include a first mode that, when activated, triggers spatial refinement when the virtual object 430 moves in the shared three-dimensional environment (e.g., in response to detecting an input pointing to the virtual object 430). For example, as Figure 4K shown, the virtual object 430 may be displayed with a toggle 432 that can be selected to activate (or deactivate) the first movement mode. In Figure 4KIn the example, the first mode is active, as indicated by switch 432 in the three-dimensional environment 450A, which indicates that in response to detecting an input corresponding to a request for the mobile virtual object 430, such as the input described above, the first electronic device 101a triggers spatial refinement when the mobile virtual object 430 (such as the movement of the virtual object 430 discussed above with reference to Figure 4I ). Alternatively, if the first mode is not active, in response to detecting an input corresponding to a request for the mobile virtual object 430 (such as the movement of the virtual object 430 discussed above with reference to Figure 4J ), the first electronic device 101a optionally does not trigger spatial refinement in the three-dimensional environment 450A. In some examples, the switch 432 is displayed together with the virtual object 430 in response to detecting an input corresponding to a request to display the switch 432. For example, in response to detecting a selection of the grabber bar 435 of the virtual object 430 (such as an air pinch gesture pointing to the grabber bar) (e.g., no request to move the virtual object 430 is detected, such as the movement of the hand when in a pinched hand shape), the first electronic device 101a displays the switch 432 in the three-dimensional environment 450A. It should be noted that the first mode can be activated or deactivated by any one of the participants in the multi-user communication session (such as any one of the first user 402, the second user 404, and the third user 406) (e.g., via an input detected by their respective electronic devices).

[0079] In some examples, one or more modes include a second mode that, when activated, triggers private movement when the virtual object 430 moves in the shared three-dimensional environment (e.g., in response to detecting an input pointing to the virtual object 430). In some examples, the private movement of the virtual object 430 is similar to the movement of a private object (such as Figure 3 's private application window 330), although the virtual object 430 is a shared virtual object, as discussed in more detail below.

[0080] In some examples, as Figure 4L shown, the virtual object 430 can be displayed together with a switch 434 that can be selected to activate (or deactivate) the second movement mode. In Figure 4LIn the example, the second mode is active, as indicated by switch 434 in the three-dimensional environment 450A, which indicates that in response to detecting an input corresponding to a request to move the virtual object 430, the first electronic device 101a moves the virtual object 430 privately for the first user 402, as discussed below. In some examples, the switch 434 is displayed together with the virtual object 430 in response to detecting an input corresponding to a request to display the switch 434. For example, in response to detecting a selection of the grabber bar 435 of the virtual object 430 (such as an air pinch gesture pointing to the grabber bar) (e.g., no request to move the virtual object 430 is detected, such as movement of the hand while in a pinched hand shape), the first electronic device 101a displays the switch 434 in the three-dimensional environment 450A. It should be noted that, as similarly discussed above, the second mode can be activated or deactivated by any one of the participants in the multi-user communication session (such as any one of the first user 402, the second user 404, and the third user 406) (e.g., via an input detected by their respective electronic devices).

[0081] In Figure 4L it, when the second movement mode is active and when the first electronic device 101a, the second electronic device 101b, and the third electronic device 101c are in a multi-user communication session, the first electronic device 101a detects an input corresponding to a request to move the virtual object 430 in the three-dimensional environment 450A. For example, as Figure 4L shown, the first electronic device 101a detects an air pinch gesture performed by the hand 403 of the first user 402, optionally when the gaze 425 points to the grabber bar 435, followed by a forward movement of the hand in space (e.g., away from the body of the first user 402).

[0082] In some examples, as Figure 4M shown, in response to detecting an input provided by the hand 403, the first electronic device 101a moves the virtual object 430 in the three-dimensional environment 450A according to the input. For example, as Figure 4M shown, the first electronic device 101a moves the virtual object 430 away from the viewing point of the first electronic device 101a in the three-dimensional environment 450A according to the forward movement of the hand 403 in space, as shown in the top view 410. In some examples, because the second movement mode is active (e.g., private movement), the first electronic device 101a moves the virtual object 430 without performing spatial refinement. For example, as Figure 4M shown, when moving the virtual object 430 in the three-dimensional environment 450A, the first electronic device 101a abandons moving the avatar 411 corresponding to the second user 404 and abandons updating the presentation of the third user 406 in the three-dimensional environment 450A. Additionally, as Figure 4MAs shown, since the second movement mode is active when the first electronic device 101a detects the input discussed above, the movement of the virtual object 430 is private to the first user 402. In other words, the movement of the virtual object 430 can only be perceived by the first user 402 from the viewpoint of the first electronic device 101a in the three-dimensional environment 450A. Thus, as shown in the top view 412, in response to the input detected by the first electronic device 101a, the second electronic device 101b abandons updating the rendering of the three-dimensional environment 450B. For example, the second electronic device 101b abandons moving the virtual object 430 in the three-dimensional environment 450B according to the input detected by the first electronic device 101a.

[0083] It should be understood that when the second mode (e.g., private mode) is active for the virtual object 430, additional or alternative interactions directed to the virtual object 430 other than movement are similarly private to the corresponding user performing the interaction. For example, if the second mode is active, inputs for rotating the virtual object 430 and / or resizing it in the three-dimensional environment 450A will similarly be private to the first user 402 of the first electronic device 101a.

[0084] Figures 4N to 4T An example interaction within a multi-user communication session including co-located users is shown. As shown in the top view 410, the first user 402 of the first electronic device 101a, the second user 404 of the second electronic device 101b, and the third user 406 of the third electronic device 101c are optionally in a multi-user communication session. In some examples, as shown in the top view 410 and as previously described herein, the first user 402 (e.g., and the first electronic device 101a), the second user 404 (e.g., and the second electronic device 101b), and the third user 406 (e.g., and the third electronic device 101c) are co-located in the physical environment 400 (e.g., corresponding to the physical environment 400 described above). Thus, as similarly discussed above, views of the shared three-dimensional environment (e.g., including the physical environment 400) are provided to the first user 402, the second user 404, and the third user 406 (e.g., visible to them) from the unique viewpoints of the first electronic device 101a, the second electronic device 101b, and the third electronic device 101c, respectively. Additionally, as Figure 4N shown in the top view 410 in, the shared three-dimensional environment includes a virtual object 430 (e.g., a game user interface associated with a game application), as similarly discussed above.

[0085] In some examples, when in a multi-user communication session including co-located users, the electronic device facilitates the movement of virtual objects according to a user-centric movement model, as discussed below. In Figure 4NIn [description], when a virtual object 430 is displayed in a shared three-dimensional environment, a first electronic device 101a detects an input corresponding to initiating movement of the virtual object 430. For example, as Figure 4N shown, the first electronic device 101a detects an air pinching gesture provided by the hand 403 of the first user 402 (e.g., and optionally when the gaze of the first user 402 is directed at the virtual object 430).

[0086] In some examples, facilitating movement of a virtual object according to a user-centric movement model includes: grouping co-located users together in a multi-user communication session (e.g., based on the viewpoints of their respective electronic devices). For example, as Figure 4O shown in the top view 410 in [description], a boundary 445 is defined in the physical environment 400 around the first user 402, the second user 404, and the third user 406 (e.g., based on the positions of the first electronic device 101a, the second electronic device 101b, and the third electronic device 101c). In some examples, as Figure 4O indicated, the boundary 445 corresponds to the "best fit" grouping of co-located users in a multi-user communication session. For example, as Figure 4O shown in the top view in [description], the size (e.g., including dimensions), shape, and / or position of the boundary 445 is based on the positions of the first user 402, the second user 404, and the third user 406 in the physical environment 400.

[0087] In some examples, the boundary 445 is determined by an electronic device associated with the first user 402, the second user 404, and / or the third user 406 based on position and pose data provided by the electronic device. For example, the first electronic device 101a, the second electronic device 101b, and / or the third electronic device 101c may exchange data corresponding to the position of the electronic device (e.g., and thus the user) in the physical environment 400, and / or data corresponding to the orientation of the electronic device (e.g., including the forward viewing direction) in the physical environment 400. In some examples, as similarly discussed herein, the position and / or pose data is determined by the electronic device relative to a reference or center of a spatial group of users and / or relative to each other.

[0088] In Figure 4O [description], the first electronic device 101a detects movement of the hand 403 in space while maintaining the air pinching gesture provided in Figure 4N [description]. For example, as Figure 4O shown, the first electronic device 101a detects a rightward movement of the hand 403 relative to the viewpoint of the first electronic device 101a, which corresponds to a request to move the virtual object 430 to the right in the shared three-dimensional environment from the viewpoint of the first electronic device 101a.

[0089] In some examples, such as Figure 4P shown, in response to detecting movement of the hand 403, the first electronic device 101a moves the virtual object 430 to the right in the shared three-dimensional environment from the viewpoint of the first electronic device 101a. Specifically, as shown in the top view 410 of Figure 4P , the first electronic device 101a moves the virtual object 430 towards a group of co-located users in the shared three-dimensional environment. In some examples, facilitating movement of the virtual object according to a user-centric movement model includes: moving the virtual object relative to (e.g., defined by and / or based on the boundary 445) the group of co-located users. For example, the movement of the virtual object according to the user-centric movement model is restricted and / or constrained by the boundary 445. In some examples, the degree to which the movement is restricted is based on the virtual object type. For example, in Figure 4N , when an input for moving the virtual object 430 is initially detected, the virtual object 430 is an object of a first type. In some examples, the first type of object is or includes a virtual object having a horizontal orientation in the shared three-dimensional environment, including two-dimensional and three-dimensional (e.g., volumetric) virtual objects having a horizontal orientation and / or surface (such as the horizontal top or bottom surface of a three-dimensional virtual object). In the example of Figure 4P , since the virtual object 430 is an object of the first type, in response to detecting movement of the hand 403 of the first user 402 discussed above, the first electronic device 101a moves the virtual object 430 according to the movement of the hand 403 without specifically restricting the movement of the virtual object 430 beyond the boundary 445. For example, as shown in the top view 410 of Figure 4P , since the virtual object 430 is a horizontally oriented virtual object, the first electronic device 101a moves the virtual object 430 at least partially within the boundary 445. In some examples, as described below, for the movement of a second type of virtual object different from the first type, the movement of the virtual object is restricted to remain outside the boundary 445 in the shared three-dimensional environment.

[0090] Figure 4Q shows an example of a multi-user communication session including co-located users and a second type of virtual object (e.g., a vertically oriented object) different from the first type (e.g., a horizontally oriented object) discussed above. For example, as shown in the top view 410 of Figure 4Q , the multi-user communication session includes a first user 402 (e.g., and the first electronic device 101a), a second user 404 (e.g., and the second electronic device 101b), and a third user 406 (e.g., and the third electronic device 101c) co-located in the physical environment 400. Additionally, as shown in Figure 4QAs shown in the top view 410 in, the multi-user communication session includes shared virtual content in a shared three-dimensional environment of the multi-user communication session. For example, as shown in the top view 410, the shared three-dimensional environment includes a virtual object 436, which corresponds to a vertically oriented virtual object and will be discussed in more detail below.

[0091] In Figure 4Q When the virtual object 436 is displayed in the shared three-dimensional environment, the first electronic device 101a detects an input corresponding to initiating the movement of the virtual object 436. For example, as Figure 4Q shown, the first electronic device 101a detects an air pinching gesture provided by the hand 403 of the first user 402 (for example, and optionally when the gaze of the first user 402 points to the virtual object 436).

[0092] In some examples, as Figure 4R shown, as similarly described above, (optionally because the multi-user communication session includes co-located users, as previously discussed above) the movement of the virtual object 436 is initiated within the multi-user communication session according to a user-centered movement model. Thus, in Figure 4R as previously discussed above, a boundary 445 is defined around the co-located users in the multi-user communication session. For example, as Figure 4R shown in the top view 410 in, the boundary 445 is defined based on the positions of the viewpoints of the first electronic device 101a, the second electronic device 101b, and the third electronic device 101c in the physical environment 400.

[0093] In Figure 4R the first electronic device 101a detects the movement of the hand 403 in space while maintaining the air pinching gesture provided in Figure 4Q For example, as Figure 4R shown, the first electronic device 101a detects a rightward movement of the hand 403 relative to the viewpoint of the first electronic device 101a, and this rightward movement corresponds to a request to move the virtual object 436 to the right in the shared three-dimensional environment from the viewpoint of the first electronic device 101a.

[0094] In some examples, as Figure 4S shown, in response to detecting the movement of the hand 403, the first electronic device 101a moves the virtual object 436 to the right in the shared three-dimensional environment from the viewpoint of the first electronic device 101a (for example, and towards the viewpoint of the third electronic device 101c). Specifically, as Figure 4SAs shown in the top view 410 in, the first electronic device 101a moves the virtual object 436 towards the group of co-located users in the shared three-dimensional environment. In some examples, as previously discussed above, facilitating the movement of the virtual object according to a user-centric movement model includes: moving the virtual object relative to a group of co-located users (e.g., defined by and / or based on the boundary 445). In some examples, since the virtual object 436 is an object with a vertical orientation (e.g., a virtual window or user interface with a vertically oriented front-facing surface), so when in Figure 4Q an input for moving the virtual object 436 is initially detected, the virtual object 436 is determined to be (e.g., classified as) a second type of object different from the first type of object (e.g., a horizontally oriented virtual object) described above. In Figure 4S an example, since the virtual object 436 is an object of the second type (e.g., and not the first type discussed above), in response to detecting the movement of the hand 403 of the first user 402 discussed above, the first electronic device 101a moves the virtual object 436 according to the movement of the hand 403 (e.g., towards the group of co-located users), but limits (e.g., stops) the movement of the virtual object 436 outside the boundary 445. For example, as Figure 4S shown in the top view 410 in, since the virtual object 436 is a vertically oriented virtual object, the first electronic device 101a moves the virtual object 436 to a position at or outside the boundary 445 in the shared three-dimensional environment, although and / or even if the movement of the hand 403 of the first user 402 corresponds to the movement of the virtual object 436 to a position within the boundary 445.

[0095] In some examples, when the virtual object 436 is moved to Figure 4S the boundary 445 in, the virtual object 436 "snaps" to a point on the boundary 445. For example, as shown in the top view 410, the first electronic device 101a aligns the center of the virtual object 436 with the point 437 on the boundary 445 (e.g., because the movement of the hand 403 corresponds to the movement of the virtual object 436 to a position within the boundary 445). In some examples, the movement of the virtual object 436 is locked (e.g., stopped) at the boundary 445, such that preventing the virtual object 436 from being moved inside the boundary 445. In some examples, the position where the virtual object 436 is displayed in response to the movement input is a position offset (e.g., offset by a predetermined distance) from the boundary 445. Additionally, as Figure 4SAs shown, when the center of the virtual object 436 is aligned with the point 437 on the boundary 445, the virtual object 436 is orthogonal to the point 437, as indicated by the double-headed arrow in the top view 410. In some examples, the orientation of the virtual object 436 is orthogonal to the forward direction of the head or torso of the user providing the movement input, such as the forward direction of the first user 402.

[0096] In Figure 4S , the first electronic device 101a detects a further movement directed at the virtual object 436 in the shared three-dimensional environment. For example, as Figure 4S shown, the first electronic device 101a detects an air pinch and drag gesture directed at the virtual object 436 in the shared three-dimensional environment, such as the air pinch provided by the hand 403, followed by the movement of the hand 403 in space relative to the viewing point of the first electronic device 101a. Alternatively, in some examples, the movement input directed at the virtual object 436 is or includes an air throw or flick gesture provided by the hand 403 of the first user 402. For example, the first electronic device 101a detects an air pinch gesture provided by the hand 403, followed by a "toss" or "throw" movement of the hand 403 in the direction of the arrow as Figure 4S shown. In either example, the first electronic device 101a also optionally detects the gaze of the first user 402 directed at the virtual object 436 during the input.

[0097] In some examples, as Figure 4T shown, in response to detecting a movement input directed at the virtual object 436, the first electronic device 101a moves the virtual object 436 according to and / or based on the movement input. For example, as shown in the top view 410 in Figure 4T , the first electronic device 101a moves the virtual object 436 to the right in the shared three-dimensional environment relative to the group of co-located users, such that the virtual object 436 is positioned further away from the viewing point of the first electronic device 101a and closer to the viewing point of the second electronic device 101b. Additionally, as similarly discussed above, as shown in the top view 410 in Figure 4T , when the virtual object 436 moves in the shared three-dimensional environment according to a user-centered movement model, the virtual object 436 "snaps" to or locks to a second point on the boundary 445. For example, as similarly discussed above, the first electronic device 101a aligns the center of the virtual object 436 with a second point on the boundary 445 in the movement direction of the virtual object 436.

[0098] In some examples, moving the virtual object 436 according to a user-centered movement model includes: updating the orientation of the virtual object 436 in the shared three-dimensional environment. For example, as Figure 4TAs shown in the top view 410 in [context], when the virtual object 436 moves in the shared three-dimensional environment, the first electronic device 101a rotates the virtual object 436 (e.g., about a vertical axis passing through the center of the virtual object 436). In some examples, the amount by which the virtual object 436 rotates in the shared three-dimensional environment (e.g., in degrees) is based on the average forward direction of the first electronic device 101a (e.g., and the first user 402), the second electronic device 101b (e.g., and the second user 404), and the third electronic device 101c (e.g., and the third user 406) in the physical environment 400. For example, as Figure 4T indicated in the top view 410 in [context], the average forward direction 452 is determined by averaging the forward directions (e.g., orientations) of the first electronic device 101a, the second electronic device 101b, and the third electronic device 101c. In some examples, the forward-facing surface of the virtual object 436 is angled to face (e.g., orthogonal or nearly orthogonal to) the average forward direction 452, as Figure 4T shown in the top view 410 in [context].

[0099] Figures 4U to 4AA illustrates an example interaction within a multi-user communication session including co-located and non-co-located users. As shown in the top view 410, the first user 402 of the first electronic device 101a discussed above co-located in the physical environment 400 and the third user 406 of the third electronic device 101c discussed above are optionally in a multi-user communication session with two non-co-located users (e.g., users not located in the physical environment 400) visually represented as avatars 411 and 413 in the top view 410 (e.g., although it should be understood that alternative representations are possible, such as those described above herein). In some examples, as similarly discussed above, views of the shared three-dimensional environment (e.g., including the physical environment 400) are provided to the first user 402 and the third user 406 (e.g., visible to them) from the unique viewpoints of the first electronic device 101a and the third electronic device 101c, respectively. Additionally, as Figure 4U shown in the top view 410 in [context], the shared three-dimensional environment includes a virtual object 430 (e.g., a game user interface associated with a game application), as similarly discussed above.

[0100] In some examples, when in a multi-user communication session including co-located and non-co-located users, the electronic device facilitates the movement of the virtual object according to the user-centric movement model discussed above. For example, in Figure 4U [context], the third electronic device 101c detects an input corresponding to a request to initiate the movement of the virtual object 430 in the shared three-dimensional environment from the viewpoint of the third electronic device 101c, such as an air pinch gesture provided by the hand 407 of the third user 406, as similarly discussed above. In some examples, asFigure 4V As shown, in response to detecting an input provided by the hand 407 of the third user 406, virtual content displayed in the shared three-dimensional environment of the co-located users is grouped together relative to the co-located users. For example, as shown in the top view 410 in Figure 4V , the virtual content of the shared three-dimensional environment includes virtual object 430 and avatars 411 and 413 relative to the co-located first user 402 and third user 406. Thus, as indicated by the first boundary 445A in the top view 410, the virtual object 430 and avatars 411 and 413 are grouped as a first group in the shared three-dimensional environment. In some examples, the first boundary 445A has one or more characteristics of the boundary 445 described previously above. For example, the first boundary 445A is based on the positions of the virtual object 430 and avatars 411 and 413 in the shared three-dimensional environment (e.g., having a size and / or shape based on these positions). Thus, as described below, a movement input directed to the virtual object 430 optionally causes the virtual object 430 and avatars 411 and 413 to move as a group (e.g., consistently) according to the movement input as defined by the first boundary 445A, which is similar to performing scene refinement on the virtual content, as discussed previously herein.

[0101] In Figure 4V , the third electronic device 101c detects movement of the hand 407 while maintaining the air pinch gesture detected in Figure 4U . For example, as shown in Figure 4V , the third electronic device 101c detects that the hand 407 moves leftward in space relative to the viewpoint of the third electronic device 101c, and this leftward movement corresponds to a request to move the virtual object 430 leftward in the shared three-dimensional environment from the viewpoint of the third electronic device 101c. In some examples, as described below, the movement of the virtual object 430 and thus the avatars 411 and 413 as discussed above is performed relative to the co-located users in the shared three-dimensional environment. For example, as shown in the top view 410 in Figure 4V , the first user 402 and the third user 406 are grouped together as co-located users in the shared three-dimensional environment, as indicated by the second boundary 445B, and the virtual object 430 and avatars 411 and 413 move accordingly in the shared three-dimensional environment, as discussed below. In some examples, the second boundary 445B has one or more characteristics of the boundary 445 described above. For example, the second boundary 445B is based on the positions of the first electronic device 101a and the third electronic device 101c in the physical environment 400 (e.g., having a size and / or shape based on these).

[0102] In some examples, as in Figure 4WAs shown, in response to detecting movement of the hand 407, the third electronic device 101c moves the virtual content defined by the first boundary 445A in the shared three-dimensional environment based on the movement of the hand. In some examples, as Figure 4W indicated by the top view 410 in Figure 4V , a lateral (e.g., leftward) movement of the hand 407 of the third user 406 (e.g., as indicated by the hand 407 in Figure 4W ) causes the virtual content defined by the first boundary 445A to move radially in the shared three-dimensional environment relative to the viewpoint of the third electronic device 101c according to a user-centered movement model. For example, in the top view 410, the virtual object 430 and the avatars 411 and 413 move radially (e.g., counterclockwise) leftward along a circle or curve centered on the third electronic device 101c (e.g., as indicated by the center 448). Thus, in some examples, as

[0103] shown, in accordance with the radial (e.g., counterclockwise) movement of the virtual object 430 and the avatars 411 and 413, the orientations of the virtual object 430 and the avatars 411 and 413 are updated in the shared three-dimensional environment. It should be understood that in some examples, the center 448 that defines the radial movement is the center of the group of co-located users (e.g., the first user 402 and the third user 406), and the center of the group of co-located users optionally corresponds to the center of the second boundary 445B, rather than the center of the electronic device that detects the movement input.

[0103] In Figure 4W , the third electronic device 101c detects a further movement input directed at the virtual object 430 in the shared three-dimensional environment. For example, as Figure 4W indicated, the third electronic device 101c detects that the hand 407 moves toward the viewpoint of the third electronic device 101c (e.g., toward the body of the third user 406) while maintaining the air pinch gesture discussed above.

[0104] In some examples, as Figure 4XAs shown, in response to detecting movement of the hand 407, the third electronic device 101c moves virtual content defined by the first boundary 445A in a shared three-dimensional environment based on the movement of the hand 407. For example, as indicated by the top view 410, according to the movement of the hand 407, the virtual object 430 and the avatars 411 and 413 move as a group (e.g., consistently) toward the group of co-located users (e.g., the first user 402 and the third user 406). In some examples, as similarly discussed above, the movement of the virtual content defined by the first boundary 445A relative to the group of co-located users (e.g., the first user 402 and the third user 406) is selectively restricted by the second boundary 445B. For example, as similarly described above, a first type of shared object (e.g., an object with a horizontal orientation) is permitted to cross the second boundary 445B, while a second type of shared object (e.g., an object with a vertical orientation) and avatars are not permitted to cross the second boundary 445B. Thus, as Figure 4X shown in the example of the top view 410 in , when moving the virtual object 430 and the avatars 411 and 413 according to the movement of the hand 407, the amount of movement (e.g., the distance of movement) of the virtual object 430 and the avatars 411 and 413 relative to the viewpoints of the first electronic device 101a and the third electronic device 101c is constrained by the second boundary 445B such that the virtual object 430 is permitted to at least partially cross the second boundary 445B, as shown, but the avatar 413 (and thus the avatar 411) is optionally not permitted to at least partially cross the second boundary 445B. It should be understood that in Figure 4X the example of , once the movement input causes the avatar 413 to reach the second boundary 445B, the movement of the virtual object 430 (e.g., which is of the first type as discussed above) into the second boundary 445B stops, as shown in the top view 410.

[0105] Figure 4Y An example of a multi-user communication session including co-located and non-co-located users and a second type of virtual object different from the first type discussed above is shown. For example, as Figure 4Y shown in the top view 410 in , the multi-user communication session includes a first user 402 (e.g., and the first electronic device 101a) and a third user 406 (e.g., and the third electronic device 101c) co-located in the physical environment 400, and includes a second user (e.g., represented by the avatar 411) and a fourth user (e.g., represented by the avatar 413) not co-located with the first user 402 and the third user 406 in the physical environment 400. Additionally, as Figure 4YAs shown in the top view 410 in, the multi-user communication session includes shared virtual content in a shared three-dimensional environment of the multi-user communication session. For example, as shown in the top view 410, the shared three-dimensional environment includes a virtual object 436, which corresponds to a vertically oriented virtual object, as discussed in more detail below.

[0106] In Figure 4Y when the virtual object 436 is displayed in the shared three-dimensional environment, the third electronic device 101c detects an input corresponding to initiating the movement of the virtual object 436. For example, as Figure 4Y shown, the third electronic device 101c detects an air pinching gesture provided by the hand 407 of the third user 406 (e.g., and optionally when the gaze of the third user 406 points to the virtual object 436).

[0107] In some examples, as Figure 4Z shown, as similarly described above, (optionally because the multi-user communication session includes co-located users, as previously discussed above) the movement of virtual content (e.g., the virtual object 436 and the avatars 411 and 413) is initiated within the multi-user communication session according to a user-centric movement model. Thus, in Figure 4Z as previously discussed above, a first boundary 445A is defined around the virtual content relative to the co-located users in the multi-user communication session. For example, as Figure 4Z shown in the top view 410 in, the first boundary 445A is defined based on the positions of the virtual object 436 and the avatars 411 and 413.

[0108] In Figure 4Z the third electronic device 101c detects the movement of the hand 407 in space while maintaining the air pinching gesture provided in Figure 4Y For example, as Figure 4Z shown, the third electronic device 101c detects the movement of the hand 407 towards the viewing point of the third electronic device 101c (e.g., towards the body of the third user 406), which corresponds to a request to move the virtual object 436 towards the viewing point of the third electronic device 101c in the shared three-dimensional environment from the viewing point of the third electronic device 101c. In some examples, as similarly discussed above, the movement of the hand 407 corresponding to the request to move the virtual object 436 causes the virtual object 436 and the avatars 411 and 413 to move in the shared three-dimensional environment. In particular, as discussed in more detail below, the movement of the virtual content bounded by the first boundary 445A is performed relative to the group of co-located users (e.g., the first user 402 and the third user 406) as defined by the second boundary 445B according to the user-centric movement model. In some examples, the second boundary 445B corresponds to the second boundary 445B described above. For example, as Figure 4ZAs shown in the top view 410 in, the second boundary 445B is defined based on the positions of the viewpoints of the first electronic device 101a and the third electronic device 101c in the physical environment 400.

[0109] In some examples, such as Figure 4AA shown, in response to detecting movement of the hand 407, the third electronic device 101c moves the virtual content defined by the first boundary 445A in the shared three-dimensional environment based on the movement of the hand 407. For example, as indicated by the top view 410, according to the movement of the hand 407, the virtual object 436 and the avatars 411 and 413 move as a group (e.g., consistently) towards the group of co-located users (e.g., the first user 402 and the third user 406). In some examples, as similarly discussed above, the movement of the virtual content defined by the first boundary 445A relative to the group of co-located users (e.g., the first user 402 and the third user 406) is selectively restricted by the second boundary 445B. For example, as similarly described above, a first type of shared object (e.g., a horizontally oriented object) is permitted to cross the second boundary 445B, while a second type of shared object (e.g., a vertically oriented object) and avatars are not permitted to cross the second boundary 445B. Thus, as Figure 4X shown in the example of the top view 410 in, when moving the virtual object 436 (e.g., which is a second type of object) and the avatars 411 and 413 according to the movement of the hand 407, the amount of movement (e.g., the movement distance) of the virtual object 436 and the avatars 411 and 413 relative to the viewpoints of the first electronic device 101a and the third electronic device 101c is constrained by the second boundary 445B, such that the virtual object 436 and the avatars 411 and 413 are optionally not permitted to at least partially cross the second boundary 445B. It should be understood that in Figure 4AA the example of, once the movement input causes the avatar 413 to reach the second boundary 445B, the movement of the virtual object 436 (e.g., and thus the avatar 411) towards the group of co-located users (e.g., the first user 402 and the third user 406) stops, as shown in the top view 410.

[0110] Thus, as outlined above, providing one or more user-selectable modes that define the movement of shared virtual objects within a multi-user communication session provides users participating in the multi-user communication session with more control over interactions directed at the shared virtual objects, which helps enhance user privacy and thus improve the user experience. Attention will now be turned to additional interactions within a multi-user communication session that includes co-located and non-co-located users.

[0111] Figures 5A to 5E Examples of interactions within a multi-user communication session that includes co-located and non-co-located users according to some examples of the present disclosure are shown. In Figure 5AIn this case, the first electronic device 101a (e.g., associated with the first user 502), the second electronic device 101b (e.g., associated with the second user 504), and the third electronic device 101c (e.g., associated with the third user 506) are in a multi-user communication session. In some examples, the first user 502, the second user 504, and the third user 506 respectively correspond to Figures 4A to 4M the first user 402, the second user 404, and the third user 406.

[0112] As Figure 5A shown in the top view 510 in, the first electronic device 101a and the second electronic device 101b are juxtaposed in the physical environment 500. Additionally, as Figure 5A shown in the top view 512 in, the third electronic device 101c is located in a physical environment 540 different from the physical environment 500. Thus, as similarly discussed above, the third electronic device 101c is not juxtaposed with the first electronic device 101a and the second electronic device 101b (e.g., the spatial group including the first user 502, the second user 504, and the third user 506 is a mixed spatial group, as previously discussed above). In some examples, thus, the first electronic device 101a and the second electronic device 101b display an avatar 515 corresponding to the third user 506, as indicated by the top view 510, and the third electronic device 101c displays an avatar 511 corresponding to the first user 502 and an avatar 513 corresponding to the second user 504, as indicated by the top view 512. In some examples, the avatars 511, 513, and 515 respectively correspond to Figures 4A to 4M the avatars 411, 413, and 415. Additionally, as Figure 5A shown and as similarly discussed above, the shared three-dimensional environment includes a virtual object 530 corresponding to the shared virtual object. In some examples, the virtual object 530 corresponds to the virtual object 430 described above. In Figure 5A the viewpoints of the electronic devices 101a, 101b, and 101c and the position of the virtual object 530 in the top views 510 and 512 optionally correspond to the original positions of these viewpoints and the virtual object 530 in the spatial group.

[0113] From Figures 5A to 5B , the spatial arrangement of the users in the spatial group within the multi-user communication session is updated based on the change in the positions of the viewpoints of the electronic devices 101a, 101b, and 101c relative to the shared three-dimensional environment. For example, as Figure 5BAs shown in the top view 510 in, the first electronic device 101a has moved to a first updated position (e.g., relative to the previous position 536c (e.g., the original position of the viewpoint of the first electronic device 101a in the spatial group)), which is caused by the movement of the first user 502 in the physical environment 500, and the second electronic device 101b has moved to a second updated position (e.g., relative to the previous position 536c), which is caused by the movement of the second user 504 in the physical environment 500. Similarly, as Figure 5B shown in the top view 512 in, the third electronic device 101c has moved to a third updated position (e.g., relative to the previous position 536b), which is caused by the movement of the third user 506 in the physical environment 540. As discussed above with reference to Figure 3 Similarly, the movements of the first electronic device 101a and the second electronic device 101b respectively cause the avatars 511 and 513 to move relative to the viewpoint of the third electronic device 101c, as indicated by the top view 512, and the movement of the third electronic device 101c causes the avatar 515 to move relative to the viewpoints of the first electronic device 101a and the second electronic device 101b, as Figure 5B indicated by the top view 510 in.

[0114] In some examples, the spatial arrangement in the spatial group of a multi-user communication session is configured to be reset (e.g., re-centered relative to the viewpoint of the corresponding user in the multi-user communication). For example, resetting the spatial arrangement in the spatial group within a multi-user communication session causes the virtual content (e.g., avatars and shared objects) to be redisplayed (e.g., repositioned (e.g., moved an equal amount) to be within the current field of view of the corresponding user) relative to the current viewpoint of the corresponding user as seen from the viewpoint of the corresponding user (e.g., the user providing the input to reset the spatial arrangement).

[0115] In Figure 5B the first electronic device 101a detects an input corresponding to a request to reset the spatial arrangement of the spatial group in the multi-user communication session. For example, as Figure 5B shown, the first electronic device 101a detects an input pointing to a physical button of the first electronic device 101a, such as via the hand 503 of the first user 502. In some examples, the input corresponds to a tap or a sequence of taps on the physical button, a rotation of the physical button, a swipe of the physical button, etc. In some examples, the input corresponds to the selection of a virtual button associated with resetting the spatial arrangement displayed at the first electronic device 101a.

[0116] In some examples, as Figure 5CAs shown, in response to detecting an input corresponding to a request to reset the spatial arrangement, the first electronic device 101a relocates the virtual object 530 and the avatar 515 corresponding to the third user 506 relative to the viewpoint of the first electronic device 101a. For example, as shown in the top view 510, the first electronic device 101a moves the virtual object 530 and the avatar 515 relative to the viewpoint of the first electronic device 101a such that the viewpoint of the first electronic device 101a is relative to Figure 5B the virtual object 530 in is positioned at the previous position 536c.

[0117] In some examples, since the multi-user communication session includes collocated and non-collocated users, the virtual object 530 and the avatar 515 are moved different amounts relative to the viewpoint of the first electronic device 101a, rather than moving the virtual object 530 and the avatar 515 equal amounts when resetting the spatial arrangement (e.g., similar to the spatial refinement discussed above). As Figure 5C shown in the top view 510, the first electronic device 101a positions the avatar 515 relative to Figure 5B the virtual object 530 in is positioned at the previous position 536b. In some examples, the first electronic device 101a abandons updating the rendering of the second user 504 relative to the viewpoint of the first electronic device 101a (e.g., because the second user 504 has not physically moved in the physical environment 500 when the input is detected in Figure 5B ). Thus, as outlined above, in the case where the multi-user communication session includes collocated and non-collocated users, resetting the spatial arrangement causes the virtual content (e.g., avatars and shared virtual objects) to be repositioned individually relative to the previous / original position of the virtual content in the shared three-dimensional environment rather than relative to the viewpoint of the corresponding user providing the input for resetting the spatial arrangement.

[0118] In some examples, the above method for resetting the spatial arrangement may cause the content to be shifted relative to the viewpoints of other electronic devices (e.g., the second electronic device 101b and / or the third electronic device 101b). For example, as Figure 5C indicated in the top view 510, when the first electronic device 101a resets the spatial arrangement of the spatial group, compared to Figure 5B the virtual object 530 and the avatar 515 are shifted further away from the viewpoint of the second electronic device 101b. Additionally, as Figure 5CAs shown in the top view 512, the avatar 511 corresponding to the first user 502 is displaced from the viewpoint of the third electronic device 101c towards the virtual object 530 and is positioned relative to the virtual object in the previous position 536c (e.g., based on the movement of the virtual object 530 relative to the viewpoint of the first electronic device 101a in the top view 510). As similarly discussed above, the third electronic device 101c updates the position of the avatar 511 without updating the position of the avatar 513 corresponding to the second user 504 (e.g., because when the first electronic device 101a detects an input in Figure 5B the second electronic device 101b does not physically change its position in the physical environment 500).

[0119] Figures 5D to 5E An example of a multi-user communication session is shown, where one of the electronic devices in the multi-communication session does not correspond to a head-mounted display. In Figure 5D the first electronic device 101a is in a multi-user communication session with the second electronic device 101b and the mobile electronic device 570. For example, as Figure 5D shown, the first electronic device 101a is displaying a three-dimensional environment 550A that includes an avatar 511 corresponding to a second user of the second electronic device 101b and a third user 506 holding the mobile electronic device 570. As Figure 5D shown, the mobile electronic device 570 does not correspond to a head-mounted display (e.g., the mobile electronic device 570 corresponds to a tablet computer or a smart phone held by the third user 506). In some examples, the mobile electronic device 570 has Figure 2 one or more components of the electronic devices 260 / 270 in

[0120] such as position sensors 204A / 204B, image sensors 206A / 206B, touch-sensitive surfaces 209A / 209B, orientation sensors 210A / 210B, microphones 213A / 213B, display generation components 214A / 214B, speakers 216A / 216B, processors 218A / 218B, memories 220A / 220B, communication circuitry 222A / 222B, and / or communication buses 208A / 208B.

[0120] In Figure 5D the example, the multi-user communication session includes collocated and non-collocated users, as similarly discussed above. For example, as Figure 5D shown, the first electronic device 101a (e.g., including the first user of the first electronic device 101a) and the mobile electronic device 570 (e.g., including the third user 506) are both located in the physical environment 500, while the second user of the second electronic device 101b is not located in the physical environment 500 (e.g., located in a different physical environment, such as the physical environment 540 discussed above). Thus, asFigure 5D As shown, the second user is visually represented via the avatar 511 corresponding to the second user in the three-dimensional environment 550A. Additionally, as Figure 5D shown, the shared three-dimensional environment of the multi-user communication session optionally includes shared virtual content, specifically the virtual object 530 discussed previously above.

[0121] As described above, in Figure 5D the example of, the multi-user communication session includes a non-head-mounted device (non-HMD) device, specifically the mobile electronic device 570. In some such examples, the virtual content shared within the multi-user communication session can be viewed and / or interacted with by the third user 506 via the mobile electronic device 570, but as two-dimensional content rather than as a virtual object within the shared three-dimensional environment. For example, as Figure 5D shown, since the virtual object 530 is shared among the first user, the second user, and the third user 506, the mobile electronic device 570 is configured to display a user interface 575 corresponding to the virtual object 530 via a display 571 (e.g., a touch screen). As previously mentioned herein, the virtual object 530 optionally corresponds to a game user interface (e.g., a virtual board game); thus, the user interface 575 is the same or a similar game user interface that enables the third user 506 to participate in the shared activity as a virtual board game (e.g., via the mobile electronic device 570). For example, the third user 506 can interact with the virtual object 530 in the shared three-dimensional environment via an input detected by the mobile electronic device 570 that points to the user interface 575. However, in this case, the third user 506 optionally has little knowledge of the spatial arrangement of the spatial group in the multi-user communication session. For example, since the mobile electronic device 570 only displays the user interface 575, the third user 506 is optionally not provided with and / or is limitedly provided (e.g., by the mobile electronic device 570) with an indication of the position of the virtual object 530 and the avatar 511 within the shared three-dimensional environment (e.g., relative to the viewing point of the mobile electronic device 570). In this case, the third user 506 optionally does not experience the spatial reality together with the first user and the second user in the multi-user communication session.

[0122] Alternatively, in some examples, when in a multi-user communication session, the mobile electronic device 570 can be configured to provide the third user 506 with a view of the shared three-dimensional environment, specifically a view from the viewing point of the mobile electronic device 570 within the spatial group. For example, as Figure 5E shown, the mobile electronic device 570 provides an augmented reality (AR) or mixed reality (MR) experience to the third user 506 using one or more external cameras of the mobile electronic device 570. As Figure 5EAs shown, a portion of the physical environment 500 and a first user 502 (including the first electronic device 101a) are optionally presented (e.g., based on the camera view of the mobile electronic device 570) on the display 571. Additionally, in some examples, the mobile electronic device 570 displays a virtual object 530 and an avatar 511 on the display 571. In some examples, as Figure 5E shown, the virtual object 530 and the avatar 511 are displayed at a certain position on the display 571, and this position is based on the spatial arrangement of the spatial group as viewed from the viewpoint of the mobile electronic device 570. In some examples, a third user 506 can interact with the virtual object 530 via an input detected by the mobile electronic device 570. For example, the mobile electronic device 570 can be configured to perform one or more operations (such as moving, rotating, and / or resizing) on the virtual object 530 and / or one or more interactions with the game user interface of the virtual object 530 in response to detecting a touch input (e.g., tap or swipe) on the display 571 and / or a hand-based air gesture (such as an air pinch gesture, an air tap gesture, etc.) detected by one or more cameras of the mobile electronic device 570. In this case, the third user 506 optionally experiences the spatial live with the first user 502 and the second user in a multi-user communication session. Thus, as outlined above, even a user not associated with an HMD-type device can participate in a multi-user communication session and can actively interact with the content shared among the users in the multi-user communication session.

[0123] It should be understood that the examples shown and described herein are merely exemplary, and additional and / or alternative elements for interacting with the exemplary content can be provided within a three-dimensional environment. It should be understood that the appearance, shape, form, and size of each of the various user interface elements and objects shown and described herein are exemplary, and alternative appearances, shapes, forms, and / or sizes can be provided. For example, virtual objects (such as the shared virtual object 310, the private application window 330, and / or the virtual objects 430 and 530) can be provided in alternative shapes other than the rectangular shape (such as a circular shape, a triangular shape, etc.). In some examples, various selectable options (such as the switches 432 and 434), user interface elements (such as the grabber bars 435 and 535), control elements, etc., described herein can be selected orally via a user verbal command (e.g., the "select option" verbal command). Additionally or alternatively, in some examples, various options, user interface elements, control elements, etc., described herein can be selected and / or manipulated via user input received through one or more separate input devices communicating with the electronic device. For example, a selection input can be received via a physical input device (such as a mouse, a touchpad, a keyboard, etc.) communicating with the electronic device.

[0124] It should also be noted that additional or alternative forms of content and / or interaction therewith may be provided in the shared three-dimensional environment in the examples provided above. For example, user interfaces of other types of applications may be provided in the shared three-dimensional environment, such as user interfaces of a web browsing application, a media player application, a text editing application, an image viewing application, a video conferencing application, etc. As another example, immersive content may be provided in the shared three-dimensional environment, such as a three-dimensional virtual environment that occupies a predefined portion (e.g., immersion levels of 100%, 90%, 80%, 75%, 50%, etc.) of the field of view of the corresponding electronic device. The virtual environment optionally corresponds to a virtual scene or environment (e.g., at a specific location and / or at a specific time of day), such as a virtual beach, a virtual park, a virtual theater, a virtual forest, etc. In some examples, the virtual environment includes virtual objects, such as virtual seats or benches, virtual rocks, virtual water, virtual clouds, virtual grass, virtual animals, etc. In the case where the virtual environment is presented in the shared three-dimensional environment, each user in the multi-user communication session may experience a portion of the virtual environment from their respective viewpoints (e.g., via the respective electronic devices of each user). For example, a virtual object in the virtual environment may be located at one position relative to one user's viewpoint, but at a different position relative to another user's viewpoint.

[0125] Figure 6 FIG. shows a flowchart of an example process for moving an object in a three-dimensional environment within a multi-user communication session based on whether the multi-user communication session includes co-located users or non-co-located users, according to some examples of the present disclosure. In some examples, process 600 begins at a first electronic device that communicates with one or more displays, one or more input devices, and a second electronic device, where the first electronic device is in a communication session with the second electronic device. In some examples, the first electronic device and the second electronic device are optionally head-mounted displays similar to or corresponding to Figure 2 electronic devices 260 / 270, respectively. As Figure 6 shown, in some examples, at 602, the first electronic device presents, via one or more displays, a three-dimensional environment that includes a first object of a first type and a visual representation of a user of the second electronic device. For example, as Figure 4A shown, the first electronic device 101a is presenting a three-dimensional environment 450A that includes a virtual object 430 (e.g., a shared virtual object) and a visual representation (e.g., a passthrough representation or a computer-generated representation) of a second user 404 of the second electronic device 101b.

[0126] In some examples, at 604, when presenting a three-dimensional environment that visually represents a user including a first object of a first type and a second electronic device, a first electronic device receives, via one or more input devices, a first input corresponding to a request to move the first object within the three-dimensional environment. For example, as Figure 4B shown, the first electronic device 101a detects an air pinch gesture provided by the hand 403 of the first user 402, optionally when the gaze 425 of the first user 402 is directed at a virtual object 430 (e.g., the grabber bar 435 of the virtual object 430), followed by movement of the hand 403 in space (e.g., to the right relative to the body of the first user 402).

[0127] In some examples, at 606, in response to receiving the first input, at 608, based on a determination that meets one or more criteria including criteria that are met when the second electronic device is juxtaposed with the first electronic device in a first physical environment, the first electronic device moves the first object of the first type within the three-dimensional environment relative to the viewpoint of the first electronic device according to the first input, without updating the rendering of the visual representation of the user of the second electronic device. For example, as Figure 4C shown, because the second electronic device 101b is juxtaposed with the first electronic device 101a in the physical environment 400, as indicated by the top view 410, the first electronic device 101a moves the virtual object 430 according to the input without updating the rendering of the visual representation of the second user 404 of the second electronic device 101b in the three-dimensional environment 450A. In some examples, at 610, based on a determination that one or more criteria are not met because the second electronic device is not juxtaposed with the first electronic device in the first physical environment, the first object of the first type and the visual representation of the user of the second electronic device are moved within the three-dimensional environment relative to the viewpoint of the first electronic device according to the first input. For example, as Figure 4F shown, because the second electronic device 101b is not juxtaposed with the first electronic device 101a in the physical environment 400, as indicated by the top views 410 and 412, the first electronic device 101a moves the virtual object 430 and the avatar 411 corresponding to the second user 404 of the second electronic device 101b within the three-dimensional environment 450A according to the input.

[0128] It should be understood that process 600 is an example, and more, fewer, or different operations may be performed in the same or a different order. Additionally, the operations in the above process 600 are optionally implemented by running an information processing device such as a general-purpose processor (e.g., as described with respect to Figure 2 ), or one or more functional modules in a dedicated chip, and / or by Figure 2 other components of

[0129] Figures 7A to 7Gillustrates example interactions within a multi - user communication session including co - located users, in accordance with some examples of the present disclosure. In Figure 7A , a first electronic device 101a (e.g., associated with a first user 702) and a second electronic device 101b (e.g., associated with a second user 704) are in a multi - user communication session. In some examples, the first user 702 and the second user 704 respectively correspond to Figures 4A to 4AA the first user 402 and the second user 404 of Figures 5A to 5E , and / or respectively correspond to

[0130] As Figure 7A shown in the top - view 710 of Figure 7A , the first electronic device 101a and the second electronic device 101b are co - located in a physical environment 700 including an indoor plant 708 and a window 709. For example, in the physical environment 700, the first user 702 wearing the first electronic device 101a is located opposite the second user 704 wearing the second electronic device 101b. Thus, the second user 704 (e.g., and the second electronic device 101b) is visible in a three - dimensional environment 750A presented by the first electronic device 101a (e.g., via a display 120a), and the first user 702 (e.g., and the first electronic device 101a) is visible in a three - dimensional environment 750B presented by the second electronic device 101b (e.g., via a display 120b). Additionally, as Figure 7A shown and discussed similarly above, the shared three - dimensional environment includes a virtual object 736 corresponding to a shared virtual object. In some examples, the virtual object 736 corresponds to the virtual object 436 described above. For example, as Figure 7A shown, the virtual object 736 is or includes a user interface associated with corresponding applications running on the electronic devices 101a and 101b, such as a media - player user interface. In Figure 7A the example of Figure 7A , although the virtual object 736 is shared between the first electronic device 101a and the second electronic device 101b (e.g., and thus is viewable and interactable by the first user 702 and the second user 704), the virtual object 736 is not currently visible in the field of view of the second electronic device 101b from the current viewpoint of the second electronic device 101b. Additionally, in Figure 7A , the viewpoints of the electronic devices 101a and 101b and the position of the virtual object 736 in the top - view 710 optionally represent the positions of these viewpoints and the virtual object 736 in the shared three - dimensional environment of the multi - user communication session.

[0131] In some examples, as Figure 7AAs shown, the virtual object 736 includes and / or displays with an interactive control for controlling the display of the content of the virtual object 736. For example, in Figure 7A , the virtual object 736 is displayed with playback controls 737 that can be selected to control the playback of content items (such as movies, television show episodes, music videos, and / or other media-based content) currently being displayed in the virtual object 736. In some examples, when the first electronic device 101a and the second electronic device 101b are in a multi-user communication session including co-located users, interacting with the virtual object 736 causes the playback controls 737 to stop being displayed in the shared three-dimensional environment, as discussed below.

[0132] In Figure 7B , the first electronic device 101a detects an input corresponding to a request to move the virtual object 736 in the three-dimensional environment 750A. For example, as Figure 7B shown, the first electronic device 101a detects an air pinching gesture performed by the hand 703 of the first user 702, optionally when the gaze 725 of the first user 702 points to the grab bar 739 in the three-dimensional environment 750A. In some examples, the grab bar 739 can be selected to initiate the movement of the virtual object 736 in the three-dimensional environment 750A. Additionally, after detecting the air pinching gesture, in some examples, the first electronic device 101a detects the movement of the hand 703. For example, as Figure 7B indicated, the first electronic device 101a detects that the hand 703 moves leftward in space relative to the viewpoint of the first electronic device 101a.

[0133] In some examples, as Figure 7C shown, in response to detecting the movement of the hand 703 of the first user 702, the first electronic device 101a moves the virtual object 736 in the three-dimensional environment 750A according to the movement of the hand 703. For example, as Figure 7C shown, according to the leftward movement of the hand 703, the virtual object 736 moves leftward in the three-dimensional environment 750A relative to the viewpoint of the first electronic device 101a. In some examples, as Figure 7C shown, because the virtual object 736 is a shared virtual object in a multi-user communication session, the movement of the virtual object 736 in the three-dimensional environment 750A causes the virtual object 736 to move correspondingly in the three-dimensional environment 750B presented at the second electronic device 101b. For example, as Figure 7CAs shown, in response to receiving input data corresponding to the movement of the virtual object 736 provided by the first electronic device 101a, the second electronic device 101b moves the virtual object 736 to the right relative to the viewpoint of the second electronic device 101b, such that the virtual object 736 is now at least partially visible in the three-dimensional environment 750B from the viewpoint of the second electronic device 101b.

[0134] In some examples, as Figure 7C shown, when the virtual object 736 moves in the three-dimensional environment 750A according to the movement of the hand 703, the first electronic device 101a stops displaying the playback control 737 associated with the virtual object 736. Additionally, in some examples, as Figure 7C shown, the playback control 737 stops being displayed together with the virtual object 736 in the three-dimensional environment 750B presented at the second electronic device 101b. In particular, while an interaction with the virtual object 736 (e.g., movement of the virtual object 736) is in progress, the playback control 737 stops being displayed to help avoid and / or impede (e.g., unintentional) interactions with the playback control 737 that may disrupt the current interaction with the virtual object 736 and / or overload the electronic devices 101a and 101b in response to potentially conflicting inputs, which is a benefit.

[0135] Additionally, in some examples, as Figure 7C shown, when the virtual object 736 moves in the three-dimensional environment 750A according to the movement of the hand 703 detected by the first electronic device 101a, the second electronic device 101b updates the visual appearance of the virtual object 736 in the three-dimensional environment 750B during the movement of the virtual object 736 in the three-dimensional environment 750B. For example, as Figure 7C indicated, such as by increasing the transparency of the content (e.g., user interface of the virtual object 736), decreasing its brightness, changing its coloring, decreasing its saturation, and / or stopping its display during the movement of the virtual object 736 caused by an input provided by the first user 702 at the first electronic device 101a, the second electronic device 101b reduces the visual emphasis and / or visual fidelity of the virtual object 736. Additionally or alternatively, in some examples, the second electronic device 101b displays a visual indication 726 (e.g., notification, alert, or message) of the input being provided by the first user 702 at the first electronic device 101a that causes the virtual object 736 to move in the three-dimensional environment 750B at the second electronic device 101b. For example, as Figure 7CAs shown, the second electronic device 101b provides a visual indication 726 that notifies the second user 704 that the first user 702 is currently providing a movement input that points to a virtual object 736 in the three-dimensional environment 750B. Changing the visual appearance of the virtual object 736 and / or providing the visual indication 726 during the movement of the virtual object 736 caused by the input provided by the first user 702 visually notifies the second user 704 that the virtual object 736 is currently being interacted with, which helps to avoid and / or prevent further interaction with the virtual object 736 while the virtual object 736 is still moving, and / or helps to avoid user confusion about the reason for the movement of the virtual object 736, which is another benefit.

[0136] In Figure 7C , the first electronic device 101a detects a further (e.g., continued) movement of the hand 703 of the first user 702 while the hand 703 maintains the air pinching gesture discussed above. For example, as Figure 7C shown, the first electronic device 101a detects that the hand 703 continues to move left relative to the viewing point of the first electronic device 101a, and this leftward movement corresponds to a request to further move the virtual object 736 leftward in the three-dimensional environment 750A relative to the viewing point of the first electronic device 101a.

[0137] In some examples, as Figure 7D shown, in response to detecting the continued movement of the hand 703 of the first user 702, the first electronic device 101a further moves the virtual object 736 leftward in the three-dimensional environment 750A according to the movement of the hand 703 relative to the viewing point of the first electronic device 101a. In some examples, as Figure 7D shown and discussed similarly above, when the first electronic device 101a moves the virtual object 736 according to the movement of the hand 703, the second electronic device 101b also correspondingly moves the virtual object 736 in the three-dimensional environment 750B. For example, in Figure 7D , the second electronic device 101b further moves the virtual object 736 leftward in the three-dimensional environment 750B based on the input data provided by the first electronic device 101a relative to the viewing point of the second electronic device 101b, and this input data corresponds to the movement of the virtual object 736 in the three-dimensional environment 750A.

[0138] In some examples, as Figure 7D shown, when the first electronic device 101a detects the end of the movement input provided by the hand 703 of the first user 702 (such as the release of the air pinching gesture and / or the relaxation of the hand 703), the first electronic device 101a redisplay the playback control 737 in the three-dimensional environment 750A (e.g., because it is no longer interacting with the virtual object 736). Additionally, as Figure 7DAs shown, when the first electronic device 101a redisplay the playback control 737 together with the virtual object 736 because the interaction with the virtual object 736 has ended, the second electronic device 101b redisplay the playback control 737 together with the virtual object 736 in the three-dimensional environment 750B (e.g., in response to receiving an indication that the input at the first electronic device 101a has ended). As Figure 7D shown, in response to receiving an indication that the input pointing to the virtual object 736 at the first electronic device 101a has ended, the second electronic device 101b optionally also restores the visual appearance of the virtual object 736 in the three-dimensional environment 750B. For example, in Figure 7D it, the second electronic device 101b increases and / or restores the visual emphasis and / or visual fidelity of the content of the virtual object 736, such as reducing the transparency of the user interface of the virtual object 736, increasing its brightness, restoring its saturation and / or coloring. Redisplaying the playback control 737 and restoring the visual appearance of the virtual object 736 facilitates the user to discover that the interaction with the virtual object 736 has ended, thereby providing the user with a visual indication that they can now interact with the playback control 737, which enhances and / or improves the overall user experience within the multi-user communication session, which is a benefit.

[0139] In some examples, the orientation of the virtual object 736 can be manipulated relative to the viewpoint of the corresponding electronic device independently (e.g., separately) from the movement of the virtual object 736 relative to the viewpoint of the corresponding electronic device. In particular, in some examples, a rotation affordance can be provided that enables the user to directly rotate the virtual object 736 to update the orientation of the virtual object 736 without the need to move the virtual object 736 and / or without otherwise moving the virtual object. For example, in Figure 7E it, as previously discussed above, the virtual object 736 is currently displayed together with the grab bar 739 (e.g., movement affordance) in the three-dimensional environment 750A. From Figures 7E to 7F it, the first electronic device 101a detects that the gaze 725 of the first user 702 moves to point to a predefined portion of the virtual object 736. In some examples, the predefined portion of the virtual object 736 corresponds to a side or edge of the virtual object 736, such as the right side of the virtual object 736 as Figure 7F shown. In some examples, as Figure 7FAs shown, in response to detecting a gaze 725 directed at a predefined portion of a virtual object 736, a first electronic device 101a displays a rotation affordance representation 742 in a three-dimensional environment 750A. In some examples, as discussed below, the rotation affordance representation 742 can be selected to initiate rotation of the virtual object 736 relative to the viewpoint of the first electronic device 101a. Additionally, in some examples, when the rotation affordance representation 742 is displayed in the three-dimensional environment 750A with the virtual object 736, the first electronic device 101a stops displaying the grappler bar 739 in the three-dimensional environment 750A, as Figure 7F shown.

[0140] In Figure 7F , when the rotation affordance representation 742 is displayed in the three-dimensional environment 750A, the first electronic device 101a detects an input provided by a hand 703 of a first user 702 that is directed at the rotation affordance representation 742 in the three-dimensional environment 750A. For example, as Figure 7F shown, the first electronic device 101a detects an air pinch gesture provided by the hand 703 of the first user 702, followed by movement of the hand 703 in space relative to the viewpoint of the first electronic device 101a, optionally when the gaze 725 is directed at the rotation affordance representation 742.

[0141] In some examples, as Figure 7G shown, in response to detecting the input provided by the hand 703, the first electronic device 101a rotates the virtual object 736, thereby changing the orientation of the virtual object 736 in the three-dimensional environment 750A relative to the viewpoint of the first electronic device 101a according to the movement of the hand 703. For example, as ​ shown, the first electronic device 101a rotates the virtual object 736 clockwise in the three-dimensional environment 750A (e.g., about a vertical axis passing through the center of the virtual object 736) according to a leftward movement of the hand 703. As ​ shown, when the first electronic device 101a rotates the virtual object 736, the first electronic device 101a abandons moving the virtual object 736 in the three-dimensional environment 750A according to the movement of the hand 703. For example, as ​ and ​ indicated by the top view 710 in, although the virtual object 736 rotates in the three-dimensional environment 750A, from the viewpoint of the first electronic device 101a, the virtual object 736 remains positioned at the same location in the three-dimensional environment 750A (e.g., because the input discussed above is directed at the rotation affordance representation 742 in the three-dimensional environment 750A rather than the grappler bar 739). As ​As shown, when the input indicating the rotation gesture 742 ends (e.g., when the first electronic device 101a detects the release of an air pinching gesture and / or the relaxation of the hand 703), and / or when the gaze 725 stops pointing to a predefined portion of the virtual object 736, the first electronic device 101a stops displaying the rotation gesture indication 742 and redisplay the grabber bar 739 in the three-dimensional environment 750A.

[0142] Accordingly, in accordance with the foregoing, some examples of the present disclosure relate to a method that includes: at a first electronic device in communication with one or more displays, one or more input devices, and a second electronic device, where the first electronic device is in a communication session with the second electronic device: presenting, via the one or more displays, a three-dimensional environment that includes a first object of a first type and a visual representation of a user of the second electronic device; while presenting the three-dimensional environment that includes the first object of the first type and the visual representation of the user of the second electronic device, receiving, via the one or more input devices, a first input corresponding to a request to move the first object within the three-dimensional environment; and in response to receiving the first input, moving, relative to a viewpoint of the first electronic device, the first object of the first type within the three-dimensional environment according to the first input based on a determination that satisfies one or more criteria that include a criterion that is satisfied when the second electronic device is juxtaposed with the first electronic device in a first physical environment, without updating a presentation of the visual representation of the user of the second electronic device, and moving, relative to the viewpoint of the first electronic device, the first object of the first type and the visual representation of the user of the second electronic device within the three-dimensional environment according to the first input based on a determination that one or more criteria are not satisfied because the second electronic device is not juxtaposed with the first electronic device in the first physical environment.

[0143] Additionally or alternatively, in some examples, the first type of object includes a virtual object shared between a user of a first electronic device and a user of a second electronic device within a communication session. Additionally or alternatively, in some examples, the three-dimensional environment further includes a second object of a second type different from the first type, and the method further includes: in response to receiving a first input, refraining from moving the second object of the second type in the three-dimensional environment relative to the viewpoint of the first electronic device according to the first input. Additionally or alternatively, in some examples, the second type of object includes a virtual object private to a user of the first electronic device within a communication session. Additionally or alternatively, in some examples, the first electronic device and the second electronic device being juxtaposed in a first physical environment is based on a determination that the second electronic device is within a threshold distance of the first electronic device in the first physical environment. Additionally or alternatively, in some examples, the second electronic device and the first electronic device being juxtaposed in a first physical environment is based on a determination that the second electronic device is located within the field of view of the first electronic device. Additionally or alternatively, in some examples, based on the determination that the second electronic device and the first electronic device are juxtaposed in the first physical environment, a visual representation of the user of the second electronic device corresponds to a passthrough representation of the user of the second electronic device.

[0144] Additionally or alternatively, in some examples, based on a determination that the second electronic device is not co-located with the first electronic device in the first physical environment, a visual representation of a user of the second electronic device corresponds to an avatar of the user of the second electronic device. Additionally or alternatively, in some examples, movement of a first object of a first type is associated with one or more patterns in a three-dimensional environment, and the one or more criteria include a second criterion that is satisfied when a first pattern among the one or more patterns is inactive. Additionally or alternatively, in some examples, the method further includes: detecting, via one or more input devices, movement of a viewing point of the first electronic device when presenting the three-dimensional environment including the visual representation of the first object of the first type and the user of the second electronic device; in response to detecting the movement of the viewing point of the first electronic device, updating the presentation of the three-dimensional environment based on an updated viewing point of the first electronic device, wherein from the updated viewing point, the visual representation of the first object of the first type and the user of the second electronic device are no longer visible in a field of view of the first electronic device; receiving, via the one or more input devices, a second input corresponding to a request to update a spatial arrangement of the three-dimensional environment when the visual representation of the first object of the first type and the user of the second electronic device are not visible in the field of view of the first electronic device; and in response to receiving the second input, updating the spatial arrangement of the three-dimensional environment, the updating including: moving the first object of the first type in the three-dimensional environment to be repositioned in the field of view of the first electronic device from the updated viewing point of the first electronic device based on a determination that one or more criteria are satisfied, without updating the presentation of the visual representation of the user of the second electronic device; and moving the first object of the first type and the visual representation of the user of the second electronic device in the three-dimensional environment to be repositioned in the field of view of the first electronic device from the updated viewing point of the first electronic device based on a determination that the one or more criteria are not satisfied.

[0145] Additionally or alternatively, in some examples, the movement of a first object of a first type is associated with one or more patterns in a three-dimensional environment, the one or more patterns including respective patterns that define the movement of the first object of the first type relative to the viewpoint of a first electronic device. Additionally or alternatively, in some examples, the method further includes: when displaying the first object of the first type and when the respective pattern is active, receiving, via one or more input devices, a second input corresponding to a request to move the first object in the three-dimensional environment; and in response to receiving the second input, based on a determination that one or more criteria are met because a second electronic device is co-located with the first electronic device in a first physical environment, moving the first object of the first type in the three-dimensional environment relative to the viewpoint of the first electronic device without updating the rendering of the visual representation of the user of the second electronic device; and based on a determination that one or more criteria are not met because the second electronic device is not co-located with the first electronic device in the first physical environment, moving the first object of the first type and the visual representation of the user of the second electronic device in the three-dimensional environment relative to the viewpoint of the first electronic device according to the first input. Additionally or alternatively, in some examples, the method further includes: when displaying the first object of the first type and when the respective pattern is not active, receiving, via one or more input devices, a second input corresponding to a request to move the first object in the three-dimensional environment; and in response to receiving the second input, moving the first object of the first type in the three-dimensional environment relative to the viewpoint of the first electronic device according to the first input without updating the rendering of the visual representation of the user of the second electronic device.

[0146] Some examples of the present disclosure relate to an electronic device, the electronic device including: one or more processors; a memory; and one or more programs, the one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing any of the methods described above.

[0147] Some examples of the present disclosure relate to a non-transitory computer-readable storage medium, the non-transitory computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by one or more processors of a first electronic device, cause the first electronic device to perform any of the methods described above.

[0148] Some examples of the present disclosure relate to a first electronic device, the first electronic device including one or more processors, a memory, and components for performing any of the methods described above.

[0149] Some examples of the present disclosure relate to an information processing apparatus for use in a first electronic device, the information processing apparatus including components for performing any of the methods described above.

[0150] For purposes of explanation, the foregoing description has been presented by reference to specific examples. However, the above illustrative discussion is not intended to be exhaustive or to limit the disclosure to the precise forms disclosed. Many modifications and variations are possible in light of the above teachings. The examples were chosen and described in order to best illustrate the principles of the disclosure and its practical application, to thereby enable others skilled in the art to best utilize the disclosure in various modifications suited to the particular use contemplated as well as the various examples described.

Claims

1. A method, comprising: At a first electronic device in communication with one or more displays, one or more input devices, and a second electronic device, wherein the first electronic device is in a communication session with the second electronic device: presenting, via the one or more displays, a three-dimensional environment including a first object of a first type and a visual representation of a user of the second electronic device; while presenting the three-dimensional environment including the first object of the first type and the visual representation of the user of the second electronic device, receiving, via the one or more input devices, a first input corresponding to a request to move the first object within the three-dimensional environment; and In response to receiving the first input: based on a determination that one or more criteria are satisfied including criteria satisfied when the second electronic device is juxtaposed with the first electronic device in a first physical environment, moving the first object of the first type in the three-dimensional environment relative to a viewpoint of the first electronic device based on the first input without updating a presentation of the visual representation of the user of the second electronic device; as well as Based on a determination that the one or more criteria are not met because the second electronic device is not co-located with the first electronic device in the first physical environment, the first object of the first type and the visual representation of the user of the second electronic device are moved in the three-dimensional environment relative to the viewpoint of the first electronic device based on the first input. 2 . The method of claim 1 , wherein the first type of object comprises a virtual object shared between the user of the first electronic device and the user of the second electronic device within the communication session.

3. The method of claim 1, wherein the three-dimensional environment further comprises a second object of a second type different from the first type, the method further comprising: In response to receiving the first input, moving the second object of the second type in the three-dimensional environment relative to the viewpoint of the first electronic device in accordance with the first input is abandoned. 4 . The method of claim 3 , wherein the second type of object comprises a virtual object private to the user of the first electronic device within the communication session. 5 . The method of claim 1 , wherein the first electronic device is juxtaposed with the second electronic device in the first physical environment based on a determination that the second electronic device is within a threshold distance of the first electronic device in the first physical environment. 6 . The method of claim 1 , wherein the second electronic device is juxtaposed with the first electronic device in the first physical environment is based on a determination that the second electronic device is within a field of view of the first electronic device.

7. The method of claim 1, wherein based on the determination that the second electronic device is juxtaposed with the first electronic device in the first physical environment, the visual representation of the user of the second electronic device corresponds to a transparent representation of the user of the second electronic device.

8. The method of claim 1, wherein based on the determination that the second electronic device is not co-located with the first electronic device in the first physical environment, the visual representation of the user of the second electronic device corresponds to a virtual avatar of the user of the second electronic device.

9. The method according to claim 1, wherein: The movement of the first object of the first type is associated with one or more patterns in the three-dimensional environment; and The one or more criteria include a second criterion that is satisfied when a first mode of the one or more modes is inactive.

10. The method according to claim 1, further comprising: detecting, via the one or more input devices, movement of the viewpoint of the first electronic device while presenting the three-dimensional environment including the first object of the first type and the visual representation of the user of the second electronic device; in response to detecting the movement of the viewpoint of the first electronic device, updating a presentation of the three-dimensional environment based on an updated viewpoint of the first electronic device, wherein the first object of the first type and the visual representation of the user of the second electronic device are no longer visible in a field of view of the first electronic device from the updated viewpoint; receiving, via the one or more input devices, a second input corresponding to a request to update the spatial arrangement of the three-dimensional environment when the first object of the first type and the visual representation of the user of the second electronic device are not visible in the field of view of the first electronic device; as well as In response to receiving the second input, updating the spatial arrangement of the three-dimensional environment, the updating comprising: based on a determination that the one or more criteria are satisfied, moving the first object of the first type in the three-dimensional environment to be repositioned in the field of view of the first electronic device from the updated viewpoint of the first electronic device without updating a presentation of the visual representation of the user of the second electronic device; as well as Based on a determination that the one or more criteria are not met, the first object of the first type and the visual representation of the user of the second electronic device are moved in the three-dimensional environment to be repositioned in the field of view of the first electronic device from the updated viewpoint of the first electronic device.

11. A method according to claim 1, wherein the movement of the first object of the first type is associated with one or more patterns in the three-dimensional environment, and the one or more patterns include corresponding patterns that limit the movement of the first object of the first type relative to the viewpoint of the first electronic device.

12. The method according to claim 11, further comprising: receiving, via the one or more input devices, a second input corresponding to a request to move the first object in the three-dimensional environment while the first object of the first type is displayed and while the corresponding mode is active; as well as In response to receiving the second input: based on a determination that the one or more criteria are satisfied because the second electronic device is juxtaposed with the first electronic device in the first physical environment, moving the first object of the first type in the three-dimensional environment relative to the viewpoint of the first electronic device based on the first input without updating a presentation of the visual representation of the user of the second electronic device; as well as Based on a determination that the one or more criteria are not met because the second electronic device is not co-located with the first electronic device in the first physical environment, the first object of the first type and the visual representation of the user of the second electronic device are moved in the three-dimensional environment relative to the viewpoint of the first electronic device based on the first input.

13. The method according to claim 11, further comprising: receiving, via the one or more input devices, a second input corresponding to a request to move the first object in the three-dimensional environment while the first object of the first type is displayed and while the corresponding mode is not active; as well as In response to receiving the second input: The first object of the first type is moved in the three-dimensional environment relative to the viewpoint of the first electronic device based on the first input without updating a presentation of the visual representation of the user of the second electronic device.

14. A first electronic device, comprising: one or more processors; Memory; and One or more programs, the one or more programs are stored in the memory and are configured to be executed by the one or more processors, the one or more programs include instructions for executing the method according to any one of claims 1 to 13.

15. A non-transitory computer-readable storage medium storing one or more programs, wherein the one or more programs include instructions that, when executed by one or more processors of a first electronic device, cause the first electronic device to perform a method according to any one of claims 1 to 13.

Images