CREATING SPATIAL TRUTH FOR SPATIAL GROUPS IN MULTI-USER COMMUNICATION SESSIONS

Abstract

Some examples of the disclosure relate to systems and methods for providing spatial truth for co-located participants in a multi-user communication session. In some examples, a first electronic device detects an indication of a request to participate in a collaborative activity with a second, co-located electronic device. In some examples, the first electronic device determines a first origin according to which content is presented in a three-dimensional environment, the first origin corresponding to a first physical location. In some examples, the first electronic device presents an object corresponding to the collaborative activity relative to the first origin. In some examples, the first electronic device generates a spatial map of the three-dimensional environment including a second origin corresponding to a second, different physical location.In some examples, the first electronic device updates the representation of the object corresponding to the shared activity so that it is relative to the second origin.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS

[0001] This application claims priority to U.S. Provisional Patent Application No. 63 / 634,168, filed April 15, 2024, and U.S. Patent Application No. 19 / 079,152, filed March 13, 2025, the entire disclosures of which are incorporated herein by reference for all purposes. AREA OF REVELATION

[0002] This generally refers to systems and methods for creating spatial truth in multi-user communication sessions where participants are located in the same physical environment. BACKGROUND OF REVELATION

[0003] Some computer graphics environments provide two-dimensional and / or three-dimensional environments in which at least some objects displayed for a user's viewing are virtual and generated by a computer. In some examples, the three-dimensional environments are presented by multiple devices communicating in a multi-user communication session. In some examples, an avatar (e.g., a representation) of each dislocated user participating in the multi-user communication session (e.g., via the computing devices) is displayed in the three-dimensional environment of the multi-user communication session. In some examples, the content in the three-dimensional environment can be shared for viewing and interaction by multiple users participating in the multi-user communication session. SUMMARY OF REVELATION

[0004] Some examples of the disclosure relate to systems and methods for providing spatial truth for co-located participants within a spatial group in a multi-user communication session. In some examples, a first electronic device is in communication with one or more displays and one or more input devices, wherein the first electronic device is co-located with a second electronic device in a physical environment. In some examples, the first electronic device detects an indication of a request to participate in a collaborative activity with the second electronic device. In some examples, in response to detecting the indication, the first electronic device determines a first origin according to which content is presented in a three-dimensional environment, the first origin corresponding to a first location in the physical environment.In some examples, the first electronic device joins a communication session with the second electronic device, including presenting, via one or more displays, an object corresponding to the shared activity in the three-dimensional environment relative to the first origin. In some examples, during the communication session with the second electronic device and while presenting the object relative to the first origin, the first electronic device generates, based on the physical environment, a spatial map of the three-dimensional environment that includes a second origin corresponding to a second location in the physical environment, where the second location is different from the first.In some examples, after generating the spatial map of the three-dimensional environment, the first electronic device updates the representation of the object corresponding to the joint activity in the three-dimensional environment to be relative to the second origin.

[0005] The complete descriptions of these examples are contained in the drawings and the detailed description, and it should be understood that this summary in no way limits the scope of the disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0006] For a better understanding of the various examples described herein, reference is made to the detailed description below along with the following drawings. Like reference numerals often refer to corresponding parts throughout the drawings. Fig. 1 illustrates an electronic device representing an augmented reality environment, according to some examples of the disclosure. Fig. 2 illustrates a block diagram of an example architecture for a system according to some examples of the disclosure. Fig. 3 illustrates an example of a spatial group in a multi-user communication session including a first electronic device and a second electronic device according to some examples of the disclosure. Fig. 4A through 4I illustrate example techniques for establishing spatial truth for co-located participants within a spatial group in a multi-user communication session according to some examples of the disclosure. Fig. 5A through 5H illustrate example techniques for restoring spatial truth for co-located participants within a spatial group in a multi-user communication session, according to some examples of the disclosure. Fig. 6 illustrates a flowchart illustrating an example process for establishing spatial truth for co-located participants in a spatial group within a multi-user communication session, according to some examples of the disclosure. DETAILED DESCRIPTION

[0007] Some examples of the disclosure relate to systems and methods for providing spatial truth for co-located participants within a spatial group in a multi-user communication session. In some examples, a first electronic device is in communication with one or more displays and one or more input devices, wherein the first electronic device is co-located with a second electronic device in a physical environment. In some examples, the first electronic device detects an indication of a request to participate in a collaborative activity with the second electronic device. In some examples, in response to detecting the indication, the first electronic device determines a first origin according to which content is presented in a three-dimensional environment, the first origin corresponding to a first location in the physical environment.In some examples, the first electronic device joins a communication session with the second electronic device, including presenting, via one or more displays, an object corresponding to the shared activity in the three-dimensional environment relative to the first origin. In some examples, during the communication session with the second electronic device and while presenting the object relative to the first origin, the first electronic device generates, based on the physical environment, a spatial map of the three-dimensional environment that includes a second origin corresponding to a second location in the physical environment, where the second location is different from the first.In some examples, after generating the spatial map of the three-dimensional environment, the first electronic device updates the representation of the object corresponding to the joint activity in the three-dimensional environment to be relative to the second origin.

[0008] As used herein, a spatial group corresponds to a group or number of participants (e.g., users) in a multi-user communication session. In some examples, a spatial group in the multi-user communication session has a spatial arrangement that dictates locations of users and content located in the spatial group. In some examples, users in the same spatial group within the multi-user communication session experience spatial truth corresponding to the spatial arrangement of the spatial group. In some examples, when the user of the first electronic device is in a first spatial group and the user of the second electronic device is in a second spatial group in the multi-user communication session, the users experience spatial truth localized to their respective spatial groups.In some examples, the user of the first electronic device and the user of the second electronic device are placed into separate spatial groups within the multi-user communication session. When the first electronic device and the second electronic device return to the same operating state, the user of the first electronic device and the user of the second electronic device are placed back into the same spatial group within the multi-user communication session.

[0009] As used herein, a hybrid spatial group corresponds to a group or number of participants (e.g., users) in a multi-user communication session in which at least a subset of the participants are not co-located in a physical environment. For example, as described by one or more examples in this disclosure, a hybrid spatial group includes at least two participants co-located in a first physical environment and at least one participant who is not co-located with the at least two participants in the first physical environment (e.g., the at least one participant is co-located in a second physical environment that is different from the first physical environment).In some examples, a hybrid spatial group in the multi-user communication session has a spatial layout that specifies locations of users and content located in the spatial group. In some examples, users in the same hybrid spatial group within the multi-user communication session experience spatial truth according to the spatial layout of the spatial group, as similarly discussed above.

[0010] In some examples, initiating a multi-user communication session may include interacting with one or more user interface elements. In some examples, a user's gaze may be tracked by an electronic device as input for orienting a selectable option / affordance within a corresponding user interface element displayed in the three-dimensional environment. For example, the gaze may be used to identify one or more options / affordances to be selected using another selection input. In some examples, a corresponding option or affordance may be selected using hand-tracking input captured via an input device connected to the electronic device.In some examples, objects displayed in the three-dimensional environment may be moved and / or reoriented in the three-dimensional environment in accordance with the motion input detected via the device.

[0011] Fig. 1 illustrates an electronic device 101 presenting an augmented reality (XR) environment (e.g., a computer-generated environment optionally including representations of physical and / or virtual objects) according to some examples of the disclosure. In some examples, as in Fig. 1, the electronic device 101 is a head-mounted display or other head-mounted device configured to be worn on the head of a user of the electronic device 101. Examples of the electronic device 101 are described below with reference to the architecture of the block diagram of Fig. 2. As described in Fig. 1, the electronic device 101 and the table 106 are located in a physical environment. The physical environment may include physical features, such as a physical surface (e.g., floor, walls) or a physical object (e.g., table, lamp, etc.). In some embodiments, the electronic device 101 may be configured to detect and / or capture images of the physical environment, including the table 106 (illustrated in the field of view of the electronic device 101).

[0012] In some examples, such as Fig. 1, the electronic device 101 includes one or more internal image sensors 114a oriented toward a user's face (e.g., eye-tracking cameras described below with respect to Fig. 2). In some examples, internal image sensors 114a are used for eye tracking (e.g., to detect the user's gaze). Internal image sensors 114a are optionally arranged in the left and right regions of the display 120 to enable eye tracking of the user's left and right eyes. In some examples, the electronic device 101 also includes external image sensors 114b and 114c directed outward from the user to detect and / or sense the physical environment of the electronic device 101 and / or movements of the user's hands or other body parts.

[0013] In some examples, display 120 has a field of view visible to the user (e.g., which may or may not correspond to a field of view of external image sensors 114b and 114c). Because display 120 is optionally part of a head-mounted device, the field of view of display 120 is optionally the same as or similar to the field of view of the user's eyes. In other examples, the field of view of display 120 may be smaller than the field of view of the user's eyes. In some examples, electronic device 101 may be an optically clear device, where display 120 is a transparent or translucent display through which portions of the physical environment can be directly viewed. In some examples, display 120 may be contained within a transparent lens and may overlap all or only a portion of the transparent lens.In other examples, the electronic device may be a video passthrough device where display 120 is an opaque display configured to display images of the physical environment captured by external image sensors 114b and 114c. Although only a single display 120 is depicted, it should be understood that display 120 may also include a stereo display pair.

[0014] In some examples, in response to a trigger, the electronic device 101 may be configured to display a virtual object 104 in the XR environment that is represented by a Fig. 1, which is not present in the physical environment, but is displayed in the XR environment positioned on the tabletop of the real table 106 (or a representation thereof). Optionally, the virtual object 104 may be displayed on the surface of the table 106 in the XR environment via the display 120 of the electronic device 101 in response to detecting the planar surface of the table 106 in the physical environment 100.

[0015] It is understood that the virtual object 104 is a representative virtual object, and one or more different virtual objects (e.g., of different dimensions such as two-dimensional or other three-dimensional virtual objects) may be enclosed and rendered in a three-dimensional XR environment. For example, the virtual object may represent an application or a user interface displayed in the XR environment. In some examples, the virtual object may represent content corresponding to the application and / or displayed via the user interface in the XR environment. In some examples, the virtual object 104 is optionally configured to be interactive and responsive to user input (e.g., air gestures such as pinch air gestures, tap air gestures, and / or touch air gestures) such that a user can virtually touch, tap, move, rotate, or otherwise interact with the virtual object 104.

[0016] In some examples, displaying an object in a three-dimensional environment may include interacting with one or more user interface objects in the three-dimensional environment. For example, initiating display of the object in the three-dimensional environment may include interacting with one or more virtual options / affordances displayed in the three-dimensional environment. In some examples, when initiating display of an object in the three-dimensional environment, the gaze of a user of the electronic device may be tracked as input to identify one or more virtual options / affordances to be selected. For example, the gaze may be used to identify one or more virtual options / affordances to be selected using further selection input. In some examples, a virtual option orA virtual offering may be selected using hand-tracking input captured via an input device communicating with the electronic device. In some examples, objects displayed in the three-dimensional environment may be moved and / or reoriented in the three-dimensional environment in accordance with the motion input captured via the device.

[0017] The following discussion describes an electronic device in communication with a display generation component and one or more input devices. It is understood that the electronic device optionally communicates with one or more other physical user interface devices, such as a touch-sensitive surface, a physical keyboard, a mouse, a joystick, a hand-tracking device, an eye-tracking device, a stylus, etc. Further, as described above, it is understood that the described electronic device, display, and touch-sensitive surface are optionally shared between two or more devices.Therefore, as used in this disclosure, information displayed on or by the electronic device is optionally used to describe information output from the electronic device for display on a separate display device (touch-sensitive or not). Similarly, as used in this disclosure, input received on the electronic device (e.g., touch input received on a touch-sensitive surface of the electronic device or touch input received on the surface of a stylus) is optionally used to describe input received on a separate input device from which the electronic device receives input information.

[0018] The device typically supports a variety of applications, such as one or more of the following: a drawing application, a presentation application, a word processing application, a website creation application, a disc authoring application, a spreadsheet application, a gaming application, a telephone application, a video conferencing application, an email application, an instant messaging application, an exercise support application, a photo management application, a digital camera application, a digital video camera application, an Internet browsing application, a digital music playback application, a television channel browsing application, and / or a digital video playback application.

[0019] Fig. 2 illustrates a block diagram of an example architecture for a system 201 according to some examples of the disclosure. In some examples, the system 201 includes multiple devices. For example, the system 201 includes a first electronic device 260 and a second electronic device 270, where the first electronic device 260 and the second electronic device 270 are in communication with each other. In some examples, the first electronic device 260 and the second electronic device 270 are a portable device, such as a mobile phone, a smartphone, a tablet computer, a laptop computer, an auxiliary device in communication with another device, a head-mounted display, etc. In some examples, the first electronic device 260 and the second electronic device 270 correspond to the architecture described above with respect to Fig. 1 described electronic device 101.

[0020] As in Fig. 2, the first electronic device 260 optionally includes various sensors (e.g., one or more hand tracking sensors 202A, one or more location sensors 204A, one or more image sensors 206A, one or more touch-sensitive surfaces 209A, one or more motion and / or orientation sensors 210A, one or more eye tracking sensors 212A, one or more microphones 213A or other audio sensors, one or more body tracking sensors (e.g., upper body and / or head tracking sensors), one or more display generation components 214A, one or more speakers 216A, one or more processors 218A, one or more memories 220A, and / or the communication circuitry 222A). In some examples, the second electronic device 270 optionally includes various sensors (e.g.,one or more hand tracking sensors 202B, one or more location sensors 204B, one or more image sensors 206B, one or more touch-sensitive surfaces 209B, one or more motion and / or orientation sensors 210B, one or more eye tracking sensors 212B, one or more microphones 213B or other audio sensors, one or more body tracking sensors (e.g., upper body and / or head tracking sensors), one or more display generation components 214B, one or more speakers 216, one or more processors 218B, one or more memories 220B, and / or the communication circuitry 222B. In some examples, the one or more display generation components 214A, 214B correspond to the display 120 in FIG. Fig. 1. One or more communication buses 208A and 208B are optionally used for communication between the aforementioned components of the electronic devices 260 and 270, respectively. The first electronic device 260 and the second electronic device 270 optionally communicate via a wired or wireless connection (e.g., via the communication circuits 222A, 222B) between the two devices.

[0021] The communication circuitry 222A, 222B optionally includes circuitry for communicating with electronic devices, networks such as the Internet, intranets, a wired network and / or a wireless network, cellular networks, and wireless local area networks (LANs). The communication circuitry 222A, 222B optionally includes circuitry for communicating using near-field communication (NFC) and / or short-range communication such as Bluetooth®.

[0022] The one or more processors 218A, 218B include one or more general purpose processors, one or more graphics processors, and / or one or more digital signal processors. In some examples, the memory 220A, 220B is a non-transitory computer-readable storage medium (e.g., flash memory, random access memory, or other volatile or non-volatile memory or storage) that stores computer-readable instructions configured to be executed by one or more processors 218A, 218B to perform the techniques, processes, and / or methods described below. In some examples, the memory 220A, 220B may include more than one non-transitory computer-readable storage medium. A non-transitory computer-readable storage medium may be any medium (e.g.,other than a signal) that can tangibly contain or store computer-executable instructions for use by, or in connection with, the instruction execution system, the instruction execution device, or the instruction execution apparatus. In some examples, the storage medium is a transitory computer-readable storage medium. In some examples, the storage medium is a non-transitory computer-readable storage medium. The non-transitory computer-readable storage medium may include, but is not limited to, magnetic, optical, and / or semiconductor storage. Examples of such storage include magnetic disks, optical disks based on Compact Disc (CD), Digital Versatile Disc (DVD), or Blu-ray technologies, as well as persistent semiconductor memory such as flash, solid-state drives, and the like.

[0023] In some examples, one or more display generation components 214A, 214B include a single display (e.g., a liquid-crystal display (LCD), organic light-emitting diode (OLED), or other types of displays). In some examples, one or more display generation components 214A, 214B include multiple displays. In some examples, one or more display generation components 214A, 214B may include a display with touch capability (e.g., a touchscreen), a projector, a holographic projector, a retinal projector, a transparent or translucent display, etc. In some examples, the electronic devices 260 and 270 include touch-sensitive surface(s) 209A and 209B for receiving user inputs such as taps and swipes or other gestures.In some examples, the display generation component(s) 214A, 214B and the touch-sensitive surface(s) 209A, 209B form touch-sensitive displays (e.g., a touchscreen integrated into the electronic devices 260 and 270, respectively, or external to the electronic devices 260 and 270, respectively, and in communication with the electronic devices 260 and 270).

[0024] The electronic devices 260 and 270 optionally include image sensor(s) 206A and 206B, respectively. The one or more image sensors 206A / 206B optionally include one or more visible light image sensors, such as charge-coupled device (CCD) sensors and / or complementary metal oxide semiconductor (CMOS) sensors, operable to obtain images of physical objects from the real-world environment. The image sensor(s) 206A / 206B also optionally include one or more infrared (IR) sensors, such as a passive or active IR sensor, for detecting infrared light from the real-world environment. For example, an active IR sensor includes an IR emitter for emitting infrared light into the real-world environment. The image sensor(s) 206A / 206B optionally also include one or more cameras configured to detect movement of physical objects in the real-world environment.The image sensor(s) 206A / 206B optionally also include one or more depth sensors configured to detect the distance of physical objects from the electronic device 260 / 270. In some examples, information from one or more depth sensors may enable the device to identify objects in the real-world environment and distinguish them from other objects in the real-world environment. In some examples, one or more depth sensors may enable the device to determine the texture and / or topography of objects in the real-world environment.

[0025] In some examples, electronic devices 260 and / or 270 use CCD sensors, event cameras, and depth sensors in combination to detect the physical environment around electronic devices 260 and / or 270. In some examples, image sensor(s) 206A / 206B include a first image sensor and a second image sensor. The first image sensor and the second image sensor work together and are optionally configured to capture different information of physical objects in the real-world environment. In some examples, the first image sensor is a visible light image sensor and the second image sensor is a depth sensor. In some examples, electronic device 260 / 270 uses image sensor(s) 206A / 206B to detect the position and orientation of device 260 / 270 and / or display generation component(s) 214A / 214B in the real-world environment.For example, the electronic device 260 / 270 uses image sensor(s) 206A / 206B to track the position and orientation of the display generation component(s) 214A / 214B relative to one or more fixed objects in the real-world environment.

[0026] In some examples, electronic device 260 / 270 includes microphone(s) 213A / 213B or other audio sensors. Device 260 / 270 uses microphone(s) 213A / 213B to capture sound from the user and / or the user's real-world environment. In some examples, microphone(s) 213A / 213B include an array of microphones (a plurality of microphones) that optionally cooperate to identify ambient noise or to locate the sound source within the real-world environment.

[0027] In some examples, device 260 / 270 includes one or more location sensors 204A / 204B to determine the location of device 260 / 270 and / or display generation component(s) 214A / 214B. Location sensor(s) 204A / 204B may include a Global Positioning System (GPS) receiver that receives data from one or more satellites and enables electronic device 260 / 270 to determine the absolute position of the device in the physical world.

[0028] In some examples, the electronic device 260 / 270 includes one or more orientation sensors 210A / 210B to detect the orientation and / or movement of the device 260 / 270 and / or the display generation component(s) 214A / 214B. For example, the electronic device 260 / 270 uses one or more orientation sensors 210A / 210B to track changes in the position and / or orientation of the electronic device 260 / 270 and / or the one or more display generation components 214A / 214B, such as relative to physical objects in the real-world environment. The orientation sensor(s) 210A / 210B optionally include one or more gyroscopes and / or one or more accelerometers.

[0029] The electronic device 260 / 270 includes, in some examples, hand tracking sensor(s) 202A / 202B and / or eye tracking sensor(s) 212A / 212B (and / or other body tracking sensor(s), such as leg, torso, and / or head tracking sensor(s)). The one or more hand tracking sensors 202A / 202B are configured to track the position / location of one or more portions of the user's hands and / or movements of one or more portions of the user's hands with respect to the cross-reality environment relative to the one or more display generation components 214A / 214A and / or relative to another defined coordinate system.The one or more eye tracking sensors 212A / 212B are configured to track the position and movement of a user's gaze (eyes, face, or generally the head) relative to the real-world or cross-reality environment and / or relative to the one or more display generation components 214A / 214A. In some examples, the one or more hand tracking sensors 202A / 202B and / or the one or more eye tracking sensors 212A / 212B are implemented together with the one or more display generation components 214A / 214A. In some examples, the one or more hand tracking sensors 202A / 202B and / or the one or more eye tracking sensors 212A / 212B are implemented separately from the one or more display generation components 214A / 214A.

[0030] In some examples, the one or more hand tracking sensors 202A / 202B (and / or other body tracking sensors such as leg, torso, and / or head tracking sensors) may utilize one or more image sensors 206A / 206B (e.g., one or more IR cameras, 3D cameras, depth cameras, etc.) that detect three-dimensional information from the real world, including one or more body parts (e.g., hands, legs, or torso of a human user). In some examples, the hands may be resolved with sufficient resolution to distinguish fingers and their respective positions.In some examples, one or more image sensors 206A / 206B are positioned relative to the user to define a field of view of the one or more image sensors 206A / 206B and an interaction space in which finger / hand position, orientation, and / or movement captured by the image sensors are used as inputs (e.g., to distinguish between a resting position of the user's hand and other people's hands in the real-world environment). Tracking the fingers / hands for input (e.g., gestures, touch, taps, etc.) may be advantageous in that the user is not required to touch, hold, or wear any type of beacon, sensor, or other device.

[0031] In some examples, the eye tracking sensor(s) 212A / 212B include at least one eye tracking camera (e.g., infrared (IR) cameras) and / or illumination sources (e.g., IR light sources such as LEDs) that emit light toward a user's eyes. The eye tracking cameras may be directed toward a user's eyes to receive reflected IR light from the light sources directly or indirectly from the eyes. In some examples, both eyes are tracked separately by respective eye tracking cameras and illumination sources, and a gaze point / gaze may be determined from tracking both eyes. In some examples, one eye (e.g., a dominant eye) is tracked by one or more respective eye tracking cameras / illumination sources.

[0032] The electronic device 260 / 270 and the system 201 are not limited to the components and configuration of Fig. 2, but may include fewer, different, or additional components in multiple configurations. In some examples, the system 201 may be a single device. A person or persons using the system 201 are optionally referred to herein as users of the device(s). Attention now turns to exemplary simultaneous displays of a three-dimensional environment on a first electronic device (e.g., corresponding to electronic device 260) and a second electronic device (e.g., corresponding to electronic device 270). As discussed below, the first electronic device may be in communication with the second electronic device in a multi-user communication session. In some examples, an avatar (e.g.,A representation of a user of the first electronic device may be displayed in the three-dimensional environment on the second electronic device, and an avatar of a user of the second electronic device may be displayed in the three-dimensional environment on the first electronic device. In some examples, the user of the first electronic device and the user of the second electronic device may be associated with a spatial group in the multi-user communication session.In some examples, interactions with content in the three-dimensional environment while the first electronic device and the second electronic device are in the multi-user communication session may result in the user of the first electronic device and the user of the second electronic device being associated with different spatial groups in the multi-user communication session.

[0033] Fig. 3 illustrates an example of a spatial group 340 in a multi-user communication session including a first electronic device 360 ​​and a second electronic device 370 according to some examples of the disclosure. In some examples, the first electronic device 360 ​​may present a three-dimensional environment 350A, and the second electronic device 370 may present a three-dimensional environment 350B. The first electronic device 360 ​​and the second electronic device 370 may be similar to the electronic device 101 or 260 / 270 and / or may be a head-mounted system / device and / or a projection-based system / device (including a hologram-based system / device) configured to generate and present a three-dimensional environment, such asHeads-up displays (HUDs), head-mounted displays (HMDs), windows with integrated display functionality, displays in the form of lenses designed to be placed over a person's eyes (e.g., similar to contact lenses), etc. In the example of . Fig. 3, a first user optionally wears the first electronic device 360 ​​and a second user optionally wears the second electronic device 370, such that the three-dimensional environment 350A / 350B can be defined by X, Y, and Z axes as viewed from a perspective of the electronic devices (e.g., a viewpoint associated with the electronic device 360 / 370, which may be, for example, a head-mounted display).

[0034] As in Fig. 3, the first electronic device 360 ​​may be located in a first physical environment that includes a table 306 and a window 309. Thus, the three-dimensional environment 350A represented by the first electronic device 360 ​​may optionally include portions of the physical environment around the first electronic device 360, such as a representation of the table 306' and a representation of the window 309'. Similarly, the second electronic device 370 may be located in a second physical environment that is different from the first physical environment (e.g., separate from the first physical environment) and includes a floor lamp 307 and a coffee table 308. Thus, the three-dimensional environment 350B represented by the second electronic device 370 may include portions of the physical environment around the second electronic device 370, such asa representation of the floor lamp 307' and a representation of the coffee table 308'. Additionally, the three-dimensional environments 350A and 350B may include representations of the floor, ceiling, and walls of the room in which the first electronic device 360 ​​and the second electronic device 370 are located, respectively.

[0035] As mentioned above, in some examples, the first electronic device 360 ​​is optionally in a multi-user communication session with the second electronic device 370. For example, the first electronic device 360 ​​and the second electronic device 370 are configured (e.g., via the communication circuits 222A / 222B) to present a common three-dimensional environment 350A / 350B that includes one or more common virtual objects (e.g., content such as images, video, audio, and the like, representations of application user interfaces, etc.).As used herein, the term "shared three-dimensional environment" refers to a three-dimensional environment independently represented, displayed, and / or viewable on two or more electronic devices, and through which content, applications, data, and the like can be shared and / or presented to users of the two or more electronic devices. In some examples, while the first electronic device 360 ​​is in the multi-user communication session with the second electronic device 370, an avatar corresponding to the user of one electronic device is optionally displayed in the three-dimensional environment displayed via the other electronic device. As shown in FIG. Fig. For example, as shown in Figure 3, an avatar 315 corresponding to the user of the second electronic device 370 is displayed on the first electronic device 360 ​​in the three-dimensional environment 350A. Similarly, an avatar 317 corresponding to the user of the first electronic device 360 ​​is displayed on the second electronic device 370 in the three-dimensional environment 350B.

[0036] In some examples, the representation of the avatars 315 / 317 as part of a shared three-dimensional environment is optionally accompanied by an audio effect corresponding to a voice of the users of the electronic devices 370 / 360. For example, the avatar 315 represented in the three-dimensional environment 350A using the first electronic device 360 ​​is optionally accompanied by an audio effect corresponding to the voice of the user of the second electronic device 370. In some such examples, when the user of the second electronic device 370 speaks, the user's voice may be captured by the second electronic device 370 (e.g., via the microphone(s) 213B) and transmitted to the first electronic device 360 ​​(e.g.,via communication circuitry 222B / 222A) so that the captured voice of the user of the second electronic device 370 can be presented to the user of the first electronic device 360 ​​in the three-dimensional environment 350A as audio (e.g., using speaker(s) 216A). In some examples, the audio effect corresponding to the voice of the user of the second electronic device 370 can be spatialized so that it appears to the user of the first electronic device 360 ​​as coming from the location of the avatar 315 in the shared three-dimensional environment 350A (e.g., even though it is output from the speakers of the first electronic device 360).Similarly, the avatar 317 presented in the three-dimensional environment 350B using the second electronic device 370 is optionally accompanied by an audio effect corresponding to the voice of the user of the first electronic device 360. In some such examples, when the user of the first electronic device 360 ​​speaks, the user's voice may be captured by the first electronic device 360 ​​(e.g., via the microphone(s) 213A) and transmitted to the second electronic device 370 (e.g., via the communication circuitry 222A / 222B) so that the captured voice of the user of the first electronic device 360 ​​may be presented as audio (e.g., using the speaker(s) 216B) to the user of the second electronic device 370 in the three-dimensional environment 350B.In some examples, the audio effect corresponding to the voice of the user of the first electronic device 360 ​​may be spatialized so that it appears to the user of the second electronic device 370 as coming from the location of the avatar 317 in the shared three-dimensional environment 350B (e.g., even though it is output from the speakers of the first electronic device 360).

[0037] In some examples, during the multi-user communication session, the avatars 315 / 317 are displayed in the three-dimensional environments 350A / 350B with corresponding orientations that correspond to and / or are based on the orientations of the electronic devices 360 / 370 (and / or the users of the electronic devices 360 / 370) in the physical environments surrounding the electronic devices 360 / 370. As in Fig. 3, the avatar 315 in the three-dimensional environment 350A is optionally facing the viewpoint of the user of the first electronic device 360, and in the three-dimensional environment 350B, the avatar 317 is optionally facing the viewpoint of the user of the second electronic device 370. When a particular user moves the electronic device (and / or themselves) in the physical environment, the user's viewpoint changes according to the movement, which may also change the orientation of the user's avatar in the three-dimensional environment. For example, if, with reference to Fig. 3, if the user of the first electronic device 360 ​​were to look to the left in the three-dimensional environment 350A, such that the first electronic device 360 ​​is rotated (e.g., by a corresponding amount) to the left (e.g., counterclockwise), the user of the second electronic device 370 would see the avatar 317 corresponding to the user of the first electronic device 360 ​​rotate to the right (e.g., clockwise) with respect to the viewpoint of the user of the second electronic device 370, corresponding to the movement of the first electronic device 360.

[0038] Additionally, in some examples, during the multi-user communication session, a viewpoint of the three-dimensional environments 350A / 350B and / or a location of the viewpoint of the three-dimensional environments 350A / 350B optionally changes in accordance with the movement of the electronic devices 360 / 370 (e.g., by the users of the electronic devices 360 / 370). For example, if during the communication session the first electronic device 360 ​​is moved closer to the representation of the table 306' and / or the avatar 315 (e.g., because the user of the first electronic device 360 ​​moves forward in the physical environment surrounding the first electronic device 360), the viewpoint of the three-dimensional environment 350A would change accordingly, such that the representation of the table 306', the representation of the window 309', and the avatar 315 appear larger in the field of view.In some examples, each user may interact independently with the three-dimensional environment 350A / 350B, such that changes to the viewpoints of the three-dimensional environment 350A and / or interactions with virtual objects in the three-dimensional environment 350A by the first electronic device 360 ​​optionally do not affect what is displayed in the three-dimensional environment 350B on the second electronic device 370, and vice versa.

[0039] In some examples, the avatars 315 / 317 are representations (e.g., a full-body rendering) of the users of the electronic devices 370 / 360. In some examples, the avatar 315 / 317 is a representation of a portion (e.g., a representation of a head, face, head and torso, etc.) of the users of the electronic devices 370 / 360. In some examples, the avatars 315 / 317 are user-personalized, user-selected, and / or user-created representations displayed in the three-dimensional environments 350A / 350B and are representative of the users of the electronic devices 370 / 360. It is understood that the Fig. 3 correspond to full-body representations of the users of the electronic devices 370 / 360, but other avatars, such as those described above, can also be made available.

[0040] As mentioned above, the three-dimensional environments 350A / 350B may be a shared three-dimensional environment presented with the electronic devices 360 / 370 while the first electronic device 360 ​​and the second electronic device 370 are in the multi-user communication session. In some examples, content viewed by a user on one electronic device may be shared with another user on a different electronic device in the multi-user communication session. In some of these examples, the content may be experienced (e.g., viewed and / or interacted with) by both users (e.g., via their respective electronic devices) in the shared three-dimensional environment. As in Fig. 3, the three-dimensional environments 350A / 350B include, for example, a common virtual object 310 (e.g., optionally a three-dimensional virtual sculpture) that can be viewed by and interacted with by both users. As shown in Fig. 3, the shared virtual object 310 may be displayed with a gripper capability (e.g., a handlebar) 335 that may be selected to initiate movement of the shared virtual object 310 within the three-dimensional environments 350A / 350B.

[0041] In some examples, the three-dimensional environments 350A / 350B include non-shared content intended for only one user in the multi-user communication session. In Fig. 3, for example, the first electronic device 360 ​​displays a private application window 330 in the three-dimensional environment 350A, which is optionally an object that is not shared between the first electronic device 360 ​​and the second electronic device 370 in the multi-user communication session. In some examples, the private application window 330 may be associated with a corresponding application running on the first electronic device 360 ​​(e.g., a media player application, a web browsing application, a messaging application, etc.). Because the private application window 330 is not shared with the second electronic device 370, the second electronic device 370 optionally displays a representation of the private application window 330 in the three-dimensional environment 350B. As shown in Fig. 3, in some examples, the representation of the private application window 330" may be a faded, obscured, discolored, and / or translucent representation of the private application window 330, preventing the user of the second electronic device 370 from viewing the contents of the private application window 330.

[0042] As mentioned above, in some examples, the user of the first electronic device 360 ​​and the user of the second electronic device 370 are located in a spatial group 340 within the multi-user communication session. In some examples, the spatial group 340 may be a basic group (e.g., a first or default group) within the multi-user communication session. For example, when the user of the first electronic device 360 ​​and the user of the second electronic device 370 initially join the multi-user communication session, the user of the first electronic device 360 ​​and the user of the second electronic device 370 are automatically (and initially, as discussed in more detail below) assigned (e.g., placed into a group) to the spatial group 340 within the multi-user communication session.In some examples, the user of the first electronic device 360 ​​and the user of the second electronic device 370 have a first spatial arrangement (e.g., a first spatial template) within the shared three-dimensional environment while the users are in the spatial group 340, as shown in FIG. Fig. 3. For example, the user of the first electronic device 360 ​​and the user of the second electronic device 370, including the objects displayed in the shared three-dimensional environment, have spatial truth within the spatial group 340. In some examples, spatial truth requires a consistent spatial arrangement between users (or their representations) and virtual objects. For example, the distance between the viewpoint of the user of the first electronic device 360 ​​and the avatar 315 corresponding to the user of the second electronic device 370 may be the same as the distance between the viewpoint of the user of the second electronic device 370 and the avatar 317 corresponding to the user of the first electronic device 360.As described herein, the avatar 317 corresponding to the user of the first electronic device 360 ​​moves in the three-dimensional environment 350B according to the movement of the user's viewpoint location relative to the user's viewpoint of the second electronic device 370 as the user's viewpoint location of the first electronic device 360 ​​moves. When the user of the first electronic device 360 ​​interacts with the shared virtual object 310 (e.g., moves the virtual object 310 in the three-dimensional environment 350A), the second electronic device 370 changes the display of the shared virtual object 310 in the three-dimensional environment 350B in accordance with the interaction (e.g., moves the virtual object 310 in the three-dimensional environment 350B).

[0043] It should be understood that in some examples, more than two electronic devices may be communicatively connected in a multi-user communication session. For example, in a situation where three electronic devices are communicatively connected in a multi-user communication session, a first electronic device would display two avatars, rather than just one, corresponding to users of the other two electronic devices. It should therefore be understood that the various processes and example interactions described herein with respect to the first electronic device 360 ​​and the second electronic device 370 in the multi-user communication session optionally apply to situations where more than two electronic devices are communicatively connected in a multi-user communication session.

[0044] In some examples, it may be advantageous to provide mechanisms for enabling a multi-user communication session that includes co-located users (e.g., co-located electronic devices associated with the users). For example, it may be desirable to enable users co-located in a first physical environment to establish a multi-user communication session such that virtual content can be shared and presented in a three-dimensional environment that is optionally visible and / or interactive to the co-located users in the multi-user communication session. As used herein, a co-located user corresponds to a local user with respect to a first electronic device. In some examples, as discussed below, the presentation of virtual objects (e.g.,Avatars and shared virtual content) in the three-dimensional environment within a multi-user communication session that includes co-located users (e.g., relative to a first electronic device) is based on creating a common coordinate space / system based on at least positions and / or orientations of the co-located users in a physical environment of the first electronic device. In particular, unlike a multi-user communication session that includes only remote users (i.e., non-co-located users), where the origin of the three-dimensional environment (e.g.,according to which content is presented) can be determined / placed at any location relative to the physical environment of a first user, a multi-user communication session involving co-located users requires agreement and / or cooperation among the electronic devices in placing the origin of the three-dimensional environment. For example, as discussed herein, since co-located users in the multi-user communication session are represented by their physical bodies, which cannot be freely moved by the first electronic device (e.g., unlike avatars, which are freely movable), the origin of the three-dimensional environment must be agreed upon by the electronic devices in the multi-user communication session.

[0045] Fig. 4A through 4I illustrate exemplary techniques for establishing spatial truth for co-located participants within a spatial group in a multi-user communication session, according to some examples of the disclosure. In some examples, as in Fig. 4A, the three-dimensional environment 450A is displayed using a first electronic device 101a (e.g., via display 120a), and the three-dimensional environment 450B is displayed using a second electronic device 101b (e.g., via display 120b). In some examples, the electronic devices 101a / 101b optionally correspond to the electronic devices 360 / 370 discussed above and / or the electronic devices 260 / 270 in Fig. 2, or are similar to them. In some examples, such as in Fig. 4A, the first electronic device 101a is used by a first user 402 (e.g., worn on the head) and the second electronic device 101b is used by a second user 404 (e.g., worn on the head).

[0046] In Fig. 4A, as indicated in plan view 410, the first electronic device 101a and the second electronic device 101b are located at the same location in the physical environment 400. For example, both the first electronic device 101a and the second electronic device 101b are located in the same room, which includes the physical window 408 and the houseplant 409. In some examples, the determination that the first electronic device 101a and the second electronic device 101b are located at the same location in the physical environment 400 is based on a distance between the first electronic device 101a and the second electronic device 101b. For example, in Fig. 4A, the first electronic device 101a and the second electronic device 101b are at the same location in the physical environment 400 because the first electronic device 101a is within a threshold distance (e.g., 0.1, 0.5, 1, 2, 3, 5, 10, 15, 20, etc. meters) from the second electronic device 101b. In some examples, the determination that the first electronic device 101a and the second electronic device 101b are at the same location in the physical environment 400 is based on communication between the first electronic device 101a and the second electronic device 101b. For example, in Fig. 4A, the first electronic device 101a and the second electronic device 101b are configured to communicate (e.g., wirelessly, such as via Bluetooth, Wi-Fi, or a server (e.g., a wireless communication terminal)). In some examples, the first electronic device 101a and the second electronic device 101b are connected to the same wireless network in the physical environment 400. In some examples, the determination that the first electronic device 101a and the second electronic device 101b are located at the same location in the physical environment 400 is based on the strength of a wireless signal transmitted between the electronic devices 101a and 101b. For example, in Fig. 4A, the first electronic device 101a and the second electronic device 101b are in the same location in the physical environment 400 because the strength of a Bluetooth signal (or other wireless signal) transmitted between the electronic devices 101a and 101b is greater than a threshold strength. In some examples, the determination that the first electronic device 101a and the second electronic device 101b are in the same location in the physical environment 400 is based on the visual detection of the electronic devices 101a and 101b in the physical environment 400. For example, as in Fig. 4A, the second electronic device 101b is positioned in a field of view of the first electronic device 101a (e.g., because the second user 404 is standing in the field of view of the first electronic device 101a), which enables the first electronic device 101a to visually detect / detect (e.g., identify or scan, such as via object recognition or other image processing techniques) the second electronic device 101b (e.g., in one or more images captured by the first electronic device 101a, such as via external image sensors 114b-i and 114c-i). Also, as in Fig. 4A, the first electronic device 101a is optionally positioned within a field of view of the second electronic device 101b (e.g., because the first user 402 is standing within the field of view of the second electronic device 101b), allowing the second electronic device 101b to visually detect the first electronic device 101a (e.g., in one or more images captured by the second electronic device 101b, such as via external image sensors 114b-ii and 114c-ii).

[0047] In some examples, the three-dimensional environments 450A / 450B include captured portions of the physical environment 400 in which the electronic devices 101a / 101b are located. For example, because the first electronic device 101a and the second electronic device 101b are located at the same location in the physical environment 400, the three-dimensional environments 450A and 450B include the physical window 408 (e.g., a representation of the physical window) and the houseplant 409 (e.g., a representation of the houseplant), but from the unique viewpoints of the first electronic device 101a and the second electronic device 101b, as shown in Fig. 4A. In some examples, the representations may include portions of the physical environment 400 viewed through a transparent or translucent display of the electronic devices 101a and 101b. In some examples, the three-dimensional environments 450A / 450B have one or more of the properties described above with reference to Fig. 3 described three-dimensional environments 350A / 350B.

[0048] In some examples, such as Fig. 4B, in accordance with determining that the first electronic device 101a and the second electronic device 101b are located in the same physical environment 400 (e.g., according to one or a combination of the factors discussed above), the first electronic device 101a displays (e.g., via the display 120a) a visual affordance 428 in the three-dimensional environment 450A that can be selected to initiate a process for joining a multi-user communication session with the second electronic device 101b. In some examples, the first electronic device 101a displays the visual affordance 428 in the three-dimensional environment 450A in response to detecting attention (e.g., including gaze 425) of the first user 402 directed toward the second user 404 (e.g., and / or the second electronic device 101b) in the three-dimensional environment 450A. In some examples, such as Fig. 4B, the first electronic device 101a displays the visual affordance 428 at a position in the three-dimensional environment 450A that, from the perspective of the first electronic device 101a, corresponds to a position of the second user 404. For example, as shown in Fig. 4B, the first electronic device 101a displays the visual affordance 428 over the second electronic device 101b and / or overlaid on the head of the second user 404 from the perspective of the first electronic device 101a. It is understood that the first electronic device 101a may alternatively display the visual affordance 428 at alternative locations in the three-dimensional environment 450A, for example, overlaid on a different part of the second user 404 (e.g., the torso of the second user 404, an arm of the second user 404, a hand of the second user 404, etc.). Furthermore, in some examples, as shown in Fig. 4B, the second electronic device 101b inputs and / or is displayed with the text "Tap to connect," thereby indicating to the first user 402 that the visual affordance 428 may be selected to begin the process of joining a multi-user communication session with the second user 404. It should also be understood that in some examples, the second electronic device 101b displays a visual affordance similar to the visual affordance 428 in the three-dimensional environment 450B in the manner discussed above, in accordance with a determination that the first electronic device 101a and the second electronic device 101b are co-located in the physical environment 400 (e.g., and / or that the attention of the second user 404 is directed to the first user 402 and / or the first electronic device 101a in the three-dimensional environment 450B), as also discussed above.

[0049] In Fig. 4B, while the first electronic device 101a is located in the same physical environment 400 with the second electronic device 101b, the first electronic device 101a detects an indication of a request to participate in a multi-user communication with the second electronic device 101b. For example, as in Fig. 4B, the electronic device 101a detects a selection input directed to the visual affordance 428 in the three-dimensional environment 450A. In some examples, as in Fig. 4B, the selection input corresponds to an air gesture performed by a hand 403 of the first user 402 and directed to the visual affordance 428. For example, as shown in Fig. 4B, the first electronic device 101a detects that the hand 403 is performing an air pinch gesture (e.g., where the index finger and thumb of the hand 403 come together to form a pinch handshape), optionally while the gaze 425 of the first user 402 is directed toward the visual affordance 428 in the three-dimensional environment 450A. In some examples, the first electronic device 101a alternatively detects a mid-air tap or touch gesture, a gaze dwell, a verbal command, or other input indicating the selection of the visual affordance 428 in the three-dimensional environment 450A.

[0050] In some examples, in response to detecting the selection of the visual indication 438, the first electronic device 101a transmits a request (e.g., directly or indirectly, such as wirelessly via a server) to the second electronic device 101b to join a multi-user communication session. In some examples, as in Fig. 4C, when the second electronic device 101b receives the request to join the multi-user communication session with the first electronic device 101a, it displays the message element 420 (e.g., a notification) corresponding to the request to join the multi-user communication session with the first electronic device 101a in the three-dimensional environment 450B. In some examples, as in Fig. 4C, the message element 420 includes a first option 421 that can be selected to accept the request (and, for example, join the multi-user communication session with the first electronic device 101a) and a second option 422 that can be selected to decline the request (and, for example, not join the multi-user communication session with the first electronic device 101a).

[0051] In Fig. 4C, the second electronic device 101b detects one or more inputs that agree to the request to participate in the multi-user communication session with the first electronic device 101a. For example, in Fig. 4C, the second electronic device 101b detects a selection of the first option 421 in the message element 420. For example, the second electronic device 101b detects an air pinch gesture directed to the first option 421. For example, as in Fig. 4C, the second electronic device, for example, 101b detects an air pinch gesture performed by the hand 405 of the second user 404, while optionally the gaze 425 of the second user 404 is directed to the first option 421 in the three-dimensional environment 450B. It should be understood that, as also discussed above, additional or alternative inputs are possible, such as air tap gestures, gaze and dwell inputs, voice commands, etc.

[0052] In some examples, in response to detecting the input to accept the request to join the multi-user communication session with the first electronic device 101a, the second electronic device 101b enters the multi-user communication session with the first electronic device 101a. In some examples, as discussed below, joining the multi-user communication session including the first electronic device 101a and the second electronic device 101b includes identifying / determining an origin (e.g., a first origin) in the physical environment 400 according to which virtual content (e.g., avatars, virtual application windows, three-dimensional models, etc.) is displayed in the shared three-dimensional environment of the multi-user communication session.

[0053] As above also with regard to Fig. 3, the first user 402 of the first electronic device 101a and the second user 404 of the second electronic device 101b may be located at the same location in the physical environment 400, and while the first electronic device 101a is in the multi-user communication session with the second electronic device 101b, the first user 402 and the second user 404 may be located in a first spatial group (e.g., a same spatial group) within the multi-user communication session. In some examples, the first spatial group includes one or more characteristics of the spatial group 340 described above with reference to Fig. 3. As also described above, the first user 402 and the second user 404, while in the first spatial group within the multi-user communication session, have a first spatial arrangement in the shared three-dimensional environment (e.g., represented by the positions and / or distance between the users 402 and 404 in the top view 410 in Fig. 4A), which is determined by the physical locations of the electronic devices 101a and 101b in the physical environment 400. In particular, the first electronic device 101a and the second electronic device 101b experience spatial truth relative to each other as dictated by the physical locations and / or orientations of the first user 402 and the second user 404, respectively.

[0054] In some examples, such as Fig. 4D, when the first electronic device 101a and the second electronic device 101b join the multi-user communication session, the first electronic device 101a and the second electronic device 101b determine a first origin 430 in the physical environment 400, as shown in the top view 410. In some examples, the first origin 430 corresponds to an intermediate / preliminary origin in the physical environment 400 (e.g., an estimate of a geometric center of the first spatial group including the first electronic device 101a and the second electronic device 101b).In some examples, creating an intermediate origin in the physical environment 400 provides an energy-efficient approach that enables participants in a multi-user communication session to begin sharing and / or interacting with the virtual content in the shared three-dimensional environment without, for example, first requiring the first electronic device 101a and the second electronic device 101b to first perform a more comprehensive (e.g., in-depth) analysis of the physical space surrounding the first electronic device 101a and the second electronic device 101b. For example, as explained below, the first origin 430 is created in . Fig. 4D by the first electronic device 101a and the second electronic device 101b using coarse (e.g., estimate-based) localization techniques that enable the first user 402 and the second user 404, after participating in the multi-user communication session, to immediately begin sharing and interacting with virtual content visible to the first user 402 and the second user 404. In some examples, as explained in more detail later, after determining the first origin 430 (e.g., the intermediate / preliminary origin), the first electronic device 101a and the second electronic device 101b jointly generate a spatial map corresponding to the physical environment 400 and including an updated (e.g., final) origin according to which virtual content is displayed and / or updated.In some examples, generating the spatial map corresponding to the physical environment 400 requires and / or involves more energy-intensive and / or time-consuming localization techniques, as explained in more detail below.

[0055] In some examples, determining the first origin 430 is based on the physical environment 400 shown in the top view 410 in Fig. 4D, on the visual recognition of the first electronic device 101a and the second electronic device 101b. For example, the first electronic device 101a performs object recognition (e.g., or a similar image processing technique) of the second electronic device 101b using the external image sensors 114b-i and 114c-i in Fig. 4D. Likewise, in some examples, the second electronic device 101b performs object detection of the first electronic device 101a using the external image sensors 114b-ii and 114c-ii. In some examples, performing object detection allows the first electronic device 101a and the second electronic device 101b to determine an approximate (e.g., estimated) position and / or orientation of the other electronic device in the physical environment 400. For example, in Fig. 4D, the first electronic device 101a determines an approximate position and / or orientation of the second electronic device 101b (e.g., and thus of the second user 404) in the physical environment 400 based on the object detection of the second electronic device 101b in the three-dimensional environment 450A. Accordingly, using the approximate locations of the first electronic device 101a and the second electronic device 101b in the physical environment 400 (e.g., and thus the approximate distance between the two locations), the first electronic device 101a and the second electronic device 101b determine an estimated geometric center of the first spatial group corresponding to the first origin 430 shown in the plan view 410 in Fig. 4D is shown.

[0056] In some examples, the visual recognition discussed above additionally or alternatively includes scanning / identifying an image visible in the shared three-dimensional environment associated with the first electronic device 101a or the second electronic device 101b. For example, as in Fig. 4D, the multi-user communication session is initiated between the first electronic device 101a and the second electronic device 101b, the second electronic device 101b displays on the display 120b of the second electronic device 101b (e.g., on an outward-facing surface of the display 120b) the image 435 that is visually recognizable to the first electronic device 101a (e.g., via the external image sensors 114b-i and 114c-i), but not necessarily visible to the first user 402. In some examples, as in Fig. 4D, the image 435 includes or corresponds to a scannable code, such as a barcode or a Quick Response (QR) code. However, it should be understood that the image 435 corresponds to any reference image that can be recognized (e.g., scanned / read) by the first electronic device 101a. In some examples, the image 435 corresponds to a visual encoding of a pose / transformation (e.g., position and / or orientation) of the second electronic device 101b in the physical environment 400 as perceived by the second electronic device 101b (e.g., based on sensor data, such as the image sensors 114aii-114cii). Accordingly, in some examples, when the first electronic device 101a visually recognizes the image 435 in the three-dimensional environment 450A (e.g.,identified), access information via image 435 that identifies, for example, the position and / or orientation of second electronic device 101b relative to first electronic device 101a (e.g., and / or as opposed to first electronic device 101a determining / calculating the position and / or orientation of second electronic device 101b itself). It should also be understood that in some examples, first electronic device 101a may also display a reference image similar to image 435 (e.g., unique to first electronic device 101a) on the outward-facing / outer surface of display 120a that is visible and recognizable to second electronic device 101b (e.g., via external image sensors 114b-ii and 114c-ii).

[0057] In some examples, determining the first origin 430 is based on the physical environment 400 shown in the top view 410 in Fig. 4D, is based on the analysis of one or more physical attributes of the physical environment 400. For example, when the first electronic device 101a and the second electronic device 101b participate in the multi-user communication session, the first electronic device 101a and the second electronic device 101b analyze and / or identify the dimensions of the physical environment, physical objects in the physical environment, a visual appearance (e.g., color and lighting characteristics) of the physical environment, etc., according to which the first origin 430 in the physical environment 400 can be defined. In some examples, as also discussed above, the one or more physical attributes of the physical environment are analyzed using images acquired by the first electronic device 101a (e.g.,using the external image sensors 114b-i and 114c-i) and by the second electronic device 101b (e.g., using the external image sensors 114b-ii and 114c-ii). In some examples, as discussed in more detail later, the one or more physical attributes of the physical environment 400 are based on simultaneous localization and mapping (SLAM) data exchanged between the first electronic device 101a and the second electronic device 101b (e.g., SLAM data stored individually in the electronic devices 101a and 101b, or SLAM data stored on one of the electronic devices 101a and 101b).

[0058] In some examples, determining the first origin 430 is based on the physical environment 400 shown in the top view 410 in Fig. 4D, on identifying one or more common (e.g., shared) surfaces and / or objects of the physical environment 400. For example, when the first electronic device 101a and the second electronic device 101b join the multi-user communication session, the first electronic device 101a and the second electronic device 101b analyze the physical environment 400 to identify an object or surface that is visible (e.g., passthrough) to both electronic devices 101a and 101b (e.g., detectable by the external image sensors 114a-i and 114b-i of the first electronic device 101a and the external image sensors 114a-ii and 114b-ii of the second electronic device 101b).In some examples, the one or more common surfaces of the physical environment 400 correspond to the walls of the physical space in which the first electronic device 101a and the second electronic device 101b are located.

[0059] In particular, in the example of Fig. 4D illustrates the one or more common surfaces of one or more walls that are visible and within the field of view of both electronic devices 101a and 101b, such as the left and / or right sidewall of the physical space (e.g., relative to the viewing angles of the first electronic device 101a and the second electronic device 101b). In some examples, the one or more common surfaces correspond to and / or include one or more physical objects in the physical environment 400. For example, the one or more common surfaces correspond to and / or include a surface of the physical window 408 and / or a surface of the houseplant 409 in the physical environment 400.In some examples, the first origin 431 is determined to be approximately equidistant from the side walls of the physical room and / or at a predefined distance from the physical window 408 or the houseplant 409. In some examples, the above approach for identifying one or more common surfaces and / or objects in the physical environment 400 optionally does not require communication between the first electronic device 101a and the second electronic device 101b, thereby providing, among other benefits, a saving of computing resources and power. For example, the first electronic device 101a and the second electronic device 101b independently analyze the physical environment 400 to determine that the surfaces are common to the electronic devices 101a and 101b (e.g.,The first electronic device 101a identifies the sidewalls of the physical space as being within its field of view, and its view approximates that those same sidewalls are also within the field of view of the second electronic device 101b (and vice versa) without the first electronic device 101a and the second electronic device 101b exchanging data corresponding to such analysis. In some of these examples, the common object must be visible and within the field of view of both electronic devices 101a and 101b. For example, in . Fig. 4D, the physical window 408 is in the field of view of the first electronic device 101a in the three-dimensional environment 450A, but not in the field of view of the second electronic device 101b in the three-dimensional environment 450B. In such a case, the first electronic device 101a and / or the second electronic device 101b may display a visual indication (e.g., a notification or other alert) prompting the first user 402 and / or the second user 404 to move their head (e.g., translate and / or rotate) to locate the indicated shared surface, thereby making the shared surface visible in the field of view of both the first electronic device 101a and the second electronic device 101b.For example, the first electronic device 101a displays a notification with the message "Locate the houseplant" in the three-dimensional environment 450A and / or the second electronic device 101b displays a notification with the message "Locate the window" in the three-dimensional environment 450B, but this may require communication between the first electronic device 101a and the second electronic device 101b (e.g., the second electronic device 101b transmits data indicating to the first electronic device 101a that the houseplant 409 is within the field of view of the second electronic device 101b and / or the first electronic device 101a transmits data indicating to the second electronic device 101b that the physical window 408 is within the field of view of the first electronic device 101a).

[0060] It is understood that in some examples the first origin 430 in Fig. 4D using one or a combination of the approaches discussed above.

[0061] In some examples, after the first electronic device 101a and the second electronic device 101b have determined the first origin 430 in the physical environment 400, a first (e.g., average / approximate) common coordinate space / system is defined for the first spatial group (e.g., a synchronized coordinate space with a first accuracy and / or confidence level). For example, as shown in the top view 410 in Fig. 4D, the first electronic device 101a is located at a first location relative to the first origin 430 of the first spatial group, and the second electronic device 101b is located at a second location, different from the first location, relative to the first origin 430. Furthermore, the first electronic device 101a is located at a first distance from the first origin 430, and the second electronic device 101b is located at a second distance (e.g., different from or equal to the first distance) from the first origin 430. Additionally, as discussed below, in some examples, the first origin 430 enables virtual content (e.g., shared applications, user interfaces, three-dimensional objects / models, etc.) presented in the shared three-dimensional environment to be positioned in the same location within the first spatial group for all participants (e.g.,by positioning the virtual content relative to the first origin 430).

[0062] In Fig. 4E, the first electronic device 101a detects an input corresponding to a request to share content with the second user 404 in the multi-user communication session. As shown in Fig. 4E, the first electronic device 101a optionally displays a user interface element 424 associated with a media player application (e.g., a movie player application). In some examples, the user interface element 424 includes one or more selectable options for sharing content (e.g., Movie A) in the multi-user communication session. For example, as shown in Fig. 4E, the user interface element 424 includes a selectable option 426 that can be selected to share Movie A with the second user 404 in the multi-user communication session (e.g., “User 2”).

[0063] In Fig. 4E, the first electronic device 101a, upon displaying the user interface element 424, detects an input corresponding to a selection of the selectable option 426. For example, as in Fig. 4E, the first electronic device 101a performs an air pinch gesture performed by the hand 403 of the first user 402, while optionally the gaze 425 of the first user 402 is directed to the selectable option 426.

[0064] In some examples, in response to detecting the selection of the selectable option 426, the first electronic device 101a initiates a process for displaying a shared virtual object in the shared three-dimensional environment. For example, in Fig. 4F, the first electronic device 101a and the second electronic device 101b determine a placement location for the virtual object 432 corresponding to the shared content. In some examples, the virtual object 432 is displayed as shown in the top view 410 in Fig. 4F, displayed at a first position within the first spatial group relative to the first origin 430. As shown in Fig. 4F, the first electronic device 101a and the second electronic device 101b represent the virtual object 432 in the three-dimensional environments 450A and 450B, respectively, according to the placement of the virtual object 432 indicated in the top view 410. For example, as shown in Fig. 4F, the first electronic device 101a displays, via the display 120a, the virtual object 432 in front of the second user 404 and to the right of the viewpoint of the first electronic device 101a in the three-dimensional environment 450A, and the second electronic device 101b displays, via the display 120b, the virtual object 432 in front of the first user 402 and to the left of the viewpoint of the second electronic device 101b in the three-dimensional environment 450B. In some examples, as in Fig. 4F, the virtual object 432 corresponds to and / or includes a virtual playback surface that displays Movie A. In some examples, the virtual object 432 includes one or more properties of the shared virtual object 310 described above with respect to Fig. 3 was discussed.

[0065] In some examples, as mentioned above, after determining the first origin 430 in the physical environment 400 (e.g., an approximate center of the first spatial cluster or another location corresponding to a location in the physical environment 400), the first electronic device 101a and the second electronic device 101b communicate with each other to jointly create a common spatial map corresponding to the physical environment 400. For example, the first electronic device 101a and the second electronic device 101b use more powerful and / or time-consuming localization approaches to determine a second (e.g., updated / final) origin in the physical environment 400, optionally corresponding to a more accurate and / or true convergence point in the physical environment 400.Furthermore, in some examples, due to the coarse estimation techniques discussed above, the first origin 430 in the physical environment may correspond to slightly different physical locations (e.g., and / or surfaces) in the physical environment 400, resulting in a less precise spatial correspondence between the first electronic device 101a and the second electronic device 101b. For example, the first origin 430 may correspond to a first location in the physical environment 400 for the first electronic device 101a, but may correspond to a second location in the physical environment 400 for the second electronic device 101b that is different from the first location, optionally resulting in the virtual object 432 (and / or other shared content) being displayed and / or visible at slightly different locations within the shared three-dimensional environment.As discussed below, determining the second origin in the physical environment 400 enables the slightly offset first origins 430 of the first electronic device 101a and the second electronic device 101b to converge at the same physical location.

[0066] In some examples, as in plan view 410 in Fig. 4G, the first electronic device 101a and the second electronic device 101b generate a spatial map 475A corresponding to the physical environment 400. In some examples, as shown in Fig. 4G, the spatial map 475A includes a second origin 430B (e.g., updated origin) that is different from the first origin 430A (e.g., corresponding to the first origin 430 discussed above). In some examples, as illustrated by the grid pattern of the spatial map 475A, the spatial map 475A includes information corresponding to positions and / or orientations of physical objects in the physical environment 400, such as the houseplant 409, a size (e.g., dimensions) of the physical space of the physical environment 400, positions and / or orientations of the participants of the multi-user communication session in the physical environment (e.g., the first user 402 and the second user 404), and / or positions and / or orientations of virtual content shared in the multi-user communication session (e.g., virtual object 432) relative to the second origin 430B.It is understood that the spatial map 475A is optionally not displayed and / or visible in the shared three-dimensional environment.

[0067] In some examples, the first electronic device 101a and the second electronic device 101b generate the spatial map 475A by synchronizing with a respective spatial map from a plurality of spatial maps corresponding to a plurality of physical environments, including the physical environment 400, which can be accessed from a spatial map repository. For example, the spatial map 475A is previously generated (e.g., by the first electronic device 101a, the second electronic device 101b, or another electronic device) and is specifically associated with the physical environment 400. In some examples, the spatial map repository includes spatial maps made accessible to the first electronic device 101a and / or the second electronic device 101b by one or more entities.For example, the spatial map 475A is owned, operated, and / or created by an owner or lessee of the physical space in which the first electronic device 101a and the second electronic device 101b are located, such as an organization, company, school, government agency, etc. In some examples, the spatial map repository is stored in the memory of the first electronic device 101a and / or the second electronic device 101b. In some examples, the spatial map repository is stored in cloud storage or on a server that is accessible by the first electronic device 101a and / or the second electronic device 101b (e.g., while the first electronic device 101a and / or the second electronic device 101b are located in the physical environment 400). In the example of FIG. Fig. 4G, the first electronic device 101a and the second electronic device 101b access the spatial map 475A from memory and / or download the spatial map 475A from cloud storage or another server during and / or after the virtual object 432 is displayed in the three-dimensional environment 450A / 450B, as discussed above.

[0068] In some examples, the spatial map 475A needs to be accessible only to the first electronic device 101a or the second electronic device 101b. For example, if the spatial map 475A is accessible to the first electronic device 101a, the first electronic device 101a may transmit data to the second electronic device 101b that enables the second electronic device 101b to synchronize with the spatial map 475A and establish the first spatial group as relative to the second origin 430B (and vice versa). In some examples, the spatial map 475A is generated based on and / or includes SLAM data, as previously discussed.

[0069] In some examples, the first electronic device 101a and the second electronic device 101b generate the spatial map 475A by exchanging time synchronization data associated with the current transformations (e.g., orientations and / or positions) of the first electronic device 101a and the second electronic device 101b in the physical environment 400. As mentioned above, when determining the first origin 430A (e.g., the first origin 430 above) in the physical environment 400, the first electronic device 101a and the second electronic device 101b perform one or more image processing techniques, such as object detection, to obtain a rough (e.g., estimated) notion of a position and / or orientation of the other electronic device (and therefore the associated user) in the physical environment 400.For example, as previously described, the first electronic device 101a detects a position and / or orientation of the second electronic device 101b relative to the viewing angle of the first electronic device 101a, and the second electronic device 101b also detects a position and / or orientation of the first electronic device 101a relative to the viewing angle of the second electronic device 101b. In some examples, generating the spatial map 475A includes exchanging data containing information corresponding to the position and / or orientation of the electronic devices 101a and 101b at specified time intervals and synchronizing the data to determine the "true" position and / or orientation of the electronic devices 101a and 101b in the physical environment 400, as discussed below.

[0070] As an example, referring again to Fig. 4D, the first electronic device 101a determines, as mentioned above, that the second electronic device 101a has a first position and a first orientation in the physical environment 400 relative to the viewing angle of the first electronic device 101a. Furthermore, the first electronic device 101a determines that the second electronic device 101b has the first position and the first orientation at a respective time and / or over a respective period of time. In Fig. 4G, the first electronic device 101a optionally transmits first data (e.g., directly or indirectly, such as via a server) to the second electronic device 101b, including information about the position (e.g., the first position) and orientation (e.g., the first orientation) of the second electronic device 101a, as detected / determined by the first electronic device 101a (e.g., via one or more sensors of the first electronic device 101a) at the respective time and / or over the respective time interval. When the first electronic device 101a transmits the first data to the second electronic device 101b, the first electronic device 101a optionally additionally transmits an indication of a request for second data from the second electronic device 101b.In some examples, the second data includes information about the position and orientation of the second electronic device 101a, as detected / determined by the second electronic device 101b (e.g., via one or more sensors of the second electronic device 101b) at the respective time and / or over the respective time interval. In other words, the second electronic device 101b transmits data back to the first electronic device 101a indicating the position and orientation that the second electronic device 101b detected for itself at the same time and / or over the same time period as the first electronic device 101a detected the first position and orientation of the second electronic device 101b in the physical environment 400, as discussed above.In some examples, when the first electronic device 101a receives (e.g., directly or indirectly) the second data from the second electronic device 101b, the first electronic device 101a synchronizes its understanding of the position and orientation of the second electronic device 101b with its own understanding of the position and orientation of the second electronic device 101b in the physical environment 400 by comparing the first data with the second data. It is understood that a similar approach is optionally performed by the second electronic device 101b to synchronize the understanding of the position and orientation of the first electronic device 101a in the physical environment 400. The above approach enables the first electronic device 101a and the second electronic device 101b to use the true (e.g., most accurate and / or more accurate) transformations (e.g.,position and orientation) of the other electronic device in the physical environment 400, thereby enabling the first electronic device 101a and the second electronic device 101b to determine the second origin 430B (e.g., updated origin) in the physical environment 400 (e.g., by determining an updated distance between the first electronic device 101a and the second electronic device 101b based on their updated / true positions).

[0071] In some examples, after generating the spatial map 475A corresponding to the physical environment 400, the first electronic device 101a and the second electronic device 101b update the positions of shared virtual content within the shared three-dimensional environment based on the spatial map 475A. For example, as shown in the top view 410 in Fig. 4G, the previously discussed virtual object 432 is displayed at a first distance 437 from the first origin 430A in the shared three-dimensional environment when the virtual object 432 is first displayed. In some examples, as discussed below, after generating the spatial map 475A, the virtual object 432 is updated to be displayed relative to the second origin 430B in the physical environment 400, rather than (e.g., and no longer) being displayed relative to the first origin 430A in the physical environment 400.

[0072] In some examples, as in plan view 410 in Fig. 4H, when the display of the virtual object 432 is updated based on the spatial map 475A, the virtual object 432 is moved / translated to be displayed at the first distance 437 from the second origin 430B, instead of at the first distance 437 from the first origin 430A as in Fig. 4G. Accordingly, in some examples, when the display of the virtual object 432 is in the top view 410 in Fig. 4H, the virtual object 432 is translated to the left relative to the viewing angle of the first electronic device 101a and to the right relative to the viewing angle of the second electronic device 101b (e.g., by the same magnitude (e.g., distance)).Further interactions with the virtual object 432, such as movement and / or rotation of the virtual object 432 performed in response to user inputs and / or displaying additional or alternative shared virtual objects in the shared three-dimensional environment are therefore also performed using the second origin 430B as a reference, thereby allowing the first user 402 and the second user 404 to experience the spatial truth within the first spatial group, which, as a benefit, enables an improved user experience and improved user perception of the virtual content.

[0073] In some examples, the first electronic device 101a and the second electronic device 101b update the spatial map 475A (and / or generate, for example, a new spatial map) including an updated origin (e.g., a third origin) according to which the spatial truth is defined within the multi-user communication session in response to detecting a "drift" event. In some examples, a drift event corresponds to user input or other user interaction that causes the created origin (e.g., the second origin 430B) in the physical environment to no longer correspond to or represent a true / reliable convergence point (e.g., synchronized location within the physical environment) of the spatial group of participants.In some examples discussed herein, detecting a drift event includes detecting movement of one or more of the electronic devices 101a / 101b that results in at least one of the electronic devices 101a / 101b being farther than a threshold distance (e.g., 0.5, 1, 2, 3, 5, 10, 12, etc. meters) from the second origin 430B. In some examples, the threshold distance corresponds to a distance large enough to cause the electronic device (e.g., the first electronic device 101a and / or the second electronic device 101b) to no longer effectively and / or reliably track and / or determine its pose (e.g., position and / or orientation) relative to the second origin 430B (e.g., such that the tracking of the pose falls below a confidence threshold). Optionally, one or more features of the physical environment also contribute to the drift event.For example, the illumination of the physical environment (e.g., based on the position(s) of the light source(s) relative to the viewing angle of the first electronic device 101a or the second electronic device 101b, the visibility of physical surfaces / feature points in the physical environment such as the common surface serving as the position of the origin, as discussed above, etc.) may impact the ability of the first electronic device 101a or the second electronic device 101b to measure its pose relative to the second origin 430B. In some examples, as discussed in more detail later, detecting a drift event includes detecting an indication that a new participant has joined the multi-user communication session. In some examples, a drift event may be detected after determining the first origin 430A / 430 as described above (e.g.,and before and / or during generation of spatial map 475A). In some examples, a drift event may be detected after generating spatial map 475A that includes second origin 430B.

[0074] In Fig. 4H, the second electronic device 101b detects the movement of the viewing angle of the second electronic device 101b relative to the second origin 430B in the physical environment 400. For example, the second user 404 moves (e.g., walks), as indicated by the arrow 471 in the top view 410 in Fig. 4H, backward in space (e.g., away from the second origin 430B and the first user 402), resulting in the viewpoint of the second electronic device 101b being shifted away from the second origin 430B in the physical environment 400.

[0075] In some examples, such as Fig. 4I, the view of the three-dimensional environment 450A is updated according to the movement of the second user 404 and the second electronic device 101a from the perspective of the first electronic device 101a. For example, as shown in Fig. 4I, the second user 404 and the second electronic device 101b are further away from the viewpoint of the first electronic device 101a in the three-dimensional environment 450A according to the movement of the second user 404 discussed above.

[0076] As mentioned above, in some examples, the movement of one or more electronic devices in a multi-user communication session corresponds to a drift event, which causes the electronic devices to generate an updated spatial map corresponding to the physical environment in which the electronic devices are located. As shown in the top view 410 in Fig. 4I, the movement of the second user 404 does not result in the second electronic device 101b being further than the threshold distance 439 from the second origin 430B in the physical environment 400. Accordingly, the Fig. 4H to 4I, the movement of the second user 404 and the second electronic device 101b optionally does not involve a drift event. Therefore, the first electronic device 101a and the second electronic device 101b refrain from generating a new / updated spatial map corresponding to the physical environment 400 and including a new / updated origin according to which the spatial truth is defined.

[0077] Accordingly, as described above, providing systems and methods for establishing spatial truth between co-located participants of a multi-user communication session enables the display of virtual objects (e.g., avatars and / or virtual content) in a shared three-dimensional environment of the multi-user communication session, thereby advantageously allowing the co-located participants to experience synchronized interaction with content and other participants, thereby enhancing user-device interaction. In addition, automatically determining an origin according to which the virtual objects (e.g.,Avatars and / or virtual content) displayed in the shared three-dimensional environment, and / or helps to avoid user input to manually select the origin in the shared three-dimensional environment; which has the further benefit of helping to save computational resources that would otherwise be consumed in responding to such user input. Attention now turns to examples of drift events that result in the first and second electronic devices generating updated spatial maps to restore the spatial truth of a multi-user communication session.

[0078] Fig. 5A through 5H illustrate exemplary techniques for restoring spatial truth for co-located participants within a spatial group in a multi-user communication session according to some examples of the disclosure. In Fig. 5A, the first electronic device 101a (e.g., associated with the first user 502) and the second electronic device 101b (e.g., associated with the second user 504) are at the same location in the physical environment 500, as also discussed above. In some examples, the first user 502 and the second user 504 correspond to the first user 402 and the second user 404, respectively, of Fig. 4A to 4I. In some examples, the physical environment 500 corresponds to the physical environment 400 of the Fig. 4A to 4I.

[0079] As in Fig. 5A, the first electronic device 101a presents (e.g., via display 120a) a three-dimensional environment 550A. In Fig. 5A, the three-dimensional environment 550A includes, as discussed above in a similar manner, representations (e.g., pass-through representations or computer-generated representations) of the physical environment 500 of the first electronic device 101a. For example, as shown in the top view 510 in Fig. 5A, the physical environment 500 corresponds to a room that includes a physical window 508 and a houseplant 509. Accordingly, as shown in Fig. 5A, the three-dimensional environment 550A represented using the first electronic device 101a includes a representation of the physical window 508 (e.g., the physical window 508 is visible in a field of view of the first electronic device 101a). In addition, as shown in Fig. As shown in Figure 5A, the second user 504 (e.g., and the second electronic device 101b) is currently visible in the three-dimensional environment 550A from a current viewpoint of the first electronic device 101a. In some examples, the three-dimensional environment 550A includes one or more of the characteristics of the three-dimensional environment 450A discussed above.

[0080] Likewise, as in Fig. 5A, the second electronic device 101b (e.g., via display 120b) represents a three-dimensional environment 550B. In Fig. 5A, the three-dimensional environment 550B, as also discussed above, includes representations (e.g., pass-through representations or computer-generated representations) of the physical environment 500 of the second electronic device 101b. As in Fig. 5A, the three-dimensional environment 550B displayed using the second electronic device 101b includes, for example, a representation of the houseplant 509 (e.g., the houseplant 509 is visible in a field of view of the second electronic device 101b). In addition, as shown in Fig. As shown in Figure 5A, the first user 502 (e.g., and the first electronic device 101a) is currently visible in the three-dimensional environment 550B from a current viewpoint of the second electronic device 101b. In some examples, the three-dimensional environment 550B includes one or more of the characteristics of the three-dimensional environment 450B discussed above.

[0081] In the example of Fig. 5A, the first electronic device 101a and the second electronic device 101b are in a multi-user communication session, as also discussed above. As discussed above with reference to Fig. 4A to 4I, for example, the first electronic device 101a (e.g., and the first user 402) and the second electronic device 101b (e.g., and the second user 404) are located in a first spatial group within the multi-user communication session. In particular, as shown in the top view 510 in Fig. 5A, the first electronic device 101a and the second electronic device 101b generate a spatial map 575A corresponding to the physical environment 500 and including the origin 530 according to which the spatial truth is defined in the first spatial group. In some examples, the spatial map 575A includes one or more properties of the spatial map 475A discussed above. In some examples, the origin 530 includes one or more properties of the second origin 430B discussed above.

[0082] In Fig. 5A, the second electronic device 101b detects the movement of the viewpoint of the second electronic device 101b relative to the origin 530 in the physical environment 500. For example, the second user 504 moves (e.g., walks), as indicated by the arrow 571 in the top view 510 in Fig. 5A, backward in space (e.g., away from the origin 530 and the first user 502), resulting in the viewpoint of the second electronic device 101b being shifted away from the origin 530 in the physical environment 500.

[0083] As mentioned above, in some examples, the movement of one or more electronic devices in a multi-user communication session may result in a drift event, which causes the electronic devices to generate an updated spatial map corresponding to the physical environment in which the electronic devices are located. As shown in the top view 510 in Fig. 5B, the movement of the second user 504 results in the second electronic device 101b being farther than the threshold distance 539 (e.g., corresponding to the threshold distance 439 above) from the origin 530 in the physical environment 500 (e.g., and / or results in the second electronic device 101b no longer being able to effectively track its pose (e.g., position and / or orientation) relative to the origin 530 (e.g., such that the tracking of the pose falls below a confidence threshold)). Accordingly, the Fig. 5B, the movement of the second user 504 and the second electronic device 101b optionally results in a drift event. Therefore, as discussed below, the first electronic device 101a and the second electronic device 101b initiate a process for generating a new / updated spatial map corresponding to the physical environment 500 and including a new / updated origin according to which the spatial truth is defined.

[0084] In some examples, in response to detecting the drift event discussed above (e.g., the movement of the second electronic device 101b by more than the threshold distance from the origin 530 in the physical environment 500), the first electronic device 101a and the second electronic device 101b determine an updated origin in the physical environment 500. For example, as shown in the top view 510 in Fig. 5C, the first electronic device 101a and the second electronic device 101b determine the updated origin 530B in the physical environment 500, which is different from the origin 530A (e.g., corresponding to the origin 530 in Fig. 5A to 5B). In some examples, the updated origin 530B is determined using the same or similar approaches described above with respect to the Fig. 4A to 4I. For example, the first electronic device 101a and the second electronic device 101b perform one or more image processing techniques, such as object detection, analyze one or more physical properties of the physical environment 500, and / or identify one or more common surfaces and / or objects in the physical environment to generate a coarse localization of the current positions and / or orientations of the first electronic device 101a and the second electronic device 101b in the physical environment 500. In some examples, the first electronic device 101a and the second electronic device 101b further communicate to jointly create a SLAM characterization of the physical environment 500 (e.g.,by which spatial truth can be created within further and / or subsequent multi-user communication sessions in the physical environment 500).

[0085] Subsequently, the first electronic device 101a and the second electronic device 101b, as described above with reference to Fig. 4A through 4I, an updated spatial map corresponding to the physical environment 500 and including the updated position and / or orientation of the second electronic device 101b. In particular, the first electronic device 101a and the second electronic device 101b optionally use a time synchronization approach, as discussed above, to identify the relative positions and / or orientations of the first electronic device 101a and the second electronic device 101b at a particular time and / or over a particular time interval. In the manner discussed above, the first electronic device 101a and the second electronic device 101b generate the updated origin 530B according to which spatial truth is restored in the first spatial group in the multi-user communication session.

[0086] In some examples, the above-described approach for restoring spatial truth for the first electronic device 101a and the second electronic device 101b is automatically performed by the first electronic device 101a and the second electronic device 101b in response to detecting a drift event. Alternatively, in some examples, the first electronic device 101a and the second electronic device 101b initiate the process for restoring spatial truth (e.g., generating an updated spatial map including an updated origin) in response to specifically detecting user input corresponding to such a request. For example, as described in Fig. 5D, the second electronic device 101b displays the message element 524 in the three-dimensional environment 550B after detecting the movement of the view angle of the second electronic device 101b that causes the second electronic device 101b to move further than the threshold distance from the origin 530 in Fig. 5B. As in Fig. 5D, the message element 524 optionally indicates to the second user 504 that the movement of the second user 504 (e.g., and the second electronic device 101b) has caused the second user 504 to no longer participate in the multi-user communication session. In addition, the message element 524 includes, as shown in Fig. 5D, in some examples, a first option 526 may be selected to allow the second user 504 to rejoin the multi-user communication session and restore spatial truth based on the current position and / or orientation of the second electronic device 101b in the physical environment 500. In some examples, as shown in Fig. 5D, the message element 524 includes a second option 528 that can be selected to forego re-participation in the multi-user communication session and restore spatial truth based on the current position and / or orientation of the second electronic device 101b in the physical environment 500. In Fig. 5C, the second electronic device 101b optionally detects a selection input (e.g., air pinch gesture, air tap gesture, air touch gesture, verbal command, etc.) directed to the first option 526 in the message element 524.

[0087] In some examples, as mentioned above, detecting a drift event that causes the first electronic device 101a and the second electronic device 101b to generate an updated spatial map corresponding to the physical environment 500 includes detecting that a new user (e.g., a third user) joins the multi-user communication session. For example, in Fig. 5E, the first user 502 and the second user 504 are in the first spatial group, as indicated in the top view 510, while the first electronic device 101a and the second electronic device 101b control interactions based on the spatial truth defined according to origin 530B in the physical environment 500 of the spatial map 575A. In some examples, a third user joins the multi-user communication session while the first user 502 and the second user 504 are in the multi-user communication session, as indicated in the top view 510 in Fig. 5F. As in Fig. 5F, for example, the third user 506 (e.g., carrying the third electronic device 101c) has entered (e.g., or is now otherwise located within) the physical space of the physical environment 500 (e.g., such that the third electronic device 101c is located in the same physical environment 500 with the first electronic device 101a and the second electronic device 101b). Furthermore, in some examples, Fig. 5F, the first electronic device 101a and / or the second electronic device 101b, while the third electronic device 101c is located with the first electronic device 101a and the second electronic device 101b in the same physical environment 500, an indication of a request from the third electronic device 101c to join the multi-user communication session in which the first electronic device 101a and the second electronic device 101b are participating. For example, the third electronic device 101c detects a sequence of one or more inputs corresponding to a request to join the multi-user communication session including the first electronic device 101a and the second electronic device 101b, such as the one described above with reference to Fig. 4A to 4B. The first electronic device 101a and / or the second electronic device 101b optionally display an indication of the request that enables the first user 502 and / or the second user 504 to approve the request, similar to the message element 420 in Fig. 4C.

[0088] In some examples, the first electronic device 101a and the second electronic device 101b detect that a drift event has occurred when the third electronic device 101c joins the multi-user communication session including the first electronic device 101a and the second electronic device 101b, as also discussed above. In some examples, in response to detecting that the drift event has occurred, the first electronic device 101a, the second electronic device 101b, and the third electronic device 101c generate an updated spatial map 575C that includes the updated origin 530C (e.g., different from the origin 530A), as shown in the top view 510 in Fig. 5G, as discussed above. For example, as shown in plan view 510 in Fig. 5G, the first electronic device 101a, the second electronic device 101b, and the third electronic device 101c cooperate to update the origin in the physical environment 500 to incorporate the position and / or orientation of the third electronic device 101c (e.g., and the third user 506) in the manner previously discussed above (e.g., by performing one or more image processing techniques to identify the position and / or orientation of the third electronic device 101c relative to the viewpoints of the first electronic device 101a and the second electronic device 101b and / or to time synchronize with the position and / or orientation of the third electronic device 101c as detected by the third electronic device 101c itself).It will be appreciated that in generating the updated spatial map 575C, an intermediate origin (e.g., similar to the first origin 430 discussed above) is optionally determined before the updated origin 530C is determined, as already discussed above with reference to FIG. Fig. 4D, but for the sake of brevity in Fig. 5G is not illustrated.

[0089] In some examples, after generating the updated spatial map 575C, the first electronic device 101a, the second electronic device 101b, and the third electronic device 101c experience, as shown in the top view 510 in Fig. 5G illustrates the spatial truth within the first spatial group relative to the updated origin 530C (e.g., corresponding to an updated / true center of the locations of users 502-506, as also discussed above). Accordingly, as already discussed above, content shared and presented in the multi-user communication session is displayed within the shared three-dimensional environment relative to the updated origin 530C, allowing interactions with the shared content between the three users 502-506 to be synchronized, thereby enhancing the overall user experience. Furthermore, as already discussed above with reference to Fig. 4G-4H discusses that, in some examples, if the first electronic device 101a and the second electronic device 101b were already displaying shared content (e.g., the virtual object 432) when the drift event discussed above was detected (e.g., the third electronic device 101c joins the multi-user communication session), the shared content is redisplayed / repositioned (e.g., translated and / or rotated) in the shared three-dimensional environment relative to the viewpoints of the first electronic device 101a and the second electronic device 101b when the updated spatial map 575C is generated, such that the shared content is now displayed relative to the updated origin 530C (e.g., and no longer relative to the origin 530A).In such a case, the third electronic device 101c optionally displays the shared content relative to the updated origin 530C in the first spatial group (e.g., instead of displaying the shared content relative to the origin 530A and updating the display of the shared content to be displayed relative to the updated origin 530C).

[0090] In some examples, instead of generating an updated spatial map in response to detecting the drift event corresponding to the third user 506 (e.g., and the third electronic device 101c) joining the multi-user communication session, the existing spatial map (e.g., spatial map 575A in Fig. 5E) is shared with the third electronic device 101c, whereby the third electronic device 101c can create a spatial truth with the first electronic device 101a and the second electronic device 101b using the existing spatial map. For example, as shown in the top view 510 in Fig. 5H, when the third electronic device 101c joins the multi-user communication session including the first electronic device 101a and the second electronic device 101b, an updated spatial map including an updated origin is not generated; instead, the third electronic device 101c synchronizes with the spatial map 575A already generated by the first electronic device 101a and the second electronic device 101b. In some examples, map data corresponding to the spatial map 575A is transmitted (e.g., directly or indirectly) from the first electronic device 101a and / or the second electronic device 101b to the third electronic device 101c. In some examples, the map data includes or corresponds to SLAM data of the physical environment 500, as already discussed above.In some examples, the first electronic device 101a and the second electronic device 101b forgo initiating the process of updating the spatial map 575A when the third electronic device 101c joins the multi-user communication session, according to a determination that the spatial map 575A corresponds to a respective spatial map of a plurality of spatial maps corresponding to a plurality of physical environments, including the physical environment 500 accessible from a spatial map repository, as discussed previously herein. For example, the third electronic device 101c downloads and / or otherwise accesses the map data from the repository when joining the multi-user communication session (e.g., from cloud storage or memory).Accordingly, after the third electronic device 101c joins the multi-user communication session, in the example of . Fig. 5H, the spatial truth for the first electronic device 101a, the second electronic device 101b, and the third electronic device 101c continues to be defined relative to the origin 530 in the physical environment 500. Furthermore, in some examples, the first electronic device 101a, the second electronic device 101b, and the third electronic device 101c may communicate to jointly update the spatial map 575A as needed, for example, in response to detecting further drift events and / or other input-based occurrences.

[0091] Accordingly, as described above, providing systems and methods for restoring spatial truth between the co-located participants of a multi-user communication session in response to detecting a drift event enables the continued display of virtual objects (e.g., avatars and / or virtual content) in the shared three-dimensional environment of the multi-user communication session after the drift event has been detected, thereby advantageously allowing the co-located participants to continue to experience synchronized interaction with content and other participants, thereby enhancing user-device interaction. In addition, automatically updating an origin according to which the virtual objects (e.g.,avatars and / or virtual content) displayed in the shared three-dimensional environment, in response to detecting the drift event, prompts and / or helps avoid user input to manually select the updated origin in the shared three-dimensional environment; which, as a further benefit, helps save computational resources that would otherwise be consumed in responding to such user input.

[0092] It is understood that the examples shown and described herein are merely exemplary and that additional and / or alternative elements may be provided within the three-dimensional environment for interacting with the illustrated content. It is understood that the appearance, shape, form, and size of the various user interface elements and objects shown and described herein are exemplary and that alternative appearances, shapes, and / or sizes may be provided. For example, the virtual objects representing application windows (e.g., virtual objects 330 and 432) may be provided in a shape other than rectangular, such as a circular or triangular shape, etc. In some examples, the various selectable options (e.g., options 421 and 422), user interface elements (e.g.,Message element 420 or user interface element 424), etc., described herein may be verbally selected via verbal commands from the user (e.g., the verbal command "select option"). Additionally or alternatively, in some examples, the various options, user interface elements, controls, etc., described herein may be selected and / or manipulated by user input received via one or more separate input devices in communication with the electronic device(s). For example, selection may be made via physical input devices such as a mouse, trackpad, keyboard, etc., that communicate with the electronic device(s).

[0093] Fig. 6 illustrates a flowchart illustrating an exemplary process for providing spatial truth for co-located participants in a spatial group within a multi-user communication session, according to some examples of the disclosure. In some examples, process 600 begins on a first electronic device communicating with one or more displays and one or more input devices, where the first electronic device is co-located with a second electronic device in a physical environment. In some examples, the first electronic device and the second electronic device are optionally a head-mounted display similar or corresponding to the device 200 of Fig. 2. As in Fig. 6, in some examples, the first electronic device detects at 602 an indication of a request to participate in a collaborative activity with the second electronic device.

[0094] For example, in Fig. 4B to 4C, the first electronic device 101a detects a user input corresponding to a request to participate in a multi-user communication session with the second electronic device 101b. Furthermore, in some examples, as shown in Fig. 4E, a user input corresponding to a request to share content (e.g., Movie A) with the second electronic device 101b in the multi-user communication session.

[0095] In some examples, in response to detecting the indication at 606, the first electronic device determines at 604 a first origin according to which content is presented in a three-dimensional environment, the first origin corresponding to a first location in the physical environment. For example, as shown in the top view 410 in Fig. 4E, the first electronic device 101a determines the first origin 430 in the physical environment 400. In some examples, at 608, the first electronic device joins a communication session with the second electronic device, including presenting, via one or more displays, an object corresponding to the shared activity in the three-dimensional environment relative to the first origin. For example, as shown in Fig. 4F, during the multi-user communication session with the second electronic device 101b, the first electronic device 101a displays the virtual object 432 in the three-dimensional environment 450A relative to the first origin 430, as indicated in the top view 410.

[0096] In some examples, during the communication session with the second electronic device and during the presentation of the object relative to the first origin, the first electronic device generates, at 610, based on the physical environment, a spatial map of the three-dimensional environment that includes a second origin corresponding to a second location in the physical environment, the second location being different from the first. For example, as shown in the top view 410 in Fig. 4G, the first electronic device 101a generates a spatial map 475A including a second origin 430B (e.g., different from the first origin 430A) in the physical environment 400. In some examples, at 612, after generating the spatial map of the three-dimensional environment, the first electronic device updates the representation of the object corresponding to the common activity in the three-dimensional environment so that it is relative to the second origin. For example, as shown in the top view 410 in Fig. 4H, the virtual object 432 is repositioned in the shared three-dimensional environment so that it is located at the first distance 437 from the second origin 430B (and, for example, no longer at the first distance 437 from the first origin 430A in Fig. 4G).

[0097] It is understood that process 600 is an example and that more, fewer, or different operations may be performed in the same or in a different order. In addition, the operations described above in process 600 are optionally implemented by executing one or more functional modules in an information processing device, such as general-purpose processors (e.g., as described with reference to Fig. 2) or application-specific chips, and / or by other components of Fig. 2 are executed.

[0098] Therefore, in accordance with the foregoing, some examples of the disclosure relate to a method comprising, at a first electronic device in communication with one or more displays and one or more input devices, the first electronic device being in the same physical environment with a second electronic device: detecting an indication of a request to participate in a joint activity with the second electronic device;in response to detecting the indication, determining a first origin according to which content is presented in a three-dimensional environment, the first origin corresponding to a first location in the physical environment, and engaging in a communication session with the second electronic device, including presenting, via the one or more displays, an object corresponding to the shared activity in the three-dimensional environment relative to the first origin; during the communication session with the second electronic device and during the presentation of the object relative to the first origin, generating, based on the physical environment, a spatial map of the three-dimensional environment including a second origin corresponding to a second location in the physical environment, the second location different from the first;and after generating the spatial map of the three-dimensional environment, updating the representation of the object corresponding to the joint activity in the three-dimensional environment so that it is relative to the second origin. ;

[0099] Additionally or alternatively, in some examples, the fact that the first electronic device is in the same physical environment as the second electronic device includes the second electronic device being within a threshold distance of the first electronic device in the physical environment. Additionally or alternatively, in some examples, the fact that the second electronic device is in the same location in the physical environment as the first electronic device includes the second electronic device being within a field of view of the first electronic device.Additionally or alternatively, in some examples, the second electronic device being co-located with the first electronic device in the physical environment includes the second electronic device being in the same physical space as the first electronic device. Additionally or alternatively, in some examples, the first origin is determined using a first environmental analysis technique and the second origin is determined using a second environmental analysis technique that is different from the first environmental analysis technique. Additionally or alternatively, in some examples, the first origin is determined based on the second electronic device performing object detection.Additionally or alternatively, in some examples, the first origin is determined based on visually detecting, via the one or more input devices, an image associated with the second electronic device that is visible in the physical environment from the perspective of the first electronic device. Additionally or alternatively, in some examples, the first origin is determined based on analyzing one or more physical characteristics of the physical environment. Additionally or alternatively, in some examples, the first origin is determined based on identifying a physical reference in the physical environment that is identifiable by the second electronic device.Additionally or alternatively, in some examples, the second origin is determined by synchronizing the spatial map of the three-dimensional environment with a respective spatial map of a plurality of spatial maps corresponding to a plurality of physical environments, including the physical environment accessible from a spatial map repository.

[0100] Additionally or alternatively, in some examples, the first origin is determined based on the first data provided by the second electronic device. Additionally or alternatively, in some examples, the first data provided by the second electronic device includes information corresponding to a position of the second electronic device relative to the first origin and an orientation of the second electronic device relative to the first origin.Additionally or alternatively, in some examples, the first origin is determined based on identifying a position of the second electronic device relative to a view angle of the first electronic device and an orientation of the second electronic device relative to the view angle of the first electronic device over a first period of time, and the first data provided by the second electronic device is collected by the second electronic device over the first period of time.Additionally or alternatively, in some examples, the method further comprises: during the communication session with the second electronic device and during the representation of the object relative to the second origin, detecting that a corresponding event has occurred; and in response to detecting that the respective event has occurred and in accordance with determining that the respective event meets one or more criteria, updating the spatial map to include a third origin corresponding to a third location in the physical environment, wherein the third location is different from the second location, and updating the representation of the object corresponding to the common activity in the three-dimensional environment to be relative to the third origin.Additionally or alternatively, in some examples, detecting that the respective event has occurred includes detecting a change in position of the second electronic device relative to the second origin, and the one or more criteria include a criterion that is met when the change in position of the second electronic device causes the second electronic device to be farther than a threshold distance from the second origin.

[0101] Additionally or alternatively, in some examples, detecting that the respective event has occurred includes detecting a change in the pose of the first electronic device relative to the second origin, and the one or more criteria include a criterion that is met when the change in the pose of the first electronic device causes synchronization of the second origin between the first electronic device and the second electronic device to fall below a confidence threshold. Additionally or alternatively, in some examples, detecting that the respective event has occurred includes detecting a change in the number of participants in the communication session, and the one or more criteria include a criterion that is met,if the change in the number of participants in the communication session corresponds to an increase in the number of participants in the communication session. Additionally or alternatively, in some examples, after detecting the increase in the number of participants in the communication session, the communication session further includes a third electronic device co-located in the physical environment with the first electronic device and the second electronic device, the method further comprising: during the communication session with the second electronic device and the third electronic device and while presenting the object relative to the third origin, detecting a first input via the one or more input devices corresponding to a request to leave the communication session; in response to detecting the first input,Ending the display of the object in the three-dimensional environment; after leaving the communication session, detecting a second input via the one or more input devices corresponding to a request to rejoin the communication session including the second electronic device and the third electronic device; and in response to detecting the second input, synchronizing with a respective spatial map of the three-dimensional environment including a respective origin and presenting the object at a respective position in the three-dimensional environment relative to the respective origin via the one or more displays.

[0102] Additionally or alternatively, in some examples, the method further comprises: during the communication session with the second electronic device and during the representation of the object relative to the second origin, detecting an indication of a request to add a third electronic device to the communication session, wherein the third electronic device is co-located in the physical environment with the first electronic device and the second electronic device; and in response to detecting the indication, adding the third electronic device to the communication session and maintaining the representation of the object relative to the second origin in the three-dimensional environment.Additionally or alternatively, in some examples, indicating the request to participate in the collaborative activity with the second electronic device includes detecting an input via the one or more input devices corresponding to a request to share content with the second electronic device. Additionally or alternatively, in some examples, indicating the request to participate in the collaborative activity with the second electronic device corresponds to a user input to share content with the first electronic device detected by the second electronic device.Additionally or alternatively, in some examples, the representation of the object corresponding to the common activity in the three-dimensional environment relative to the first origin is performed according to a determination that the first origin is determined with a first confidence level, and the updating of the representation of the object corresponding to the common activity in the three-dimensional environment relative to the second origin is performed according to a determination that the second origin is determined with a second confidence level that is greater than the first confidence level.

[0103] Some examples of the disclosure relate to a first electronic device comprising: one or more processors; a memory; and one or more programs stored in the memory and configured to be executed by the one or more processors, wherein the one or more programs include instructions for performing any of the above-mentioned methods.

[0104] Some examples of the disclosure are directed to a non-transitory, computer-readable storage medium storing one or more programs, wherein the one or more programs comprise instructions that, when executed by one or more processors of a first electronic device, cause the first electronic device to perform one of the aforementioned methods.

[0105] Some examples of the disclosure are directed to a first electronic device comprising one or more processors, memory, and means for performing any of the above methods.

[0106] Some examples of the disclosure are directed to an information processing device for use in a first electronic apparatus, the information processing device comprising means for performing any of the methods disclosed above.

[0107] The foregoing description has been described with reference to specific examples for the purpose of explanation. However, the foregoing illustrative discussions are not intended to be exhaustive or to limit the disclosure to the precise forms disclosed. Many modifications and variations are possible in light of the above teachings. The examples were chosen and described in order to best explain the principles of the disclosure and their practical application, and thus to enable others skilled in the art to best utilize the disclosure and various described examples with various modifications as suited to the particular use contemplated. QUOTES CONTAINED IN THE DESCRIPTION

[0000] This list of documents submitted by the applicant was generated automatically and is included solely for the convenience of the reader. This list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions. Cited patent literature

[0000] US 63 / 634,168

[0001] US 19 / 079,152

[0001]

Claims

[1] Method comprising: on a first electronic device communicating with one or more displays and one or more input devices, the first electronic device being co-located with a second electronic device in a physical environment: Recognizing an indication of a request to participate in a joint activity with the second electronic device; in response to recognizing the information: Determining a first origin according to which content is presented in a three-dimensional environment, the first origin corresponding to a first location in the physical environment; and Participating in a communication session with the second electronic device, including presenting an object corresponding to the joint activity in the three-dimensional environment relative to the first origin, via the one or more advertisements; during the communication session with the second electronic device and during the representation of the object relative to the first origin, generating, based on the physical environment, a spatial map of the three-dimensional environment including a second origin corresponding to a second location in the physical environment, the second location being different from the first; and after generating the spatial map of the three-dimensional environment, updating the representation of the object corresponding to the joint activity in the three-dimensional environment so that it is relative to the second origin. [2] The method of claim 1, wherein the fact that the first electronic device is in the same physical environment with the second electronic device comprises: that the second electronic device is located in the physical environment within a threshold distance from the first electronic device; that the second electronic device is in the field of view of the first electronic device; and / or that the second electronic device is located in the same physical space as the first electronic device. [3] Method according to one of claims 1 to 2, wherein: the first origin is determined using a first environmental analysis technique; and the second origin is determined using a second environmental analysis technique that is different from the first environmental analysis technique. [4] The method of any one of claims 1 to 3, wherein the first origin is determined based on performing object recognition of the second electronic device. [5] The method of any one of claims 1 to 4, wherein the first origin is determined based on visually detecting, via the one or more input devices, an image associated with the second electronic device that is visible in the physical environment from the perspective of the first electronic device. [6] The method of any one of claims 1 to 5, wherein the first origin is determined based on the analysis of one or more physical properties of the first physical environment. [7] The method of any one of claims 1 to 6, wherein the second origin is determined by synchronizing the spatial map of the three-dimensional environment with a respective spatial map of a plurality of spatial maps corresponding to a plurality of physical environments, including the physical environment accessible from a spatial map repository. [8] The method of any one of claims 1 to 7, wherein the second origin is determined based on first data provided by the second electronic device, the first data including information corresponding to a position of the second electronic device relative to the first origin and an orientation of the second electronic device relative to the first origin. [9] The method of claim 8, wherein: the first origin is determined based on identifying a position of the second electronic device relative to a viewing angle of the first electronic device and an orientation of the second electronic device relative to the viewing angle of the first electronic device over a first period of time; and the first data provided by the second electronic device are collected by the second electronic device over the first period of time. [10] A method according to any one of claims 1 to 9, further comprising: during the communication session with the second electronic device and during the representation of the object relative to the second origin, detecting that a corresponding event has occurred; and in response to detecting that the relevant event has occurred, in accordance with a determination that the relevant event meets one or more criteria: Updating the spatial map to include a third origin corresponding to a third location in the physical environment, where the third location is different from the second location; and Update the representation of the object corresponding to the joint activity in the three-dimensional environment so that it is relative to the third origin. [11] The method of claim 10, wherein: detecting that the respective event has occurred includes detecting a change in the position of the second electronic device relative to the second origin; and the one or more criteria include a criterion that is satisfied when the change in position of the second electronic device results in the second electronic device being farther than a threshold distance from the second origin. [12] The method of claim 10, wherein: detecting that the respective event has occurred includes detecting a change in the position of the first electronic device relative to the first origin; and the one or more criteria include a criterion that is satisfied when the change in pose of the first electronic device causes a synchronization of the second origin between the first electronic device and the second electronic device to fall below a confidence threshold. [13] The method of claim 10, wherein: the recognition that the respective event has occurred includes the recognition of a change in the number of participants in the communication session; and the one or more criteria include a criterion that is met if the change in the number of participants in the communication session corresponds to an increase in the number of participants in the communication session. [14] First electronic device comprising: one or more processors; a RAM; and one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing a method according to any one of claims 1 to 13. [15] A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions that, when executed by one or more processors of an electronic device, cause the electronic device to perform a method according to any one of claims 1 to 13.

Images