Visual representation of a user during a multi-user communication session and audio experience during a multi-user communication session

The described systems adapt visual and audio representations in multi-user communication systems based on co-location status, improving user experience by dynamically adjusting to co-location changes.

JP2026009094APending Publication Date: 2026-01-19APPLE INC
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
JP2025113893
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2025-06-20
Filing Date
2025-07-04
Publication Date
2026-01-19

AI Technical Summary

Technical Problem

Existing multi-user communication systems fail to adapt the visual and audio representation of users based on their co-location status, leading to suboptimal user experience during transitions between co-located and non-co-located interactions.

Method used

Systems and methods that dynamically change the visual appearance and audio properties of users in multi-user communication sessions based on co-location status, using sensors to detect spatial and audio overlap, and adjust representations and audio levels accordingly.

Benefits of technology

Enhances user experience by providing adaptive visual and audio adjustments that improve interaction quality during co-location transitions, ensuring seamless communication across varying environments.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2026009094000001_ABST
    Figure 2026009094000001_ABST
Patent Text Reader

Abstract

To provide systems and methods involving visual representations and audio experiences of users during a multi-user communication session.SOLUTION: This includes example systems and methods for changing a visual appearance of a user during a multi-user communication session in response to detecting that the user transitions from being a non-collocated user (e.g., a remote user) in the multi-user communication session to being a collocated user in the multi-user communication session, and / or vice versa. This also includes example systems and methods for determining a mode of a visual representation of a user of an electronic device participating in a multi-user communication session that is already active among users of other electronic devices. This also includes example systems and methods for enhancing the audio experience of co-located users of electronic devices during a multi-user communication session.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] (CROSS-REFERENCE TO RELATED APPLICATIONS) This application claims the benefit of U.S. Provisional Patent Application No. 63 / 667,978, filed July 5, 2024, U.S. Provisional Patent Application No. 63 / 805,656, filed May 14, 2025, and U.S. Provisional Patent Application No. 19 / 245,107, filed June 20, 2025, the contents of which are incorporated by reference herein in their entirety for all purposes.

[0002] The present invention relates generally to systems and methods involving the visual representation and audio experience of users during a multi-user communication session. [Background technology]

[0003] Some computer graphical environments provide computer-generated two-dimensional and / or three-dimensional environments in which at least some objects displayed for user viewing are virtual. In some examples, the three-dimensional environment is presented by multiple devices communicating in a multi-user communication session. In some examples, an avatar (e.g., a representation) of each non-co-located user participating in the multi-user communication session (e.g., via a computing device) is displayed within the three-dimensional environment of the multi-user communication session. In some examples, content may be shared within the three-dimensional environment for viewing and interaction by multiple users participating in the multi-user communication session. Summary of the Invention

[0004] A multi-user communication session may include co-located users and / or remote users, the users of which are optionally in the multi-user communication session via respective electronic devices associated with the respective users.

[0005] A co-located user is, optionally, a user in a multi-user communication session whose electronic device (and person (e.g., the user's body or part of the body)) shares the visual space of a physical environment with another electronic device (and person) of another user, and / or whose electronic device (and person) shares the audio space of a physical environment with another electronic device (and person) of another user. When a first electronic device shares the visual space of the physical environment with a second electronic device, one or more first portions of the physical environment are optionally captured by the first electronic device and one or more second portions of the physical environment are captured by the second electronic device, and these first and second captured portions are optionally analyzed to determine overlap of characteristics associated with the first and second captured portions, and further, optionally, analyzed taking into account metadata associated with the capture of the first and second captured portions, such as the orientation of the first electronic device within the physical environment when the one or more first portions were captured and the orientation of the second electronic device within the physical environment when the one or more second portions were captured. When the first electronic device shares the audio space of the physical environment with the second electronic device, audio data detected by one or more first microphones in communication with the first electronic device is optionally also detected by one or more second microphones in communication with the second electronic device.

[0006] A remote user (e.g., a non-co-located user) is, optionally, a user of a multi-user communication session whose electronic device (and person) does not share the visual space of the physical environment with other electronic devices (and people) of another user, and / or whose electronic device (and person) does not share the audio space of the physical environment with other electronic devices (and people) of other users.

[0007] When the first electronic device is co-located with the second electronic device but not with the third electronic device, the second electronic device is optionally not also co-located with the third electronic device. When the first electronic device is co-located with the second electronic device and co-located with the third electronic device, the second electronic device is optionally also co-located with the third electronic device.

[0008] Some examples of the present disclosure are directed to systems and methods for changing the visual appearance of a user of an electronic device during a multi-user communication session in response to detecting that the user of the electronic device transitions from being a non-collocated user in the multi-user communication session to being a collocated user in the multi-user communication session.

[0009] Some examples of the present disclosure are directed to systems and methods for changing the visual appearance of a user in a multi-user communication session in response to detecting that the user transitions from being a collocated user in the multi-user communication session to being a non-collocated user in the multi-user communication session.

[0010] Some examples of the present disclosure are directed to systems and methods for determining a mode of visual representation of a user of an electronic device participating in an already active multi-user communication session between users of other electronic devices, according to some examples of the present disclosure.

[0011] Some examples of the present disclosure are directed to systems and methods for enhancing the audio experience of co-located users during a multi-user communication session, such as, at a first electronic device of a first user co-located with a second user of a second electronic device during the multi-user communication session, while a first audio property of the first electronic device is at a first level, the first electronic device optionally changes the level of the first audio property in response to a change in distance between the first electronic device and the second electronic device.

[0012] A full description of these examples is set forth in the Drawings and Detailed Description, and it should be understood that this Summary is not intended to limit the scope of the present disclosure in any way.

[0013] For a better understanding of the various examples described herein, reference should be made to the following detailed description in conjunction with the following drawings, in which like reference numerals frequently refer to corresponding parts throughout the drawings, in which: [Brief explanation of the drawings]

[0014] [Figure 1] 1 illustrates an electronic device presenting an augmented reality environment, according to some examples of the present disclosure.

[0015] [Figure 2] 1 shows a block diagram of an example architecture for a system according to some examples of the present disclosure.

[0016] [Figure 3] 1 illustrates an example of a spatial group in a multi-user communication session including a first electronic device and a second electronic device, according to some examples of the present disclosure.

[0017] [Figure 4A]10 generally illustrates an example of changing the mode of a visual representation of a user in a multi-user communication session in response to detecting that the user has changed from being a non-collocated user in a multi-user communication session to a collocated user in a multi-user communication session, or in response to detecting that the user has changed from being a collocated user in a multi-user communication session to being a non-collocated user in a multi-user communication session, according to some examples of the present disclosure. [Figure 4B] 10 generally illustrates an example of changing the mode of a visual representation of a user in a multi-user communication session in response to detecting that the user has changed from being a non-collocated user in a multi-user communication session to a collocated user in a multi-user communication session, or in response to detecting that the user has changed from being a collocated user in a multi-user communication session to being a non-collocated user in a multi-user communication session, according to some examples of the present disclosure. [Figure 4C] 10 generally illustrates an example of changing the mode of a visual representation of a user in a multi-user communication session in response to detecting that the user has changed from being a non-collocated user in a multi-user communication session to a collocated user in a multi-user communication session, or in response to detecting that the user has changed from being a collocated user in a multi-user communication session to being a non-collocated user in a multi-user communication session, according to some examples of the present disclosure. [Figure 4D]10 generally illustrates an example of changing the mode of a visual representation of a user in a multi-user communication session in response to detecting that the user has changed from being a non-collocated user in a multi-user communication session to a collocated user in a multi-user communication session, or in response to detecting that the user has changed from being a collocated user in a multi-user communication session to being a non-collocated user in a multi-user communication session, according to some examples of the present disclosure. [Figure 4E] 10 generally illustrates an example of changing the mode of a visual representation of a user in a multi-user communication session in response to detecting that the user has changed from being a non-collocated user in a multi-user communication session to a collocated user in a multi-user communication session, or in response to detecting that the user has changed from being a collocated user in a multi-user communication session to being a non-collocated user in a multi-user communication session, according to some examples of the present disclosure. [Figure 4F] 10 generally illustrates an example of changing the mode of a visual representation of a user in a multi-user communication session in response to detecting that the user has changed from being a non-collocated user in a multi-user communication session to a collocated user in a multi-user communication session, or in response to detecting that the user has changed from being a collocated user in a multi-user communication session to being a non-collocated user in a multi-user communication session, according to some examples of the present disclosure. [Figure 4G]10 generally illustrates an example of changing the mode of a visual representation of a user in a multi-user communication session in response to detecting that the user has changed from being a non-collocated user in a multi-user communication session to a collocated user in a multi-user communication session, or in response to detecting that the user has changed from being a collocated user in a multi-user communication session to being a non-collocated user in a multi-user communication session, according to some examples of the present disclosure. [Figure 4H] 10 generally illustrates an example of changing the mode of a visual representation of a user in a multi-user communication session in response to detecting that the user has changed from being a non-collocated user in a multi-user communication session to a collocated user in a multi-user communication session, or in response to detecting that the user has changed from being a collocated user in a multi-user communication session to being a non-collocated user in a multi-user communication session, according to some examples of the present disclosure.

[0018] [Figure 4I] 1 illustrates an example of joining a user of an electronic device to an already active multi-user communication session between users of other electronic devices, according to some examples of the present disclosure. [Figure 4J] 1 illustrates an example of joining a user of an electronic device to an already active multi-user communication session between users of other electronic devices, according to some examples of the present disclosure. [Figure 4K] 1 illustrates an example of joining a user of an electronic device to an already active multi-user communication session between users of other electronic devices, according to some examples of the present disclosure. [Figure 4L] 1 illustrates an example of joining a user of an electronic device to an already active multi-user communication session between users of other electronic devices, according to some examples of the present disclosure. [Figure 4M]1 illustrates an example of joining a user of an electronic device to an already active multi-user communication session between users of other electronic devices, according to some examples of the present disclosure. [Figure 4N] 1 illustrates an example of joining a user of an electronic device to an already active multi-user communication session between users of other electronic devices, according to some examples of the present disclosure. [Figure 4O] 1 illustrates an example of joining a user of an electronic device to an already active multi-user communication session between users of other electronic devices, according to some examples of the present disclosure.

[0019] [Figure 5A] 1 illustrates an example of an electronic device in a multi-user communication session that changes the level of a first audio property based on a change in distance between the electronic device and another electronic device co-located with the electronic device in the multi-user communication session, according to some examples of the present disclosure. [Figure 5B] 1 illustrates an example of an electronic device in a multi-user communication session that changes the level of a first audio property based on a change in distance between the electronic device and another electronic device co-located with the electronic device in the multi-user communication session, according to some examples of the present disclosure. [Figure 5C] 1 illustrates an example of an electronic device in a multi-user communication session that changes the level of a first audio property based on a change in distance between the electronic device and another electronic device co-located with the electronic device in the multi-user communication session, according to some examples of the present disclosure. [Figure 5D] 1 illustrates an example of an electronic device in a multi-user communication session that changes the level of a first audio property based on a change in distance between the electronic device and another electronic device co-located with the electronic device in the multi-user communication session, according to some examples of the present disclosure. [Figure 5E]1 illustrates an example of an electronic device in a multi-user communication session that changes the level of a first audio property based on a change in distance between the electronic device and another electronic device co-located with the electronic device in the multi-user communication session, according to some examples of the present disclosure. [Figure 5F] 1 illustrates an example of an electronic device in a multi-user communication session that changes the level of a first audio property based on a change in distance between the electronic device and another electronic device co-located with the electronic device in the multi-user communication session, according to some examples of the present disclosure. [Figure 5G] 1 illustrates an example of an electronic device in a multi-user communication session that changes the level of a first audio property based on a change in distance between the electronic device and another electronic device co-located with the electronic device in the multi-user communication session, according to some examples of the present disclosure. [Figure 5H] 1 illustrates an example of an electronic device in a multi-user communication session that changes the level of a first audio property based on a change in distance between the electronic device and another electronic device co-located with the electronic device in the multi-user communication session, according to some examples of the present disclosure.

[0020] [Figure 6] FIG. 1 is a flow diagram illustrating an example method for changing a mode of a visual representation of a user in a multi-user communication session in response to detecting that the user has changed from being a non-co-located user in the multi-user communication session to a co-located user in the multi-user communication session, according to some examples of the present disclosure.

[0021] [Figure 7] FIG. 1 is a flow diagram illustrating an example method for determining a mode of a visual representation of a user of an electronic device participating in an already active multi-user communication session among users of other electronic devices, according to some examples of the present disclosure.

[0022] [Figure 8] 1 is a flow diagram illustrating an example method for changing a level of a first audio property of a first electronic device co-located with a second electronic device during a multi-user communication session, according to some examples of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0023] A multi-user communication session may include co-located users and / or remote users, the users of which are optionally in the multi-user communication session via respective electronic devices associated with the respective users.

[0024] A co-located user is, optionally, a user in a multi-user communication session whose electronic device (and person (e.g., the user's body or part of the body)) shares the visual space of a physical environment with another electronic device (and person) of another user, and / or whose electronic device (and person) shares the audio space of a physical environment with another electronic device (and person) of another user. When a first electronic device shares the visual space of the physical environment with a second electronic device, one or more first portions of the physical environment are optionally captured by the first electronic device and one or more second portions of the physical environment are captured by the second electronic device, and these first and second captured portions are optionally analyzed to determine overlap of characteristics associated with the first and second captured portions, and further, optionally, analyzed taking into account metadata associated with the capture of the first and second captured portions, such as the orientation of the first electronic device within the physical environment when the one or more first portions were captured and the orientation of the second electronic device within the physical environment when the one or more second portions were captured. When the first electronic device shares the audio space of the physical environment with the second electronic device, audio data detected by one or more first microphones in communication with the first electronic device is optionally also detected by one or more second microphones in communication with the second electronic device.

[0025] A remote user (e.g., a non-co-located user) is, optionally, a user of a multi-user communication session whose electronic device (and person) does not share the visual space of the physical environment with other electronic devices (and people) of another user, and / or whose electronic device (and person) does not share the audio space of the physical environment with other electronic devices (and people) of other users.

[0026] When the first electronic device is co-located with the second electronic device but not with the third electronic device, the second electronic device is optionally not also co-located with the third electronic device. When the first electronic device is co-located with the second electronic device and co-located with the third electronic device, the second electronic device is optionally also co-located with the third electronic device.

[0027] Some examples of the present disclosure are directed to systems and methods for changing the visual appearance of a user in a multi-user communication session in response to detecting that the user transitions from being a non-collocated user in the multi-user communication session to being a collocated user in the multi-user communication session.

[0028] Some examples of the present disclosure are directed to systems and methods for changing the visual appearance of a user of an electronic device during a multi-user communication session in response to detecting that the user of the electronic device transitions from being a non-collocated user in the multi-user communication session to being a collocated user in the multi-user communication session.

[0029] Some examples of the present disclosure are directed to systems and methods for determining the mode of a visual representation of a user of an electronic device that is participating in an already active multi-user communication session among users of other electronic devices.

[0030] Some examples of the present disclosure are directed to systems and methods for enhancing the audio experience of co-located users during a multi-user communication session, such as, at a first electronic device of a first user co-located with a second user of a second electronic device during the multi-user communication session, while a first audio property of the first electronic device is at a first level, the first electronic device optionally changes the level of the first audio property in response to a change in distance between the first electronic device and the second electronic device.

[0031] It should be noted that, as used herein, a first electronic device and a second electronic device are co-located with each other when a first user of the first electronic device is co-located with a second user of the second electronic device. Similarly, a first electronic device and a second electronic device are not co-located with each other when a first user of the first electronic device is not co-located with a second user of the second electronic device.

[0032] FIG. 1 illustrates an electronic device 101 presenting an extended reality (XR) environment (e.g., a computer-generated environment that optionally includes representations of physical and / or virtual objects) according to some examples of the present disclosure. In some examples, as shown in FIG. 1, the electronic device 101 is a head-mounted display or other head-mountable device configured to be worn on the head of a user of the electronic device 101. Examples of the electronic device 101 are described below with reference to the architectural block diagram of FIG. 2. As shown in FIG. 1, the electronic device 101 and a table 106 are located in a physical environment. The physical environment may include physical features such as physical surfaces (e.g., floors, walls) or physical objects (e.g., tables, lamps, etc.). In some examples, the electronic device 101 may be configured to detect and / or capture images of the physical environment, including the table 106 (shown within the field of view of the electronic device 101).

[0033] 1, electronic device 101 includes one or more internal image sensors 114a (e.g., eye-tracking cameras described below with reference to FIG. 2) oriented toward the user's face. In some examples, internal image sensor 114a is used for eye tracking (e.g., detecting the user's gaze). Internal image sensor 114a is optionally positioned on left and right portions of display 120 to enable eye tracking of the user's left and right eyes. In some examples, electronic device 101 also includes external image sensors 114b and 114c facing outward from the user to detect and / or capture the physical environment of electronic device 101 and / or movements of the user's hands or other body parts.

[0034] In some examples, display 120 has a field of view visible to the user (e.g., which may or may not correspond to the field of view of external image sensors 114b and 114c). Because display 120 is optionally part of a head-mounted device, the field of view of display 120 is optionally the same as or similar to the field of view of the user's eyes. In other examples, the field of view of display 120 may be smaller than the field of view of the user's eyes. In some examples, electronic device 101 may be an optical see-through device in which display 120 is a transparent or translucent display through which a portion of the physical environment can be viewed directly. In some examples, display 120 may be contained within a transparent lens or may overlap all or only a portion of a transparent lens. In other examples, electronic device 101 may be a video pass-through device in which display 120 is an opaque display configured to display images of the physical environment captured by external image sensors 114b and 114c. While a single display 120 is shown, it should be understood that display 120 may include a stereo pair of displays.

[0035] 1 , which is not present in the physical environment but is displayed in the XR environment positioned on top of a real-world table 106 (or a representation thereof). Optionally, the virtual object 104 may be displayed on a surface of the table 106 in the XR environment displayed via the display 120 of the electronic device 101 in response to detecting the plane of the table 106 in the physical environment 100.

[0036] It should be understood that virtual object 104 is exemplary of a virtual object, and that one or more different virtual objects (e.g., of various dimensionalities, such as two-dimensional or other three-dimensional virtual objects) can be included and rendered within the three-dimensional XR environment. For example, the virtual object may represent an application or a user interface displayed within the XR environment. In some examples, the virtual object may represent content corresponding to an application and / or displayed via a user interface in the XR environment. In some examples, virtual object 104 is optionally interactive and configured to respond to user input (e.g., air gestures such as an air pinch gesture, an air tap gesture, and / or an air touch gesture) such that a user may virtually touch, tap, move, rotate, or otherwise interact with virtual object 104.

[0037] In some examples, displaying an object within the three-dimensional environment may include interaction with one or more user interface objects within the three-dimensional environment. For example, initiating the display of an object within the three-dimensional environment may include interaction with one or more virtual options / affordances displayed within the three-dimensional environment. In some examples, a user's gaze may be tracked by the electronic device as input to identify one or more virtual options / affordances for selection when initiating the display of the object within the three-dimensional environment. For example, the gaze may be used to identify one or more virtual options / affordances for selection using another selection input. In some examples, the virtual options / affordances may be selected using hand-tracking input detected via an input device in communication with the electronic device. In some examples, an object displayed within the three-dimensional environment may be moved and / or reoriented within the three-dimensional environment according to movement input detected via the input device.

[0038] In the following description, an electronic device is described that communicates with a display generating component (e.g., one or more displays) and one or more input devices. Additionally, the electronic device optionally communicates with one or more output devices, such as one or more audio output devices. It should be understood that the electronic device optionally communicates with one or more other physical user interface devices, such as a touch-sensitive surface, a physical keyboard, a mouse, a joystick, a hand-tracking device, an eye-tracking device, a stylus, etc. It should also be understood that, as discussed above, the described electronic devices, displays, and touch-sensitive surfaces are optionally distributed across two or more devices. Thus, as used in this disclosure, information displayed on or by an electronic device may optionally be used to describe information output by the electronic device for display on another display device (touch-sensitive or non-touch-sensitive). Similarly, as used in this disclosure, input received at an electronic device (e.g., touch input received on a touch-sensitive surface of the electronic device or touch input received on the surface of a stylus) is optionally used to describe input received at a separate input device from which the electronic device receives input information. In some embodiments, the electronic device has (e.g., includes or communicates with) a display generating component (e.g., a display device such as a head-mounted device (HMD), a display, a projector, a touch-sensitive display (also known as a "touch screen" or "touch screen display"), or other device or component that presents visual content to a user, e.g., generated on or in the display generating component itself or from the display generating component and viewable elsewhere).

[0039] The device typically supports a variety of applications, such as one or more of a drawing application, a presentation application, a word processing application, a website creation application, a disc authoring application, a spreadsheet application, a gaming application, a telephony application, a video conferencing application, an email application, an instant messaging application, a training support application, a photo management application, a digital camera application, a digital video camera application, a web browsing application, a digital music playback application, a television channel browsing application, and / or a digital video playback application.

[0040] 2 shows a block diagram of an example architecture of a system 201 according to some examples of the present disclosure. In some examples, the system 201 includes multiple devices. For example, the system 201 includes a first electronic device 260 and a second electronic device 270, where the first electronic device 260 and the second electronic device 270 communicate with each other. In some examples, the first electronic device 260 and the second electronic device 270 are portable devices, such as a mobile phone, a smartphone, a tablet computer, a laptop computer, an auxiliary device that communicates with another device, a head-mounted display, etc. In some examples, the first electronic device 260 and the second electronic device 270 correspond to the electronic device 101 described above with reference to FIG. 1.

[0041] As shown in FIG. 2 , first electronic device 260 optionally includes various sensors (e.g., one or more hand tracking sensors 202A, one or more location sensors 204A, one or more image sensors 206A, one or more touch-sensitive surface 209A, one or more movement and / or orientation sensors 210A, one or more eye tracking sensors 212A, one or more microphones 213A or other audio sensors, one or more body tracking sensors (e.g., torso and / or head tracking sensors), one or more display generating components 214A, one or more speakers 216A, one or more processors 218A, one or more memories 220A, and / or communications circuitry 222A. In some examples, second device 270 includes various sensors (e.g., one or more hand tracking sensors 202B, one or more location sensors 204B, one or more image sensors 206B, one or more touch-sensitive surface 209A, one or more movement and / or orientation sensors 210A, one or more eye tracking sensors 212A, one or more microphones 213A or other audio sensors, one or more body tracking sensors (e.g., torso and / or head tracking sensors), one or more display generating components 214A, one or more speakers 216A, one or more processors 218A, one or more memories 220A, and / or communications circuitry 222A). In some examples, second device 270 includes various sensors (e.g., one or more hand tracking sensors 202B, one or more location sensors 204B, one or more image sensors 206B, one or more touch-sensitive surface 209A, one or more movement and / or orientation sensors 210A, one or more eye tracking sensors 212A, one or more microphones 213A or other audio sensors, one or more body tracking sensors (e.g., torso and / or head tracking sensors), one or more display 209B, one or more movement and / or orientation sensors 210B, one or more eye tracking sensors 212B, one or more microphones 213B or other audio sensors, one or more body tracking sensors (e.g., torso and / or head tracking sensors), one or more display generating components 214B, one or more speakers 216, one or more processors 218B, one or more memories 220B, and / or communications circuitry 222B. In some examples, one or more display generating components 214A, 214B correspond to display 120 of FIG. 1. One or more communications buses 208A and 208B are optionally used for communications between the above-mentioned components of electronic devices 260 and 270, respectively. First electronic device 260 and second electronic device 270 optionally communicate via a wired or wireless connection between the two devices (e.g., via communications circuitry 222A, 222B).

[0042] Communications circuitry 222A, 222B optionally includes circuitry for communicating with electronic devices, networks such as the Internet, an intranet, wired and / or wireless networks, cellular networks, and wireless local area networks (LANs). Communications circuitry 222A, 222B optionally includes circuitry for communicating using short-range communications such as near field communication (NFC) and / or Bluetooth.

[0043] The processor(s) 218A, 218B include one or more general-purpose processors, one or more graphics processors, and / or one or more digital signal processors. In some examples, the memory 220A, 220B is a non-transitory computer-readable storage medium (e.g., flash memory, random access memory, or other volatile or non-volatile memory or storage) that stores computer-readable instructions configured to be executed by the processor(s) 218A, 218B to perform the techniques, processes, and / or methods described below. In some examples, the memory 220A, 220B can include two or more non-transitory computer-readable storage media. A non-transitory computer-readable storage medium can be any medium (other than a signal) that can tangibly store or carry computer-executable instructions used by or in connection with an instruction execution system, apparatus, or device. In some examples, the storage medium is a transient computer-readable storage medium. In some examples, the storage medium is a non-transitory computer-readable storage medium. Non-transitory computer-readable storage media may include, but are not limited to, magnetic, optical, and / or semiconductor storage devices. Examples of such storage include magnetic disks, compact discs (CDs), digital versatile discs (DVDs), or optical discs based on Blu-ray technology, as well as persistent solid-state memory such as flash and solid-state drives.

[0044] In some examples, display generating component(s) 214A, 214B include a single display (e.g., a liquid crystal display (LCD), organic light emitting diode (OLED), or other type of display). In some examples, display generating component(s) 214A, 214B include multiple displays. In some examples, display generating component(s) 214A, 214B may include a display with touch capabilities (e.g., a touchscreen), a projector, a holographic projector, a retina projector, a transparent or translucent display, etc. In some examples, electronic devices 260 and 270 include touch-sensitive surface(s) 209A and 209B, respectively, for receiving user inputs such as tap and swipe inputs or other gestures. In some examples, display generating component(s) 214A, 214B and touch-sensitive surface(s) 209A, 209B form touch-sensitive display(s) (e.g., touchscreens integrated with or external to electronic devices 260 and 270, respectively, in communication with electronic devices 260 and 270, respectively).

[0045] Electronic devices 260 and 270 optionally include image sensor(s) 206A and 206B, respectively. Image sensor(s) 206A / 206B optionally include one or more visible light image sensors, such as charge-coupled device (CCD) sensors and / or complementary metal-oxide semiconductor (CMOS) sensors, operable to acquire images of physical objects from the real-world environment. Image sensor(s) 206A / 206B also optionally include one or more infrared (IR) sensors, such as passive or active IR sensors, for detecting infrared light from the real-world environment. For example, an active IR sensor includes an IR emitter for emitting infrared light into the real-world environment. Image sensor(s) 206A / 206B also optionally include one or more cameras configured to capture movement of physical objects in the real-world environment. Image sensor(s) 206A / 206B also optionally include one or more depth sensors configured to detect the distance of a physical object from electronic device 260 / 270. In some examples, information from the one or more depth sensors may enable the device to identify an object in the real-world environment and distinguish it from other objects in the real-world environment. In some examples, the one or more depth sensors may enable the device to determine the texture and / or topography of an object in the real-world environment.

[0046] In some examples, the electronic devices 260 and 270 use a combination of a CCD sensor, an event camera, and a depth sensor to detect the physical environment around the electronic devices 260 and 270. In some examples, the image sensor(s) 206A / 206B include a first image sensor and a second image sensor. The first image sensor and the second image sensor cooperate and are optionally configured to capture different information of physical objects in the real-world environment. In some examples, the first image sensor is a visible light image sensor and the second image sensor is a depth sensor. In some examples, the electronic devices 260 / 270 use the image sensor(s) 206A / 206B to detect the position and orientation of the electronic devices 260 / 270 and / or the display generating component(s) 214A / 214B within the real-world environment. For example, electronic device 260 / 270 uses image sensor(s) 206A / 206B to track the position and orientation of display generating component(s) 214A / 214B relative to one or more fixed objects in the real-world environment.

[0047] In some examples, electronic device 260 / 270 includes microphone(s) 213A / 213B or other audio sensors. Device 260 / 270 uses microphone(s) 213A / 213B to detect sounds from the user and / or the user's real-world environment. In some examples, microphone(s) 213A / 213B include an array of microphones (multiple microphones) optionally working in concert, such as to identify ambient noise or to localize a sound source within a space in the real-world environment.

[0048] In some examples, the device 260 / 270 includes location sensor(s) 204A / 204B and / or display generation component(s) 214A / 214B for detecting the location of the device 260 / 270. For example, the location sensor(s) 204A / 204B may include a Global Positioning System (GPS) receiver that receives data from one or more satellites, allowing the electronic device 260 / 270 to determine the device's absolute position in the physical world.

[0049] In some examples, the electronic device 260 / 270 includes orientation sensor(s) 210A / 210B to detect the orientation and / or movement of the electronic device 260 / 270 and / or the display generating component(s) 214A / 214B. For example, the electronic device 260 / 270 uses the orientation sensor(s) 210A / 210B to track changes in the position and / or orientation of the electronic device 260 / 270 and / or the display generating component(s) 214A / 214B relative to physical objects in a real-world environment, etc. The orientation sensor(s) 210A / 210B optionally include one or more gyroscopes and / or one or more accelerometers.

[0050] Electronic device 260 / 270, in some examples, includes hand tracking sensor(s) 202A / 202B and / or eye tracking sensor(s) 212A / 212B (and / or other body tracking sensor(s), such as leg, torso, and / or head tracking sensor(s)). Hand tracking sensor(s) 202A / 202B are configured to track the position / location of one or more parts of a user's hand and / or the movement of one or more parts of a user's hand relative to the extended reality environment, relative to display generating component(s) 214A / 214B, and / or relative to another defined coordinate system. The eye tracking sensor(s) 212A / 212B are configured to track the position and movement of a user's gaze (more generally, eyes, face, or head) relative to the real world or extended reality environment and / or relative to the display generation component(s) 214A / 214B. In some examples, the hand tracking sensor(s) 202A / 202B and / or the eye tracking sensor(s) 212A / 212B are implemented together with the display generation component(s) 214A / 214B. In some examples, the hand tracking sensor(s) 202A / 202B and / or the eye tracking sensor(s) 212A / 212B are implemented separately from the display generation component(s) 214A / 214B.

[0051] In some examples, hand tracking sensor(s) 202A / 202B (and / or other body tracking sensor(s), such as leg, torso, and / or head tracking sensor(s)) can use image sensor(s) 206A / 206B (e.g., one or more IR cameras, 3D cameras, depth cameras, etc.) to capture three-dimensional information from the real world, including one or more body parts (e.g., the hands, legs, or torso of a human user). In some examples, the hand can be resolved with sufficient resolution to distinguish fingers and their respective positions. In some examples, the one or more image sensor(s) 206A / 206B are positioned relative to the user to define the field of view of the image sensor(s) 206A / 206B and an interaction space in which the position, orientation, and / or movement of the fingers / hands captured by the image sensor(s) are used as input (e.g., to distinguish from the user's stationary hand or other hands of other people in the real-world environment). Tracking fingers / hands for input (e.g., gestures, touches, taps, etc.) can be advantageous in that it does not require the user to touch, hold, or wear any kind of beacon, sensor, or other marker.

[0052] In some examples, the eye tracking sensor(s) 212A / 212B include at least one eye tracking camera (e.g., an infrared (IR) camera) and / or an illumination source (e.g., an IR light source such as an LED) that emits light toward the user's eyes. The eye tracking camera may be aimed at the user's eyes to receive reflected IR light from the light source directly or indirectly from the eyes. In some examples, both eyes are tracked separately by respective eye tracking cameras and illumination sources, and focus / gaze can be determined from tracking of both eyes. In some examples, one eye (e.g., a dominant eye) is tracked by one or more respective eye tracking cameras / illumination sources.

[0053] 2 and may include fewer, other, or additional components in multiple configurations. In some examples, system 201 may be implemented in a single device. In some examples, system 201 is implemented in multiple devices. One or more people using system 201 are optionally referred to herein as one or more users of the device(s).

[0054] Attention now turns to exemplary simultaneous displays of three-dimensional environments on a first electronic device (e.g., corresponding to electronic device 260) and a second electronic device (e.g., corresponding to electronic device 270). As described below, the first electronic device can communicate with the second electronic device in a multi-user communication session. In some examples, an avatar (e.g., a representation) of a user of the first electronic device may be displayed within the three-dimensional environment at the second electronic device, and an avatar of a user of the second electronic device may be displayed within the three-dimensional environment at the first electronic device.

[0055] 3 illustrates an example of a spatial group 340 in a multi-user communication session including a first electronic device 360 ​​and a second electronic device 370, according to some examples of the present disclosure. In some examples, the first electronic device 360 ​​may present a three-dimensional environment 350A, and the second electronic device 370 may present a three-dimensional environment 350B. The first electronic device 360 ​​and the second electronic device 370 may be similar to the electronic devices 101 or 260 / 270 and / or may be head-mountable and / or projection-based systems / devices (including hologram-based systems / devices) configured to generate and present three-dimensional environments, such as, for example, a head-up display (HUD), a head-mounted display (HMD), a window with integrated display capabilities, a display formed as a lens designed to be placed over a person's eye (e.g., similar to a contact lens), etc. In the example of FIG. 3, a first user is optionally wearing a first electronic device 360 ​​and a second user is optionally wearing a second electronic device 370, so that the three-dimensional environment 350A / 350B can be defined by X, Y, and Z axes as seen from the perspective of the electronic devices (e.g., a viewpoint associated with electronic device 360 / 370, which may be a head-mounted display).

[0056] 3 , first electronic device 360 ​​may be in a first physical environment that includes table 306 and window 309. Thus, three-dimensional environment 350A presented using first electronic device 360 ​​optionally includes captured portions of the physical environment surrounding first electronic device 360, such as a representation of table 306′ and a representation of window 309′. Similarly, second electronic device 370 may be in a second physical environment that is different from (e.g., separate from) the first physical environment, including floor lamp 307 and coffee table 308. Thus, three-dimensional environment 350B presented using second electronic device 370 optionally includes captured portions of the physical environment surrounding second electronic device 370, such as a representation of floor lamp 307′ and a representation of coffee table 308′. Additionally, the three-dimensional environments 350A and 350B may include representations of the floor, ceiling, and walls of the rooms in which the first electronic device 360 ​​and the second electronic device 370 are located, respectively.

[0057] As described above, in some examples, the first electronic device 360 ​​is optionally in a multi-user communication session with the second electronic device 370. For example, the first electronic device 360 ​​and the second electronic device 370 are configured (e.g., via the communication circuits 222A / 222B) to present a shared three-dimensional environment 350A / 350B that includes one or more shared virtual objects (e.g., content such as images, video, audio, a representation of an application's user interface, etc.). As used herein, the term "shared three-dimensional environment" refers to a three-dimensional environment independently presented, displayed, and / or viewed via two or more electronic devices, in which content, applications, data, etc. may be shared and / or presented to users of the two or more electronic devices. In some examples, while the first electronic device 360 ​​is in a multi-user communication session with the second electronic device 370, an avatar corresponding to a user of one electronic device is optionally displayed within the three-dimensional environment displayed via the other electronic device. 3, at first electronic device 360, avatar 315 corresponding to the user of second electronic device 370 is displayed within three-dimensional environment 350A. Similarly, at second electronic device 370, avatar 317 corresponding to the user of first electronic device 360 ​​is displayed within three-dimensional environment 350B. In some examples, three-dimensional environments 350A / 350B are spatially aligned.

[0058] In some examples, the presentation of avatar 315 / 317 as part of the shared three-dimensional environment is optionally accompanied by audio effects corresponding to the voice of the user of electronic device 370 / 360. For example, avatar 315 displayed within three-dimensional environment 350A using first electronic device 360 ​​is optionally accompanied by audio effects corresponding to the voice of the user of second electronic device 370. In some such examples, when the user of second electronic device 370 speaks, the user's voice may be detected by second electronic device 370 (e.g., via microphone(s) 213B) and transmitted to first electronic device 360 ​​(e.g., via communications circuitry 222B / 222A), such that the detected voice of the user of second electronic device 370 may be presented as audio (e.g., using speaker(s) 216A) to the user of first electronic device 360 ​​within three-dimensional environment 350A. In some examples, audio effects corresponding to the voice of the user of the second electronic device 370 may be spatialized to appear to the user of the first electronic device 360 ​​as emanating from the location of the avatar 315 within the shared three-dimensional environment 350A (e.g., despite being output from speakers of the first electronic device 360). Similarly, avatar 317 displayed within the three-dimensional environment 350B using the second electronic device 370 is, optionally, accompanied by audio effects corresponding to the voice of the user of the first electronic device 360. In some such examples, when a user of the first electronic device 360 ​​speaks, the user's voice may be detected by the first electronic device 360 ​​(e.g., via microphone(s) 213A) and transmitted to the second electronic device 370 (e.g., via communication circuitry 222A / 222B), so that the detected voice of the user of the first electronic device 360 ​​may be presented as audio (e.g., using speaker(s) 216B) to the user of the second electronic device 370 within the three-dimensional environment 350B.In some examples, audio effects corresponding to the voice of the user of the first electronic device 360 ​​may be spatialized so that they appear to the user of the second electronic device 370 to emanate from the location of the avatar 317 within the shared three-dimensional environment 350B (e.g., despite being output from the speakers of the first electronic device 360).

[0059] In some examples, during a multi-user communication session, avatars 315 / 317 are displayed in three-dimensional environments 350A / 350B with respective orientations that correspond to and / or are based on the orientation of electronic devices 360 / 370 (and / or the users of electronic devices 360 / 370) within the physical environment surrounding electronic devices 360 / 370. For example, as shown in FIG. 3 , in three-dimensional environment 350A, avatar 315 optionally faces toward the viewpoint of a user of first electronic device 360, and in three-dimensional environment 350B, avatar 317 optionally faces toward the viewpoint of a user of second electronic device 370. As a particular user moves their electronic device (and / or themselves) within the physical environment, the user's viewpoint changes accordingly, and therefore the orientation of the user's avatar within the three-dimensional environment may also change. For example, referring to FIG. 3 , if the user of the first electronic device 360 ​​looks leftward within the three-dimensional environment 350A such that the first electronic device 360 ​​is rotated (e.g., by a corresponding amount) to the left (e.g., counterclockwise), the user of the second electronic device 370 will see the avatar 317 corresponding to the user of the first electronic device 360 ​​rotate to the right (e.g., clockwise) relative to the perspective of the user of the second electronic device 370 as the first electronic device 360 ​​moves.

[0060] Additionally, in some examples, during a multi-user communication session, the viewpoint of three-dimensional environment 350A / 350B and / or the location of the viewpoint of three-dimensional environment 350A / 350B optionally change in accordance with movement of electronic device 360 / 370 (e.g., by the user of electronic device 360 / 370). For example, if during a communication session, first electronic device 360 ​​is moved closer toward table 306′ and / or representation of avatar 315 (e.g., because the user of first electronic device 360 ​​has moved forward in the physical environment surrounding first electronic device 360), the viewpoint of three-dimensional environment 350A changes accordingly, such that representation of table 306′, representation of window 309′, and avatar 315 appear larger in the field of view. In some examples, each user may interact with three-dimensional environment 350A / 350B independently, such that changes in perspective of three-dimensional environment 350A and / or interactions with virtual objects in three-dimensional environment 350A by first electronic device 360, optionally, do not affect what is shown in three-dimensional environment 350B at second electronic device 370, and vice versa.

[0061] In some examples, the avatar 315 / 317 is a representation (e.g., a full-body rendering) of the user of the electronic device 370 / 360. In some examples, the avatar 315 / 317 is a representation of a portion of the user of the electronic device 370 / 360 (e.g., a rendering of the head, hand(s), face, head and torso, etc.). In some examples, the avatar 315 / 317 is a user-personalized, user-selected, and / or user-created representation displayed within the three-dimensional environment 350A / 350B representing the user of the electronic device 370 / 360. While the avatars 315 / 317 shown in FIG. 3 correspond to full-body representations of the user of the electronic device 370 / 360, respectively, it should be understood that alternative avatars, such as those described above, may be provided.

[0062] As described above, while first electronic device 360 ​​and second electronic device 370 are in a multi-user communication session, three-dimensional environment 350A / 350B may be a shared three-dimensional environment presented using electronic devices 360 / 370. In some examples, content viewed by one user at one electronic device may be shared with another user at another electronic device in the multi-user communication session. In some such examples, content may be experienced (e.g., viewed and / or interacted with) by both users (e.g., via their respective electronic devices) within the shared three-dimensional environment. For example, as shown in FIG. 3 , three-dimensional environment 350A / 350B includes a shared virtual object 310 (e.g., optionally a three-dimensional virtual sculpture) that is viewable by and interactive with both users. As shown in FIG. 3 , shared virtual object 310 may be displayed with a grabber affordance (e.g., handlebars) 335 that can be selected to initiate movement of shared virtual object 310 within three-dimensional environment 350A / 350B.

[0063] In some examples, three-dimensional environment 350A / 350B includes non-shared content that is private to one user in a multi-user communication session. For example, in FIG. 3 , first electronic device 360 ​​displays a private application window 330 within three-dimensional environment 350A, which is, optionally, an object that is not shared between first electronic device 360 ​​and second electronic device 370 in the multi-user communication session. In some examples, private application window 330 may be associated with an individual application (e.g., a media player application, a web browsing application, a messaging application, etc.) running on first electronic device 360. Because private application window 330 is not shared with second electronic device 370, second electronic device 370 optionally displays a representation of private application window 330″ within three-dimensional environment 350B. As shown in FIG. 3 , in some examples, the representation of the private application window 330″ may be a faded, occluded, discolored, and / or translucent representation of the private application window 330 that prevents a user of the second electronic device 370 from viewing the content of the private application window 330.

[0064] As described above, in some examples, the user of the first electronic device 360 ​​and the user of the second electronic device 370 are in a spatial group 340 within a multi-user communication session. In some examples, the spatial group 340 may be a baseline (e.g., first or default) spatial group within the multi-user communication session. For example, when the user of the first electronic device 360 ​​and the user of the second electronic device 370 initially join the multi-user communication session, the user of the first electronic device 360 ​​and the user of the second electronic device 370 are automatically (and initially, as described in more detail below) associated (e.g., grouped) with the spatial group 340 within the multi-user communication session. In some examples, while the users are in the spatial group 340 as shown in FIG. 3 , the user of the first electronic device 360 ​​and the user of the second electronic device 370 have a first spatial arrangement (e.g., a first spatial template) within the shared three-dimensional environment. For example, the user of the first electronic device 360 ​​and the user of the second electronic device 370, including the objects displayed in the shared three-dimensional environment, have spatial authenticity within the spatial group 340. In some examples, spatial authenticity requires consistent spatial placement between the users (or their representations) and the virtual objects. For example, the distance between the viewpoint of the user of the first electronic device 360 ​​and the avatar 315 corresponding to the user of the second electronic device 370 may be the same as the distance between the viewpoint of the user of the second electronic device 370 and the avatar 317 corresponding to the user of the first electronic device 360. As described herein, if the location of the viewpoint of the user of the first electronic device 360 ​​moves, the avatar 317 corresponding to the user of the first electronic device 360 ​​moves within the three-dimensional environment 350B according to the movement of the location of the user's viewpoint relative to the viewpoint of the user of the second electronic device 370.Additionally, when a user of first electronic device 360 ​​performs an interaction on shared virtual object 310 (e.g., moves virtual object 310 within three-dimensional environment 350A), second electronic device 370 changes the display of shared virtual object 310 within three-dimensional environment 350B in accordance with the interaction (e.g., moves virtual object 310 within three-dimensional environment 350B).

[0065] It should be understood that in some examples, more than two electronic devices may be communicatively linked in a multi-user communication session. For example, in a situation where three electronic devices are communicatively linked in a multi-user communication session, a first electronic device will display two avatars, rather than just one avatar, corresponding to the users of the other two electronic devices. Thus, it should be understood that the various processes and example interactions described herein with reference to first electronic device 360 ​​and second electronic device 370 in a multi-user communication session optionally apply to a situation where more than two electronic devices are communicatively linked in a multi-user communication session.

[0066] In some examples, it may be advantageous to provide mechanisms for facilitating multi-user communication sessions involving collocated and non-collocated users (e.g., collocated and non-collocated electronic devices associated with the user). For example, it may be desirable to enable a user collocated in a first physical environment to establish a multi-user communication session with one or more users not collocated in the first physical environment, whereby virtual content may be shared and presented within a three-dimensional environment that is optionally viewable by and / or interactive with the collocated and non-collocated users in the multi-user communication session. As used herein, with respect to the first electronic device, a collocated user corresponds to a local user, and a non-collocated user corresponds to a remote user. As also described above, the three-dimensional environment optionally includes avatars corresponding to remote users of non-collocated electronic devices in the multi-user communication session. In some examples, the presentation of virtual objects (e.g., avatars and shared virtual content) in a three-dimensional environment within a multi-user communication session including co-located and non-co-located users (e.g., relative to a first electronic device) is based on the position and / or orientation of the co-located users in the physical environment of the first electronic device. Note that if a first user in a multi-user communication session is a remote user with respect to a second user in the multi-user communication session, the second user is a remote user with respect to the first user, and if the first user is a co-located user with respect to the second user, the second user is a co-located user with respect to the first user.

[0067] 4A-4H generally illustrate examples of changing the mode of a visual representation of a user in a multi-user communication session in response to detecting that the user has changed from being a remote user in the multi-user communication session to being a co-located user in the multi-user communication session, or in response to detecting that the user has changed from being a co-located user in the multi-user communication session to being a non-co-located user in the multi-user communication session, according to some examples of the present disclosure.

[0068] 4A-4H, the multi-user communication session includes users 402, 404, and 406, each of which is in a multi-user communication session via a respective electronic device 101a / 101b / 101c. In some examples, while electronic device 101a is in a multi-user communication session with electronic device 101b and electronic device 101c, a first three-dimensional environment (e.g., three-dimensional environment 450A) is presented using electronic device 101a (e.g., via display 120a), a second three-dimensional environment is presented using electronic device 101b (e.g., via a display in communication with electronic device 101b), and a third three-dimensional environment is presented using electronic device 101c (e.g., via a display in communication with electronic device 101c). In some examples, electronic devices 101a / 101b optionally correspond to or are similar to electronic devices 360 / 370 described above and / or electronic devices 260 / 270 of Figure 2. Additionally, electronic device 101c optionally includes one or more characteristics of electronic devices 360 / 370 described above and / or electronic devices 260 / 270 of Figure 3. In some examples, as shown in Figure 4A, electronic device 101a is being used (e.g., worn on the head) by a first user 402, electronic device 101b is being used (e.g., worn on the head) by a second user 404, and electronic device 101c is being used (e.g., worn on the head) by a third user 406.

[0069] 4A, top view 410 shows users 402 / 404 (e.g., with their electronic devices 101a / 101b) in a first room and user 406 (e.g., with electronic device 101c) in a different room. Top view 410 also shows a physical door 408 between the first room in which users 402 / 404 (e.g., with their electronic devices 101a / 101b) are co-located and a second room in which user 406 (e.g., with electronic device 101c) resides. The first room, optionally, corresponds to a first physical environment (e.g., physical environment 400), and the second room, optionally, corresponds to a second physical environment different from the first physical environment.

[0070] 4A , electronic device 101a and electronic device 101b are co-located within physical environment 400 (e.g., share the visual space of physical environment 400). For example, electronic devices 101a / 101b are both located in the same room on a first side of physical door 408. In FIG. 4A , electronic devices 101a / 101b optionally share the visual space of physical environment 400, in addition to optionally sharing the audio space of physical environment 400. For example, in FIG. 4A , electronic device 101a optionally presents user 404 and electronic device 101b via display 120a because electronic device 101a faces user 404 and electronic device 101b (e.g., user 404 and electronic device 101b are within the field of view of electronic device 101a). In some examples, the presentation of user 404 and electronic device 101b via electronic device 101a is an optical pass-through presentation (or another type of pass-through presentation). For example, one or more portions of display 120a are optionally at least partially transparent such that one or more objects in physical environment 400 within the field of view of electronic device 101a are visible through one or more (e.g., transparent or translucent) portions of display 120a. As another example, when the presentation of user 404 and electronic device 101b is a video pass-through presentation, electronic device 101a optionally captures one or more portions of the physical environment via one or more cameras in communication with electronic device 101a and displays images of the captured portions via display 120a, including portions of the physical environment in which user 404 and electronic device 101b are located.

[0071] As described above with reference to Figure 3, while electronic devices are communicatively linked in a multi-user communication session, users may be represented by avatars corresponding to the users of the electronic devices. In Figure 4A, electronic devices 101a and 101b are co-located in physical environment 400, so the users of electronic devices 101a and 101b are represented in the multi-user communication session via their physical personas (e.g., bodies) that are visible in a pass-through of physical environment 400 (e.g., rather than via virtual avatars). For example, as shown in Figure 4A, second user 404 is visible in the field of view of electronic device 101a (first user 402 is optionally visible in the field of view of electronic device 101b while electronic devices 101a and 101b are in the multi-user communication session).

[0072] 4A , electronic device 101a displays via display 120a spatial avatar 405a (e.g., a three-dimensional representation of user 406's visual appearance) corresponding to user 406, who is in a multi-user communication session via electronic device 101c. Relative to user 402 and user 404 (e.g., relative to electronic devices 101a / 101b), user 406 is a remote user in the multi-user communication session. In other words, electronic device 101c is optionally not co-located with electronic devices 101a / 101b. Spatial avatar 405a of user 406 in the multi-user communication session of FIG. 4A optionally includes one or more features of avatar 315 of FIG. 3 and, optionally, is accompanied by audio effects corresponding to the voice of user 406, as described with reference to avatar 315 of FIG. 3 . Thus, in some examples, non-co-located users in a multi-user communication session are displayed as virtual three-dimensional objects.

[0073] The multi-user communication session of Figure 4A also includes shared content 409 that is visible and / or interactable between users of the multi-user communication session from their respective three-dimensional environments. For example, electronic devices 101a / 101b / 101c optionally present shared content 409 (e.g., a virtual cube). In some examples, the multi-user communication session of Figure 4A is initiated in response to input from one of users 402-406 to share content 409 with the other users 402-406. Shared content 409 represents visual content, such as a presentation, a movie, and / or audio. Shared content 409 optionally includes one or more features described with reference to shared virtual object 310 of Figure 3.

[0074] 4A-4B show an example of electronic device 101a maintaining the location of the representation of spatial avatar 405a of user 406 on electronic device 101c in response to movements of user 406 that do not result in user 406 being co-located with users 402 / 404. In the illustrated example of FIGS. 4A-4B, the location of user 406 within the user's 406's individual physical environment changes, but the location of the representation of spatial avatar 405a, which corresponds to the user's 406's visual appearance as displayed by electronic device 101a, is maintained. Alternatively, it should be noted that in some examples, the location of the representation of spatial avatar 405a changes in response to the user's 406's movements in the user's 406's physical environment. For example, if movement of user 406 brings user 406 closer to the visual appearance of user 402 displayed by electronic device 101c, a corresponding change in the distance between avatar 405a of user 406 and user 402 is optionally displayed via electronic devices 101a, 101b, and / or 101c, as also described above with reference to Figure 3. Thus, the visual appearance of the remote user optionally includes one or more characteristics of those described above with reference to avatar 315 of Figure 3.

[0075] FIG. 4C illustrates an example of an electronic device 101a displaying a representation 405b (e.g., a two-dimensional representation) of a remote user 406 in place of the remote user's 406 spatial avatar 405a. In some examples, the representation 405b includes a live camera feed from an image capture device in communication with the electronic device 101c. As shown in the top view 410 of FIGS. 4A-4C, the representation 405b of the user 406 of the electronic device 101c optionally consumes less space (e.g., less surface area or volume) than the spatial avatar 405a of the user 406 of the electronic device 101c within the environment (e.g., an augmented reality environment) viewable via the display 120a. Thus, in some examples, non-colocated users in a multi-user communication session are displayed as virtual two-dimensional objects. In some examples, non-colocated users in a multi-user communication session are displayed as virtual two-dimensional objects in response to input provided by the user 406 specifying that they be so represented within the multi-user communication session. For example, user 406 of electronic device 101c has optionally selected an option to be represented non-spatially without an avatar (e.g., displayed on electronic device 101c) rather than spatially with an avatar. In some examples, electronic device 101a transitions between displaying a representation 405b of user 406 of electronic device 101c and displaying a spatial avatar 405a of user 406 of electronic device 101c, as described further below with reference to Figures 4G and 4H.

[0076] In some examples, electronic device 101a detects that electronic device 101c is co-located with electronic device 101a. For example, while displaying via display 120a a spatial avatar 405a or representation 405b of user 406 of electronic device 101c, electronic device 101a detects an event corresponding to the co-location of electronic devices 101a / 101c. For example, electronic device 101a optionally detects that electronic device 101c shares a visual and / or audio space of physical environment 400 with electronic device 101a. In response, electronic device 101a ceases displaying spatial avatar 405a of user 406 of electronic device 101c, as shown in FIGS. 4B-4D .

[0077] 4B through 4D (e.g., or from FIG. 4C to 4D), electronic device 101c enters physical environment 400. For example, user 406 of electronic device 101c has walked through physical door 408. In some examples, in response to determining that user 406 is in physical environment 400, which is the same environment as user 402, electronic device 101a determines that electronic device 101c is co-located with electronic device 101a (e.g., shares the visual space of physical environment 400) and presents user 406 of electronic device 101c via display 120a, such as via optical pass-through, as shown in the presentation of user 406 via display 120a in FIG.

[0078] In some examples, the determination that electronic device 101a and electronic device 101c are co-located in physical environment 400 is based on the distance between electronic device 101a and electronic device 101c. For example, in Figure 4D, electronic device 101a and electronic device 101c are co-located in physical environment 400 because electronic device 101a is within a threshold distance (e.g., 0.1, 0.5, 1, 2, 3, 5, 10, 15, 20 meters, etc.) of electronic device 101c.

[0079] In some examples, the determination that electronic device 101a and electronic device 101c are co-located in physical environment 400 is based on the distance between electronic device 101a and electronic device 101c. For example, in FIG. 4D , electronic device 101a and electronic device 101c are configured to communicate (e.g., wirelessly via Bluetooth, Wi-Fi, or a server (e.g., a wireless communication terminal), etc.). In some examples, electronic device 101a and electronic device 101c are connected to the same wireless network within physical environment 400, and co-location is optionally based on electronic devices 101a / 101c being connected to the same network (e.g., the same wireless network, such as block 430a in FIG. 4O), such that when electronic devices 101a / 101c are co-located within physical environment 400, electronic devices 101a / 101c are optionally connected to the same wireless network, and when electronic devices 101a / 101c are not co-located within a multi-user communication session, electronic devices 101a / 101c are not connected to the same wireless network.

[0080] In some examples, the determination that electronic device 101a and electronic device 101c are co-located in physical environment 400 is based on the strength of wireless signals transmitted between electronic devices 101a and 101c. For example, in Figure 4D, electronic device 101a and electronic device 101c are co-located in physical environment 400 because the strength of the Bluetooth® signal (or other wireless signal) transmitted between electronic devices 101a and 101c is greater than a threshold strength.

[0081] In some examples, the determination that electronic device 101a and electronic device 101c are co-located in physical environment 400 is based on visual detection (e.g., block 430d of FIG. 4O) of electronic devices 101a and 101b in physical environment 400. For example, as shown in FIG. 4D, electronic device 101c is positioned within the field of view of electronic device 101a (e.g., because a third user 406 is standing within the field of view of electronic device 101a, as is a second user 404), which enables electronic device 101a to visually detect (e.g., identify or scan, such as via object detection or other image processing techniques) electronic device 101c (e.g., within one or more images captured by electronic device 101a, such as via external image sensors 114b-i and 114c-i). Similarly, as shown in FIG. 4D , electronic device 101a is optionally positioned within the field of view of electronic device 101c (e.g., because first user 402 is within the field of view of electronic device 101c), thereby enabling electronic device 101c to visually detect electronic device 101a (e.g., within one or more images captured by electronic device 101c, such as via an external image sensor in communication with electronic device 101c (e.g., an external image sensor having one or more characteristics of external image sensors 114b-i and 114c-i, but in communication with electronic device 101c instead of electronic device 101a)).

[0082] In some examples, the determination that electronic device 101a and electronic device 101c are co-located within physical environment 400 is based on overlapping simultaneous localization and mapping (SLAM) data (e.g., block 430b of FIG. 4O) exchanged between electronic device 101a and electronic device 101c (e.g., SLAM data stored individually on electronic devices 101a and 101c, or SLAM data stored on one of electronic devices 101a and 101b). For example, electronic device 101a and electronic device 101c optionally utilize the SLAM data to facilitate a shared understanding of one or more physical characteristics of physical environment 400, such as the dimensions of the physical environment, physical objects within the physical environment, and the visual appearance of the physical environment (e.g., color and lighting characteristics). In some examples, electronic device 101a and electronic device 101c are each configured to analyze physical environment 400 based on one or more characteristics of the other electronic device as individually perceived by the electronic device to determine a common reference point (e.g., a shared reference point or object) within physical environment 400. For example, based on one or more images captured via external image sensors 114b-i and 114c-i, electronic device 101a analyzes the position of electronic device 101c within the physical environment relative to the viewpoint of electronic device 101a, and based on one or more images captured via an external image sensor in communication with electronic device 101c, electronic device 101c analyzes the position of electronic device 101a within physical environment 400 relative to the viewpoint of user 406 to establish spatial authenticity. In some examples, the electronic device 101a detects overlapping SLAM maps between the first electronic device 101a and the third electronic device 101c, and / or the electronic device 101c detects overlapping SLAM maps between the first electronic device 101a and the third electronic device 101c.

[0083] In some examples, the determination that electronic device 101a and electronic device 101c are co-located within physical environment 400 is based on a determination that electronic devices 101a / 101c share an audio space of the physical environment. For example, electronic devices 101a / 101c optionally share an audio space of the physical environment if audio data detected by one or more first microphones communicating with electronic device 101a is also detected by one or more second microphones communicating with electronic device 101c. As another example, electronic devices 101a / 101c optionally emit particular sounds, such as particular sounds undetectable by the human ear, and electronic devices 101a / 101c are determined to be co-located in response to an individual electronic device (e.g., one of electronic devices 101a / 101c) detecting the sound emitted by speaker(s) communicating with the other electronic device.

[0084] In some examples, electronic devices 101a and 101b have been determined to be co-located in a manner similar to that described above with reference to FIG. 4D and the determination of the co-location of electronic devices 101a and 101c.

[0085] 4O is a block diagram illustrating various features of a multi-user communication session from the perspective of co-located electronic devices, according to some examples. In some examples, the co-located electronic devices in the multi-user communication session are connected (at block 430a) to the same network, such as the same wireless local area network, Wi-Fi, etc., as described above. In some examples, the co-located electronic devices in the multi-user communication session have overlap in the respective SLAM maps associated with the co-located electronic devices (at block 430b), as described above. In some examples, the co-located electronic devices in the multi-user communication session share (at block 430c) the audio space of the electronic devices' physical environment, as described above. In some examples, the co-located electronic devices in the multi-user communication session share (at block 430d) the visual space of the electronic devices' physical environment, as described above with reference to visual detection of the physical environment (e.g., objects and / or walls and / or other physical spatial signatures within the physical environment). In some examples, these co-located electronic devices in a multi-user communication session present representations of the users of the co-located electronic devices via optical pass-through, as described above (at block 430e).

[0086] 4D , in some examples, in response to determining that user 406 (e.g., electronic device 101c) is within physical environment 400, the same environment as user 402, during a multi-user communication session, electronic device 101a determines that electronic device 101c is co-located with electronic device 101a (e.g., sharing the visual space of physical environment 400), ceases displaying spatial avatar 405a, and presents user 406 via display 120a, such as via optical pass-through, as illustrated by the presentation of user 406 of electronic device 101c via display 120a in FIG. 4D . Thus, in response to electronic device 101a detecting that electronic device 101c is co-located with electronic device 101a, electronic device 101a changes the visual appearance of user 406 within the three-dimensional environment viewable through display 120a of electronic device 101a. In some examples, electronic device 101a utilizes fewer computational resources in presenting user 406 when user 406 is co-located compared to when user 406 is remote. For example, when user 406 is remote, electronic device 101a displays a virtual representation of user 406 (e.g., spatial avatar 405a or representation 405b), and when user 406 is co-located (e.g., sharing the visual space of physical environment 400 with electronic device 101a), electronic device 101a ceases displaying the virtual representation of user 406 (e.g., spatial avatar 405a or representation 405b) and, optionally, presents user 406 via an optical pass-through, which is optionally less resource-intensive. Thus, in some examples, electronic device 101a changes the appearance of user 406 in the three-dimensional environment visible through display 120a in response to electronic device 101c transitioning from remote to co-located in physical environment 400 during a multi-user communication session.In some examples, if the user 406 of the electronic device 101c is not within the field of view of the electronic device 101a when the user 406 of the electronic device 101c enters the physical environment 400, the electronic device 101a maintains a presentation of a spatial avatar 405a or representation 405b of the user 406 of the electronic device 101c, and then moves the user 406 of the electronic device 101c to a position within the field of view of the electronic device 101a, or moves the user 406 of the electronic device 101c to a position within the field of view of the electronic device 101a. When user 406 of electronic device 101c comes within (e.g., enters) the field of view of electronic device 101a, such as by movement of user 402 of electronic device 101a causing them to enter (e.g., head rotation of user 402 changing what is in the field of view of electronic device 101a), electronic device 101a ceases displaying spatial avatar 405a or representation 405b of user 406 of electronic device 101c and presents user 406 via optical pass-through when the user is within the field of view of electronic device 101a. Thus, in some examples, a determination that electronic device 101a and electronic device 101c are co-located is further based on user 406 of electronic device 101c being within the field of view of electronic device 101a. In some examples, when electronic devices 101a / 101c are determined to be co-located, even if electronic device 101c ceases to be within the field of view of electronic device 101a, electronic device 101a maintains optical pass-through enablement for user 406 of electronic device 101c and optionally does not present spatial avatar 405a or representation 405b of user 406 until it is determined that electronic devices 101a / 101c are no longer co-located. Thus, in some examples, after determining that two electronic devices are co-located, a determination that the electronic devices are no longer co-located includes additional criteria (e.g., cessation of SLAM map overlap and / or another criterion) beyond a determination that one of the two electronic devices is not within the field of view of the other electronic device.Alternatively, in some examples, after determining that two electronic devices are co-located, determining that the electronic devices are no longer co-located does not involve any additional criteria beyond determining that one of the two electronic devices is not within the field of view of the other electronic device.

[0087] 4D to 4E, user 406 (and electronic device 101c) leaves physical environment 400, while user 402 (and electronic device 101a) remains within physical environment 400 while remaining in the multi-user communication session (i.e., between users 402-406 (via electronic devices 101a-101c)). Thus, in FIG. 4E, electronic device 101a and electronic device 101c no longer share the visual space of physical environment 400 because electronic device 101c is on the other side of physical door 408 (e.g., an opaque door), which is shown as closed in FIG. 4E. Electronic device 101a, optionally, determines that electronic device 101c is no longer co-located with electronic device 101c while electronic device 101c remains in the multi-user communication session with electronic device 101c. In response, electronic device 101a begins displaying, via display 120a, a virtual representation of user 406, as shown by spatial avatar 405a in FIG. 4E, or alternatively, representation 405b as shown in FIG. 4F. Thus, in some examples, electronic device 101a, optionally, transitions between presenting a pass-through representation of the co-located user and displaying a representation of the remote user in response to detecting that the user is no longer co-located in physical environment 400 with electronic device 101a during the multi-user communication session. Thus, in some examples, electronic device 101a changes the visual appearance of a user in a multi-user communication session with electronic device 101a in response to detecting that the user transitions from being a co-located user in the multi-user communication session to being a remote user in the multi-user communication session.

[0088] 4G and 4H show examples of electronic device 101a transitioning display modes of representations of users who are not co-located with electronic device 101a (e.g., the electronic device does not share the visual space of physical environment 400) in a multi-user communication session. In FIG. 4G, remote users who are not co-located with electronic device 101a (e.g., the electronic device does not share the visual space of the physical environment) in a multi-user communication session are represented by electronic device 101a as spatial avatars. For example, in FIG. 4G, electronic device 101a displays spatial avatars 415a, 417a, and 419a, each of which corresponds to a different remote user who is not co-located with electronic device 101a in physical environment 400. Additionally, in FIG. 4G, electronic device 101a displays spatial avatar 405a corresponding to user 406 who is not co-located with electronic device 101a in physical environment 400. Note that different users of different electronic devices corresponding to spatial avatars 415a, 417a, and 419a may or may not be co-located with each other, i.e., the fact that an electronic device is not co-located with electronic device 101a (e.g., not in physical environment 400) is, optionally, independent of whether the electronic devices are co-located with each other.

[0089] 4G-4H, user 427 of electronic device 101d participates in a multi-user communication session while co-located with electronic device 101a. For example, user 406 walks into physical environment 400 of user 402 through physical door 408, and user 427 initially participates in the multi-user communication session while co-located with user 402 of electronic device 101a. In response to detecting that an additional co-located user (e.g., user 427 of electronic device 101d) is in a multi-user communication session, electronic device 101a optionally transitions the display of the remote user's representation from spatial avatars 405a, 415a, 417a, and 419a to two-dimensional representations 405b, 415b, 417b, and 419b, similar to that described for representation 405b of user 406 in FIG. 4C. In this way, electronic device 101a conserves space within the three-dimensional environment visible through display 120a, thereby accommodating the representation of user 427 of electronic device 101d (e.g., because the pass-through representation of user 427 of electronic device 101d now occupies space within the three-dimensional environment of user 402 visible through display 120a). Additionally, to maintain full representations of remote users (e.g., users not co-located with electronic device 101a), electronic device 101a optionally rearranges the displays of representations 405b, 415b, 417b, and 419b of non-co-located users to accommodate the optical pass-through representation of user 427 of electronic device 101d (e.g., to fully present the user's persona based on their position within the field of view of electronic device 101a), as shown in FIG. Thus, in some examples, the electronic device 101a transitions the display of non-colocated users in a multi-user communication session from being represented as spatial avatars to being represented as two-dimensional objects in response to a threshold number of co-located users (e.g., 3, 5, 8, 10, 16, 20, or another number of co-located users) being present within the physical environment of the user of the electronic device 101a.Additionally or alternatively, in some examples, the electronic device 101a transitions the representation of remote users in the multi-user communication session from being represented as two-dimensional objects to being represented as spatial avatars in response to fewer than a threshold number of co-located users in the multi-user communication session being present in the physical environment 400 of the user 402 of the electronic device 101a. Thus, the determination of how to represent non-co-located users in the multi-user communication session (e.g., users remote to the electronic device 101a) is optionally based on the number of co-located users in the multi-user communication session with the electronic device 101a. Furthermore, displaying non-co-located users as two-dimensional representations conserves computing resources at the electronic device 101a (e.g., because displaying two-dimensional representations consumes less power than displaying three-dimensional (e.g., spatial) avatars, as described above).

[0090] Additionally or alternatively, in some examples, electronic device 101a transitions display modes of representations of users who are not collocated (e.g., whose electronic devices do not share the visual space of physical environment 400) with electronic device 101a in the multi-user communication session in response to detecting a change in the spatial state of the users in the colocated multi-user communication session in physical environment 400. In some examples, changing the spatial state of the users in the colocated multi-user communication session in physical environment 400 includes interacting with selectable options to control the spatial state of the colocated users (e.g., local users in physical environment 400) in the multi-user communication session. For example, as shown in FIG. 4G, electronic device 101a displays selectable options 435 in three-dimensional environment 450A concurrently with spatial avatars 415a, 417a, 405a, and 419a. In some examples, selectable option 435 is selectable to transition the spatial state of user 402 of electronic device 101a and user 404 of electronic device 101b during a multi-user communication session (e.g., because user 402 and user 404 are co-located in physical environment 400, as described above). For example, in FIG. 4G , electronic device 101a optionally detects a selection provided by user 402 directed at selectable option 435 in three-dimensional environment 450A, such as via an air pinch gesture performed by hand 403 of user 402 while user 402's line of sight 426 is directed at selectable option 435 in three-dimensional environment 450A. In some examples, when electronic device 101a detects selection of selectable option 435, user 402 and user 404 are spatial within the multi-user communication session (e.g., the spatial state is "spatial"), and as a result, electronic device 101a and electronic device 101b are experiencing spatial reality with a remote user within three-dimensional environment 450A (e.g., a user in the multi-user communication session who is not co-located with users 402 and 404 and is represented by representations 405a, 415a, 417a, and 419a in FIG. 4G), as discussed herein.

[0091] In some examples, as shown in FIG. 4H, in response to detecting a selection of selectable option 435, electronic device 101a transitions the spatial state of collocated users (e.g., user 402 and user 404 in physical environment 400) in the multi-user communication session from being spatial within the multi-user communication session to being non-spatial within the multi-user communication session (e.g., from a "spatial" spatial state to a "non-spatial" spatial state). In particular, in some examples, when user 402 of electronic device 101a and user 404 of electronic device 101b transition to participating non-spatially within the multi-user communication session, electronic device 101a and electronic device 101b no longer experience spatial reality with the remote users in the multi-user communication session, thereby causing electronic device 101a (e.g., and electronic device 101b) to transition their display of representations of the remote users from spatial avatars 405a, 415a, 417a, and 419a of FIG. 4G to two-dimensional representations 405b, 415b, 417b, and 419b of FIG. 4H, as described above (optionally regardless of user 427 participating in the multi-user communication session while co-located with user 402 of electronic device 101a). For example, as shown in FIG. 4H, because a local user (e.g., user 402, 404, and / or 427) in physical environment 400 no longer experiences spatial reality with the remote users in the multi-user communication session, selecting selectable option 435 (e.g., simultaneously) causes each of the remote users to no longer be represented spatially as avatars 405a, 415a, 417a, and 419a, but instead to be represented non-spatially as two-dimensional representations 405b, 415b, 417b, and 419b within three-dimensional environment 450A.4H , the local users continue to experience spatial reality with each other (e.g., via their respective electronic devices) even though they no longer experience spatial reality with the remote users in the multi-user communication session because they remain co-located within physical environment 400. Thus, in some examples, when the display of a representation of a remote user is transitioned from a spatial avatar to a two-dimensional representation at electronic device 101a in the manner discussed above, electronic devices 101b and / or 101d similarly transition the display of a representation of the remote user to a two-dimensional representation within their respective three-dimensional environments. For example, because users 404 and 427 and their respective electronic devices 101b and 101d are still co-located in physical environment 400 with user 402 of electronic device 101a and therefore continue to experience spatial authenticity with user 402 in three-dimensional environment 450A, the transitioning of the display of the remote user's representation at electronic device 101a is maintained across the co-located electronic devices during the multi-user communication session such that the manner in which the remote user's representation is displayed remains consistent across the co-located electronic devices (e.g., thereby preserving spatial authenticity within the multi-user communication session for the co-located users). Transitioning the display of the remote user's representation in the manner described above when the spatial state of the local user within the multi-user communication session is changed to non-spatial maintains a consistent experience for users within the multi-user communication session, including maintaining the consistency of the remote user's representation relative to the local user within the multi-user communication session, thereby improving user-device interaction.

[0092] In some examples, as shown in FIG. 4H, after transitioning the spatial state of the co-located users within physical environment 400, and therefore transitioning the display of the remote users' representations from spatial avatars 405a, 415a, 417a, and 419a to two-dimensional representations 405b, 415b, 417b, and 419b, electronic device 101a updates selectable options 435 to be selectable for controlling the display mode of the remote users' representations during the multi-user communication session. For example, as shown in FIG. 4H, selectable options 435 are updated to be selectable to transition the spatial state of a co-located user (e.g., user 402, 404, and / or 427) within physical environment 400 from non-spatial back to spatial (e.g., thus transitioning the display of the remote user's representation from two-dimensional representations 405b, 415b, 417b, and 419b back to spatial avatars 405a, 415a, 417a, and 419a), which allows the co-located user to once again experience spatial authenticity with the remote user in the multi-user communication session.

[0093] In some examples, selectable options 435 are available to (e.g., displayed for and / or selectable by) each of the users co-located within physical environment 400. For example, in FIG. 4G , electronic device 101a displays selectable options 435 within three-dimensional environment 450A, while electronic device 101b (e.g., associated with user 404) also and / or similarly displays selectable options 435 (e.g., within the three-dimensional environment presented at electronic device 101b). In some such examples, selection of selectable option 435 detected by electronic device 101b (e.g., provided by user 404 via an air pinch gesture, such as similarly described above) similarly transitions the spatial state of the co-located users within physical environment 400 from spatial to non-spatial within the multi-user communication session (e.g., thus transitioning the display of the remote user's representation from a spatial avatar to a two-dimensional representation at electronic device 101a). Similarly, in FIG. 4H, while user 427 of electronic device 101d is co-located with user 402 of electronic device 101a and user 404 of electronic device 101b in physical environment 400 during a multi-user communication session, electronic device 101d also and / or similarly displays selectable options 435 (e.g., within a three-dimensional environment presented at electronic device 101d).

[0094] In some examples, selectable options 435 are selectable by each of the co-located users in physical environment 400 to change the spatial state of the co-located users within the multi-user communication session, but the same selectable options (e.g., in function and / or usage) are, optionally, not selectable by a remote user (e.g., a user not co-located with user 402 of electronic device 101a in physical environment 400) to change the spatial state of the remote user within the multi-user communication session. For example, for an individual remote user, such as the user associated with spatial avatar 415a in FIG. 4G and two-dimensional representation 415b in FIG. 4H, the display of selectable options 435 (or similar options / user interface elements) is specific to the individual user at the individual electronic device. In particular, because the remote users associated with spatial avatar 415a of FIG. 4G and two-dimensional representation 415b of FIG. 4H are not co-located with user 402 of electronic device 101a (and / or optionally, any other users in the multi-user communication session) in physical environment 400, selectable options similar to selectable options 435 displayed by individual electronic devices associated with the remote users can be selected to individually control the display mode (e.g., and therefore spatiality) of their representations without affecting the display mode of representations of other remote users in the multi-user communication session (e.g., without affecting the spatial state of the other remote users).Thus, for example, referring to FIG. 4G, while the spatial state of co-located users (e.g., user 402 of electronic device 101a and user 404 of electronic device 101b) is spatial within a multi-user communication session, if an electronic device associated with a remote user represented by spatial avatar 415a detects an input to control the display mode of the remote user (e.g., an input directed to a selectable option similar to selectable option 435), spatial avatar 415a is transitioned to be re-displayed as two-dimensional representation 415b within three-dimensional environment 450A without changing the display mode (e.g., without transitioning the spatial state) of other representations of the remote user (e.g., without causing electronic device 101a to transition the display of two-dimensional representations 417b, 405b, and 419b back to the spatial avatar).

[0095] It should be understood that while the co-located users (e.g., users 402, 404, and / or 427) in physical environment 400 are non-spatial within the multi-user communication session of FIG. 4H , display of selectable options 435 (or similar options / user interface elements) is, optionally, not provided to remote users within the multi-user communication session. For example, because the local user is currently non-spatial within the multi-user communication session (e.g., thus leaving representations of the remote users displayed as two-dimensional representations within the multi-user communication session), individual remote users cannot individually transition to be spatial within the multi-user communication session with the local user in physical environment 400 in the manner discussed above. Alternatively, in some examples, the co-located users (e.g., users 402, 404, and / or 427) in physical environment 400 are non-spatial within the multi-user communication session of FIG. 4H , but a display of selectable option 435 (or similar option / user interface element) is provided to the remote users within the multi-user communication session specific to controlling their spatiality with one or more of the other remote users within the multi-user communication session. For example, an individual remote user can individually control its spatial state (e.g., spatial or non-spatial) via selection of selectable option 435 (or similar option / user interface element) for the other remote users within the multi-user communication session, such that the individual remote user is visually represented spatially (e.g., via a spatial avatar) relative to the other remote users within the multi-user communication session (e.g., regardless of the current spatiality of the other remote users within the multi-user communication session) when the individual remote user is spatial with the other remote users within the multi-user communication session (e.g., notwithstanding that the local users within physical environment 400 are non-spatial with the remote users within the multi-user communication session).Similarly, in some examples, when an individual remote user is non-spatial within a multi-user communication session (e.g., despite the local user in physical environment 400 being non-spatial with the remote users in the multi-user communication session), the individual remote user is visually represented non-spatially (e.g., via a two-dimensional representation) with respect to the other remote users in the multi-user communication session (e.g., regardless of the current spatiality of the other remote users in the multi-user communication session). In some examples, the multi-user communication session remains a non-spatial multi-user communication session (e.g., such that the local user does not experience spatial reality with the remote users in the multi-user communication session) until the individual local user selects selectable option 435 (e.g., FIG. 4H) to transition the local user's spatial state back to spatial (e.g., such that the multi-user communication session reverts to a spatial multi-user communication session, such that the local user again experiences spatial reality with the remote users, as described above).

[0096] Thus, as outlined above, providing a system and method for changing the visual appearance of a user in a multi-user communication session in response to detecting that the user transitions from being a remote user in the multi-user communication session to being a co-located user in the multi-user communication session, and / or vice versa, enables different display modes of a user in the multi-user communication session based on whether the user is a co-located user or a non-co-located user, thereby improving user-device interaction and efficiently utilizing computing resources. Furthermore, providing a remote user with a selectable option for changing the spatial state of a co-located user in a multi-user communication session enables the co-located user to quickly and effectively change the display mode of the remote user, which, as another benefit, helps to conserve display space within a three-dimensional environment and therefore computing resources.

[0097] 4I-4N illustrate examples of joining a user of an electronic device to an already active multi-user communication session between other users of other electronic devices, according to some examples of the present disclosure.

[0098] In some examples, a user of an electronic device (e.g., different from the user of electronic device 101a) participates in a multi-user communication session and is presented to the multi-user communication session in a manner based on whether the user of the electronic device is co-located with electronic device 101a. For example, if a participating user is not co-located with electronic device 101a, such as when user 427 of electronic device 101d (e.g., in top view 410) is not co-located with user 402 of electronic device 101a of FIG. 4I, electronic device 101a optionally displays a representation of the participating user of the electronic device in addition to generating audio corresponding to the participating user in the first manner (e.g., audio effects corresponding to the user's voice as described above); and if a participating user of an electronic device is co-located with electronic device 101a, such as when user 427 of electronic device 101d is co-located with user 402 of electronic device 101a of FIG. 4N, electronic device 101a optionally does not display a representation of the participating user of the electronic device that electronic device 101a would otherwise display if the participating user of the electronic device was not co-located with user 402 of electronic device 101a, and / or does not generate audio corresponding to the participating user of the electronic device in the same first manner.

[0099] In some examples, a user of an electronic device that participates in a multi-user communication session is not collocated with a user of an electronic device that is in the multi-user communication session, such as in FIG. 4I where user 427 of electronic device 101d is not collocated with user 402 of electronic device 101a, and the multi-user communication session in which the user of the electronic device participates was previously a multi-user communication session that was only between non-collocated users of electronic devices, such as only between user 402 of electronic device 101a and a user of an electronic device that is not collocated with electronic device 101a in FIG. 4I, and then electronic device 101a maintains functionality within the multi-user communication session as being not collocated with other users of electronic devices in the multi-user communication session, such as electronic device 101a displaying visual representations of non-collocated users of electronic devices that were in the multi-user communication session before joining the new non-collocated user, and maintaining the display of those representations, in addition to adding visual representations of the newly joined non-collocated users to the multi-user communication session in response to the joining of the user of the electronic device.

[0100] In some examples, a user of an electronic device that participates in a multi-user communication session is co-located with a user of an electronic device in the multi-user communication session, such as when the participating user is user 404 of electronic device 101b in FIG. 4I who is co-located with user 402 of electronic device 101a, and the multi-user communication session in which the user of the electronic device participates was previously a multi-user communication session between a co-located user of the electronic device and a non-co-located user of the electronic device, such as between users 402 and 406 of electronic devices 101a / 101c, each co-located in FIG. 4J, and user 427 who is not co-located with users 402 and 404 in FIG. 4J, and then the electronic devices in the multi-user communication session, in response to the participation of the user of the electronic device, perform different operations based on whether the participating user is co-located with a previously co-located user of the electronic device or a user who is not co-located with any other user of the electronic device in the multi-user communication session. For example, when a request to add a new user to a multi-user communication session is accepted, if the multi-user communication session includes co-located users of a first set of electronic devices (e.g., co-located with each other) and non-co-located users of a second set of electronic devices, and if the participating users are co-located with the co-located users of the first set of electronic devices, the electronic devices of the co-located users of the first set are optionally configured to display virtual representations of the non-co-located users of the second set of electronic devices and present the participating users via optical pass-through, while the electronic devices of the users of the second set are optionally configured to display virtual representations of the co-located users of the first set of electronic devices, including displaying virtual representations of the participating users, since the participating users are not co-located with either the co-located users of the first set of electronic devices or the non-co-located users of the second set of electronic devices.

[0101] In some examples, a user of an electronic device participating in a multi-user communication session is co-located with a user of an electronic device that is in the multi-user communication session, such as being co-located with user 402 of electronic device 101a, and the multi-user communication session in which the user of the electronic device participates was previously a multi-user communication session that was only between non-co-located users of the electronic devices, such as only between user 402 of electronic device 101a and user 427 of electronic device 101d in FIG. 4J, and then, in response to the participation of the user of the electronic device, the multi-user communication session includes at least one pair of co-located users of the electronic devices in addition to at least one non-co-located user of the electronic device (e.g., a user that is not co-located for the pair of co-located users of the electronic devices), and the multi-user communication session appears differently (e.g., represents the users differently) for the pair of co-located users of the electronic devices compared to at least one of the non-co-located users of the electronic devices. For example, the newly joined user is optionally co-located with user 402 of electronic device 101a of FIG. 4J (who, in this example, is not co-located with another user in the multi-user communication session), and in response to the user of the electronic device joining the multi-user communication session, the newly joined user is presented to user 402 of electronic device 101a of FIG. 4J via optical pass-through, while electronic device 101a continues to display a virtual representation of the non-co-located user (e.g., spatial avatar 429a of user 427 of electronic device 101d of FIG. 4J), and to the electronic device of the non-co-located user in the multi-user communication session (e.g., electronic device 101d of FIG. 4J), the newly added user is displayed as a virtual representation along with the display of the virtual representation of user 402 of electronic device 101a.

[0102] In some examples, a first user of a first electronic device joins a multi-user communication session that is already active only among non-co-located users of the electronic devices, and the first user of the first electronic device is co-located with one of the non-co-located users of the electronic devices who is in the active multi-user communication session. For example, the first user of the first electronic device is optionally co-located with a second user of a second electronic device who is in the multi-user communication session, and the second user of the second electronic device optionally accepts a request for the first user of the first electronic device to join a multi-user communication session that was between non-co-located users of the electronic devices prior to accepting the request. In some examples, the second user of the second electronic device is displaying spatial avatars or two-dimensional representations of the other non-co-located users of the electronic devices who are in the multi-user communication session when the second user of the second electronic device accepts the first user of the first electronic device into the multi-user communication session. When the second user of the second electronic device accepts the first user of the first electronic device into a multi-user communication session (which was between non-co-located users of the electronic devices prior to accepting the request), the first electronic device optionally treats the second user of the second electronic device differently compared to the non-co-located users of the electronic devices in the multi-user communication session. For example, at the second electronic device, the second electronic device optionally displays spatial avatars or two-dimensional representations of other non-co-located users of electronic devices that are in the multi-user communication session, presenting the first user of the first electronic device via optical pass-through because the first user of the first electronic device is co-located with the second user of the second electronic device.Continuing with this example, the second electronic device optionally does not generate or present audio data (e.g., the first user speaking) via the audio output device of the second electronic device because the first electronic device and the second electronic device are co-located in a multi-user communication session (e.g., sharing the audio space of the physical environment in which the first electronic device and the second electronic device are co-located), but the second electronic device generates and presents audio effects corresponding to the voices of other users of other electronic devices that are not co-located with the first electronic device and the second electronic device. In some examples, if the first user of the first electronic device is within the field of view of the second electronic device before the second user of the second electronic device accepts the first user of the first electronic device into a multi-user communication session that is active only among non-co-located users, the second electronic device optionally presents the first user of the first electronic device via optical pass-through, even if the first user of the first electronic device is not in a multi-user communication session that includes the second user of the second electronic device. In some examples, in response to the second user of the second electronic device accepting the first user of the first electronic device into the multi-user communication session, the first electronic device optionally initiates a process for other non-co-located electronic devices in the multi-user communication session to display a spatial avatar or two-dimensional representation of the first user of the first electronic device.

[0103] In some examples, the determination of whether to display a spatial avatar or two-dimensional representation of the first user of the first electronic device within the individual environment displayed by the individual, non-collocated electronic device is based on whether the individual, non-collocated electronic device is displaying other spatial avatars or two-dimensional representations of other users of other electronic devices. For example, if the individual, non-collocated electronic device is displaying spatial avatars of other users of other electronic devices when the first user is participating, the individual, non-collocated electronic device optionally proceeds to also display the spatial avatar of the first user, and if the individual, non-collocated electronic device is displaying two-dimensional representations of other users of other electronic devices when the first user is participating, the individual, non-collocated electronic device optionally proceeds to also display two-dimensional representations of the first user. In some examples, the determination of whether to display a spatial avatar or two-dimensional representation of the first user of the first electronic device within the individual environment displayed by the individual, non-collocated electronic device is based on selected preferences of the first user of the first electronic device, as described above herein. In some examples, the determination of whether to display a spatial avatar or two-dimensional representation of the first user of the first electronic device within the individual environment displayed by the individual non-co-located electronic device is based on the type of shared visual content displayed within the multi-user communication session. For example, if a user interface of a slideshow presentation is shared in the multi-user communication session, the other users of the multi-user communication session are optionally represented as two-dimensional representations next to the slideshow presentation instead of spatial avatars, or as spatial avatars instead of two-dimensional representations.

[0104] In FIG. 4I, a multi-user communication session is active between user 402 of electronic device 101a, user 404 of electronic device 101b, and user 406 of electronic device 101c, each of which are co-located.

[0105] 4I , while electronic device 101a is co-located with electronic devices 101b and 101c in physical environment 400 (e.g., while electronic device 101a is in a multi-user communication session with electronic devices 101b and 101c), electronic device 101a (and optionally electronic devices 101b and 101c) detects an indication of a request to add electronic device 101d to the current multi-user communication session between electronic devices 101a, 101b, and 101c. In some examples, the request is presented at electronic device 101a in response to detecting that electronic device 101d is near electronic device 101a (e.g., within the same physical environment 400 and / or in the same building, but outside the same physical visual and / or audio space of physical environment 400). For example, electronic device 101a optionally detects that electronic device 101d is in a lounge or lobby area of ​​a building and is active (e.g., electronic device 101d is a head-worn device worn by a fourth user), and electronic device 101a detects that the fourth user is on the contact list of electronic device 101a and / or that electronic device 101d is discoverable to electronic device 101a (e.g., discoverable wirelessly via BLUETOOTH or another wireless communication technology). In some examples, the electronic device 101d is not discoverable until certain criteria are met, such as criteria that are met when the location of the electronic device 101d is a first location (e.g., a co-located location or a non-co-located location), criteria that are met when the electronic device 101d is discoverable wirelessly by the electronic device 101a, criteria that are met when the electronic device 101d is connected to the Internet, criteria that are met when the electronic device 101d is in a particular operating mode (e.g., in an on state, not in a notification-restricted state such as a DO NOT DISTURB state (e.g., a focus mode)), and / or another criterion.In some examples, the request is presented in response to detecting that the electronic device 101d is active and in a particular location within the physical environment 400, such as a lounge area or office space, or outside the physical environment 400, at a particular time, such as a time corresponding to a meeting with the user 402 of the first electronic device 101a (e.g., known from data associated with a calendar or planning application running on the electronic device 101a). Additionally or alternatively, in some examples, the request is presented at the electronic device 101a in response to the electronic device 101a initiating communication with the fourth electronic device 101d, such as via a telephone or video call.

[0106] In some examples, electronic device 101d is not co-located (e.g., does not share the visual space of physical environment 400) with electronic device 101a, electronic device 101b, and third electronic device 101c, as shown in FIG. 4I. For example, as shown in overhead view 410 of FIG. 4I, fourth electronic device 101d is located in a different room (e.g., with fourth user 427) from the room of physical environment 400 (in which electronic devices 101a, 101b, and 101c are located). In some examples, while electronic device 101d is within physical environment 440, electronic device 101d exceeds a threshold distance (e.g., as described above) of electronic device 101a, electronic device 101b, and / or electronic device 101c. Additionally, in some examples, as shown in FIG. 4I, electronic device 101d is not within the field of view of electronic device 101a when the request is detected.

[0107] In some examples, when electronic device 101a (and optionally electronic device 101b and electronic device 101c) detects the above-mentioned indication, electronic device 101a (and optionally electronic device 101b and electronic device 101c) displays a message element 420 (e.g., a notification) corresponding to a request to include fourth electronic device 101d in the multi-user communication session (e.g., such that a multi-user communication session exists between electronic devices 101a-101d). In some examples, as shown in FIG. 4I, message element 420 includes a first option 421 selectable to accept the request (e.g., to have fourth electronic device 101d join the multi-user communication session) and a second option 422 selectable to reject the request (e.g., to forgo joining multi-user communication session electronic device 101d). In some examples, fourth electronic device 101d has not been in any multi-user communication session prior to joining the multi-user communication session with electronic devices 101a-101c. In some embodiments, the fourth electronic device 101d is in a multi-user communication session that does not include any of the electronic devices 101a-101c prior to joining the multi-user communication session with the electronic devices 101a-101c.

[0108] 4I, the first electronic device optionally detects one or more inputs accepting a request to include electronic device 101d in the active multi-user communication session. For example, in FIG. 4I, electronic device 101a optionally detects a selection of first option 421 in message element 420. As an example, electronic device 101a optionally detects that a user of electronic device 101a has performed an air pinch gesture directed toward first option 421, such as a pinch performed by the hand of first user 402, while the gaze of first user 402 is directed toward first option 421 on electronic device 101a (e.g., without being directed toward second option 422). It should be understood that additional or alternative inputs, such as an air tap gesture, gaze and dwell input, verbal commands, etc., are possible.

[0109] In some examples, in response to input directed to first option 421, electronic device 101a joins multi-user communication session electronic device 101d and displays spatial avatar 429a of user 427, as shown in Figure 4J, because user 427 is not co-located with user 402 of electronic device 101a. Alternatively, in some examples, in response to input directed to first option 421, electronic device 101a joins multi-user communication session electronic device 101d and displays a two-dimensional representation of user 427 (e.g., representation 429b of Figure 4K), as shown in Figure 4K, because user 427 is not co-located with user 402 of electronic device 101a. In some examples, the electronic device 101a displays a representation 429b or spatial avatar 429a of the user 427 of the electronic device 101d, as described with reference to the electronic device 101a displaying the representation 405b or spatial avatar 405a of the user 406 of the electronic device 101c of Figures 4A-4C.

[0110] In some examples, electronic device 101d is co-located with user 402 of electronic device 101a when electronic device 101d participates in a multi-user communication session. In FIG. 4L, electronic device 101d is in the same physical environment 400 as electronic device 101a but is not yet in a multi-user communication session. In FIG. 4L, a multi-user communication session is active between user 402 of electronic device 101a, user 404 of electronic device 101b, and user 406 of electronic device 101c, each of which is co-located. In some examples, one or more of electronic devices 101a-101c detect that electronic device 101d is co-located with electronic devices 101a-101c. It should be noted that because electronic devices 101a-101c are co-located, when an individual electronic device 101a-101c detects that electronic device 101d is co-located with an individual electronic device 101a-101c, the individual electronic device detecting the co-location optionally causes the display of message element 420 in the multi-user communication session by the respective electronic device 101a-101c. In some examples, in response to detecting the co-location, message element 420 is displayed by the electronic device detecting the co-location. In FIG. 4L , message element 420 is displayed by electronic device 101a, even though within the illustrated field of view of electronic device 101a, and display 120a does not include user 427 of electronic device 101d, but only includes user 404 of electronic device 101b (e.g., because user 402 of electronic device 101a is facing user 404 of electronic device 101b directly (e.g., without facing user 427 of electronic device 101d)).

[0111] In some examples, in response to an input directed to the first option 421 of FIG. 4L, because user 427 is colocated with user 402 of electronic device 101a (optionally as determined by electronic device 101a and / or by a colocated electronic device 101a that has detected the colocation of electronic device 101d while colocated with electronic device 101a in the multi-user communication session), electronic device 101a participates in the multi-user communication session electronic device 101d without displaying spatial avatar 429a or representation 429b of user 427, as shown in FIG. 4M. In some examples, when user 427 of electronic device 101d joins the multi-user communication session, electronic device 101a optionally provides user 402 with a notification that user 427 of electronic device 101d is now in the multi-user communication session, such as via a user interface notification indicating in text that a fourth user 427 of electronic device 101d has joined the multi-user communication session, regardless of whether electronic device 101a's field of view includes user 427 of electronic device 101d. In particular, user 427 of electronic device 101d optionally appears via optical pass-through when user 402 of electronic device 101a's field of view includes user 427 of electronic device 101d, as shown in Figures 4L through 4N. Note that in Figure 4N, the three-dimensional environments including virtual content 409 displayed to their respective users via electronic devices 101a-101d are optionally spatially aligned.

[0112] Thus, as outlined above, providing a system and method for determining the mode of visual representation of a user of an electronic device participating in an already active multi-user communication session among users of other electronic devices allows for different display modes of users within a multi-user communication session based on whether the user is a co-located or non-co-located user, thereby improving user-device interaction and efficiently utilizing computing resources.

[0113] In some situations, audio feedback and audio spill (e.g., audio bleed) can occur when electronic devices are colocated in a multi-user communication session and include audio devices for detecting and presenting audio to respective users of the respective electronic devices. When these audio events occur, the audio experience of the colocated users may become undesirable. As an example, when electronic devices are colocated and streaming the same movie, audio spill can occur when the playback of the movie on a first electronic device is offset in time from the playback of the movie on a second electronic device in the multi-user communication session, allowing the user of the second electronic device to hear audio corresponding to the playback of the movie being presented by the first electronic device. In this case, the user of the second electronic device will hear the audio signal of the movie from the first electronic device, offset in time from the playback of the movie on the second electronic device, in addition to hearing the audio signal from their own electronic device. As another example, audio feedback can occur when sounds from various electronic devices playing the movie are detected and amplified by the other electronic devices. As another example, when respective electronic devices are collocated in a multi-user communication session and include audio devices for detecting and presenting audio to respective users of the respective electronic devices, and the multi-user communication session also includes non-collocated electronic devices, audio from the non-collocated users may be presented at different times, which results in different collocated users being presented with the same audio at different times, which reduces the user experience. Therefore, systems and methods for controlling audio properties of electronic devices to reduce undesirable coupling between audio being generated for presentation at different collocated electronic devices are desirable.

[0114] 5A-5H show examples of an electronic device during a multi-user communication session that changes the level of a first audio property based on a change in distance between the electronic device and another electronic device that is co-located with the electronic device during the multi-user communication session, according to some examples of the present disclosure.

[0115] 5A illustrates a user 502 of electronic device 101a and a user 504 of electronic device 101b co-located in physical environment 500. These users 502 and 504 are participating in a multi-user communication session via their respective electronic devices 101a / 101b. Thus, user 504 of electronic device 101b is optionally presented within a three-dimensional environment visible through electronic device 101a via optical pass-through, and user 502 of electronic device 101a is optionally presented within a three-dimensional environment visible through electronic device 101b via optical pass-through (e.g., provided that the individual users are within the field of view of the other users). In the illustrated example of FIG. 5A, user 502 of electronic device 101a is sitting in physical chair 508b next to physical table 508a, and user 504 of electronic device 101b is standing in the physical environment.

[0116] In some examples, the electronic device 101a is in communication with one or more first audio input devices and one or more first audio output devices. The one or more first audio input devices include one or more first microphones that are optionally attached to or integrated into the electronic device 101a. For example, in the illustrated example of FIG. 5A , the user 502 is wearing the electronic device 101a on the user's head, and the audio devices are optionally integrated into the electronic device 101a. In some examples, the audio devices in communication with the electronic device 101a include one or more characteristics of the audio devices described with reference to FIG. 2. For example, the audio devices of the electronic device 101a optionally include one or more characteristics of the speaker(s) 216a and the microphone(s) 213a. The microphone(s) of the electronic device 101a are optionally configured to detect / capture sounds in the environment of the user 502 of the electronic device 101a, such as sounds corresponding to the user's voice in the environment of the user 502 of the electronic device 101a. The audio output devices of electronic device 101 a are optionally oriented to face the ears of a user of electronic device 101 a. In some examples, electronic device 101 a includes speakers configured to face the ears of a user and / or be worn on, around, and / or within the ears of a user, and includes outward-facing speakers (e.g., facing outward, away from the user's head or ears) and configured to generate sound for the hearing of a person in a physical environment that may or may not be in a multi-user communication session.

[0117] Similarly, in some examples, electronic device 101b is in communication with one or more second audio input devices and one or more second audio output devices. The one or more second audio input devices include one or more second microphones optionally attached to or integrated with electronic device 101b. For example, in the illustrated example of FIG. 5A , user 504 is wearing electronic device 101b on the user's head, and audio devices are optionally integrated into electronic device 101b. In some examples, audio devices in communication with electronic device 101b include one or more characteristics of the audio devices described with reference to FIG. 2. For example, audio devices of electronic device 101b optionally include one or more characteristics of speaker(s) 216b and microphone(s) 213b. The microphone(s) of electronic device 101b are optionally configured to detect / capture sounds in the environment of user 504 of electronic device 101b, such as sounds corresponding to the voice of a user in the environment of user 504 of electronic device 101b. The audio output devices of electronic device 101b are optionally oriented to face the ears of a user of electronic device 101b. In some examples, electronic device 101b includes speakers configured to face the ears of a user and / or be worn on, around, and / or within the ears of a user, and includes outward-facing speakers (e.g., facing outward, away from the user's head or ears) and configured to generate sound for the hearing of a person in a physical environment that may or may not be in a multi-user communication session.

[0118] Because electronic devices 101a / 101b are co-located, electronic devices 101a / 101b optionally share the audio of physical environment 500. For example, if a sound source, such as a speaker, is located in physical environment 500 and is generating sound, users 502 / 504 optionally hear the sound the sound source is generating in the physical environment and detect the sound as coming from the same location in the physical environment. If electronic devices 101a / 101b include microphones, electronic devices 101a / 101b optionally detect audio being generated from sound sources in the users' physical environments. In some examples, while electronic devices 101a / 101b are co-located, when user 502 speaks, electronic device 101b detects sound corresponding to user 502, and when user 504 speaks, electronic device 101a detects sound corresponding to user 504. Further, as described above in this disclosure, in some examples, when electronic devices 101a / 101b share an audio space of a physical environment, audio data detected by a first microphone of electronic device 101a is also detected by a second microphone of electronic device 101b. Additionally or alternatively, electronic devices 101a / 101b of FIG. 5A are optionally co-located according to other characteristics of co-location described herein, such as those described with reference to FIG.

[0119] 5A , electronic devices 101a / 101b each present shared content 511 (e.g., shared virtual content, such as shared content 511 that is visible only through electronic devices 101a / 101b). Shared content 511 optionally includes one or more characteristics of shared content 409 of FIG. 4A . If the multi-user communication session is only between electronic devices 101a / 101b, shared content 511 optionally represents shared visual virtual content being shared in the multi-user communication session by electronic device 101a or electronic device 101b. If the multi-user communication session is between electronic devices 101a / 101b and a non-co-located user, shared content 511 may additionally or alternatively represent content being shared in the multi-user communication session by a non-co-located user (e.g., by electronic device 101a / 101b and the non-co-located electronic device). Additionally, when a multi-user communication session is between electronic device 101a / 101b and another electronic device of a non-colocated user, shared content 511 optionally also represents a visual representation (e.g., a spatial avatar and / or a two-dimensional representation of the user as described above) and / or an audio representation (e.g., the voice of the non-colocated user) of that non-colocated user.

[0120] In the illustrated examples of Figures 5A-5H, glyphs 512a-512h, 514a-514h, and 516a-516h are provided to reference various audio levels and properties associated with electronic devices 101a / 101b during the respective illustrated multi-user communication sessions.

[0121] Glyph 512a in FIG. 5A indicates a maximum system volume level of an individual electronic device (e.g., electronic device 101a and / or 101b). The maximum system volume level optionally corresponds to the maximum system volume level of electronic device 101a that may be output via an audio device of electronic device 101a. For example, glyph 512a optionally indicates the maximum amount of gain or amplification of an audio signal that the settings of electronic device 101a can provide to the audio signal. For example, if shared content 511 is a movie being played and electronic device user 502 is watching the movie, electronic device 101a is optionally outputting audio corresponding to the movie. The maximum volume level of electronic device 101a is optionally indicated by 512a. Similarly, the maximum system volume level of electronic device 101b is optionally indicated by glyph 512a.

[0122] Glyph 514a in FIG. 5A indicates the current system volume level of an individual electronic device, such as electronic device 101a. As shown in the illustrated example of FIG. 5A, glyph 514 includes a slider that is not completely filled in. This indicates that the current volume level setting of electronic device 101a is less than the maximum volume level setting of electronic device 101a. Thus, for example, in response to user input during a multi-user communication session, user 502 of electronic device 101a can optionally increase the volume level (or decrease the volume level) of electronic device 101a. Note that the slider length of glyph 512a's slider is the same as the slider length of glyph 514a in FIG. 5A, and this similarity is intended to indicate that the maximum current volume level setting of the electronic device is the maximum volume level indicated by glyph 512a. Note also that the current system volume level of electronic device 101a is optionally the same as or different from the current system volume level of electronic device 101b.

[0123] 5A , glyph 516a indicates that the difference in audio latency between electronic device 101a and electronic device 101b is a first amount. For example, even if both devices receive the same audio signal, electronic device 101a optionally presents the audio signal at a first time and electronic device optionally presents the audio signal at a second time that is different from the first time, optionally due to distinguishing characteristics introduced during the manufacturing process of individual electronic devices 101a / 101b, even if electronic devices 101a / 101b are the same type of device. As another example, if a multi-user communication session includes collocated electronic devices 101a / 101b and non-collocated electronic devices, and the non-collocated electronic devices detect that a user of the non-collocated electronic device is speaking, when an audio signal corresponding to the voice of the user of the non-collocated electronic device is received by electronic device 101a / 101b, the processing time associated with processing the audio signal for presentation to individual users 502 / 504 of individual electronic devices 101a / 101b (via respective audio output devices of electronic devices 101a / 101b) is optionally different, thus resulting in differences in audio latency between electronic devices 101a / 101b.

[0124] In Figure 5A, electronic devices 101a / 101b are a first distance apart, and from Figure 5A to Figure 5B, the distance between electronic devices 101 / 101b is reduced to a second distance that is less than the first distance. For example, from Figure 5A to Figure 5B, user 504 of electronic device 101b is walking closer to user 502 of electronic device 101a. In response to detecting this event, which includes a decrease in the distance between electronic devices 101a / 101b, electronic device 101a reduces the maximum system volume level of electronic device 101a, as indicated by glyph 512b in Figure 5B. In the illustrated example of the resulting change in the maximum system volume level of electronic device 101a from Figure 5A to Figure 5B, even though the maximum system volume level of electronic device 101a decreased due to a decrease in the distance between electronic devices 101a / 101b, the decrease in the maximum system volume level did not cause a change in the current system volume level setting, as shown by glyph 514b in Figure 5B, because the new maximum system volume level setting corresponds to a volume level that is greater than the current volume level of electronic device 101a in Figures 5A and 5B. Thus, in Figure 5B, in response to a user input to increase the volume level of electronic device 101a (e.g., optionally, a user input directed at a physical or virtual knob, user interface element, or button that is a dedicated affordance for changing the volume level of electronic device 101a, and a user input requesting an increase in the volume level), electronic device 101a increases the volume level in accordance with the user input to the maximum volume level of the electronic device, as shown by glyph 512b in Figure 5B. Thus, in some examples, when a co-located electronic device adjusts (e.g., changes) its allowable volume level (e.g., maximum allowable volume level) due to a change in the distance between the co-located electronic devices, the current volume level setting of the co-located electronic device is optionally not changed.

[0125] In Figure 5B, electronic devices 101a / 101b are a second distance apart, and from Figure 5B to Figure 5C, the distance between electronic devices 101a / 101b is reduced to a third distance that is less than the second distance. For example, from Figure 5B to Figure 5C, user 504 of electronic device 101b is walking closer to user 502 of electronic device 101a. In response to detecting this event, which includes a decrease in the distance between electronic devices 101a / 101b, electronic device 101a reduces the maximum system volume level of electronic device 101a, as indicated by glyph 512c in Figure 5C. In the illustrated example of the resulting changes in the audio properties of electronic device 101a from Figure 5B to Figure 5C, the maximum system volume level of electronic device 101a is reduced as shown from glyph 512b in Figure 5B to glyph 512c in Figure 5C, and the current volume level of electronic device 101a is reduced as shown from glyph 514b in Figure 5B to glyph 514c in Figure 5C. This reduction in the current volume level of electronic device 101a occurs because the new maximum system volume level setting in Figure 5C corresponds to a lower volume level than the current volume level of electronic device 101a in Figure 5B. Thus, in FIG. 5C , in response to a user input that increases the volume level of electronic device 101a from the depicted current volume level, electronic device 101a optionally forgoes increasing the volume level in accordance with the user input because, in FIG. 5C , the depicted current volume level of electronic device 101a (e.g., glyph 514c) is at the depicted maximum allowed volume level of electronic device 101a (e.g., glyph 512c), given the distance between electronic devices 101a / 101b. Further, in the illustrated example, the slider fill line in glyph 512c in FIG. 5C is intended to represent equal in length to the full slider glyph 514c. From FIG. 5B to FIG. 5C , as the distance changes (e.g., from the second distance in FIG. 5B to the third distance in FIG. 5C ), the maximum slider fill length of glyph 514c corresponds to a maximum volume level where the volume level is reduced to a position lower than the position of the current system volume level setting in FIG. 5B , and so these lengths are equal.Thus, in some examples, changes in the allowed volume levels of the co-located electronic devices due to changes in the distance between the co-located electronic devices optionally affect the current volume level settings of the co-located electronic devices. In this way, electronic device 101a reduces the amount of audio feedback and / or audio bleed between electronic devices 101a / 101b in a multi-user communication session.

[0126] In some examples, the amount of change in the level of the audio property of electronic device 101a is based on the amount of difference in audio latency between co-located electronic devices 101a / 101b. In the illustrated examples of Figures 5A-5C, the amount of difference in audio latency is a first amount, and the amount of change in the audio property of electronic device 101a is, optionally, based on the first amount. In the illustrated examples of Figures 5D-5G, the amount of difference in audio latency is a second amount greater than the first amount, and the amount of change in the audio property of electronic device 101a resulting from the same change in distance described with reference to Figures 5A-5C is shown to be greater, respectively.

[0127] In Figure 5D, electronic devices 101a / 101b are separated by a first distance (e.g., the first distance described with reference to Figure 5A). However, in Figure 5D, the amount of difference in audio latency between electronic devices 101a / 101b is a second amount, as indicated by glyph 516d, that is greater than the first amount described with reference to Figures 5A-5C.

[0128] 5D to 5E, the distance between electronic devices 101a / 101b is reduced to a second distance (e.g., the second distance described with reference to FIG. 5B) that is less than the first distance. For example, from FIG. 5D to 5E, user 504 of electronic device 101b is walking closer to user 502 of electronic device 101a. In response to detecting this event, which includes a decrease in the distance between electronic devices 101a / 101b (and while the difference in the amount of audio latency between electronic devices 101a / 101b is the second amount), electronic device 101a reduces the maximum system volume level of electronic device 101a to a level that is lower than the reduction in the maximum system volume level of electronic device 101a described with reference to FIGS. 5A and 5B, as indicated by glyph 512e in FIG. 5E. This difference in the reduction of the maximum system volume level of electronic device 101a is optionally due to a difference in the amount of audio latency between electronic devices 101a / 101b (e.g., the difference between the first amount described with reference to FIGS. 5A-5C and the second amount described with reference to FIGS. 5D-5F). That is, because the second amount of audio latency is greater than the first amount of audio latency, the same change in distance results in a greater change in the level of the audio properties. Furthermore, in the illustrated example of the resulting change in the audio properties of electronic device 101a from FIG. 5D to FIG. 5E, the maximum allowed system volume level of electronic device 101a is reduced as shown from glyph 512d in FIG. 5D to glyph 512e in FIG. 5E, and the current volume level of electronic device 101a is reduced as shown from glyph 514d in FIG. 5D to glyph 514e in FIG. 5E. This reduction in the current volume level of electronic device 101a occurs because the new maximum system volume level setting in Figure 5E corresponds to a lower volume level than the current volume level of electronic device 101a in Figure 5D. In some examples, the illustrated current volume level of electronic device 101a in glyph 514e of Figure 5E is at the illustrated maximum allowed volume level of electronic device 101a in glyph 512e of Figure 5E.

[0129] In some examples, the electronic device 101a changes the level of the audio property by a first amount when a first change in displacement occurs at a first distance, and changes the level of the audio property by a second amount different from the first amount when a second change in displacement occurs at a second distance different from the first distance. For example, using the location of the electronic device 101a as a reference, if the electronic device 101b is 15 meters away from the electronic device 101a and is then moved to be 10 meters away from the electronic device 101a, the electronic device 101a optionally reduces the maximum system volume level of the electronic device 101a by a first amount, and if the electronic device 101b is 6 meters away from the electronic device 101a and is then moved to be 1 meter away from the electronic device 101a, the electronic device 101a optionally reduces the maximum system volume level of the electronic device 101a by a second amount greater than the first amount, even though the electronic device 101b moved the same amount of distance toward the electronic device 101a in both cases. In some examples, the electronic device 101a reduces the maximum system volume level of the electronic device 101a by a second amount (greater than the first amount) in the second case because the sound intensity of a sound source is inversely proportional to the distance from the sound source (e.g., sound intensity is proportional to the inverse of the square of the distance from the sound source).

[0130] In FIG. 5E, electronic devices 101a / 101b are separated by a second distance (e.g., the second distance described with reference to FIG. 5B), and from FIG. 5E to FIG. 5F, the distance between electronic devices 101a / 101b is reduced to a third distance (e.g., the third distance described with reference to FIG. 5C) that is less than the second distance. For example, from FIG. 5E to FIG. 5F, user 504 of electronic device 101b is walking closer to user 502 of electronic device 101a. In response to detecting this event, which includes a decrease in the distance of electronic devices 101a / 101b (and while the difference in the amount of audio latency between electronic devices 101a / 101b is the second amount), electronic device 101a reduces the maximum system volume level of electronic device 101a to a level that is lower than the reduction in the maximum system volume level of electronic device 101a described with reference to FIG. 5F, even though the same change in distance has occurred, as indicated by glyph 512f in FIG. 5F. As mentioned above, this difference in the reduction of the maximum system volume level of electronic device 101a is optionally due to a difference in the amount of audio latency between electronic devices 101a / 101b (e.g., the difference between the first amount described with reference to FIGS. 5A-5C and the second amount described with reference to FIGS. 5D-5F). Further, in the illustrated example of the resulting change in the audio properties of electronic device 101a from FIG. 5E to FIG. 5F, the maximum system volume level of electronic device 101a is reduced as shown from glyph 512e in FIG. 5E to glyph 512f in FIG. 5F, and the current volume level of electronic device 101a is reduced as shown from glyph 514e in FIG. 5E to glyph 514f in FIG. 5F, optionally because the highest allowed maximum system level of electronic device 101a in FIG. 5F is lower than the current allowed maximum system level of electronic device 101a in FIG. 5E. In some examples, the illustrated current volume level of electronic device 101a in glyph 514f of Figure 5F is at the illustrated maximum allowed volume level of electronic device 101a in glyph 512f of Figure 5F. Thus, in some examples, electronic device 101a changes the audio level of an audio property based on the amount of relative audio latency between electronic device 101a and the co-located electronic device.

[0131] In some examples, when electronic device 101a is in a multi-user communication session with electronic device 101b and is co-located with electronic device 101b, electronic device 101b detects and transmits audio detected by electronic device 101b to electronic device 101a. For example, the detected audio optionally includes a user 504 of electronic device 101b speaking in the physical environment and a microphone of electronic device 101b detecting that audio of user 504. In some examples, when electronic devices 101a / 101b share the audio space of the physical environment in which electronic devices 101a / 101b are co-located, the microphone of electronic device 101a similarly detects audio being detected by the microphone of electronic device 101b. For example, when a user 504 of electronic device 101b is speaking, the microphone of electronic device 101b is optionally detecting the voice of user 504, and the microphone of electronic device 101a is optionally detecting the voice of user 504. Based on the distance between electronic devices 101a / 101b, audio signals detected in the physical environment emanating from user 504 optionally differ in amplitude (e.g., strength or signal strength).For example, when the distance between electronic devices 101a / 101b is a first distance, while a user 504 of electronic device 101b is speaking, electronic device 101b detects, optionally via a microphone of electronic device 101b, the voice of user 504 having a first signal strength in the audio space of the physical environment, and electronic device 101a detects, optionally via a microphone of electronic device 101a, the voice of user 504 having a second signal strength in the audio space of the physical environment, and electronic device 101a When the distance between electronic device 101b and electronic device 101b is a second distance greater than the first distance, while user 504 of electronic device 101b is speaking, electronic device 101b, optionally via the microphone of electronic device 101b, detects the voice of user 504 having a first signal strength in the audio space of the physical environment, and electronic device 101a, optionally via the microphone of electronic device 101a, detects the voice of user 504 having a third signal strength less than the second signal strength in the audio space of the physical environment. In some examples, electronic device 101a generates audio corresponding to the audio detected at electronic device 101b and / or the audio detected at electronic device 101a to maintain an optimal audio presentation level for user 502 of the voice of user 504 who is co-located in a multi-user communication session in the physical environment with user 502. For example, continuing with the above example introducing that the signal strength of the user's 504's voice is a third signal strength when the distance between electronic devices 101a / 101b is a second distance, electronic device 101a optionally amplifies the audio corresponding to user 504 so that the presentation of the audio signal has a second strength at the second distance.

[0132] In some examples, when electronic device 101a is in a multi-user communication session with electronic device 101b and is co-located with electronic device 101b, electronic device 101b detects and transmits audio detected by electronic device 101b to electronic device 101a, but electronic device 101a forgoes amplifying and / or assisting in presenting the audio received from electronic device 101a. For example, FIG. 5H shows electronic device 101a forgoing amplifying the audio signal detected at electronic device 101b, as indicated by glyph 518h. In some examples, electronic device 101a in FIG. 5H forgoes amplifying the audio signal transmitted from electronic device 101b because electronic device 101a detects that the distance between electronic devices 101a / 101b is less than a threshold distance (e.g., 12 m, 10 m, 8 m, 5 m, 2 m, 0.8 m, 0.5 m, or another threshold distance).

[0133] In some examples, electronic device 101a amplifies and / or otherwise assists in the presentation of audio received from electronic device 101a based on the distance between electronic devices 101a / 101b. For example, FIG. 5G shows electronic device 101a amplifying an audio signal detected at electronic device 101b, as indicated by glyph 518g. Glyph 518g is provided to indicate that a certain amount of audio transmitted from electronic device 101b is amplified at electronic device 101a to be heard by user 502 of electronic device 101a. In some examples, electronic device 101a in FIG. 5G amplifies the audio signal transmitted from electronic device 101b because electronic device 101a detects that the distance between electronic devices 101a / 101b exceeds a threshold distance (e.g., the threshold distance described above). Therefore, the electronic device 101a optionally smartly decides whether to amplify the audio signal transmitted from the electronic device 101b based on the distance between the electronic devices 101a / 101b, thus saving computing resources and power that would be released in the process of amplifying and presenting the audio signal transmitted from the electronic device 101b.

[0134] In some examples, a first electronic device is co-located in a multi-user communication session with a second electronic device, and the first electronic device amplifies audio based on user focus. For example, if the multi-user communication session includes a first real or virtual element associated with a first audio component and a second real or virtual element associated with a second audio component, and the first electronic device detects that the user's focus (e.g., gaze) is directed toward the first real or virtual element in the multi-user communication session, the first electronic device optionally amplifies the first audio component relative to the second audio component in the multi-user communication session. Continuing with this example, if the first electronic device detects that the user's focus is directed toward the second real or virtual element in the multi-user communication session, the first electronic device optionally amplifies the second audio component relative to the first audio component.

[0135] In some examples, an electronic device co-located in a multi-user communication session with another electronic device initiates a process to synchronize its audio clock with the other electronic device. In some examples, an electronic device co-located in a multi-user communication session with another electronic device synchronizes its audio clock by buffering audio received from non-co-located users in the multi-user communication session so that the received audio can be presented simultaneously (and / or within 1 second, 0.1 seconds, 0.05 seconds, 0.001 seconds, or another time period of the same time) via each co-located electronic device. For example, if the multi-user communication session includes a first user of a first electronic device that is co-located with a second user of a second electronic device, and a third user of a third electronic device that is not co-located with the first and second users, the first electronic device optionally buffers audio transmitted from (and / or detected at) the third electronic device to align the presentation of audio received from the third electronic device with the presentation at the second electronic device.

[0136] It is understood that the examples shown and described herein are merely illustrative, and that additional and / or alternative elements may be provided within the three-dimensional environment for interacting with the example content. It should be understood that the appearance, shape, form, and size of each of the various user interface elements and objects shown and described herein are exemplary, and that alternative appearances, shapes, forms, and / or sizes may be provided. For example, virtual objects representing application windows (e.g., virtual objects 330, 435, 535, and 537) may be provided in alternative shapes other than rectangular, such as circular, triangular, etc. Additionally or alternatively, in some examples, the various options, user interface elements, controls, etc. described herein may be selected and / or manipulated via user input received via one or more separate input devices in communication with the electronic device(s). For example, selection input may be received via a physical input device, such as a mouse, trackpad, keyboard, etc., in communication with the electronic device(s).

[0137] 6 is a flow diagram illustrating a method 600 for changing a mode of a visual representation of a user in a multi-user communication session in response to detecting that the user has changed from being a non-co-located user in the multi-user communication session to a co-located user in the multi-user communication session, according to some examples of the present disclosure. It is understood that method 600 is an example, and that more, fewer, or different operations may be performed in the same or a different order. Additionally, the operations of method 600 described below are optionally implemented by executing one or more functional modules of an information processing device, such as a general-purpose processor (e.g., as described with respect to FIG. 2) or an application-specific chip, and / or by other components of FIG. 2.

[0138] Thus, in accordance with the above, some examples of the present disclosure may involve a first electronic device (e.g., electronic device 101a of FIG. 4A) in communication with one or more first displays, one or more first input devices, and one or more first output devices (e.g., one or more first audio output devices), where a first user of the first electronic device and a second electronic device different from the first electronic device may be involved, such as in a multi-user communication session described with reference to FIGS. 4A-4H including user 402 of electronic device 101a and user 404 of electronic device 101b. 4A , displaying (602 of FIG. 6 ) a second user of a second electronic device having a first appearance via one or more first displays, while a communication session is active between multiple users of different electronic devices, including a second user of the second electronic device having a first appearance, the first appearance including a visual representation of the second user of the second electronic device, such as electronic device 101a displaying spatial avatar 405a of user 406 of FIG. 4A ; and while displaying the second user of the second electronic device having the first appearance via the one or more first displays, determining that criteria are met (604 of FIG. 6), including one or more criteria that are met when the first electronic device and the second electronic device are within a shared visual space of the physical environment, such as when user 406 of electronic device 101c is co-located with user 402 of electronic device 101a, as shown in FIG. 4D; and displaying a second display via one or more first displays, as shown in FIG. 4D with electronic device 101a no longer displaying spatial avatar 405a of user 406. ceasing to display the second user of the second electronic device having the first appearance (606 of FIG. 6 ); and presenting the second user of the second electronic device having a second appearance different from the first appearance (608 of FIG. 6 ) at the location of the second user of the second electronic device via one or more first displays, as shown on electronic device 101 a presenting user 406 of FIG. 4D via pass-through, in accordance with a determination that the location of the second user of the second electronic device is within the field of view of the first electronic device (e.g.,6). Thus, in some examples, the appearance of a user in a multi-user communication session is changed in response to detecting that the user transitions from being in the multi-user communication session as a remote user to being a co-located user.

[0139] Additionally or alternatively, in some examples, the visual representation of the second user of the second electronic device is a two-dimensional representation of the second user of the second electronic device displayed in a window of a user interface, such as representation 405b of user 406 in FIG. 4C.

[0140] Additionally or alternatively, in some examples, the visual representation of the second user of the second electronic device is a three-dimensional representation of the second user of the second electronic device, such as spatial avatar 405a of user 406 in FIG. 4A.

[0141] Additionally or alternatively, in some examples, the visual representation of the second user of the second electronic device is a three-dimensional representation of the second user of the second electronic device, such as spatial avatar 405a of user 406 of FIG. 4G, and while displaying the three-dimensional representation of the second user of the second electronic device, a number of users of the electronic devices in the communication session within the shared visual space of the physical environment is less than a threshold number (e.g., a threshold described with reference to FIGS. 4G and 4H) of users of electronic devices in the communication session within the shared visual space of the physical environment, such as user 402 of electronic device 101a and user 404 of electronic device 101b of FIG. 4G, and method 600 may include, while displaying the second user of the second electronic device having a first appearance, inputting a visual representation of the second user of the second electronic device, such as spatial avatar 405a of user 406 of FIG. 4G, a user of electronic device 101a, user 404 of electronic device 101b, and user 427 of electronic device 101d of FIG. 4H, via one or more first input devices. The method further includes detecting a change in the number of users of the electronic devices in the communication session within the shared visual space to a number that exceeds a threshold number of users of the electronic devices in the communication session within the shared visual space of the physical environment, and, in response to detecting a change in the number of users of the electronic devices in the communication session within the shared visual space of the physical environment to a number that exceeds the threshold number of users of the electronic devices in the communication session within the shared visual space of the physical environment, changing a visual representation of the second user of the second electronic device from a three-dimensional representation of the second user of the second electronic device to a two-dimensional representation of the second user of the second electronic device, including displaying a two-dimensional representation of the second user of the second electronic device within a window of a user interface, as indicated by a transition from a display of a spatial avatar 405a of the user 406 of the electronic device 101c to a representation 405b of the user 406 of the electronic device 101c, via the one or more first displays.

[0142] Additionally or alternatively, in some examples, the one or more criteria further include a criterion that is met when the first electronic device and the second electronic device are connected to the same wireless local area network.

[0143] Additionally or alternatively, in some examples, the one or more criteria further include a criterion that is met when image data captured by one or more first image capture devices in communication with the first electronic device includes image data of a second electronic device, such as an external image sensor of electronic device 101a of FIG. 4D detecting image data of electronic device 101c.

[0144] Additionally or alternatively, in some examples, the one or more criteria further include a criterion that is met when audio data detected by one or more first microphones communicating with a first electronic device, such as the microphone of electronic device 101a of FIG. 4D detecting audio data in physical environment 400 that is also detected by electronic device 101c of FIG. 4D , is also detected by one or more second microphones communicating with a second electronic device.

[0145] Additionally or alternatively, in some examples, the one or more criteria further include a criterion that is met when a first context mapping of the physical environment of the first electronic device at least partially overlaps with a second context mapping of the physical environment of the second electronic device, such as described with reference to the SLAM map above, and / or such that the external image sensor of the electronic device 101a of Figure 4D detects image data of the physical environment 400 of Figure 4D and the external image sensor of the electronic device 101c of Figure 4D detects image data of the physical environment 400 of the electronic device 101c of Figure 4D. Additionally or alternatively, in some examples, the first electronic device or the second electronic device detected at least partial overlap between the first context mapping of the physical environment of the first electronic device and the second context mapping of the physical environment of the second electronic device.

[0146] Additionally or alternatively, in some examples, method 600 further includes, after presenting the second user of the second electronic device having the second appearance at the location of the second user of the second electronic device, detecting via one or more first input devices that the one or more criteria are no longer met, such as user 406 of electronic device 101c walking out of physical environment 400 of FIG. 4D , and displaying via one or more first displays the second user of the second electronic device having the first appearance, such as spatial avatar 405a of user 406 of FIG. 4E or representation 405b of FIG. 4F , in response to detecting that the one or more criteria are no longer met.

[0147] Additionally or alternatively, in some examples, method 600 further includes detecting a request to display the shared virtual content during the communication session via one or more first displays via one or more first input devices; in response to detecting the request to display the shared virtual content during the communication session, displaying the shared virtual content, such as shared content 409 of FIG. 4A , at a first location within the three-dimensional environment to a first user of a first electronic device via one or more first displays; and in accordance with determining that one or more criteria are met, initiating a process to cause the shared virtual content to be displayed at a first location within the three-dimensional environment to a second user of a second electronic device via one or more second displays in communication with the second electronic device, such as shared content 409 of FIG. 4A being displayed by electronic device 101c within the three-dimensional environment viewable by electronic device 101c to user 406.

[0148] Additionally or alternatively, in some examples, the three-dimensional environment displayed via the one or more first displays includes shared virtual content of the communication session, such as shared virtual content 409 of FIG. 4A.

[0149] Additionally or alternatively, in some examples, the communication session was activated in response to a request to display shared virtual content in the communication session, such as in response to electronic device 101a requesting shared virtual content 409 of FIG. 4A to be shared in a multi-user communication session including user 404 of electronic device 101b and user 406 of electronic device 101c.

[0150] Additionally or alternatively, in some examples, method 600 further includes presenting, via one or more first audio output devices, audio detected by one or more second input devices in communication with the second electronic device, such as electronic device 101a presenting audio captured by one or more microphones of electronic device 101c of FIG. 4A , via one or more first audio output devices, while displaying, via one or more first displays, a second user of the second electronic device having a first appearance, such as spatial avatar 405a of FIG. 4A , and, in response to determining that one or more criteria are met, ceasing to present the audio detected by the one or more second input devices in communication with the second electronic device via the one or more first audio output devices. For example, in FIGS. 4A through 4D , one or more criteria are optionally met, and in response, in FIG. 4D , the electronic device ceasing to present the audio detected by the microphone of electronic device 101c via a speaker of electronic device 101a.

[0151] Additionally or alternatively, in some examples, shared virtual content is displayed via one or more first displays in a communication session, such as shared virtual content 409 in Figure 4A, where the shared virtual content of the communication session includes an audio component. For example, shared virtual content 409 is a movie that includes a user interface showing visual components of the movie, and includes audio associated with the movie. Additionally or alternatively, in some examples, method 600 further includes, while presenting an audio component of the shared virtual content of the communication session via the one or more first audio output devices, forgoing presenting, via the one or more first audio output devices, audio detected by one or more second input devices communicating with the second electronic device in accordance with a determination that the one or more criteria are met, such as forgoing presenting, via the first audio output devices, audio effects corresponding to audio of electronic device 101c that is co-located with electronic device 101a of FIG. 4D , and presenting, via the one or more first audio output devices, audio detected by one or more second input devices communicating with the second electronic device in accordance with a determination that the one or more criteria are not met, such as presenting, via the one or more first audio output devices, audio effects corresponding to audio of electronic device 101c that is not co-located with electronic device 101a of FIG. 4A .

[0152] Additionally or alternatively, in some examples, method 600 further includes, in response to detecting that one or more criteria are met, forgoing presenting, via one or more first displays, a second user of the second electronic device having a second appearance at a location of the second user of the second electronic device relative to a location of the first user of the first electronic device in accordance with a determination that a second position of the second user of the second electronic device is not within a field of view of the first electronic device. For example, if user 404 of electronic device 101c was not within the field of view of electronic device 101a (e.g., if user 402 of electronic device 101a was not looking towards electronic device 101c in FIG. 4D but instead looked away from electronic device 101c (e.g., opposite the direction of looking towards electronic device 101c in FIG. 4D)), user 406 of electronic device 101c would be co-located with electronic device 101a but, optionally, not visible via display 120a (e.g., until user 406 of electronic device 101c came within the field of view of electronic device 101a).

[0153] Some examples of the present disclosure are directed to a first electronic device comprising one or more processors, a memory, and one or more programs, the one or more programs being stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing any of the methods described above.

[0154] Some examples of the present disclosure are directed to a non-transitory computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by one or more processors of the first electronic device, cause the first electronic device to perform any of the methods described above.

[0155] Some examples of the present disclosure are directed to a first electronic device comprising one or more processors, a memory, and means for performing any of the above methods.

[0156] Some examples of the present disclosure are directed to an information processing apparatus for use in a first electronic device, the information processing apparatus comprising means for performing any of the above methods.

[0157] 7 is a flow diagram illustrating a method 700 for determining a mode of a visual representation of a user of an electronic device participating in an already active multi-user communication session among users of other electronic devices, according to some examples of the present disclosure. It is understood that method 700 is an example, and that more, fewer, or different operations may be performed in the same or a different order. Additionally, the operations of method 700 described below are optionally implemented by executing one or more functional modules of an information processing device, such as a general-purpose processor (e.g., as described with respect to FIG. 2) or an application-specific chip, and / or by other components of FIG. 2.

[0158] Thus, in accordance with the above, some examples of the present disclosure include, at a first electronic device (e.g., electronic device 101a of FIG. 4I) in communication with one or more first displays, one or more first input devices, and one or more first output devices (e.g., one or more first audio output devices), while a communication session is active between multiple users of different electronic devices, including a first user of the first electronic device and a second user of a second electronic device different from the first electronic device, detecting an event (702 of FIG. 7) corresponding to a request for a third user of a third electronic device to join the communication session, such as an event causing display of message element 420 of FIG. 4I and / or selection of first portion 421 of FIG. 4I via one or more first input devices; and, in response to the event corresponding to the request for the third user of the third electronic device to join the communication session, adding user 427 of electronic device 101d to the multi-user communication session that was active between user 402 of electronic device 101a, user 404 of electronic device 101b, and user 406 of electronic device 101c. adding a third user of a third electronic device to the communication session (704 of FIG. 7) such that the plurality of users of the different electronic devices in the communication session includes a first user of the first electronic device, a second user of the second electronic device, and a third user of the third electronic device; and satisfying one or more first criteria, including a criterion that is met when the first electronic device and the third electronic device are within a shared visual space of the physical environment, such as when user 427 of electronic device 101d is co-located with user 402 of electronic device 101a, as shown in FIG. 4N. presenting (706 of FIG. 7 ) a location of the third user of the third electronic device having a first appearance as shown to user 427 of electronic device 101d presented via optical pass-through by electronic device 101a via one or more first displays in accordance with a determination that the one or more first criteria are met, in accordance with a determination that the third position of the third user of the third electronic device is within the field of view of the first electronic device; and presenting (706 of FIG. 7 ) a location of the third user of the third electronic device having a first appearance as shown to user 427 of electronic device 101d presented via optical pass-through by electronic device 101a via one or more first displays in accordance with a determination that the one or more first criteria are not met.and displaying (708 of FIG. 7) the third user of the third electronic device having a second appearance different from the first appearance, the second appearance including a visual representation of the third user of the third electronic device, such as spatial avatar 429a or representation 429b of user 427 of electronic device 101d of FIG. 4J or FIG. 4K.

[0159] Additionally or alternatively, in some examples, when an event is detected, the communication session is only between electronic devices within a shared visual space of the physical environment, such as a multi-user communication session that in the illustrated example is only between users 402-406 of co-located electronic devices 101a-101c of FIG. 4I.

[0160] Additionally or alternatively, in some examples, when the event is detected, the communication session is only between electronic devices that are not within a shared visual space of the physical environment. For example, in Figure 4I, the event optionally corresponds to a request to add user 404 of electronic device 101b to the active multi-user communication session, and when the event is detected, the active multi-user communication session is optionally only between user 402 of electronic device 101a and user 427 of electronic device 101d, without including user 4024 of electronic device 101b and user 406 of electronic device 101c, which are in the same physical environment as electronic device 101a in Figure 4I.

[0161] Additionally or alternatively, in some examples, the visual representation of the third user of the third electronic device is a two-dimensional representation of the third user of the second electronic device displayed in a window of a user interface, such as representation 429b of user 427 of electronic device 101d in FIG. 4K.

[0162] Additionally or alternatively, in some examples, the visual representation of the third user of the third electronic device is a three-dimensional representation of the third user of the second electronic device, such as spatial avatar 429a of user 427 of electronic device 101d in FIG. 4J.

[0163] Additionally or alternatively, in some examples, the one or more criteria further include a criterion that is met when the first electronic device and the third electronic device are connected to the same wireless local area network.

[0164] Additionally or alternatively, in some examples, the one or more criteria further include a criterion that is met when image data captured by one or more first image capture devices in communication with the first electronic device includes image data of a third electronic device.

[0165] Additionally or alternatively, in some examples, the one or more criteria further include a criterion that is met when audio data detected by one or more first microphones in communication with the first electronic device is also detected by one or more second microphones in communication with a third electronic device.

[0166] Additionally or alternatively, in some examples, the one or more criteria further include a criterion that is met when a first context mapping of the physical environment of the first electronic device at least partially overlaps with a second context mapping of the physical environment of the third electronic device.

[0167] Additionally or alternatively, in some examples, the first electronic device or the third electronic device detected at least partial overlap between a first context mapping of the physical environment of the first electronic device and a second context mapping of the physical environment of the third electronic device.

[0168] Additionally or alternatively, in some examples, method 700 includes determining that one or more criteria are no longer met after presenting the third user of the third electronic device having the first appearance at the location of the third user of the electronic device, as described above with reference to example method 600, and displaying the third user of the third electronic device having the second appearance via the one or more first displays in response to determining that the one or more criteria are no longer met.

[0169] Additionally or alternatively, in some examples, as described with reference to Figures 4A-4B, following a determination that one or more criteria are not met, in accordance with a determination that the location of the third user of the third electronic device within the physical environment of the third electronic device is a first remote location, a visual representation of the third user of the third electronic device is displayed at the first location, and in accordance with a determination that the location of the third user of the third electronic device is a second remote location different from the first remote location within the physical environment of the third electronic device, a visual representation of the third user of the third electronic device is displayed at the first location.

[0170] Additionally or alternatively, in some examples, as described above with reference to method 600 and / or the examples of Figures 4G-4H, in accordance with a determination that the number of multiple users of different electronic devices in the shared visual space of the physical environment is at least a threshold number, the visual representation of the third user on the third electronic device is a two-dimensional representation of the second user on the second electronic device, and in accordance with a determination that the number of multiple users of different electronic devices in the shared visual space of the physical environment is less than a threshold number, the visual representation of the third user on the third electronic device is a three-dimensional representation of the second user on the second electronic device.

[0171] Additionally or alternatively, in some examples, the one or more first output devices include one or more first audio output devices, and method 700 includes, in accordance with a determination that the one or more first criteria are not satisfied, presenting audio detected by one or more third input devices in communication with the third electronic device via the one or more audio output devices, and in accordance with a determination that the one or more first criteria are satisfied, forgoing presenting audio detected by one or more third input devices in communication with the third electronic device via the one or more audio output devices, as described above with reference to example method 600.

[0172] Additionally or alternatively, in some examples, the one or more first displays include a head-mounted display system and the one or more audio output devices are worn by a first user of the first electronic device, as described above with reference to the example method 600.

[0173] Some examples of the present disclosure are directed to a first electronic device comprising one or more processors, a memory, and one or more programs, the one or more programs being stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing any of the methods described above.

[0174] Some examples of the present disclosure are directed to a non-transitory computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by one or more processors of the first electronic device, cause the first electronic device to perform any of the methods described above.

[0175] Some examples of the present disclosure are directed to a first electronic device comprising one or more processors, a memory, and means for performing any of the above methods.

[0176] Some examples of the present disclosure are directed to an information processing apparatus for use in a first electronic device, the information processing apparatus comprising means for performing any of the above methods.

[0177] 8 is a flow diagram illustrating a method 800 for modifying a level of a first audio property of a first electronic device co-located with a second electronic device during a multi-user communication session, according to some examples of the present disclosure. One or more examples of method 800 are illustrated and / or described above with reference to one or more of FIGS. 5A-5H . It is understood that method 800 is an example, and that more, fewer, or different operations may be performed in the same or a different order. Additionally, the operations of method 800 described below are, optionally, implemented by executing one or more functional modules of an information processing device, such as a general-purpose processor (e.g., as described with respect to FIG. 2 ) or an application-specific chip, and / or by other components of FIG. 2 .

[0178] Thus, in accordance with the above, some examples of the present disclosure may involve a first electronic device (e.g., electronic device 101a of FIG. 4I) in communication with one or more first displays, one or more first input devices, and one or more first audio output devices, while a communication session is active between multiple users of different electronic devices, including a first user of the first electronic device (e.g., user 502 of electronic device 101a of FIG. 5A) and a second user of a second electronic device different from the first electronic device (e.g., user 504 of electronic device 101b of FIG. 5A), while the first electronic device and the second electronic device are within a shared audio space of a physical environment (e.g., physical environment 500 of FIG. 5A), and while a first audio property of the first electronic device is set to a first level (e.g., glyph 512a of FIG. 5A indicates that the maximum volume of electronic device 101a is set to a first level). 5A to 5B. The present invention is directed to a method (e.g., method 800 of FIG. 8) that includes detecting an event (802 of FIG. 8) corresponding to a trigger for changing a first audio property of a first electronic device from a first level to a second level different from the first level, where the event includes a change in distance between a first position of the first electronic device and a second position of the second electronic device, such as a decrease in distance between the electronic devices 101a / 101b from FIG. 5A to 5B. In response to detecting the event corresponding to the trigger for changing the first audio property of the first electronic device from the first level to the second level, changing the first audio property of the first electronic device from the first level to the second level (804 of FIG. 8), such as a glyph 512b of FIG. 5B indicating that the maximum volume of the electronic device 101a is set to a second level lower than the first level of FIG. 5A, in response to the change in distance from FIG. 5A to 5B.

[0179] Additionally or alternatively, in some examples, while the first electronic device and the second electronic device are within a shared audio space of the physical environment, audio data detected by one or more first microphones communicating with the first electronic device is also detected by one or more second microphones communicating with the second electronic device, which also detect audio provided by the user 504 of electronic device 101b via the microphone of electronic device 101b, as described with reference to the microphone of electronic device 101a detecting audio provided by the user 504 of electronic device 101b (e.g., the voice of user 504).

[0180] Additionally or alternatively, in some examples, the first audio property is a system volume level of the first electronic device, such as the current volume level of electronic device 101a, as indicated by glyphs 514b and 514c, which decreases as the distance between electronic devices 101a / 101b changes from FIG. 5B to FIG. 5C.

[0181] Additionally or alternatively, in some examples, the first audio property is a maximum system volume level of the first electronic device, such as a maximum volume level of electronic device 101a, as indicated by glyphs 512b and 512c, which decreases as the distance between electronic devices 101a / 101b changes from FIG. 5B to FIG. 5C.

[0182] Additionally or alternatively, in some examples, the first audio property is also a maximum system volume level of the second electronic device, and the first audio property of the second electronic device is set to the first level while the first audio property of the first electronic device is set to the first level. Additionally or alternatively, in some examples, method 800 further includes initiating a process to cause the second electronic device to change the first audio property of the second electronic device from the first level to the second level in response to detecting an event corresponding to a trigger for changing the first audio property of the first electronic device from the first level to the second level. For example, in Figures 5A-5H, glyphs 512a-512h optionally correspond to the maximum volume level setting of electronic device 101a / 101b. As another example, when electronic device 101a detects a change in the distance between electronic devices 101a / 101b, electronic device 101a optionally sends a signal to electronic device 101b to cause electronic device 101b to change the level of an audio property at electronic device 101b, such as making the maximum allowable volume level of electronic device 101b the same as the maximum allowable volume level of electronic device 101a, based on the distance between electronic devices 101a / 101b. Thus, the maximum volume levels of both electronic devices 101a / 101b are optionally adjusted in response to the change in distance between electronic devices 101a / 101b. Furthermore, in some examples, user 504 and electronic device 101b in FIGS. 5A-5H represent one or more users and electronic devices that are co-located with user 502 of electronic device 101a, and the maximum volume levels of all of the co-located electronic devices during a multi-user communication session may change based on the change in distance between two or more (or all) of the co-located electronic devices.

[0183] Additionally or alternatively, in some examples, the first level is greater than the second level, as shown in glyph 512a of FIG. 5A to glyph 512a of FIG. 5B.

[0184] Additionally or alternatively, in some examples, the second level is greater than the first level. For example, as electronic device 101a increases the distance between electronic devices 101a / 101b, such as from when electronic devices 101a / 101b are located at their respective positions in Figure 5B to when they are located at their respective positions in Figure 5A, electronic device 101a optionally increases the maximum volume level of electronic device 101a to the level shown in glyph 512a in Figure 5A. In some examples, electronic device 101a increases the current volume level of electronic device 101a based on the increase in distance between electronic devices 101a / 101b.

[0185] Additionally or alternatively, in some examples, as described herein above, in accordance with a determination that the change in distance between the first position of the first electronic device and the second position of the second electronic device is a first change amount of distance, the difference between the first level and the second level of the first audio property is a first difference amount, and in accordance with a determination that the change in distance between the first position of the first electronic device and the second position of the second electronic device is a second change amount of distance that is different from the first change amount of distance, the difference between the first level and the second level of the first audio property is a second difference amount that is different from the first difference amount.

[0186] Additionally or alternatively, in some examples, in response to a determination that the change in distance corresponds to a decrease in distance between the first position of the first electronic device and the second position of the second electronic device, the second level of the audio property is less than the first level of the first audio property, and in response to a determination that the change in distance corresponds to an increase in distance between the first position of the first electronic device and the second position of the second electronic device, the second level of the audio property is greater than the first level of the first audio property.

[0187] Additionally or alternatively, in some examples, the second level of the first audio property of the first electronic device is based on audio latency between the first electronic device and the second electronic device, as described with reference to Figures 5A-5C and 5D-5F.

[0188] Additionally or alternatively, in some examples, as described with reference to Figures 5A-5C and Figures 5D-5F, in accordance with a determination that the amount of audio latency between the first electronic device and the second electronic device is a first amount, the level difference between the second level and the first level of the first audio property of the first electronic device is a first individual amount difference, and in accordance with a determination that the amount of audio latency between the first electronic device and the second electronic device is a second amount different from the first amount, the level difference between the second level and the first level of the first audio property of the first electronic device is a second individual amount difference different from the first individual amount difference.

[0189] Additionally or alternatively, in some examples, the first electronic device presents audio components of the communication session via one or more first audio output devices, the first audio property being a maximum system volume level of the first electronic device, and when an event corresponding to a trigger changing the first audio property of the first electronic device from the first level to the second level is detected, the audio components of the communication session are presented at the first volume level via the one or more first audio output devices, and the audio components of the communication session continue to be presented at the first volume level via the one or more first audio output devices in response to detecting the event corresponding to a trigger changing the first audio property of the first electronic device from the first level to the second level, as described with reference to glyphs 514a / 514b of Figures 5A and 5B.

[0190] Additionally or alternatively, in some examples, the first electronic device presents audio components of the communication session via one or more first audio output devices, the first audio property being a maximum system volume level of the first electronic device, and when an event corresponding to a trigger changing the first audio property of the first electronic device from the first level to the second level is detected, the audio components of the communication session are presented at the first volume level, and method 800 further includes presenting the audio components of the communication session via the one or more audio output devices at a second volume level different from the first volume level in response to detecting the event corresponding to a trigger changing the first audio property of the first electronic device from the first level to the second level, as described with reference to glyphs 514b / 514c of Figures 5B and 5C.

[0191] Additionally or alternatively, in some examples, the first audio property of the first electronic device is a maximum volume level (e.g., glyph 512a of FIG. 5A ), and method 800 includes detecting, while the first audio property of the first electronic device is set to a first individual level, a second event corresponding to a request to display shared virtual content in the communication session, the shared virtual content being associated with an audio component, such as detecting a request by electronic device 101a to display shared content 511 of the multi-user communication session and shared content 511 corresponding to a movie; and, in response to detecting the second event corresponding to the request to display the shared virtual content in the communication session, displaying one or more first display devices. displaying the shared virtual content, such as electronic device 101a displaying a movie from the perspective of user 502, via the one or more first audio output devices; and, based on detecting playback of the movie within the multi-user communication session (and / or optionally in addition to based on the distance between electronic devices 101a / 101b), setting a first audio property of a first electronic device, such as electronic device 101a setting glyph 512a to the illustrated level or a second level different from the illustrated level, for audio components of the shared virtual content to a second individual level different from the first individual level; and presenting the audio components associated with the shared virtual content via one or more first audio output devices at an individual volume level equal to or lower than the second individual level.

[0192] Additionally or alternatively, in some examples, in accordance with a determination that the distance between the first position of the first electronic device and the second position of the second electronic device exceeds a threshold distance, presenting audio detected by one or more second microphones communicating with the second electronic device via one or more first audio output devices, as shown and described with reference to glyph 518g of FIG. 5G, and in accordance with a determination that the distance between the first position of the first electronic device and the second position of the second electronic device is less than a threshold distance, forgoing presenting audio detected by one or more second microphones communicating with the second electronic device via one or more first audio output devices, as shown and described with reference to glyph 518h of FIG. 5H.

[0193] Additionally or alternatively, in some examples, the one or more first displays include a head-mounted display system and the one or more audio output devices are worn by a first user of the first electronic device, as described above with reference to the example method 600.

[0194] Some examples of the present disclosure are directed to a first electronic device comprising one or more processors, a memory, and one or more programs, the one or more programs being stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing any of the methods described above.

[0195] Some examples of the present disclosure are directed to a non-transitory computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by one or more processors of the first electronic device, cause the first electronic device to perform any of the methods described above.

[0196] Some examples of the present disclosure are directed to a first electronic device comprising one or more processors, a memory, and means for performing any of the above methods.

[0197] Some examples of the present disclosure are directed to an information processing apparatus for use in a first electronic device, the information processing apparatus comprising means for performing any of the above methods.

[0198] The foregoing description has been set forth with reference to specific embodiments for purposes of explanation. However, the illustrative description above is not intended to be exhaustive or to limit the disclosure to the precise form disclosed. Many modifications and variations are possible in light of the above teachings. The examples were chosen and described to best explain the principles of the disclosure and its practical application, thereby enabling those skilled in the art to best utilize the disclosure and various described examples, with various modifications suited to the particular use contemplated.

Claims

1. 1. A method comprising: A first electronic device in communication with one or more first displays, one or more first input devices, and one or more first output devices, While a communication session is active between multiple users of different electronic devices, including a first user of the first electronic device and a second user of a second electronic device different from the first electronic device, displaying, via the one or more first displays, the second user of the second electronic device having a first appearance, the first appearance including a visual representation of the second user of the second electronic device; while displaying the second user of the second electronic device having the first appearance via the one or more first displays; determining that one or more criteria are met, including a criterion that is met when the first electronic device and the second electronic device are within a shared visual space of a physical environment; and In response to determining that the one or more criteria are met, ceasing to display the second user of the second electronic device having the first appearance via the one or more first displays; and in response to determining that the location of the second user of the second electronic device is within the field of view of the first electronic device; and presenting, via the one or more first displays, the second user of the second electronic device at the location of the second user of the second electronic device with a second appearance different from the first appearance.

2. 10. The method of claim 1, wherein the visual representation of the second user of the second electronic device is a two-dimensional representation of the second user of the second electronic device displayed in a window of a user interface.

3. The method of claim 1 , wherein the visual representation of the second user of the second electronic device is a three-dimensional representation of the second user of the second electronic device.

4. the visual representation of the second user of the second electronic device is a three-dimensional representation of the second user of the second electronic device, and while displaying the three-dimensional representation of the second user of the second electronic device, a number of users of electronic devices in the shared visual space of the physical environment during the communication session is less than a threshold number of users of electronic devices in the shared visual space of the physical environment during the communication session, and the method further comprises: while displaying to the second user the second electronic device having the first appearance; detecting, via the one or more first input devices, a change in the number of users of electronic devices in the shared visual space of the physical environment during the communication session to a number that exceeds the threshold number of users of electronic devices in the shared visual space of the physical environment during the communication session; in response to detecting a change in the number of users of electronic devices within the shared visual space of the physical environment during the communication session to a number that exceeds the threshold number of users of electronic devices within the shared visual space of the physical environment during the communication session; 10. The method of claim 1, further comprising: changing the visual representation of the second user of the second electronic device from the three-dimensional representation of the second user of the second electronic device to a two-dimensional representation of the second user of the second electronic device via the one or more first displays, comprising displaying the two-dimensional representation of the second user of the second electronic device in a window of a user interface.

5. the plurality of users includes a third user of a third electronic device that is displayed with the second appearance different from the first electronic device and the second electronic device, the visual representation of the second user of the second electronic device is a three-dimensional representation of the second user of the second electronic device, the three-dimensional representation of the second user of the second electronic device is displayed simultaneously with selectable options selectable to control a spatial state associated with one or more users of the plurality of users that meet the one or more criteria, the method comprising: detecting an indication of selection of the selectable option while simultaneously displaying the second user of the second electronic device having the first appearance, the third user of the third electronic device having the second appearance, and the selectable option; In response to detecting the indication of the selection of the selectable option, 10. The method of claim 1, further comprising: changing the visual representation of the second user of the second electronic device from the three-dimensional representation of the second user of the second electronic device to a two-dimensional representation of the second user of the second electronic device via the one or more first displays, comprising displaying the two-dimensional representation of the second user of the second electronic device in a window of a user interface without changing the appearance of the third user of the third electronic device.

6. 6. The method of claim 5, wherein detecting the indication of the selection of the selectable option comprises detecting a selection input directed toward the selectable option provided by the first user via the one or more first input devices.

7. the selectable options are further displayed by the third electronic device; detecting the indication of the selection of the selectable option includes receiving, from the third electronic device, input data indicative of a respective input provided by the third user corresponding to the selection of the selectable option detected by the third electronic device; The method of claim 5 , comprising:

8. The method of claim 1 , wherein the one or more criteria further comprises a criterion that is met when the first electronic device and the second electronic device are connected to the same wireless local area network.

9. 2. The method of claim 1 , wherein the one or more criteria further include a criterion that is met when image data captured by one or more first image capture devices in communication with the first electronic device includes image data of the second electronic device.

10. 2. The method of claim 1 , wherein the one or more first input devices include one or more first microphones, and the one or more criteria further include a criterion that is satisfied when audio data detected by the one or more first microphones is also detected by one or more second microphones in communication with the second electronic device.

11. 2. The method of claim 1 , wherein the one or more criteria further comprise a criterion that is met when a first context mapping of a physical environment of the first electronic device at least partially overlaps with a second context mapping of a physical environment of the second electronic device.

12. 12. The method of claim 11, wherein the first electronic device or the second electronic device detects the at least partial overlap between the first context mapping of the physical environment of the first electronic device and the second context mapping of the physical environment of the second electronic device.

13. after presenting the second user of the second electronic device having the second appearance to the location of the second user of the second electronic device; Detecting via the one or more first input devices that the one or more criteria are no longer satisfied; and in response to detecting that the one or more criteria are no longer satisfied; displaying the second user of the second electronic device having the first appearance via the one or more first displays; The method of claim 1 , comprising:

14. detecting, via the one or more first input devices, a request to display shared virtual content during the communication session via the one or more first displays; in response to detecting the request to display the shared virtual content during the communication session; displaying the shared virtual content at a first location within a three-dimensional environment to the first user of the first electronic device via the one or more first displays; In accordance with determining that the one or more criteria are met, initiating a process to cause the second user of the second electronic device to display the shared virtual content via one or more second displays in communication with the second electronic device at the first location within the three-dimensional environment; The method of claim 1 , comprising:

15. The method of claim 1 , wherein the communication session is activated in response to a request to display shared virtual content during the communication session.

16. the one or more first output devices include one or more first audio output devices, and the method further comprises: presenting, via the one or more first audio output devices, audio detected by one or more second input devices in communication with the second electronic device while displaying, via the one or more first displays, to the second user of the second electronic device having the first appearance; and ceasing to present the audio detected by the one or more second input devices in communication with the second electronic device via the one or more first audio output devices in response to determining that the one or more criteria are met.

17. the one or more first output devices include one or more first audio output devices, shared virtual content is displayed via the one or more first displays during the communication session, the shared virtual content of the communication session includes an audio component, and the method further comprises: while presenting the audio component of the shared virtual content of the communication session via the one or more first audio output devices. in accordance with a determination that the one or more criteria are met, forgoing presenting audio detected by one or more second input devices in communication with the second electronic device via the one or more first audio output devices; 10. The method of claim 1, further comprising: presenting the audio detected by the one or more second input devices in communication with the second electronic device via the one or more first audio output devices in accordance with a determination that the one or more criteria are not met.

18. In response to detecting that the one or more criteria are met, responsive to determining that the location of the second user of the second electronic device is not within a field of view of the first electronic device; forgoing presenting the second user of the second electronic device having the second appearance at the location of the second user of the second electronic device relative to the location of the first user of the first electronic device via the one or more first displays; The method of claim 1 , comprising:

19. a first electronic device, one or more processors; Memory and and one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising instructions for performing the method of any one of claims 1 to 18.

20. 19. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by one or more processors of the first electronic device, cause the first electronic device to perform the method of any one of claims 1 to 18.