System and method for managing space group in multiuser communication session
By adjusting avatar positions based on shared content type, the system ensures consistent spatial group management in multi-user communication sessions, enhancing user interaction and experience.
Patent Information
- Application Number
- CN202410711405.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2024-01-24
- Filing Date
- 2024-06-04
- Publication Date
- 2024-12-06
AI Technical Summary
Existing systems fail to effectively manage the spatial arrangement of users in multi-user communication sessions based on the type of shared content in three-dimensional environments, leading to inconsistent user interactions and experiences.
Electronic devices adjust the distance and position of avatars in a three-dimensional environment based on the type of shared content, maintaining a consistent spatial reality for users by updating avatar positions relative to a shared object or viewpoint.
This approach ensures consistent spatial group management, enhancing user interaction and experience by aligning avatar positions with shared content, thereby improving the overall usability and coherence of multi-user communication sessions.
Smart Images

Figure CN119094690A_ABST
Abstract
Description
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS
[0002] This application claims the benefit of U.S. Provisional Application No. 63 / 506,116 filed on June 4, 2023, U.S. Provisional Application No. 63 / 514,327 filed on July 18, 2023, U.S. Provisional Application No. 63 / 578,616 filed on August 24, 2023, U.S. Provisional Application No. 63 / 587,595 filed on October 3, 2023, U.S. Provisional Application No. 18 / 421,675 filed on January 24, 2024, and U.S. Patent Application No. 18 / 421,827 filed on January 24, 2024, the contents of which are incorporated herein by reference in their entirety for all purposes. Technical Field
[0003] The present disclosure generally relates to systems and methods for managing spatial groups within a multi-user communication session. Background Art
[0004] Some computer graphics environments provide two-dimensional and / or three-dimensional environments in which at least some of the objects displayed for user observation are virtual and computer-generated. In some examples, the three-dimensional environment is presented by multiple devices communicating in a multi-user communication session. In some examples, an avatar (e.g., a representation) of each user participating in the multi-user communication session (e.g., via a computing device) is displayed in the three-dimensional environment of the multi-user communication session. In some examples, content can be shared in the three-dimensional environment for viewing and interaction by multiple users participating in the multi-user communication session. Summary of the invention
[0005] Some examples of the present disclosure relate to systems and methods for managing the positions of users in a spatial group within a multi-user communication session based on the display of shared content in a three-dimensional environment. In some examples, a first electronic device, a second electronic device, and a third electronic device are communicatively linked in a multi-user communication session. In some examples, the first electronic device displays a three-dimensional environment including an avatar corresponding to a user of the second electronic device and an avatar corresponding to a user of the third electronic device, wherein the avatar corresponding to the user of the second electronic device and the avatar corresponding to the user of the third electronic device are separated by a first distance. In some examples, in response to detecting an input corresponding to a request to display shared content in a three-dimensional environment, the first electronic device displays a first object corresponding to the shared content in a three-dimensional environment based on determining that the shared content is a first type of content. In some examples, the first electronic device updates the avatar corresponding to the user of the second electronic device and the avatar corresponding to the user of the third electronic device, so that the avatar corresponding to the user of the second electronic device and the avatar corresponding to the user of the third electronic device are separated by a second distance different from the first distance. In some examples, based on determining that the shared content is a second type of content different from the first type of content, the first electronic device displays a second object corresponding to the shared content in a three-dimensional environment. In some examples, the first electronic device maintains the display interval of the avatar corresponding to the user of the second electronic device and the avatar corresponding to the user of the third electronic device by a first distance.
[0006] In some examples, a first electronic device, a second electronic device, and a third electronic device are communicatively linked in a multi-user communication session. In some examples, the first electronic device displays a three-dimensional environment including an avatar corresponding to a user of the second electronic device and an avatar corresponding to a user of the third electronic device, wherein the avatar corresponding to the user of the second electronic device is displayed at a first position relative to a viewpoint of the first electronic device, and the avatar corresponding to the user of the third electronic device is displayed at a second position relative to a viewpoint of the first electronic device. In some examples, in response to detecting an input corresponding to a request to display content in a three-dimensional environment, the first electronic device displays a first object corresponding to the shared content in the three-dimensional environment based on determining that the content corresponds to shared content. In some examples, the first electronic device moves the avatar corresponding to the user of the second electronic device to a first update position relative to the viewpoint of the first electronic device, and moves the avatar corresponding to the user of the third electronic device to a second update position different from the first update position. In some examples, the first electronic device moves the avatar in a corresponding direction based on the position of the first object in the three-dimensional environment.
[0007] A comprehensive description of these examples is provided in the drawings and detailed description, and it should be understood that this summary does not limit the scope of the present disclosure in any way. BRIEF DESCRIPTION OF THE DRAWINGS
[0008] For a better understanding of the various examples described herein, reference should be made to the following detailed description and the following drawings. Throughout the drawings, like reference numerals generally refer to corresponding parts.
[0009] Figure 1 An electronic device presenting an extended reality environment according to some examples of the present disclosure is shown.
[0010] Figure 2 A block diagram illustrating an exemplary architecture of a system according to some examples of the present disclosure.
[0011] Figure 3 Examples of spatial groups of users of a first electronic device and users of a second electronic device in a multi-user communication session according to some examples of the present disclosure are shown.
[0012] FIG. 4A to FIG. 4N Example interactions between users in a multi-user communication session according to some examples of the present disclosure are shown.
[0013] FIG. 5A to FIG. 5S Example interactions between users in a multi-user communication session according to some examples of the present disclosure are shown.
[0014] FIG. 6A to FIG. 6I Example interactions between users in a multi-user communication session according to some examples of the present disclosure are shown.
[0015] FIG. 7A to FIG. 7B A flow diagram illustrating an example process for updating a spatial group of users in a multi-user communication session based on content displayed in a three-dimensional environment according to some examples of the present disclosure is shown.
[0016] Figure 8 A flow diagram illustrating an example process for moving three-dimensional representations of users within a multi-user communication session when sharing content in a three-dimensional environment according to some examples of the present disclosure is shown.
[0017] FIG. 9A to FIG. 9B A flow chart illustrating an example process for updating a spatial user group in a multi-user communication session based on content displayed in a three-dimensional environment according to some examples of the present disclosure is shown. DETAILED DESCRIPTION
[0018] Some examples of the present disclosure relate to systems and methods for managing the positions of users in a spatial group within a multi-user communication session based on the display of shared content in a three-dimensional environment. In some examples, a first electronic device, a second electronic device, and a third electronic device are communicatively linked in a multi-user communication session. In some examples, the first electronic device displays a three-dimensional environment including an avatar corresponding to a user of the second electronic device and an avatar corresponding to a user of the third electronic device, wherein the avatar corresponding to the user of the second electronic device and the avatar corresponding to the user of the third electronic device are separated by a first distance. In some examples, in response to detecting an input corresponding to a request to display shared content in a three-dimensional environment, the first electronic device displays a first object corresponding to the shared content in a three-dimensional environment based on determining that the shared content is a first type of content. In some examples, the first electronic device updates the avatar corresponding to the user of the second electronic device and the avatar corresponding to the user of the third electronic device, so that the avatar corresponding to the user of the second electronic device and the avatar corresponding to the user of the third electronic device are separated by a second distance different from the first distance. In some examples, based on determining that the shared content is a second type of content different from the first type of content, the first electronic device displays a second object corresponding to the shared content in a three-dimensional environment. In some examples, the first electronic device maintains the display interval of the avatar corresponding to the user of the second electronic device and the avatar corresponding to the user of the third electronic device by a first distance.
[0019] In some examples, a first electronic device, a second electronic device, and a third electronic device are communicatively linked in a multi-user communication session. In some examples, the first electronic device displays a three-dimensional environment including an avatar corresponding to a user of the second electronic device and an avatar corresponding to a user of the third electronic device, wherein the avatar corresponding to the user of the second electronic device is displayed at a first position relative to a viewpoint of the first electronic device, and the avatar corresponding to the user of the third electronic device is displayed at a second position relative to a viewpoint of the first electronic device. In some examples, in response to detecting an input corresponding to a request to display content in a three-dimensional environment, the first electronic device displays a first object corresponding to the shared content in the three-dimensional environment based on determining that the content corresponds to shared content. In some examples, the first electronic device moves the avatar corresponding to the user of the second electronic device to a first update position relative to the viewpoint, and moves the avatar corresponding to the user of the third electronic device to a second update position different from the first update position. In some examples, the first electronic device moves the avatar in a corresponding direction based on the position of the first object in the three-dimensional environment.
[0020] In some examples, multiple users in a multi-user communication session have or are associated with a spatial group that indicates the location of one or more users and / or content in a shared three-dimensional environment. In some examples, users sharing the same spatial group within the multi-user communication session experience a spatial reality (e.g., as defined later herein) based on the spatial arrangement of users in the spatial group (e.g., distances between adjacent users). In some examples, when a user of a first electronic device shares a spatial arrangement with a user of a second electronic device, the user experiences a spatial reality relative to a three-dimensional representation (e.g., avatar) corresponding to the user in their respective three-dimensional environment.
[0021] In some examples, displaying (sharing) content in a three-dimensional environment while in a multi-user communication session may include interaction with one or more user interface elements. In some examples, the user's gaze may be tracked by an electronic device as an input for targeting selectable options / indicators within a corresponding user interface element displayed in the three-dimensional environment. For example, the gaze may be used to identify one or more options / indicators selected as a target using another selection input. In some examples, hand tracking input detected via an input device that communicates with the electronic device may be used to select a corresponding option / indicator. In some examples, objects displayed in the three-dimensional environment may be moved and / or reoriented in the three-dimensional environment based on movement input detected via the input device.
[0022] Figure 1 An electronic device 101 is shown that presents an extended reality (XR) environment (e.g., a computer-generated environment) according to some examples of the present disclosure. In some examples, the electronic device 101 is a handheld device or a mobile device, such as a tablet, a laptop, a smart phone, or a head-mounted display. Figure 2 An example of an electronic device 101 is described by using an architectural block diagram of FIG. Figure 1 As shown, electronic device 101, table 106, and coffee cup 152 are located in physical environment 100. The physical environment may include physical features, such as physical surfaces (e.g., floors, walls) or physical objects (e.g., tables, lamps, etc.). In some examples, electronic device 101 may be configured to capture an image of physical environment 100 including table 106 and coffee cup 152 (shown in the field of view of electronic device 101). In some examples, in response to a trigger, electronic device 101 may be configured to capture an image of physical environment 100 including table 106 and coffee cup 152 (shown in the field of view of electronic device 101). Figure 11. A virtual object 110 (e.g., two-dimensional virtual content) is displayed in the computer-generated environment 100 (e.g., a rectangular representation shown), which virtual object does not exist in the physical environment 100, but is displayed in the computer-generated environment on top of (e.g., anchored to) the computer-generated representation 106' of the real-world table 106. For example, in response to detecting a flat surface of the table 106 in the physical environment 100, the virtual object 110 may be displayed on the surface of the computer-generated representation 106' of the table in the computer-generated environment, next to the computer-generated representation 152' of the real-world coffee cup 152 displayed via the electronic device 101.
[0023] It should be understood that the virtual object 110 is a representative virtual object and may include and render one or more different virtual objects (e.g., virtual objects with various dimensions, such as two-dimensional or three-dimensional virtual objects) in a three-dimensional computer-generated environment. For example, a virtual object may represent an application or user interface displayed in a computer-generated environment. In some examples, a virtual object may represent content corresponding to an application and / or displayed via a user interface in a computer-generated environment. In some examples, the virtual object 110 is optionally configured to be interactive and responsive to user input, so that a user can virtually touch, tap, move, rotate, or otherwise interact with the virtual object. In some examples, the virtual object 110 may be displayed in a three-dimensional computer-generated environment within a multi-user communication session ("multi-user communication session", "communication session"). In some such examples, as described in more detail below, the virtual object 110 may be viewable and / or configured to be interactive and responsive to user input provided by multiple users and / or by multiple users, respectively. In addition, it should be understood that the 3D environment (or 3D virtual object) described herein may be a representation of a 3D environment (or three-dimensional virtual object) projected or presented at an electronic device.
[0024] In the following discussion, an electronic device that communicates with a display generation component and one or more input devices is described. It should be understood that the electronic device optionally communicates with one or more other physical user interface devices, such as a touch-sensitive surface, a physical keyboard, a mouse, a joystick, a hand tracking device, an eye tracking device, a stylus, etc. In addition, as described above, it should be understood that the described electronic device, display, and touch-sensitive surface are optionally distributed between two or more devices. Therefore, as used in the present disclosure, information displayed on or by an electronic device is optionally used to describe information output by the electronic device to be displayed on an independent display device (touch-sensitive or non-touch-sensitive). Similarly, as used in the present disclosure, input received on an electronic device (e.g., touch input received on a touch-sensitive surface of an electronic device, or touch input received on the surface of a stylus) is optionally used to describe input received on an independent input device, and the electronic device receives input information from the independent input device.
[0025] The device typically supports a variety of applications, such as one or more of the following applications: a drawing application, a presentation application, a word processing application, a website creation application, a disk editing application, a spreadsheet application, a gaming application, a telephony application, a video conferencing application, an email application, an instant messaging application, a fitness support application, a photo management application, a digital camera application, a digital video camera application, a web browsing application, a digital music player application, a television channel browsing application, and / or a digital video player application.
[0026] Figure 2 A block diagram of an exemplary architecture of a system 201 according to some examples of the present disclosure is shown. In some examples, the system 201 includes multiple devices. For example, the system 201 includes a first electronic device 260 and a second electronic device 270, wherein the first electronic device 260 and the second electronic device 270 communicate with each other. In some examples, the first electronic device 260 and the second electronic device 270 are portable devices, such as mobile phones, smart phones, tablet computers, laptop computers, auxiliary devices that communicate with another device, etc.
[0027] like Figure 2As shown, the first electronic device 260 optionally includes various sensors (e.g., one or more hand tracking sensors 202A, one or more position sensors 204A, one or more image sensors 206A, one or more touch-sensitive surfaces 209A, one or more motion and / or orientation sensors 210A, one or more eye tracking sensors 212A, one or more microphones 213A or other audio sensors, etc.), one or more display generation components 214A, one or more speakers 216A, one or more processors 218A, one or more memories 220A, and / or communication circuits 222A. In some embodiments, the second electronic device 270 optionally includes various sensors (e.g., one or more hand tracking sensors 202B, one or more position sensors 204B, one or more image sensors 206B, one or more touch-sensitive surfaces 209B, one or more motion and / or orientation sensors 210B, one or more eye tracking sensors 212B, one or more microphones 213B or other audio sensors, etc.), one or more display generation components 214B, one or more speakers 216, one or more processors 218B, one or more memories 220B, and / or communication circuits 222B. One or more communication buses 208A and 208B are optionally used for communication between the above components of electronic devices 260 and 270, respectively. First electronic device 260 and second electronic device 270 optionally communicate via a wired or wireless connection between the two devices (e.g., via communication circuits 222A to 222B).
[0028] The communication circuits 222A, 222B optionally include circuits for communicating with electronic devices, networks such as the Internet, intranets, wired networks and / or wireless networks, cellular networks, and wireless local area networks (LANs). The communication circuits 222A, 222B optionally include circuits for using near field communication (NFC) and / or short-range communication such as A circuit for communicating.
[0029] Processors 218A, 218B include one or more general purpose processors, one or more graphics processors, and / or one or more digital signal processors. In some examples, memories 220A, 220B are non-transitory computer-readable storage media (e.g., flash memory, random access memory, or other volatile or non-volatile memory or storage devices) storing computer-readable instructions, which are configured to be executed by processors 218A, 218B to perform the techniques, processes, and / or methods described below. In some examples, memories 220A, 220B may include more than one non-transitory computer-readable storage medium. A non-transitory computer-readable storage medium may be any medium (e.g., excluding signals) that can tangibly contain or store computer-executable instructions for use by or in combination with an instruction execution system, device, and apparatus. In some examples, the storage medium is a transient computer-readable storage medium. In some examples, the storage medium is a non-transitory computer-readable storage medium. A non-transitory computer-readable storage medium may include, but is not limited to, a magnetic storage device, an optical storage device, and / or a semiconductor storage device. Examples of such storage devices include magnetic disks, optical disks based on CD, DVD or Blu-ray technology, and persistent solid-state memory such as flash memory, solid-state drives, or the like.
[0030] In some examples, display generation components 214A, 214B include a single display (e.g., a liquid crystal display (LCD), an organic light emitting diode (OLED), or other type of display). In some examples, display generation components 214A, 214B include multiple displays, such as a stereoscopic display pair. In some examples, display generation components 214A, 214B may include a display with touch capabilities (e.g., a touch screen), a projector, a holographic projector, a retinal projector, a transparent or translucent display, etc. In some examples, electronic devices 260 and 270 include touch-sensitive surfaces 209A and 209B, respectively, for receiving user inputs such as tap inputs and swipe inputs or other gestures. In some examples, display generation components 214A, 214B and touch-sensitive surfaces 209A, 209B form a touch-sensitive display (e.g., a touch screen integrated with electronic devices 260 and 270, respectively, or a touch screen that communicates with electronic devices 260 and 270, respectively, outside electronic devices 260 and 270).
[0031] Electronic devices 260 and 270 optionally include image sensors 206A and 206B, respectively. Image sensors 206A / 206B optionally include one or more visible light image sensors (such as a charge coupled device (CCD) sensor) and / or a complementary metal oxide semiconductor (CMOS) sensor operable to obtain an image of a physical object from a real-world environment. Image sensors 206A / 206B also optionally include one or more infrared (IR) sensors, such as a passive IR sensor or an active IR sensor, for detecting infrared light from the real-world environment. For example, an active IR sensor includes an IR emitter for emitting infrared light into the real-world environment. Image sensors 206A / 206B also optionally include one or more cameras configured to capture the movement of physical objects in the real-world environment. Image sensors 206A / 206B also optionally include one or more depth sensors configured to detect the distance of physical objects from device 260 / 270. In some examples, information from one or more depth sensors may allow a device to identify an object in a real-world environment and distinguish it from other objects in the real-world environment. In some examples, one or more depth sensors may allow a device to determine the texture and / or topography of an object in a real-world environment.
[0032] In some examples, electronic devices 260 and 270 use CCD sensors, event cameras, and depth sensors in combination to detect the physical environment around electronic devices 260 and 270. In some examples, image sensors 206A / 206B include a first image sensor and a second image sensor. The first image sensor and the second image sensor work in tandem and are optionally configured to capture different information of physical objects in a real-world environment. In some examples, the first image sensor is a visible light image sensor, and the second image sensor is a depth sensor. In some examples, device 260 / 270 uses image sensor 206A / 206B to detect the position and orientation of device 260 / 270 and / or display generation component 214A / 214B in a real-world environment. For example, device 260 / 270 uses image sensor 206A / 206B to track the position and orientation of display generation component 214A / 214B relative to one or more fixed objects in a real-world environment.
[0033] In some examples, device 260 / 270 includes microphone 213A / 213B or other audio sensor. Device 260 / 270 uses microphone 213A / 213B to detect sounds from the user and / or the user's real-world environment. In some examples, microphone 213A / 213B includes a microphone array (multiple microphones) that optionally operate in concert to identify ambient noise or locate sound sources in the space of the real-world environment.
[0034] In some examples, the device 260 / 270 includes a location sensor 204A / 204B for detecting the location of the device 260 / 270 and / or the display generating component 214A / 214B. For example, the location sensor 204A / 204B may include a global positioning system (GPS) receiver that receives data from one or more satellites and allows the device 260 / 270 to determine the absolute location of the device in the physical world.
[0035] In some examples, the device 260 / 270 includes an orientation sensor 210A / 210B for detecting the orientation and / or movement of the device 260 / 270 and / or the display generation component 214A / 214B. For example, the device 260 / 270 uses the orientation sensor 210A / 210B to track changes in the position and / or orientation of the device 260 / 270 and / or the display generation component 214A / 214B, such as changes relative to physical objects in the real world environment. The orientation sensor 210A / 210B optionally includes one or more gyroscopes and / or one or more accelerometers.
[0036] In some examples, device 260 / 270 includes hand tracking sensor 202A / 202B and / or eye tracking sensor 212A / 212B. Hand tracking sensor 202A / 202B is configured to track the position / location of one or more parts of a user's hand and / or the movement of one or more parts of a user's hand relative to an extended reality environment, relative to display generation component 214A / 214B and / or relative to another defined coordinate system. Eye tracking sensor 212A / 212B is configured to track the position and movement of a user's gaze (more generally, eyes, face, or head) relative to a real world or extended reality environment and / or relative to display generation component 214A / 214B. In some examples, hand tracking sensor 202A / 202B and / or eye tracking sensor 212A / 212B is implemented together with display generation component 214A / 214B. In some examples, hand tracking sensors 202A / 202B and / or eye tracking sensors 212A / 212B are implemented separately from display generation components 214A / 214B.
[0037] In some examples, the hand tracking sensors 202A / 202B may use image sensors 206A / 206B (e.g., one or more IR cameras, 3D cameras, depth cameras, etc.) that capture three-dimensional information from the real world including one or more hands (e.g., one or more hands of a human user). In some examples, the hands may be resolved with sufficient resolution to distinguish fingers and their corresponding positioning. In some examples, one or more image sensors 206A / 206B are positioned relative to the user to define a field of view and interaction space of the image sensors 206A / 206B, in which the finger / hand positions, orientations, and / or movements captured by the image sensors are used as input (e.g., to distinguish from the user's idle hands or other hands of other people in the real-world environment). Tracking fingers / hands for input (e.g., gestures, touches, taps, etc.) may be advantageous because it does not require the user to touch, hold, or wear any type of beacon, sensor, or other marker.
[0038] In some examples, eye tracking sensors 212A / 212B include at least one eye tracking camera (e.g., an infrared (IR) camera) and / or an illumination source (e.g., an IR light source such as an LED) that emits light toward the user's eyes. The eye tracking camera can be pointed at the user's eyes to receive reflected IR light from the light source directly or indirectly from the eyes. In some examples, both eyes are tracked separately by corresponding eye tracking cameras and illumination sources, and focus / gaze can be determined by tracking both eyes. In some examples, one eye (e.g., the dominant eye) is tracked by corresponding eye tracking camera / illumination source.
[0039] Device 260 / 270 and system 201 are not limited to Figure 2Components and configurations, but may include fewer components, other components or additional components in multiple configurations. In some examples, system 201 can be implemented in a single device. One or more people using system 201 are optionally referred to as one or more users of the device in this article. Now turn your attention to the exemplary simultaneous display of a three-dimensional environment on a first electronic device (e.g., corresponding to electronic device 260) and a second electronic device (e.g., corresponding to electronic device 270). As described below, a first electronic device can communicate with a second electronic device in a multi-user communication session. In some examples, an avatar (e.g., representation) of a user of a first electronic device can be displayed in a three-dimensional environment at a second electronic device, and an avatar of a user of a second electronic device can be displayed in a three-dimensional environment at a first electronic device. In some examples, a user of a first electronic device and a user of a second electronic device can be associated with a spatial group in a multi-user communication session. In some examples, the interaction with the content in a three-dimensional environment when the first electronic device and the second electronic device are in a multi-user communication session can cause the user of the first electronic device and the user of the second electronic device to become associated with different spatial groups in the multi-user communication session.
[0040] Figure 3 An example of a spatial group of users of a first electronic device and users of a second electronic device in a multi-user communication session according to some examples of the present disclosure is shown. In some examples, the first electronic device 360 may present a three-dimensional environment 350A, and the second electronic device 370 may present a three-dimensional environment 350B. The first electronic device 360 and the second electronic device 370 may be similar to the electronic device 101 or 260 / 270, and / or may be head-mounted systems / devices and / or projection-based systems / devices (including hologram-based systems / devices) configured to generate and present a three-dimensional environment, such as a heads-up display (HUD), a head-mounted display (HMD), a window with integrated display capabilities, a display formed as a lens designed to be placed on a person's eye (e.g., similar to a contact lens), respectively. Figure 3 In the example, the first user optionally wears the first electronic device 360 and the second user optionally wears the second electronic device 370, so that the three-dimensional environment 350A / 350B can be defined by the X, Y, and Z axes viewed from the perspective of the electronic devices (e.g., a viewpoint associated with the electronic device 360 / 370 (which can be, for example, a head-mounted display)).
[0041] like Figure 3As shown, the first electronic device 360 may be in a first physical environment including a table 306 and a window 309. Therefore, the three-dimensional environment 350A presented using the first electronic device 360 optionally includes a captured portion of the physical environment surrounding the first electronic device 360, such as a representation 306' of the table and a representation 309' of the window. In other examples, the three-dimensional environment 350A presented using the first electronic device 360 optionally includes a portion of the physical environment viewed through a transparent or semi-transparent display of the first electronic device 360. Similarly, the second electronic device 370 may be in a second physical environment different from the first physical environment (e.g., separate from the first physical environment), the second physical environment including a floor lamp 307 and a coffee table 308. Therefore, the three-dimensional environment 350B presented using the second electronic device 370 optionally includes a captured portion of the physical environment surrounding the second electronic device 370, such as a representation 307' of the floor lamp and a representation 308' of the coffee table. In other examples, the three-dimensional environment 350B presented using the second electronic device 370 optionally includes a portion of the physical environment viewed through a transparent or semi-transparent display of the second electronic device 370. Additionally, the three-dimensional environments 350A and 350B may include representations of the floor, ceiling, and walls of the rooms in which the first electronic device 360 and the second electronic device 370 are respectively located.
[0042] As described above, in some examples, the first electronic device 360 is optionally in a multi-user communication session with the second electronic device 370. For example, the first electronic device 360 and the second electronic device 370 (e.g., via the communication circuit 222A / 222B) are configured to present a shared three-dimensional environment 350A / 350B that includes one or more shared virtual objects (e.g., content such as images, video, audio, etc., representations of user interfaces of applications, etc.). As used herein, the term "shared three-dimensional environment" refers to a three-dimensional environment that is independently presented, displayed, and / or visible at two or more electronic devices, via which content, applications, data, etc. can be shared and / or presented to users of the two or more electronic devices. In some examples, when the first electronic device 360 is in a multi-user communication session with the second electronic device 370, an avatar corresponding to a user of one electronic device is optionally displayed in the three-dimensional environment displayed via another electronic device. For example, as Figure 3 As shown, at the first electronic device 360, an avatar 315 corresponding to the user of the second electronic device 370 is displayed in the three-dimensional environment 350A. Similarly, at the second electronic device 370, an avatar 317 corresponding to the user of the first electronic device 360 is displayed in the three-dimensional environment 350B.
[0043] In some examples, the presentation of the avatar 315 / 317 as part of the shared three-dimensional environment is optionally accompanied by an audio effect corresponding to the voice of the user of the electronic device 370 / 360. For example, the avatar 315 displayed in the three-dimensional environment 350A using the first electronic device 360 is optionally accompanied by an audio effect corresponding to the voice of the user of the second electronic device 370. In some such examples, when the user of the second electronic device 370 speaks, the user's voice can be detected by the second electronic device 370 (e.g., via microphone 213B) and transmitted to the first electronic device 360 (e.g., via communication circuit 222B / 222A), so that the detected voice of the user of the second electronic device 370 can be presented to the user of the first electronic device 360 as audio in the three-dimensional environment 350A (e.g., using speaker 216A). In some examples, the audio effect corresponding to the voice of the user of the second electronic device 370 can be spatialized so that it appears to the user of the first electronic device 360 as emanating from the location of the avatar 315 in the shared three-dimensional environment 350A (e.g., despite being output from the speaker of the first electronic device 360). Similarly, avatar 317 displayed in three-dimensional environment 350B using second electronic device 370 is optionally accompanied by audio effects corresponding to the voice of the user of first electronic device 360. In some such examples, when the user of first electronic device 360 speaks, the user's voice may be detected by first electronic device 360 (e.g., via microphone 213A) and transmitted to second electronic device 370 (e.g., via communication circuitry 222A / 222B), so that the detected voice of the user of first electronic device 360 may be presented to the user of second electronic device 370 as audio in three-dimensional environment 350B (e.g., using speaker 216B). In some examples, the audio effect corresponding to the voice of the user of first electronic device 360 may be spatialized so that it appears to the user of second electronic device 370 as emanating from the location of avatar 317 in shared three-dimensional environment 350B (e.g., despite being output from a speaker of first electronic device 360).
[0044] In some examples, when in a multi-user communication session, the avatars 315 / 317 are displayed in the three-dimensional environment 350A / 350B at respective orientations that correspond to and / or are based on the orientation of the electronic device 360 / 370 (and / or the user of the electronic device 360 / 370) in the physical environment surrounding the electronic device 360 / 370. Figure 3As shown, in three-dimensional environment 350A, avatar 315 is optionally facing the viewpoint of the user of first electronic device 360, and in three-dimensional environment 350B, avatar 317 is optionally facing the viewpoint of the user of second electronic device 370. When a particular user moves the electronic device in the physical environment (and / or the particular user moves), the user's viewpoint changes according to the movement, which may also change the orientation of the user's avatar in the three-dimensional environment. For example, referring to Figure 3 , if the user of the first electronic device 360 looks to the left in the three-dimensional environment 350A, causing the first electronic device 360 to rotate to the left (e.g., counterclockwise) (e.g., a corresponding amount), the user of the second electronic device 370 will see the avatar 317 corresponding to the user of the first electronic device 360 rotate to the right (e.g., clockwise) relative to the viewpoint of the user of the second electronic device 370 based on the movement of the first electronic device 360.
[0045] Additionally, in some examples, the viewpoint of the three-dimensional environment 350A / 350B and / or the position of the viewpoint of the three-dimensional environment 350A / 350B optionally changes based on movement of the electronic device 360 / 370 (e.g., by a user of the electronic device 360 / 370) while in a multi-user communication session. For example, if the first electronic device 360 moves closer to the representation 306' of the table and / or the avatar 315 while in a communication session (e.g., because the user of the first electronic device 360 moves forward in the physical environment surrounding the first electronic device 360), the viewpoint of the three-dimensional environment 350A will change accordingly, making the representation 306' of the table, the representation 309' of the window, and the avatar 315 appear larger in the field of view. In some examples, each user may interact with three-dimensional environment 350A / 350B independently, such that changes in the viewpoint of three-dimensional environment 350A and / or interaction of first electronic device 360 with virtual objects in three-dimensional environment 350A optionally do not affect content shown in three-dimensional environment 350B at second electronic device 370, and vice versa.
[0046] In some examples, the avatar 315 / 317 is a representation of a user of the electronic device 370 / 360 (e.g., a full body rendering). In some examples, the avatar 315 / 317 is a representation of a portion of a user of the electronic device 370 / 360 (e.g., a rendering of a head, a face, a head and torso, etc.). In some examples, the avatar 315 / 317 is a user-personalized, user-selected, and / or user-created representation displayed in the three-dimensional environment 350A / 350B that represents the user of the electronic device 370 / 360. It should be understood that although Figure 3 The avatars 315 / 317 shown in correspond to full body representations of users of the electronic devices 370 / 360, respectively, although alternative avatars such as those described above may be provided.
[0047] As described above, when the first electronic device 360 and the second electronic device 370 are in a multi-user communication session, the three-dimensional environment 350A / 350B can be a shared three-dimensional environment presented using the electronic devices 360 / 370. In some examples, in the multi-user communication session, content viewed by one user at one electronic device can be shared with another user at another electronic device. In some such examples, the content can be experienced (e.g., viewed and / or interacted with) by both users (e.g., via their respective electronic devices) in a shared three-dimensional environment. For example, Figure 3 As shown, the three-dimensional environment 350A / 350B includes a shared virtual object 310 (e.g., which is optionally a three-dimensional virtual sculpture) that can be viewed by two users and interacted with by two users. Figure 3 As shown, the shared virtual object 310 may be displayed along with a grabber-enabled representation (e.g., a control bar) 335 that can be selected to initiate movement of the shared virtual object 310 within the three-dimensional environment 350A / 350B.
[0048] In some examples, the three-dimensional environment 350A / 350B includes non-shared content that is private to one user in a multi-user communication session. Figure 3 , first electronic device 360 is displaying private application window 330 in three-dimensional environment 350A, which is optionally an object that is not shared between first electronic device 360 and second electronic device 370 in a multi-user communication session. In some examples, private application window 330 may be associated with a corresponding application (e.g., such as a media player application, a web browsing application, a messaging application, etc.) operating on first electronic device 360. Because private application window 330 is not shared with second electronic device 370, second electronic device 370 optionally does not display a representation of private application window 330" in three-dimensional environment 350B, or optionally displays a representation of private application window 330" in three-dimensional environment 350B. Figure 3 As shown, in some examples, the representation 330" of the private application window can be a faded, blocked, discolored, and / or translucent representation of the private application window 330 that prevents the user of the second electronic device 370 from viewing the content of the private application window 330. In addition, as shown in FIG. Figure 3 As shown, a representation of private application window 330" is optionally displayed in three-dimensional environment 350B at a location relative to avatar 317 corresponding to a user of first electronic device 360 (e.g., based on a distance between private application window 330 and a viewpoint of the user of first electronic device 360 at first electronic device 360).
[0049] As described above, in some examples, a user of a first electronic device 360 and a user of a second electronic device 370 are associated with a spatial group 340 within a multi-user communication session. In some examples, the spatial group 340 controls where users and / or content are (e.g., initially) positioned within a shared three-dimensional environment. For example, the spatial group 340 can be a baseline (e.g., first or default) spatial group within a multi-user communication session. For example, when a user of the first electronic device 360 and a user of the second electronic device 370 initially join the multi-user communication session, the user of the first electronic device 360 and the user of the second electronic device 370 are automatically (and initially, as discussed in more detail below) positioned according to the spatial group 340 within the multi-user communication session. In some examples, when the users are in a multi-user communication session, the spatial group 340 controls where users and / or content are (e.g., initially) positioned within the shared three-dimensional environment. For example, the spatial group 340 can be a baseline (e.g., first or default) spatial group within the multi-user communication session. Figure 3 When in the space group 340 shown, the user of the first electronic device 360 and the user of the second electronic device 370 have a spatial arrangement within the shared three-dimensional environment. For example, the user of the first electronic device 360 and the user of the second electronic device 370 (including objects displayed in the shared three-dimensional environment) have a spatial reality within the space group 340. In some examples, the spatial reality requires a consistent spatial arrangement between the user (or its representation) and the virtual objects in the shared three-dimensional environment. For example, the distance between the viewpoint of the user of the first electronic device 360 and the avatar 315 (e.g., corresponding to the ellipse 315A) corresponding to the user of the second electronic device 370 can be the same as the distance between the viewpoint of the user of the second electronic device 370 and the avatar 317 (e.g., corresponding to the ellipse 317A) corresponding to the user of the first electronic device 360. As described herein, if the position of the viewpoint of the user of the first electronic device 360 moves, the avatar 317 corresponding to the user of the first electronic device 360 moves in the three-dimensional environment 350B according to the movement of the position of the user's viewpoint relative to the viewpoint of the user of the second electronic device 370. In addition, if the user of the first electronic device 360 performs an interaction on the shared virtual object 310 (e.g., moves the virtual object 310 in the three-dimensional environment 350A), the second electronic device 370 changes the display of the shared virtual object 310 in the three-dimensional environment 350B according to the interaction (e.g., moves the virtual object 310 in the three-dimensional environment 350B).
[0050] It should be understood that in some examples, more than two electronic devices can be communicatively linked in a multi-user communication session. For example, in a situation where three electronic devices are communicatively linked in a multi-user communication session, a first electronic device will display two avatars corresponding to the users of the other two electronic devices, rather than just one avatar. Therefore, it should be understood that the various processes and exemplary interactions described herein with reference to a first electronic device 360 and a second electronic device 370 in a multi-user communication session are optionally applicable to situations where more than two electronic devices are communicatively linked in a multi-user communication session.
[0051] In some examples, it may be advantageous to selectively change (e.g., update relative to a first default spatial group) the spatial group of users in a multi-user communication session based on content displayed in a three-dimensional environment, including updating the display of avatars corresponding to users of electronic devices communicatively linked in the multi-user communication session. For example, as described herein, content may be shared and presented in a three-dimensional environment so that the content may optionally be viewed and / or interacted with by multiple users in the multi-user communication session. As described above, the three-dimensional environment optionally includes avatars corresponding to users of electronic devices in the communication session. In some cases, presenting content in a three-dimensional environment with avatars corresponding to users of electronic devices may result in portions of the content being blocked or obscured from the viewpoint of one or more users in the multi-user communication session. In some examples, changes in the presentation of content in a three-dimensional environment (e.g., changes in the size of the content) may similarly create obstructions and / or other complications relative to the viewpoint of one or more users in the multi-user communication session. Therefore, in some examples, the positions of avatars corresponding to users in a multi-user communication session may be updated based on the type of content being presented, as described in more detail herein.
[0052] FIG. 4A to FIG. 4N Example interactions between users in a multi-user communication session according to some examples of the present disclosure are shown. In some examples, when a first electronic device 460 is in a multi-user communication session with a second electronic device 470 (and a third electronic device (not shown)), the first electronic device 460 is used to present a three-dimensional environment 450A, and the second electronic device 470 is used to present a three-dimensional environment 450B. In some examples, the electronic devices 460 / 470 optionally correspond to the electronic devices 360 / 370 described above. In some examples, the three-dimensional environment 450A / 450B includes an optical perspective or video pass-through portion of the physical environment in which the electronic devices 460 / 470 are located. For example, the three-dimensional environment 450A includes a window (e.g., a representation 409' of the window), and the three-dimensional environment 450B includes a coffee table (e.g., a representation 408' of the coffee table) and a floor lamp (e.g., a representation 407' of the floor lamp). In some examples, the three-dimensional environment 450A / 450B optionally corresponds to the above referenced electronic devices 360 / 370. Figure 3 As described above, the three-dimensional environment also includes avatars 415 / 417 corresponding to users of electronic devices 470 / 460, respectively, and avatars 419 corresponding to users of third electronic devices (not shown). In some examples, avatars 415 / 417 optionally correspond to the above referenced avatars 415 / 417. Figure 3 Incarnation 315 / 317 described.
[0053] As referenced above Figure 3Similarly described, the user of the first electronic device 460, the user of the second electronic device 470, and the user of the third electronic device can be in a spatial group 440 (e.g., a baseline spatial group such as a circle (e.g., a "session" spatial group)) within the multi-user communication session (e.g., by Figure 4A In some examples, space group 440 optionally corresponds to the above reference Figure 3 As similarly described above, when the user of the first electronic device 460, the user of the second electronic device 470, and the user of the third electronic device are in the spatial group 440 within the multi-user communication session, the users have a spatial arrangement (e.g., composed of Figure 4A 415A, 417A, and 419A in the image), so that the electronic device maintains a consistent spatial relationship (e.g., spatial reality) between the position of the user's viewpoint (e.g., which corresponds to the position of the ellipses 415A / 417A / 419A) and the shared virtual content at each electronic device. Figure 4A As shown, when the user of the first electronic device 460, the user of the second electronic device 470, and the user of the third electronic device (not shown) have a spatial arrangement in a multi-user communication session, each user is separated by a first distance 431A (e.g., a predetermined / predefined distance) in the three-dimensional environment. For example, at the first electronic device 460, from the viewpoint of the user of the first electronic device 460, the avatar 415 corresponding to the user of the second electronic device 470 and the avatar 419 corresponding to the user of the third electronic device are separated by a first distance 431A in the three-dimensional environment 450A, and the avatar 415 and the avatar 419 are each also positioned to be separated by the first distance 431A from the viewpoint of the user of the first electronic device 460. Similarly, at the second electronic device 470, from the viewpoint of the user of the second electronic device 470, the avatar 419 and the avatar 417 corresponding to the user of the first electronic device 460 are separated by a first distance 431A, and the avatar 419 and the avatar 417 are each also positioned to be separated by the first distance 431A from the viewpoint of the user of the second electronic device 470.
[0054] In some examples, as previously referenced Figure 3 As discussed, avatars corresponding to users of electronic devices in a multi-user communication session are displayed with corresponding orientations (e.g., initially) based on the spatial grouping of the users. Figure 4A As shown, in the space group 440, the avatars corresponding to the users of the first electronic device 460, the second electronic device 470, and the third electronic device (not shown) are displayed with an orientation facing the (eg, predetermined) center 432 of the space group 440. FIG. 4A to FIG. 4NIn the example of FIG. 4 , the orientation of the avatar is represented by the directionality of the arrows of ellipses 415A / 417A / 419A.
[0055] In some examples, the spatial group of users in a multi-user communication session is selectively changed based on determining that the number of users in the multi-user communication session has changed. FIG. 4A to FIG. 4B , a user of a fourth electronic device (not shown) joins a multi-user communication session including a user of the first electronic device 460, a user of the second electronic device 470, and a user of a third electronic device (not shown). Figure 4B As shown, when the user of the fourth electronic device joins the multi-user communication session, the shared three-dimensional environment is updated to include an avatar 421 corresponding to the user of the fourth electronic device (not shown). Figure 4B As shown, the first electronic device 460 updates the three-dimensional environment 450A to include an avatar 421 corresponding to the user of the fourth electronic device, and similarly, the second electronic device 470 updates the three-dimensional environment 450B to include the avatar 421.
[0056] In some examples, when an avatar 421 corresponding to a user of a fourth electronic device is displayed in a shared three-dimensional environment, the spatial group of users in the multi-user communication session is updated to accommodate the user of the fourth electronic device (not shown), while maintaining the spatial separation between adjacent users in the multi-user communication session. Figure 4B As shown, the positions of ellipses 415A, 417A, and 419A are shifted within spatial group 440 to provide space / availability for ellipse 421A corresponding to the user of the fourth electronic device. Figure 4B As shown, when updating the spatial group, the spatial intervals between the user pairs of the first electronic device 460, the second electronic device 470, the third electronic device (not shown), and the fourth electronic device (not shown) in the multi-user communication session are maintained. Figure 4B As shown, in the updated spatial group 440, each ellipse is still separated from the adjacent ellipse by the first distance 431A. Figure 4B As shown, at the first electronic device 460, the avatar 415 is spaced apart from the avatar 421 by a first distance 431A, and the avatar 421 is also spaced apart from the avatar 419 by a first distance 431A. Figure 4B As shown, at the second electronic device 470, the avatar 421 is spaced a first distance 431A from the avatar 419, and the avatar 419 is spaced a first distance 431A from the avatar 417. Figure 4B As shown, when an avatar 421 corresponding to a user of a fourth electronic device is displayed in the shared three-dimensional environment, avatars 415 , 417 , and 419 remain oriented to face the center 432 of the spatial group 440 .
[0057] Alternatively, in some examples, when a new user joins the multi-user communication session, the avatars corresponding to the users in the multi-user communication session may not remain separated from the adjacent avatars (and / or user's viewpoints) by the first distance 431A. For example, when an additional user joins the multi-user communication session, such as a user of a fourth electronic device represented by avatar 421 or an additional user such as a user of a fifth electronic device (not shown), the distance between adjacent avatars and / or viewpoints in the shared three-dimensional environment (e.g., three-dimensional environment 450A / 450B) decreases to less than the first distance 431A. Figure 4B However, the viewpoints of the avatars and / or users in the real-time communication session are optionally still radially positioned relative to the center 432 of the spatial group 440 (e.g., in a circular arrangement having the same radius) and are evenly spaced the same distance from adjacent avatars (e.g., as shown in FIG. 1 ). Figure 4B Similarly shown) (e.g., which is less than the first distance 431A as described above) or the same angular distance.
[0058] It should be understood that similar processing as above will apply to the user leaving FIG. 4A to FIG. 4N For example, if the user of the second electronic device 470 wants to leave Figure 4B 41A, and the user of the third electronic device (not shown) joins the multi-user communication session. In this case, the spatial group 440 will be updated to be similar to Figure 3 However, the user of the first electronic device 460 and the user of the third electronic device will be spaced apart from each other by a first distance 431A (eg, opposite and facing each other in the spatial group 440).
[0059] In some examples, the spatial groups of users in a multi-user communication session, and therefore the spatial separations between pairs of users, are not updated when the respective users stop sharing their avatars (e.g., turn off a setting for sharing their avatars). FIG. 4B to FIG. 4C , the user of the fourth electronic device provides an input detected at the fourth electronic device (not shown) for causing the avatar 421 to no longer be displayed in the shared three-dimensional environment. Figure 4C As shown, at the first electronic device 460 and the second electronic device 470, the avatar 421 corresponding to the user of the fourth electronic device is no longer displayed in the three-dimensional environment 450A / 450B, respectively. In addition, in some examples, because the user of the fourth electronic device is still in the multi-user communication session, the avatar 421 is replaced with a two-dimensional representation 427 corresponding to the user of the fourth electronic device. For example, Figure 4C As shown, the first electronic device 460 and the second electronic device 470 respectively replace the display of the avatar 421 with a two-dimensional object (e.g., canvas / tile) including a representation of the user of the fourth electronic device in the three-dimensional environments 450A and 450B. In some examples, the two-dimensional representation 427 includes an image (e.g., a photo) representing the user of the fourth electronic device. In some examples, the two-dimensional representation 427 includes an image of the avatar 421 corresponding to the user of the fourth electronic device. In some examples, the two-dimensional representation 427 includes a video representing the user of the fourth electronic device (e.g., a real-time stream of an avatar corresponding to the user of the fourth electronic device or a recorded video including the user of the fourth electronic device). Additionally or alternatively, in some examples, the two-dimensional representation 427 includes text corresponding to the user of the fourth electronic device, such as the name of the user of the fourth electronic device, the initials of the name of the user of the fourth electronic device, the nickname of the user of the fourth electronic device, etc.
[0060] In addition, if Figure 4C As shown, when the two-dimensional representation 427 is placed in the shared three-dimensional environment, the spatial group 440 is not updated in the multi-user communication session. Figure 4C As shown, in the spatial group 440, the two-dimensional representation 427 represented by the rectangle 427A is separated from the avatar 415 represented by the ellipse 415A and the avatar 419 represented by the ellipse 419A by a first distance 431A. Figure 4C As shown, the avatar corresponding to the user, represented by ellipses 415A / 417A / 419A, remains oriented facing the center 432 of the spatial group 440 when the two-dimensional representation represented by rectangle 427A is displayed in the shared three-dimensional environment.
[0061] In some examples, as described above, when sharing content in a shared three-dimensional environment, the spatial separation between adjacent users in a multi-user communication session is selectively updated. Figure 4D , second electronic device 470 is displaying user interface object 430 represented by rectangle 430A in spatial group 440 in three-dimensional environment 450B. In some examples, user interface object 430 is associated with a corresponding application (e.g., a media player application) running on second electronic device 470 and is therefore private to the user of second electronic device 470. Figure 4D As shown, the three-dimensional environment 450A at the first electronic device 460 includes a representation of the user interface object 430" (which will be similarly displayed at the third electronic device (not shown) and the fourth electronic device (not shown)). Figure 4D, user interface object 430 optionally includes option 423A, which can be selected to display shared content (e.g., "Content A") corresponding to a corresponding application (e.g., media content corresponding to a media player application).
[0062] In some examples, such as Figure 4D As shown, when private content (such as user interface objects 430 that are private to users of second electronic device 470) is displayed in three-dimensional environment 450A / 450B, spatial groups 440 and, therefore, spatial separation between pairs of users in a multi-user communication session are maintained. Figure 4D As shown, when the user interface object 430 represented by the rectangle 430A is displayed and the ellipses 415A / 417A / 419A / 421A corresponding to the user of the electronic device remain spaced apart from each other by the first distance 431A, the spatial group 440 is not updated.
[0063] exist Figure 4D , when user interface object 430 is displayed in three-dimensional environment 450B, second electronic device receives selection input 472A directed to option 423A in user interface object 430 in three-dimensional environment 450B. For example, the selection input corresponds to a pinch gesture (e.g., where the index finger and thumb of the hand are in contact) provided by a hand of a user of second electronic device 470, optionally when the user's gaze is directed to option 423A in user interface object 430. In some examples, selection input 472A corresponds to some other suitable input, such as a tap input, a gaze exceeding a threshold time period, a verbal command, etc.
[0064] In some examples, in response to receiving selection input 472A, second electronic device 470 displays media player user interface 445 in three-dimensional environment 450B, such as Figure 4E In some examples, such as Figure 4E As shown, the media player user interface 445 is configured to present audio-based media (e.g., songs, podcasts, or other audio-based content) in the three-dimensional environment 450B. Figure 4E, a media player user interface 445 is presenting a song (e.g., as spatial or stereo audio output by a second electronic device 470) and includes a plurality of media controls 446, such as playback controls (e.g., forward, rewind, and pause / play buttons), a scroll bar with a playhead, volume level controls, sharing options, etc. In some examples, as described above, the media player user interface 445 can be a shared object in a multi-user communication session. Thus, the media player user interface 445 can be viewed and interacted with by users in the multi-user communication session, including a user of the first electronic device 460, a user of the second electronic device 470, a user of a third electronic device (not shown), and a user of a fourth electronic device (not shown). For example, as Figure 4E As shown, when the second electronic device 470 displays the media player user interface 445 in the three-dimensional environment 450B, the first electronic device 460 displays the media player user interface 445 in the three-dimensional environment 450A.
[0065] In some examples, Figure 4E In some examples, when the media player user interface 445 is displayed in the three-dimensional environment 450A / 450B, the spatial groups 440 and the spatial spacing between the user pairs in the multi-user communication session are selectively updated based on the type of content of the media player user interface 445. In some examples, the content that is the first type of content includes content that is below a threshold size when displayed in the three-dimensional environment 450A / 450B. For example, because the media player user interface 445 is a two-dimensional object, the threshold size is optionally a threshold width (e.g., 1 cm, 2 cm, 5 cm, 10 cm, 15 cm, 30 cm, 50 cm, 100 cm, 150 cm, etc.), a threshold length, and / or a threshold area. Alternatively, if a three-dimensional object having a volume is displayed in the three-dimensional environment 450A / 450B, the threshold size will optionally be a threshold volume and / or a threshold surface area.
[0066] exist Figure 4E In the example of , media player user interface 445 is determined to be below the threshold size and is therefore a first type of content. In some examples, based on determining that media player user interface 445 is the first type of content, spatial group 440 is updated to accommodate display of media player user interface 445 in the shared three-dimensional environment without updating the spatial separation between adjacent pairs of users in the multi-user communication session. For example, Figure 4E As shown, the positions of the users (e.g., their viewpoints and corresponding avatars) in the multi-user communication session are shifted to accommodate the display of the media player user interface 445 represented by rectangle 445A in the spatial group 440. However, as Figure 4EAs shown, in multi-user communication, the spatial interval is maintained at a first distance 431A. Figure 4E In FIG. 4 , the user of the second electronic device 470 represented by the ellipse 415A and the user of the fourth electronic device represented by the ellipse 421A are separated by a first distance 431A. Similarly, in Figure 4E 4, the user of the third electronic device represented by ellipse 419A and the media player user interface 445 represented by rectangle 445A are also separated by a first distance 431A. Figure 4E As shown, in some examples, when shared content is displayed in the three-dimensional environment 450A / 450B, the orientation of the avatars corresponding to the users in the multi-user communication session is updated to face the shared content rather than the center of the spatial group. Figure 4E 4, ellipses 415A / 417A / 419A / 421A are rotated to face the media player user interface 445 represented by rectangle 445A in the spatial group 440. Thus, when the first type of content is shared in the multi-user communication session, the spatial separation between users and / or shared content is maintained. In other examples, when the shared content is displayed in the three-dimensional environment 450A / 450B, the orientation of the avatars corresponding to the users in the multi-user communication session continues to face the center of the spatial group.
[0067] Alternatively, in some examples, when the first type of content is shared in the multi-user communication session, the avatars corresponding to the users in the multi-user communication session may not remain separated from the adjacent avatars (and / or the user's viewpoint) by the first distance 431A. For example, when the first type of content is displayed in the shared three-dimensional environment, the distance between adjacent avatars and / or viewpoints in the shared three-dimensional environment (e.g., three-dimensional environment 450A / 450B) is reduced to less than Figure 4E However, the avatars and / or viewpoints of the users in the real-time communication session are optionally still positioned radially relative to the center 432 of the spatial group 440 (e.g., in a circular arrangement) and are evenly spaced the same distance from adjacent avatars and / or shared content (e.g., as shown in FIG. 4 ). Figure 4E Similarly shown) (eg, which is less than the first distance 431A as described above).
[0068] Alternatively, in some examples, the content that is a second type of content different from the first type of content includes content that is larger than the threshold size when displayed in the three-dimensional environment 450A / 450B. Figure 4F In the example, the second electronic device 470 alternatively receives an input corresponding to a request to display shared content (eg, “Content B”) as the second type of content. Figure 4FAs shown, as an example, the user interface object 430 alternatively includes an option 423B that can be selected to initiate display of the second type of shared content in the multi-user communication session. Figure 4F , the second electronic device 470 receives selection input 472B pointing to option 423B. For example, as similarly discussed above, the second electronic device 470 detects an air pinch gesture, a tap or touch gesture, a gaze dwell, a verbal command, etc. corresponding to the selection of option 423B in the three-dimensional environment 450B.
[0069] In some examples, such as Figure 4G As shown, in response to receiving a selection of option 423B, the second electronic device 470 displays a playback user interface 447 configured to present video content (e.g., movie content, segment content associated with a television program, video clips, music videos, etc.) in the three-dimensional environment 450B. In some examples, such as Figure 4G As shown, playback user interface 447 includes playback controls 456 (e.g., forward, backward, and / or pause / play buttons) for controlling playback of video content and is displayed with a grabber or joystick indicator 435 that can be selected to initiate movement of playback user interface 447 in three-dimensional environment 450B. In some examples, as described above, playback user interface 447 can be shared content in a multi-user communication session, such that playback user interface 447 can be viewed and interacted with by users in the multi-user communication session. Thus, as described above, playback user interface 447 can be shared content in a multi-user communication session. Figure 4G As shown, when the playback user interface 447 is displayed in the three-dimensional environment 450B, the first electronic device 460 optionally also displays the playback user interface 447 in the three-dimensional environment 450A.
[0070] In some examples, as described above, playback user interface 447 is a second type of content, particularly because, for example, playback user interface 447 has a size that is greater than the threshold size described above. For example, the width and / or length of two-dimensional playback user interface 447 is greater than a threshold width and / or length (and / or area), as similarly discussed above. Thus, in some examples, when playback user interface 447 is displayed in a shared three-dimensional environment, spatial group 440 is updated to accommodate the display of playback user interface 447, including updating the spatial separation between pairs of users in a multi-user communication session due to the larger size (e.g., width and / or length) of playback user interface 447. For example, in Figure 4GIn the updated spatial group 440, the spacing interval is reduced to a second distance 431B that is smaller than the first distance 431A described above, so that from the viewpoint of the user of the first electronic device 460, the avatars 419, 421, and 415 are each spaced apart by the second distance in the three-dimensional environment 450A, and from the viewpoint of the user of the second electronic device 470, the avatars 419 and 421 are spaced apart by the second distance, and the avatar 417 is positioned in the three-dimensional environment 450B at the second distance 431B from the viewpoint of the user of the second electronic device 470. In some examples, in the updated spatial group 440, the distance (e.g., second distance 431B) between adjacent avatars (e.g., avatars 419 and 417) is not equal to the distance between the avatar (e.g., avatar 419 or 421) and the playback user interface 447. For example, as Figure 4H As shown, in the updated spatial group 440, the distance between the avatar 417 represented by the ellipse 417A and the playback user interface 447 represented by the rectangle 447A is greater than the distance (e.g., the second distance 431B) between the avatar 417 represented by the ellipse 417A and the avatar 415 represented by the ellipse 415A. In addition, as similarly described above, because the playback user interface 447 is a shared object, when the playback user interface 447 is displayed, the orientation of the avatar represented by the arrows of the ellipses 415A to 421A in the spatial group 440 in the shared three-dimensional environment is oriented to face the playback user interface 447 represented by the rectangle 447A.
[0071] In some examples, the spatial intervals described above change based on a change in the size of playback user interface 447. For example, in Figure 4H , when playback user interface 447 is displayed in three-dimensional environment 450A, first electronic device 460 detects input corresponding to a request to increase the size of playback user interface 447 in three-dimensional environment 450A. As an example of input, first electronic device 460 detects first selection input 472C-i (e.g., provided by a first hand of a user of first electronic device 460) pointing to the upper right corner of playback user interface 447 in three-dimensional environment 450B, and detects second selection input 472C-ii (e.g., provided by a second hand of the user of first electronic device 460) pointing to the lower left corner of playback user interface 447. In some examples, first selection input 472C-i and second selection input 472C-ii are followed by corresponding movements of the first hand and the second hand of the user of the first electronic device apart, such as Figure 4H In some examples, the input alternatively corresponds to a selection of a user interface element that can be selected to increase the size of playback user interface 447.
[0072] In some examples, such as Fig. 4IAs shown, in response to detecting the above input corresponding to the request to increase the size of the playback user interface 447, the first electronic device 460 increases the size of the playback user interface 447 in the three-dimensional environment 450A according to the input. Fig. 4I As shown, because the playback user interface 447 is a shared object, the size of the playback user interface 447 also increases in the three-dimensional environment 450B at the second electronic device 470 (e.g., and in the corresponding three-dimensional environments at the third and fourth electronic devices).
[0073] Additionally or alternatively, in some examples, when the size of playback user interface 447 (e.g., the real or actual size (e.g., width, length, area, volume, etc.) of playback user interface 447 and / or the aspect ratio of playback user interface 447) is changed in shared three-dimensional environment 450A / 450B (e.g., based on the above inputs), one or more visual attributes (e.g., including visual appearance) of the content of playback user interface 447 are adjusted to account for the transition in size of playback user interface 447 on the electronic devices in the communication session. For example, as described above Figure 4N As shown, when the first electronic device 460 and / or the second electronic device 470 increases the size of the playback user interface 447 in the three-dimensional environment 450A / 450B, the video content of the playback user interface 447 and optionally the playback controls 456 are faded, blocked, reduced in brightness, increased in opacity, and / or visually adjusted in other ways so that the video content is no longer visible to the user at its corresponding electronic device. In some examples, when the size of the playback user interface 447 is changed, the content of the playback user interface 447 is immediately stopped from being displayed (e.g., immediately faded out). It should be understood that the same fading behavior is similarly applied to an instance of reducing the size of the playback user interface 447 in a shared three-dimensional environment in response to a user input detected by one of the electronic devices in the multi-user communication session. In some examples, the content of playback user interface 447 remains visually adjusted until the size (e.g., including aspect ratio) of playback user interface 447 remains static (e.g., unchanged) for at least a threshold amount of time (e.g., 0.1 seconds, 0.2 seconds, 0.3 seconds, 0.5 seconds, 1 second, 1.5 seconds, 2 seconds, 3 seconds, 5 seconds, etc.). Figure 4H After the input in question is finished, Figure 4NThe video content of playback user interface 447 in the playback interface 447 remains faded and / or invisible to users of first electronic device 460, second electronic device 470, third electronic device (not shown), and fourth electronic device (not shown) for at least a threshold amount of time. Additionally or alternatively, in some examples, the content of playback user interface 447 remains visually adjusted until the size of the content (e.g., the size and / or aspect ratio of the video content) corresponds to (e.g., matches) the new size (e.g., and / or aspect ratio) of playback user interface 447 for a threshold amount of time (e.g., 0.1 seconds, 0.2 seconds, 0.3 seconds, 0.5 seconds, 1 second, 1.5 seconds, 2 seconds, 3 seconds, 5 seconds, etc.).
[0074] In some examples, based on determining that the threshold amount of time described above has passed without detecting an input (or some other indication, such as an indication of an input received at an electronic device different from first electronic device 460) that causes the size (e.g., including aspect ratio) of playback user interface 447 to change in the shared three-dimensional environment, the content of playback user interface 447 is (e.g., gradually) redisplayed and / or becomes visible again in playback user interface 447. For example, Fig. 4I As shown, the video content including playback controls 456 is again displayed and / or visible (e.g., faded in) in playback user interface 447 in three-dimensional environment 450A / 450B. In some examples, such as Fig. 4I As shown, when the video content is redisplayed in playback user interface 447, the size of the video content (e.g., including the aspect ratio of the video content) is increased in three-dimensional environment 450A / 450B in accordance with the increased size of playback user interface 447. Thus, adjusting the visibility of the content of playback user interface 447 when the size of playback user interface 447 is changed in the shared three-dimensional environment helps prevent and / or reduce the occurrence of visual blurring and / or distortion of the content of playback user interface 447, thereby helping to reduce or prevent eyestrain or other discomfort to the user during the communication session.
[0075] It should be appreciated that in some examples, alternative forms of input may cause the size (e.g., including aspect ratio) of playback user interface 447 to change, which optionally causes the content of playback user interface 447 to visually adjust in the manner described above when playback user interface 447 is resized. For example, causing the video content of playback user interface 447 to be displayed in an alternative orientation (e.g., from a horizontal orientation to a horizontal orientation) to a horizontal orientation. Figure 4HIn some examples, the video content of playback user interface 447 is visually adjusted (e.g., faded out) while playback user interface 447 is updated to have an alternative orientation as similarly discussed above. Additionally, it should be understood that in some examples, when the size of a virtual object (e.g., a window) displaying content is changed in a manner similar to that described above, additional or alternative types of content are similarly visually adjusted. For example, if the above reference is made to Figure 4H The input in question alternatively points to Figure 4E 445, which causes the size (e.g., including aspect ratio) of the media player user interface 445 to change, the content of the media player user interface 445 including the plurality of media controls 446 will optionally be visually adjusted (e.g., faded out) in a manner similar to that discussed above. It should also be understood that in some examples, an indication of the user input may be provided by a user who is not actively participating in the multi-user communication session, which causes the content to be visually adjusted in the manner described above. For example, if the video content in the playback user interface 447 corresponds to a real-time stream of content (e.g., content provided by a particular person, entity, etc.), one or more actions performed by the real-time streamer may cause the size (e.g., including aspect ratio) of the playback user interface 447 to change as similarly discussed above.
[0076] In some examples, when the size of playback user interface 447 increases in the shared three-dimensional environment, such as Fig. 4I As shown by the increase in size of rectangle 447A in , the spacing spacing in spatial group 440 decreases based on (e.g., proportionally or equally to) the increase in size of playback user interface 447. Fig. 4I As shown, each avatar represented by ellipses 415A to 421A is spaced apart from the adjacent avatar by a third distance 431C, which is smaller than the second distance 431B and the first distance 431A. Fig. 4I As shown, at the first electronic device 460, when increasing in the large and small three-dimensional environment 450A of the playback user interface 447, the avatars 415, 419, and 421 are shifted in the field of view of the first electronic device 460, so that the avatar 419 is spaced a third distance from the avatar 421, the avatar 421 is spaced a third distance from the avatar 415, and the avatar 415 is spaced a third distance from the viewpoint of the user of the first electronic device 460. Similarly, as Fig. 4IAs shown, at the second electronic device 470, avatar 419 and avatar 421 are spaced a third distance apart, avatar 421 is spaced a third distance apart from the viewpoint of the user of the second electronic device 470, and avatar 417 is spaced a third distance apart from the viewpoint of the user of the second electronic device 470. In addition, when the size of the playback user interface 447 increases, the orientations of the avatars 415 to 421 remain pointed toward the playback user interface 447 in the shared three-dimensional environment.
[0077] In some examples, such as Fig. 4I As shown, when the size of a shared object (such as playback user interface 447) increases in the shared three-dimensional environment, the distance between center 432 of spatial group 440 and the shared object also increases (e.g., proportionally or equally). Fig. 4I As shown, when the size of the playback user interface 447 increases in the shared three-dimensional environment, the distance between the playback user interface 447 represented by rectangle 447A and the center 432 of the spatial group 440 also increases, making the playback user interface 447 appear farther away from the viewpoint of the user of the electronic device 460 / 470 in the three-dimensional environment 450A / 450B.
[0078] In some examples, the above-mentioned interval spacing is associated with a minimum interval spacing. For example, the minimum interval spacing is a fourth distance that is smaller than the third distance (e.g., Figure 4J 431D in FIG. 431D). In some examples, as the size of the shared object (such as playback user interface 447) continues to increase in the shared three-dimensional environment (e.g., in response to user input), the spacing described herein continues to decrease to a minimum spacing (e.g., a fourth distance). In some examples, when the spacing is the minimum spacing, if the size of the shared object (such as playback user interface 447) further increases in the shared three-dimensional environment, the spacing remains at the minimum spacing.
[0079] In some examples, updates to the intervals between adjacent avatars within the spatial group 440 according to the first type and the second type of shared content may be similarly applied to the previously referenced avatars. Figure 4C The two-dimensional representation 427 in question. For example, returning to reference Figure 4C , because the size (e.g., width and / or length, as described above) of the two-dimensional representation 427 is within the threshold size as described above, when the two-dimensional representation 427 is displayed in the three-dimensional environment 450A / 450B, the spacing between adjacent avatars (e.g., avatar 417 represented by ellipse 417A and avatar 419 represented by ellipse 419A) remains unchanged (e.g., remains at the first distance 431A), as described above. However, if the first electronic device 460 or the second electronic device 470 is to receive an input for changing the size of the two-dimensional representation 427 (such as the input described above with reference to FIG. 1 ), the two-dimensional representation 427 may be displayed in the three-dimensional environment 450A / 450B. Figure 4H431B or third distance 431C), as similarly discussed above.
[0080] In some examples, when playback user interface 447 is shared and displayed in a multi-user communication session, if a user of a fifth electronic device (not shown) joins the multi-user communication session without sharing their avatar (e.g., turns off a setting for sharing their avatar), as similarly discussed above herein, the shared three-dimensional environment includes a two-dimensional representation corresponding to the user of the fifth electronic device. Figure 4J , first electronic device 460 and second electronic device 470 update three-dimensional environments 450A and 450B, respectively, to include two-dimensional representation 429 represented by rectangle 429A in spatial group 440. In some examples, because playback user interface 447 is displayed when a user of a fifth electronic device joins the multi-user communication session, the two-dimensional representation 429 corresponding to the user of the fifth electronic device is docked next to playback user interface 447 in the shared three-dimensional environment, as shown in FIG. Figure 4J shown.
[0081] As previously described, as the size of playback user interface 447 increases in the shared three-dimensional environment, the spacing between adjacent users in spatial group 440 decreases accordingly (e.g., proportionally or equally), such as to Fig. 4I In some examples, when the two-dimensional representation 429 is displayed in the shared three-dimensional environment and docked next to (e.g., displayed in a fixed position adjacent to) the playback user interface 447, the spacing is updated based on the size of both the playback user interface 447 and the two-dimensional representation 429, such as the total size (e.g., the sum of the width and / or length) of the playback user interface 447 and the two-dimensional representation 429 (e.g., including the size of any unoccupied space between them). Thus, Figure 4J As shown, when the two-dimensional representation 429 corresponding to the user of the fifth electronic device is displayed in the shared three-dimensional environment, the separation distance is reduced to a fourth distance 431D (e.g., which is optionally the minimum separation distance discussed above) in the spatial group 440 that is less than the third distance 431C. Figure 4J As shown, at first electronic device 460, avatars 419, 421, and 415 are shifted in the field of view of three-dimensional environment 450A so that avatar 419 is spaced a fourth distance from avatar 421, avatar 421 is spaced a fourth distance from avatar 415, and avatar 415 is spaced a fourth distance from the viewpoint of the user of first electronic device 460. Similarly, in some examples, such as Figure 4JAs shown, at the second electronic device 470, in the three-dimensional environment 450B, avatar 419 is shifted to be a fourth distance away from avatar 421, avatar 421 is shifted to be a fourth distance away from the viewpoint of the user of the second electronic device 470, and avatar 417 is shifted to be a fourth distance away from the viewpoint of the user of the second electronic device 470.
[0082] In some examples, when in a multi-user communication session, first electronic device 460 and second electronic device 470 display respective avatars corresponding to respective users at respective locations within the spatial group based on the locations of the two-dimensional representations of the respective users within a communication representation (e.g., a canvas) displayed in a shared three-dimensional environment. Figure 4K In the embodiment, when the user of the first electronic device 460, the user of the second electronic device 470, the user of the third electronic device (not shown), and the user of the fourth electronic device (not shown) are in a multi-user communication session as similarly described above, the first electronic device 460 and the second electronic device 470 display representations of the users in a shared three-dimensional environment according to the spatial states of the users. Figure 4K As shown, the user of the first electronic device 460, the user of the second electronic device 470, and the user of the third electronic device are spatially enabled such that the users are represented by their respective avatars (such as avatars 415, 417, and 419) in a shared three-dimensional environment as previously discussed herein. Figure 4K As shown, the user of the fourth electronic device is optionally not spatially enabled such that the user is represented by a two-dimensional representation 427 (eg, within a window or canvas), as similarly discussed above.
[0083] exist Figure 4K In some examples, as similarly discussed above, users in a multi-user communication session are arranged in spatial groups 440. Figure 4K As shown, when in spatial group 440, avatars 415, 417, and 419 represented by ellipses 415A, 417A, and 419A, and two-dimensional representation 427 represented by rectangle 427A are spaced apart from adjacent users by spatial spacing 431A. Figure 4K 4, a user of a first electronic device 460 represented by ellipse 417A in spatial group 440 and a user of a third electronic device represented by ellipse 419A are separated by spatial separation 431A in spatial group 440. In some examples, as previously described, spatial separation 431A corresponds to a default and / or initial spatial separation within spatial group 440. In addition, as Figure 4K As shown, representations of users are optionally oriented facing toward center 432 of spatial group 440 (eg, according to a conversational (eg, circular) arrangement within a shared three-dimensional environment).
[0084] exist Figure 4L , the first electronic device 460 and the second electronic device 470 optionally detect that a user of a fifth electronic device (not shown) joins the multi-user communication session. In some examples, the user of the fifth electronic device joins the multi-user communication session when the user is in a non-spatial state (e.g., when the user of the fifth electronic device joins the multi-user communication session, the avatar representation or other video-based representation of the user of the fifth electronic device is not currently enabled / activated). Figure 4L As shown, when the user of the fifth electronic device joins the multi-user communication session, the first electronic device 460 and the second electronic device 470 display a two-dimensional representation of the user of the fifth electronic device in the three-dimensional environment 450A / 450B. Figure 4L As shown, the two-dimensional representation of the user of the fourth electronic device is updated to a canvas 427 that includes a first representation 428a (e.g., an image or other two-dimensional representation) of the user of the fourth electronic device and a second representation 428b of the user of the fifth electronic device (who has just joined the multi-user communication session). Figure 4L As shown, in the three-dimensional environment 450A / 450B, a first representation 428 a of a user of a fourth electronic device is displayed on the left side of a canvas 427 , and a second representation 428 b of a user of a fifth electronic device is displayed on the right side of the canvas 427 .
[0085] In some examples, based on determining that the corresponding user currently represented by the two-dimensional representation in the shared three-dimensional environment switches his avatar so that the corresponding user is in the spatial state, a position of the avatar corresponding to the corresponding user within the spatial group 440 is selected based on the position of the two-dimensional representation in the canvas. Figure 4M In the embodiment of the present invention, the user of the fifth electronic device provides an input for switching his / her avatar (e.g., detected by the fifth electronic device), so that the user of the fifth electronic device transitions from a non-spatial state to a spatial state within the multi-user communication session. Figure 4M As shown, the first electronic device 460 and the second electronic device 470 display an avatar 411 corresponding to the user of the fifth electronic device. Figure 4M As shown, the first electronic device 460 and the second electronic device 470 stop displaying the second representation 428b of the user of the fifth electronic device in the canvas 427 in the three-dimensional environment 450A / 450B.
[0086] In some examples, as described above, the location at which avatar 411 is displayed within spatial group 440 is based on Figure 4L The position of the second representation 428b within the canvas 427 is selected. For example, as shown above with reference Figure 4LAs discussed, when the user of the fifth electronic device is in a non-spatial state within the multi-user communication session, the second representation 428b of the user of the fifth electronic device is positioned on the right side of the canvas 427 (the first representation 428a is on the left side of the canvas 427). Figure 4M In FIG. 4 , when an avatar 411 corresponding to a user of the fifth electronic device is displayed in the three-dimensional environment 450A / 450B, the avatar 411 is displayed on the right side of the canvas 427 based on the positioning of the second representation 428b on the right side of the canvas 427, which still includes the two-dimensional representation of the user of the fourth electronic device. Figure 4M As shown, avatar 411 represented by ellipse 411A is positioned in spatial group 440 between two-dimensional representation 427 represented by rectangle 427A and avatar 419 represented by ellipse 419A.
[0087] Alternatively, in some examples, if a user of a fourth electronic device (not shown) instead of the user of the fifth electronic device as described above provides input for switching their avatar, the avatar corresponding to the user of the fourth electronic device instead of the avatar 411 described above will be displayed in the three-dimensional environment 450A / 450B. In addition, as similarly discussed above, the avatar corresponding to the user of the fourth electronic device will be displayed based on the first representation 428a in the three-dimensional environment 450A / 450B. Figure 4L The avatar 428a of the user of the fourth electronic device is optionally displayed at a position within the spatial group 440 according to the position within the canvas 427 in the multi-user communication session. For example, because the first representation 428a of the user of the fourth electronic device is positioned on the left side of the canvas 427, and the user of the fourth electronic device is in a non-spatial state within the multi-user communication session, the avatar corresponding to the user of the fourth electronic device will be displayed on the left side of the canvas 427 in the three-dimensional environment 450A / 450B.
[0088] In addition, in some examples, such as Figure 4M As shown, when the avatar 411 is displayed in the three-dimensional environment 450A / 450B, the first electronic device 460 and the second electronic device 470 update the spatial arrangement between adjacent users in the multi-user communication session. Figure 4M As shown, in order to accommodate the display of the avatar 411 represented by the ellipse 411A, the first electronic device 460 and the second electronic device 470 space the adjacent users in the multi-user communication session according to the updated spatial interval 431E within the spatial group 440. Figure 4M As shown, avatar 411 represented by ellipse 411A is optionally separated from avatar 419 represented by ellipse 419A by an updated spatial interval 431E in spatial group 440. In some examples, updated spatial interval 431E is less than Figure 4L 431A in the space interval, as described similarly with reference to the other examples above. In addition, in some examples, such as Figure 4MAs shown, the first electronic device 460 and the second electronic device 470 maintain the orientation of the avatars 411-419 facing the center 432 of the spatial group 440. It should be understood that, as similarly discussed herein, if a user of a fourth electronic device (not shown) were to switch their avatars in a manner similar to the user of the fifth electronic device, the first electronic device 460 and the second electronic device 470 would update the three-dimensional environment 450A / 450B to include the avatar corresponding to the user of the fourth electronic device in place of the two-dimensional representation or canvas 427.
[0089] Thus, one advantage of the disclosed method of automatically updating spatial groups of users in a multi-user communication session based on the type of content shared and displayed in a shared three-dimensional environment, which includes changing the spatial spacing between adjacent users (e.g., represented by their avatars), is that users can be provided with an unobstructed viewing experience of the shared content, which also allows for unobstructed interaction with the shared content. As another benefit, automatically updating the spatial groups of users as described above helps prevent and / or reduce the need for user input for manually rearranging shared content and / or the positions of users in the shared three-dimensional environment, which helps reduce power consumption of electronic devices that would otherwise need to respond to such user corrections. In addition, when switching between displaying two-dimensional representations of users and displaying three-dimensional representations of users (e.g., avatars), automatically updating the spatial groups of users in a multi-user communication session, which includes changing the spatial spacing between adjacent users, enables the spatial context of the two-dimensional representations of the respective users to be automatically preserved relative to the viewpoints of other users, thereby maintaining the spatial context of the users within the spatial group as a whole, which further improves user-device interaction.
[0090] As described above, when electronic devices are communicatively linked in a multi-user communication session, displaying shared content in a shared three-dimensional environment causes the spatial groups of users of the electronic devices to be updated based on the content type. Attention is now directed to additional or alternative examples of updating the spatial groups of users in a multi-user communication session when shared content is displayed in a three-dimensional environment shared between electronic devices.
[0091] FIG. 5A to FIG. 5S 1 shows example interactions between users in a multi-user communication session according to some examples of the present disclosure. In some examples, when a first electronic device 560 is in a multi-user communication session with a second electronic device 570 and a third electronic device (not shown), a three-dimensional environment 550A is presented using the first electronic device 560, and a three-dimensional environment 550B is presented using the second electronic device 570. In some examples, electronic devices 560 / 570 optionally correspond to the electronic devices 460 / 470 and / or Figure 3In some examples, the three-dimensional environment 550A / 550B includes an optical see-through or video pass-through portion of the physical environment in which the electronic device 560 / 570 is located. For example, the three-dimensional environment 550A includes a window (e.g., representation 509' of the window), and the three-dimensional environment 550B includes a coffee table (e.g., representation 508' of the coffee table) and a floor lamp (e.g., representation 507' of the floor lamp). In some examples, the three-dimensional environment 550A / 550B optionally corresponds to the three-dimensional environment 450A / 450B and / or Figure 3 As described above, the three-dimensional environment also includes avatars 515 / 517 / 519 corresponding to the user of the first electronic device 560, the user of the second electronic device 570, and the user of the third electronic device (not shown). In some examples, the avatars 515 / 517 / 519 optionally correspond to the above-mentioned avatars 415 / 417 / 419 and / or Figure 3 Incarnation 315 / 317.
[0092] As discussed earlier in this article, Figure 5A In the example, the user of the first electronic device 560, the user of the second electronic device 570, and the user of the third electronic device (not shown) can share a spatial group 540 (e.g., a baseline or initial spatial group, such as a session distribution) within the multi-user communication session. In some examples, the spatial group 540 optionally corresponds to the spatial group 440 described above and / or the spatial group 440 described above. Figure 3 The space group discussed is 340. As mentioned above FIG. 4A to FIG. 4N Similarly described, when a user of a first electronic device 560 represented by ellipse 517A, a user of a second electronic device 570 represented by ellipse 515A, and a user of a third electronic device represented by ellipse 519A have a spatial group 540 within a multi-user communication session, adjacent users are spaced apart in a shared three-dimensional environment by a spatial interval (such as a first distance 531), as shown in FIG. Figure 5A Additionally, as previously discussed herein, when communicatively linked in a multi-user communication session, the electronic devices maintain a consistent spatial relationship (e.g., spatial reality) between the location of the user's viewpoint (e.g., which corresponds to the location of the avatar 515 / 517 / 519 in the shared three-dimensional environment and represented by the ellipses 515A / 517A / 519A in the spatial group 540) and the virtual content at each electronic device. In some examples, such as Figure 5A As shown and as previously discussed herein, when arranged according to the spatial group 540, the avatars 515 / 517 / 519 are shown with respective orientations such that the avatars 515 / 517 / 519 face the center 532 (eg, a predetermined or predefined center) of the spatial group 540.
[0093] In some examples, as previously referenced Figure 3 As discussed, the user's position within spatial group 540 may change in response to detecting an input that causes the position of the user's viewpoint to change within the shared three-dimensional environment. FIG. 5A to FIG. 5B , the position of the viewpoint of the user of the third electronic device represented by ellipse 519A is shifted in the shared three-dimensional environment (e.g., in response to movement of the third electronic device caused by movement of the user of the third electronic device, as similarly discussed previously). Figure 5B As shown, the position of the avatar 519 corresponding to the user of the third electronic device is updated in the shared three-dimensional environment based on the shift of the position of the viewpoint of the user of the third electronic device (not shown). For example, based on the shift of the position of the viewpoint of the user of the third electronic device (not shown), at the first electronic device 560, the avatar 519 is shifted backward in the three-dimensional environment 550A so that the avatar 519 is located at a position farther away from the viewpoint of the user of the first electronic device 560, and at the second electronic device 570, the avatar 519 is shifted forward in the three-dimensional environment 550B so that the avatar 519 is located closer to the viewpoint of the user of the second electronic device 570. In some examples, the center 532 of the spatial group 540 is updated based on the updated position of the viewpoint of the user of the third electronic device represented by the ellipse 519A in the shared three-dimensional environment, as shown in FIG. Figure 5B shown.
[0094] As previously discussed herein, when a user of first electronic device 560, a user of second electronic device 570, and a user of a third electronic device (not shown) are in a multi-user communication session, content can be shared and displayed in a shared three-dimensional environment so that the content can be viewed and interacted with by the users. In some examples, such as Figure 5C As shown, the three-dimensional environment 550A may include a user interface object 530 associated with a corresponding application running on the first electronic device 560. In some examples, such as Figure 5C As shown, user interface object 530 includes option 523A, which can be selected to initiate a process of displaying shared content (eg, "Content B") corresponding to a corresponding application in a shared three-dimensional environment. Figure 5C In the example of FIG. 5 , the user interface object 530 represented by the rectangle 530A in the space group 540 is a private object that can only be viewed and interacted with by the user of the first electronic device 560. Figure 5C As shown, the three-dimensional environment 550B at the second electronic device 570 includes a representation of the user interface object 530 (eg, it does not include the content of the user interface object 530), as previously discussed herein.
[0095] In some examples, such as Figure 5CAs shown, the first electronic device 560 can detect a selection input 572A directed to an option 523A in the user interface object 530 in the three-dimensional environment 550A. For example, as similarly discussed above, the first electronic device 560 detects that the user of the first electronic device 560 provides a pinch input (e.g., where the user's index finger and thumb are in contact) (or other suitable input, such as a tap input, a verbal command, a gaze exceeding a threshold time period, etc.) when the user's gaze is directed to the option 523A.
[0096] In some examples, in response to receiving a selection of option 523A in user interface object 530, the first electronic device initiates a process of sharing and displaying content associated with user interface object 530 in a shared three-dimensional environment. In some examples, when the shared content is displayed in the shared three-dimensional environment, spatial group 540 is updated so that avatars 515 / 517 / 519 are repositioned in the shared three-dimensional environment based on the location where the shared content is to be displayed. For example, Figure 5D As shown, square 541 represents the placement of the shared content in the shared three-dimensional environment. In some examples, the placement is based on Figure 5C The selection is based on the position of the user interface object 530 represented by the rectangle 530A in the space group 540. For example, Figure 5D As shown, the square 541 indicating the placement position is located at Figure 5C In other examples, the placement location is arbitrarily selected, is selected based on the perspective of the user providing input for sharing content in the shared three-dimensional environment, and / or is a default placement location within spatial group 540 in the multi-user communication session (e.g., selected by an application associated with the content).
[0097] In some examples, when determining the placement location of the shared content, a reference line 539 is established between the placement location represented by the square 541 and the center 532 of the spatial group 540, such as Figure 5D In some examples, avatars corresponding to users (e.g., including the users' viewpoints) in the multi-user communication session are repositioned (e.g., displaced / moved) relative to reference line 539. Figure 5E As shown, the avatar (e.g., including the user's viewpoint) is moved / displaced (e.g., radially) relative to reference line 539 to be positioned in front of and facing the placement location represented by square 541. For example, Figure 5E As shown by the arrows in , avatar 519 represented by ellipse 519A shifts counterclockwise around reference line 539, avatar 515 represented by ellipse 515A shifts counterclockwise around reference line 539 in space group 540, and avatar 517 represented by ellipse 517A shifts clockwise relative to reference line 539. Thus, in some examples, as Fig. 5F As shown, when the shared content is displayed in the shared three-dimensional environment, the avatars represented by ellipses 515A / 517A / 519A (e.g., including the user's viewpoint) are repositioned in the spatial group 540, so that at the first electronic device 560, the avatar 515 corresponding to the user of the second electronic device 570 and the avatar 519 corresponding to the user of the third electronic device (not shown) are located to the left of the viewpoint of the user of the first electronic device 560. Similarly, Fig. 5F As shown, at the second electronic device 570, when the shared content is displayed in the three-dimensional environment 550B, the avatar 517 corresponding to the user of the first electronic device 560 is located to the right of the viewpoint of the user of the second electronic device 570, and the avatar 519 corresponding to the user of the third electronic device (not shown) is located to the left of the viewpoint of the user of the second electronic device 570. In some examples, the movement of the avatars corresponding to the users, represented by ellipses 515A / 517A / 519A, is displayed with animation, so that the avatars 515 and 519 at the first electronic device 560 and the avatars 517 and 519 at the second electronic device 570 are gradually moved / repositioned relative to the viewpoints of the users of the first electronic device 560 and the second electronic device 570, respectively. It should be understood that while avatars 515 and 519 are discussed as moving counterclockwise relative to reference line 539 and avatar 517 is discussed as moving clockwise relative to the reference line, in some examples, avatars 515 and / or 519 alternatively move clockwise relative to reference line 539 and avatar 517 alternatively moves counterclockwise relative to the reference line (e.g., as described above, based on the position of the placement location represented by square 541).
[0098] In some examples, such as Fig. 5F As shown, the shared content corresponds to playback user interface 547, which corresponds to playback user interface 447 discussed previously above. As described above, playback user interface 547 includes playback controls 556 and a grabber or handle bar indicator 535 that can be selected to initiate movement of playback user interface 547 in three-dimensional environment 550B. In addition, in some examples, such as Fig. 5F As shown, the avatars 515 / 517 / 519 represented by ellipses 515A / 517A / 519A are oriented to face the playback user interface 547 in the shared three-dimensional environment. In some examples, the spacing between adjacent avatars 515 / 517 / 519 in the spatial group 540 is based on the above reference FIG. 4A to FIG. 4N For example, as previously described in reference Figure 4G As discussed, Fig. 5FThe shared content in the playback user interface 547 is the playback user interface 547 (e.g., which is the second type of content as described above), so the avatar 515 represented by the ellipse 515A is separated from the avatar 517 represented by the ellipse 517A by a distance based on the size of the playback user interface 547 (e.g., Figure 4G 4B in the second distance 431B), and avatar 517 represented by ellipse 517A is spaced the same distance from avatar 519 represented by ellipse 519A. Therefore, as described above, when the shared content is displayed in the shared three-dimensional environment, the positions of the avatars corresponding to the users in spatial group 540 (e.g., including the user's viewpoint) are updated (e.g., repositioned / moved) with a directionality (e.g., clockwise or counterclockwise) based on the position where the shared content is displayed in the shared three-dimensional environment.
[0099] In some examples, the above method of moving / shifting the avatar around the reference line 539 allows the context of the user's spatial arrangement to be preserved when the playback user interface 547 is displayed in a shared three-dimensional environment. Figure 5C , before displaying playback user interface 547, in spatial group 540, user interface object 530 represented by rectangle 530A is located to the right of the viewpoint of the user of first electronic device 560, and avatar 515 corresponding to the user of second electronic device 570 represented by ellipse 515A is located to the left of the viewpoint of the user of first electronic device 560 represented by ellipse 517A. Fig. 5F , after the playback user interface 547 represented by rectangle 547A is displayed in the shared three-dimensional environment, in the spatial group 540, the avatar 515 represented by ellipse 515A is still located to the left of the viewpoint of the user of the first electronic device 560 represented by ellipse 517A, and the playback user interface 547 corresponding to the user interface object 530 represented by rectangle 547A is still located to the right (and in front) of the viewpoint of the user of the first electronic device 560.
[0100] In some examples, if playback user interface 547 stops being shared and / or displayed in three-dimensional environment 550A / 550B (e.g., in response to user input), avatars 515 / 517 / 519 are rearranged in spatial group 540 to have a conversational arrangement, such as Figure 5A Alternatively, in some examples, if playback user interface 547 ceases to be shared and / or displayed in three-dimensional environment 550A / 550B, avatar 515 / 517 / 519 returns to its previous arrangement just before sharing of playback user interface 547, as shown in FIG. Figure 5B Similar as shown.
[0101] In some examples, when a corresponding user in a multi-user communication session turns off his or her avatar, the position of the avatar corresponding to the user (e.g., including the user's viewpoint) is repositioned in spatial group 540. For example, Figure 5G , when a user of a first electronic device 560, a user of a second electronic device 570, and a user of a third electronic device (not shown) are in a multi-user communication session, the second electronic device 570 detects an input corresponding to a request to close an avatar 515 corresponding to the user of the second electronic device 570 in the multi-user communication session. As an example, Figure 5G As shown, three-dimensional environment 550B includes user interface element 520 for controlling display of avatar 515 corresponding to a user of second electronic device 570 in a multi-user communication session, such as via selectable option 521 .
[0102] exist Figure 5G , when displaying user interface element 520 including selectable option 521, second electronic device 570 detects selection input 572B pointing to selectable option 521 in three-dimensional environment 550B. For example, as similarly discussed above, second electronic device 570 detects an air pinch gesture, a tap or touch gesture, a gaze dwell, a verbal command, etc. corresponding to a request to select selectable option 521 in three-dimensional environment 550B.
[0103] In some examples, such as Figure 5H As shown, in response to detecting the selection of the selectable option 521, the second electronic device 570 initiates a process of stopping the display of the avatar 515 corresponding to the user of the second electronic device 570 in the multi-user communication session. Figure 5H As shown, at the first electronic device 560, the avatar 515 corresponding to the user of the second electronic device 570 is no longer displayed in the three-dimensional environment 550A. In addition, at the second electronic device 570, because the user of the second electronic device 570 is no longer spatially represented by an avatar in the multi-user communication session, the second electronic device 570 initiates a process of replacing the display of the avatars 517 and 519 corresponding to the users of the first electronic device 560 and the third electronic device (not shown), respectively, with two-dimensional representations, as discussed in more detail below.
[0104] In some examples, when the avatar 515 corresponding to the user of the second electronic device 570 stops being displayed in the shared three-dimensional environment, the positions of the avatars corresponding to the users of the first electronic device 560 and the third electronic device (not shown) (e.g., including the user's viewpoint) are updated (e.g., repositioned) in the spatial group 540 in the multi-user communication session. In some examples, as similarly discussed above, the position of the avatar represented by the ellipse 517A / 519A (e.g., including the user's viewpoint) is repositioned based on the position occupied by the avatar corresponding to the user of the second electronic device 570 in the spatial group 540 (e.g., including the viewpoint of the user of the second electronic device 570). For example, Figure 5H As shown, the position in the spatial group 540 occupied by the avatar 515 corresponding to the user of the second electronic device 570 is represented by a square 543. As similarly discussed above, a reference line 539 can be established between the position represented by the square 543 and the center 532 of the spatial group 540. In some examples, when the avatars corresponding to the users of the first electronic device 560 and the third electronic device (not shown) represented by the ellipses 517A / 519A (e.g., including the viewpoints of the users) are repositioned in the spatial group 540, the avatars are repositioned in a directional manner (e.g., clockwise or counterclockwise) around the center 532 of the spatial group 540. Figure 5H The reference line 539 in is moved (e.g., using animation). Figure 5H As shown by the arrows in , in the space group 540 , the avatar 519 represented by the ellipse 519A is shifted clockwise away from the reference line 539 , and the avatar 515 represented by the ellipse 515A is shifted counterclockwise away from the reference line 539 .
[0105] Therefore, in some examples, such as Fig.5I As shown, when the positions of the avatars corresponding to the users of the first electronic device 560 and the third electronic device (not shown) (e.g., including the viewpoints of the users) are shifted in the space group 540, at the first electronic device 560, the avatar 519 corresponding to the user of the third electronic device is located on the right side of the viewpoint of the user of the first electronic device 560. Fig.5I As shown, the three-dimensional environment 550A is updated to include a two-dimensional representation 525 corresponding to the user of the second electronic device 570, as similarly discussed herein. Fig.5I As shown, avatars 517 and 519, represented by ellipses 517A and 519A, are oriented facing two-dimensional representation 525 in a shared three-dimensional environment.
[0106] In addition, if Fig.5IAs shown, at the second electronic device 570, the three-dimensional environment 550B is updated to include a two-dimensional representation 527 corresponding to the user of the first electronic device 560 and a two-dimensional representation 529 corresponding to the user of the third electronic device (not shown). In some examples, because the user of the second electronic device 570 has turned off its avatar in the multi-user communication session, the user of the second electronic device 570 no longer experiences the spatial reality with the users of the first electronic device 560 and the third electronic device (e.g., via their respective avatars). Therefore, as described above, when the respective user in the multi-user communication session no longer displays his avatar in the shared three-dimensional environment, the position of the avatar corresponding to the other users in the spatial group 540 (e.g., including the user's viewpoint) is updated (e.g., repositioned / moved) with a directionality (e.g., clockwise or counterclockwise) based on the position previously occupied by the respective user (e.g., via his avatar) in the shared three-dimensional environment.
[0107] In some examples, if the user of the second electronic device 570 provides input to switch the avatar 515 corresponding to the user of the second electronic device 570, when the avatar 515 corresponding to the user of the second electronic device 570 is redisplayed in the three-dimensional environment 550A / 550B, the avatars 515 / 517 / 519 are rearranged in the spatial group 540 to have a conversation arrangement, such as Figure 5A Alternatively, in some examples, if the user of the second electronic device 570 provides input to switch the avatar 515 corresponding to the user of the second electronic device 570, then when the avatar 515 corresponding to the user of the second electronic device 570 is redisplayed in the three-dimensional environment 550A / 550B, the avatar 515 / 517 / 519 returns to its previous arrangement just before the display of the avatar 515 in the three-dimensional environment 550A / 550B was stopped, as shown in FIG. Figure 5G Similar as shown.
[0108] In some examples, the reference Figure 5B If a new user joins the multi-user communication session but does not enable their avatar to be displayed in the shared three-dimensional environment (e.g., their avatar is turned off, as similarly discussed above), the first electronic device 560 and the second electronic device 570 display a two-dimensional representation corresponding to the new user in the three-dimensional environment 550A / 550B (e.g., similar to Fig.5I525 in the spatial group 540). In some examples, because the new user has no previous spatial position within the spatial group 540, the electronic device 560 / 570 may select by default a placement position for the two-dimensional representation to the left of the avatar 515 (e.g., to the left of the ellipse 515A in the spatial group 540). In some examples, the placement position of the two-dimensional representation is any other desired position, such as a position specified by the user. In some examples, after determining the placement position of the two-dimensional representation, the avatars 515 / 517 / 519 are rearranged relative to the reference line extending from the placement position in the manner described above.
[0109] In some examples, the placement of the avatar relative to the location where content is shared and displayed in the shared three-dimensional environment is based on the location where existing content is displayed in the shared three-dimensional environment. Figure 5J , when the user of the first electronic device 560, the user of the second electronic device 570, and the user of the third electronic device (not shown) are in a multi-user communication session, the two-dimensional representation 529 is displayed at a corresponding position in the three-dimensional environment 550A / 550B. In some examples, the two-dimensional representation 529 represented by the rectangle 529A in the spatial group 540 corresponds to the user of the third electronic device (e.g., the user of the third electronic device is currently in a non-spatial state), as discussed similarly above. Alternatively, in some examples, the two-dimensional representation 529 corresponds to a shared application window (e.g., similar to the playback user interface 447), which can be viewed and interacted with by the users in the multi-user communication session.
[0110] exist Figure 5K In the example, the second electronic device 570 detects the movement of the viewpoint of the user of the second electronic device 570. Figure 5K As shown, the second electronic device 570 detects that the user's head rotates to the right relative to the three-dimensional environment 550B, which causes the viewpoint of the second electronic device 570 to rotate to the right relative to the three-dimensional environment 550B. In some examples, when the user's viewpoint changes, such as Figure 5K As shown, the portion of the physical environment visible in the three-dimensional environment 550B shifts according to the movement of the viewpoint. Figure 5K As shown, the representation 508' of the coffee table has moved to the left in the current field of view, and a larger portion of the right side wall is visible in the current field of view.
[0111] In addition, Figure 5K In FIG. 5 , the user of the second electronic device 570 has initiated the process of sharing the content in the three-dimensional environment 550A / 550B. Figure 5K As shown, the second electronic device 570 is displaying a user interface object 544 associated with a corresponding application running on the second electronic device 570. In some examples, such as Figure 5KAs shown and as similarly discussed above, user interface object 544 includes option 543A that can be selected to initiate a process of displaying shared content (e.g., “Content C”) corresponding to a corresponding application in a shared three-dimensional environment. Figure 5K In the example of , user interface object 544 represented by rectangle 544A in spatial group 540 is a private object that can only be viewed and interacted with by a user of second electronic device 570, as discussed previously herein.
[0112] exist Figure 5K , second electronic device 570 detects selection input 572C directed to option 543A in user interface object 544 in three-dimensional environment 550B. For example, as similarly discussed above, second electronic device 570 detects that the user of second electronic device 570 provides a pinch input (e.g., where the user's index finger and thumb are in contact) (or other suitable input, such as a tap input, a verbal command, a gaze exceeding a threshold time period, etc.) when the user's gaze is directed to option 543A.
[0113] In some examples, in response to receiving a selection of option 543A in user interface object 544, second electronic device 570 initiates a process of sharing and displaying content associated with user interface object 544 in the shared three-dimensional environment. In some examples, as similarly discussed above, when the shared content is displayed in the shared three-dimensional environment, spatial group 540 is updated so that avatar 515 / 517 is repositioned in the shared three-dimensional environment based on the location where the shared content is to be displayed. In some examples, the location where the shared content is to be displayed corresponds to the location where existing content is displayed in the shared three-dimensional environment. For example, Figure 5L As shown, square 541 represents the placement of the shared content in the shared three-dimensional environment. Figure 5L As shown, based on Figure 5K The placement position is selected by the position of the two-dimensional representation 529 represented by the rectangle 529A in the space group 540. For example, Figure 5L As shown, the square 541 indicating the placement position is located at Figure 5K The position of rectangle 529A in FIG.
[0114] In some examples, such as Figure 5M As shown, when the shared content is displayed in the three-dimensional environment 550A / 550B, the shared content is displayed by Figure 5L The square 541 in the space group 540 represents the location of the placement position. For example, Figure 5MAs shown, the shared content corresponds to a media player user interface 545 (e.g., corresponding to the above-described media player user interface 445) represented by rectangle 545A in spatial group 540, including a plurality of media controls 546 (e.g., corresponding to the above-described plurality of media controls 446). Figure 5M As shown, when the media player user interface 545 is displayed at the first electronic device 560, the media player user interface 545 replaces the display of the two-dimensional representation 529 at the placement location in the three-dimensional environment 550A. In addition, in some examples, such as Figure 5M As shown, the two-dimensional representation 529 is redisplayed as an object docked on one side (e.g., the left or right side) of the media player user interface 545. For example, although the two-dimensional representation 529 is Figure 5M 545, the two-dimensional representation 529 may alternatively be displayed on the left side of the media player user interface 545 (e.g., based on the storage of the two-dimensional representation 529 relative to the Figure 5L Alternatively, in some examples, if the two-dimensional representation 529 corresponds to a shared application window, the first electronic device 560 and the second electronic device 570 stop displaying the two-dimensional representation 529 in the three-dimensional environment 550A / 550B. Figure 5M As shown, before the user of the second electronic device 570 provides input to share the media player user interface 545 in the three-dimensional environment 550A / 550B, the avatars corresponding to the users in the multi-user communication session are not repositioned (e.g., displaced / moved) relative to the placement location represented by square 541, which is the location of the two-dimensional representation 529 (or other existing shared content) in the three-dimensional environment 550A / 550B. Figure 5M In the three-dimensional environment 550A / 550B, when the media player user interface 545 is shared and displayed, at the first electronic device 560, the avatar 515 corresponding to the user of the second electronic device 570 remains displayed on the right side of the viewpoint of the user of the first electronic device 560, and at the second electronic device 570, the avatar 517 corresponding to the user of the first electronic device 560 remains displayed on the left side of the viewpoint of the user of the second electronic device 570.
[0115] Additionally, in some examples, as described above, at the first electronic device 560, when the media player user interface 545 is shared and displayed in the three-dimensional environment 550A, the two-dimensional representation 529 remains displayed at the same position relative to the viewpoint of the user of the first electronic device 560. For example, the two-dimensional representation 529 is optionally displayed at a reduced size in the three-dimensional environment 550A and shifted to the right (or left) in the three-dimensional environment 550A when the media player user interface 545 is displayed, but before the media player user interface 545 is shared in the multi-user communication session, the two-dimensional representation 529 and the media player user interface 545 occupy the same position in the three-dimensional environment 550A relative to the viewpoint of the user of the first electronic device 560. Figure 5K In addition, in some examples, at the first electronic device 560, the avatar 515 corresponding to the user of the second electronic device 570 is angled / rotated relative to the viewpoint of the user of the first electronic device 560 to face the same position as the two-dimensional representation 529 in the multi-user communication session. Figure 5K The location of the location at the second electronic device 570 is displayed in the example. Figure 5M As shown, at the second electronic device 570, when the media player user interface 545 is shared and displayed in the three-dimensional environment 550B, the media player user interface 545 and the two-dimensional representation 529 are displayed from the viewpoint of the user of the second electronic device 570 instead of Figure 5K For example, from the viewpoint of the user of the second electronic device 570, based on the two-dimensional representation 529 relative to Figure 5K The position of user interface object 544 in the second electronic device 570 (e.g., the distance and orientation between two-dimensional representation 529 and user interface object 544) is determined, and the size of two-dimensional representation 529 is reduced and optionally moved in three-dimensional environment 550B. In addition, in some examples, from the viewpoint of the user of second electronic device 570, based on the relative position of avatar 517 Figure 5K The avatar 517 corresponding to the user of the first electronic device 560 moves in the three-dimensional environment 550B according to the position of the user interface object 544 in the first electronic device 560 (e.g., the distance and orientation between the avatar 517 and the user interface object 544).
[0116] In some examples, the placement location of the shared content is alternatively selected relative to the viewpoint of the user providing input for sharing the content in the shared three-dimensional environment. Figure 5N In the example, when the user of the first electronic device 560, the user of the second electronic device 570, and the user of the third electronic device (not shown) are in a multi-user communication session, the user of the first electronic device 560 has initiated a process of sharing content in a shared three-dimensional environment. Figure 5NAs shown, the first electronic device 560 is displaying a user interface object 530 represented by a rectangle 530A in the space group 540 that is associated with a corresponding application running on the first electronic device 560. In some examples, such as Figure 5N As shown and as similarly discussed above, user interface object 530 includes option 523A that can be selected to initiate a process of displaying shared content corresponding to a corresponding application in a shared three-dimensional environment. Figure 5N In the example of , user interface object 530 is a private object that can only be viewed and interacted with by a user of first electronic device 560, as previously discussed herein.
[0117] exist Figure 5N , the first electronic device 560 detects a selection input 572D directed to an option 523A in a user interface object 530 in the three-dimensional environment 550A. For example, as similarly discussed above, the first electronic device 560 detects that a user of the first electronic device 560 provides a pinch input (e.g., where the user's index finger and thumb are in contact) (or other suitable input, such as a tap input, a verbal command, a gaze exceeding a threshold time period, etc.) when the user's gaze is directed to the option 523A.
[0118] In some examples, in response to receiving a selection of option 523A in user interface object 530, first electronic device 560 initiates a process of sharing and displaying content associated with user interface object 530 in a shared three-dimensional environment. In some examples, when the shared content is displayed in a shared three-dimensional environment that contains existing shared content (e.g., without an existing canvas), as similarly discussed above, spatial group 540 is updated so that avatar 515 / 517 / 519 is repositioned in the shared three-dimensional environment based on the location where the shared content is to be displayed. For example, Fig.5O As shown, square 541 represents the placement of the shared content in the shared three-dimensional environment. In some examples, the placement is based on Figure 5N The selection is based on the position of the user interface object 530 represented by the rectangle 530A in the space group 540. For example, Fig.5O As shown, the square 541 indicating the placement position is located at Figure 5N The position of rectangle 530A in FIG.
[0119] In some examples, when determining the placement location of the shared content, a reference line 539 is established between the placement location represented by square 541 and the location of the user of the first electronic device 560 represented by ellipse 517A in space group 540, such as Fig.5OIn particular, a reference line 539 is established between the placement location represented by square 541 and the viewpoint of the user sharing content in the shared three-dimensional environment. In some examples, as similarly discussed above, avatars corresponding to the users in the multi-user communication session (e.g., including the viewpoints of the users) are repositioned (e.g., displaced / moved) relative to reference line 539. Fig.5O As shown, the avatar (e.g., including the user's viewpoint) is moved / displaced (e.g., radially) relative to reference line 539 to be positioned in front of and facing the placement location represented by square 541. For example, Fig.5O As shown by the arrows in , in the space group 540, the avatar 519 represented by the ellipse 519A is shifted clockwise around the reference line 539, and the avatar 515 represented by the ellipse 515A is shifted counterclockwise around the reference line 539. As described above, because the reference line 539 is determined based on the viewpoint of the user of the first electronic device 560, the avatar 517 represented by the ellipse 517A is not shifted (e.g., clockwise or counterclockwise) relative to the reference line 539 in the space group 540. Therefore, in some examples, such as Figure 5P As shown, when the shared content is displayed in the shared three-dimensional environment, the avatars corresponding to users other than the user sharing the content (e.g., including the user's viewpoint) represented by the ellipse 515A / 519A are repositioned in the spatial group 540 so that at the first electronic device 560, the avatar 515 corresponding to the user of the second electronic device 570 is located to the left of the viewpoint of the user of the first electronic device 560 (e.g., moving counterclockwise relative to the viewpoint of the user of the first electronic device), and the avatar 519 corresponding to the user of the third electronic device (not shown) is located to the right of the viewpoint of the user of the first electronic device 560 (e.g., moving clockwise relative to the viewpoint of the user of the first electronic device). Similarly, as Figure 5P As shown, at the second electronic device 570, when the shared content is displayed in the three-dimensional environment 550B, the avatar 517 corresponding to the user of the first electronic device 560 and the avatar 519 corresponding to the user of the third electronic device (not shown) are located to the right of the viewpoint of the user of the second electronic device 570. In some examples, as similarly discussed above, the movement of the avatars corresponding to the users represented by the ellipses 515A / 517A / 519A is displayed with animation.
[0120] Alternatively, in some examples, when sharing the above content in a multi-user communication session, the arrangement of users in the spatial group 540 is determined based on the position of each user relative to the midpoint of the reference line 539. For example, in Fig.5OIn the spatial group 540 in FIG. 5 , a separate line may be established between the midpoint of the reference line 539 to each of the ellipse 515A representing the user of the second electronic device 570 and the ellipse 519A representing the user of the third electronic device (not shown). The order of the individual lines relative to the reference line 539 may be used to determine Figure 5P Arrangement of users in the spatial group 540 shown. For example, because the separate line drawn between the ellipse 515A and the midpoint of the reference line 539 is on the left side of the reference line 539, the avatar 515 is positioned on the left side of the viewpoint of the user of the first electronic device 560 represented by the ellipse 517A, and because the separate line drawn between the ellipse 517A and the midpoint of the reference line 539 is on the right side of the reference line 539, the avatar 517 is positioned on the right side of the viewpoint of the user of the first electronic device 560, as shown in FIG. Figure 5P As shown at the first electronic device 560 in .
[0121] In some examples, such as Figure 5P As shown, the shared content corresponds to playback user interface 547, which corresponds to playback user interface 447 discussed previously above. As described above, playback user interface 547 includes playback controls 556 and a grabber or handle bar indicator 535 that can be selected to initiate movement of playback user interface 547 in three-dimensional environment 550B. In addition, in some examples, such as Figure 5P As shown, avatars 515 / 517 / 519 represented by ellipses 515A / 517A / 519A are oriented to face playback user interface 547 in the shared three-dimensional environment. Thus, as described above, in some examples, when content is shared in the shared three-dimensional environment, the positions of users other than the user sharing the content in spatial group 540 are repositioned within the shared three-dimensional environment relative to the user sharing the content.
[0122] In some examples, in accordance with determining that an event has occurred for updating the spatial arrangement of users within spatial group 540 that is not associated with a user currently in a spatial state within the multi-user communication session, the users are rearranged in the shared three-dimensional environment based at least in part on an average detected orientation of the users' respective electronic devices. For example, as described above, the electronic devices discussed herein are worn on a particular user's head during use, such that the orientation of the particular electronic device is determined by the orientation of the user's head (e.g., a particular degree of rotation along pitch, yaw, and / or roll directions).
[0123] exist Figure 5Q , when the user of the first electronic device 560, the user of the second electronic device 570, and the user of the third electronic device (not shown) are in a spatial state in a multi-user communication session, their avatars (e.g., avatars 515 / 517 / 519) are displayed with corresponding orientations determined based on the orientations of the users' heads. Figure 5Q As shown, the user of the first electronic device 560 represented by ellipse 517A and the user of the third electronic device represented by ellipse 519A have orientations pointing left and right, respectively, in the spatial group 540 relative to the direction from the respective users to the center, and the user of the second electronic device 560 represented by ellipse 515A has an orientation pointing forward (e.g., straight ahead) in the spatial group 540 (e.g., neutral relative to the direction from the respective users at the center). Figure 5Q , at the first electronic device 560, the avatar 515 corresponding to the user of the second electronic device 570 is oriented to face right in the shared three-dimensional environment relative to the viewpoint of the first electronic device 560. Additionally, the avatar 519 corresponding to the user of the third electronic device is oriented away from the viewpoint of the user of the first electronic device 560, but in the same direction as the forward direction of the user of the first electronic device 560. Similarly, Figure 5Q As shown, at the second electronic device 570 , the avatar 517 corresponding to the user of the first electronic device 560 and the avatar 519 corresponding to the user of the third electronic device are oriented to face left relative to the viewpoint of the user of the second electronic device 570 .
[0124] exist Figure 5Q In , an event occurs that causes the spatial arrangement of users in spatial group 540 to be updated. For example, in Figure 5Q In some examples, the first electronic device 560, the second electronic device 570, and / or the third electronic device (not shown) detect that a new user has joined the multi-user communication session (e.g., a user of a fourth electronic device (not shown)). Figure 5Q As shown, in response to detecting that a new user has joined the multi-user communication session, the first electronic device 560 and the second electronic device 570 display a visual indication 531 in the shared three-dimensional environment indicating that a new user (eg, "User 4") is joining the multi-user communication session.
[0125] In some examples, when a new user (e.g., a user of a fourth electronic device (not shown)) joins the multi-user communication session, the new user is in a non-spatial state. For example, as similarly discussed above, when a user of a fourth electronic device (not shown) joins the spatial group 540, the user of the fourth electronic device is represented by a two-dimensional representation in the shared three-dimensional environment rather than being in a spatial state with the other users. Figure 5RIn some examples, the user of the fourth electronic device joining the multi-user communication session in a non-spatial state corresponds to an event that causes the spatial arrangement of the users in the spatial group 540 to be updated. Thus, in some examples, when the first electronic device 560, the second electronic device 570, and the third electronic device (not shown) initiate display of the two-dimensional representation of the user of the fourth electronic device, the current spatial users (e.g., the user of the first electronic device 560, the user of the second electronic device 570, and the user of the third electronic device (not shown)) are repositioned within the spatial group 540. In some examples, as described in more detail below, the spatial group 540 is updated so that the avatars 515 / 517 / 519 are repositioned in the shared three-dimensional environment based on the location where the two-dimensional representation of the user of the fourth electronic device (not shown) is to be displayed.
[0126] In some examples, the placement of the two-dimensional representation of the user of second electronic device 570 is determined based on an average position of the users in spatial group 540 and an average orientation of electronic devices associated with the spatial users in spatial group 540. Figure 5R As shown, the average center 532 of the spatial group 540 is determined based on the position of the spatial users in the spatial group 540, which corresponds to the position of the ellipse 515A / 517A / 519A. In some examples, the average orientation of the electronic device is determined for those users in the spatial group 540 who are currently in the spatial state (e.g., excluding those users who are not in the spatial state). For example, as described above, the user of the first electronic device 560 and the user of the third electronic device (not shown) are both oriented to face right in the spatial group 540, which causes the orientation of the first electronic device 560 and the third electronic device to also be oriented to point to the right, as shown in FIG. Figure 5R Similarly, as described above, the user of the second electronic device 570 is oriented to face forward in the direction toward the avatar 517 / 519, which causes the orientation of the second electronic device 570 to also be directed forward toward the avatar 517 / 519, as shown in FIG. Figure 5R Therefore, the average orientation of the first electronic device 560, the second electronic device 570 and the third electronic device is determined to be in the right direction in the space group 540, as shown in FIG. Figure 5R In some examples, the average orientation of the electronic device is determined independent of the location and / or direction of gaze.
[0127] Alternatively, in some examples, the average orientation of the electronic devices is determined individually by the electronic devices relative to the nominal center of the field of view of each electronic device. For example, rather than averaging the vectors corresponding to the orientations of the electronic devices in the manner described above, the positions of the users in spatial group 540 relative to the center of the field of view of each user at each electronic device are determined, and the average orientation is determined based on an offset of these positions.
[0128] In some examples, when the average center 532 and the average orientation are determined in the manner described above, a placement position of the two-dimensional representation corresponding to the user of the fourth electronic device (not shown) can then be determined. In some examples, the placement position represented by square 541 corresponds to a position in spatial group 540 that is a predetermined distance from the average center 532 and in the direction of the average orientation of the first electronic device 560, the second electronic device 570, and the third electronic device. For example, Figure 5R As shown, the placement position of the two-dimensional representation of the user of the fourth electronic device represented by square 541 is determined to be at a predetermined distance from the average center 532 and in the direction of the average orientation of the first electronic device 560, the second electronic device 570 and the third electronic device (not shown).
[0129] In some examples, the placement location of the two-dimensional representation is determined similar to one of the methods provided above based on determining that the average direction of the orientation of the first electronic device 560, the second electronic device 570, and / or the third electronic device (not shown) is equal and opposite (e.g., zero) due to the electronic devices being oriented to face opposite directions. For example, the placement location of the two-dimensional representation corresponding to the user of the fourth electronic device is selected arbitrarily and / or based on the average center 532 of the spatial group 540 (e.g., without regard to the orientation of the electronic device).
[0130] In some examples, as similarly discussed above, when determining the placement location of the two-dimensional representation, a reference line 539 is established between the placement location represented by square 541 and the average center 532 of the spatial group 540, such as Figure 5R In particular, a reference line 539 is established between the placement location represented by square 541 and the average location of spatial users in the shared three-dimensional environment. In some examples, as similarly discussed above, avatars corresponding to users in the multi-user communication session (e.g., including the users' viewpoints) are repositioned (e.g., displaced / moved) relative to reference line 539. In some examples, as Figure 5R As shown, the avatar (e.g., including the user's viewpoint) is moved / displaced (e.g., radially) relative to reference line 539 to be positioned in front of and facing the placement location represented by square 541. For example, Figure 5RAs shown by the arrows in , avatar 515 represented by ellipse 515A and avatar 517 represented by ellipse 517A shift counterclockwise around reference line 539 in space group 540, and avatar 519 represented by ellipse 519A shifts clockwise around reference line 539. Thus, in some examples, as Figure 5S As shown, when the two-dimensional representation 525 represented by rectangle 525A is displayed in the shared three-dimensional environment, the avatars corresponding to the users currently in the spatial state represented by ellipses 515A / 517A / 519A are repositioned in the spatial group 540 (e.g., including the user's viewpoint), so that at the first electronic device 560, the avatar 515 corresponding to the user of the second electronic device 570 is located to the left of the viewpoint of the user of the first electronic device 560, and the avatar 519 corresponding to the user of the third electronic device (not shown) is located to the right of the viewpoint of the user of the first electronic device 560. Similarly, in some examples, such as Figure 5S As shown, at the second electronic device 570 , an avatar 517 corresponding to the user of the first electronic device 560 and an avatar 519 corresponding to the user of the third electronic device (not shown) are located on the right side of the viewpoint of the user of the second electronic device 570 .
[0131] Thus, as described above, in some examples, when an event is detected that is associated with a user that is not currently in a spatial state and causes the spatial arrangement of users in spatial group 540 to be updated, the users that are currently in a spatial state within spatial group 540 are repositioned within the shared three-dimensional environment based on the average position of the users and the average orientation of their respective electronic devices. Figure 5Q to Figure 5S In the example shown, the spatial arrangement of users in the spatial group is updated regardless of whether content is currently being shared and displayed in the three-dimensional environment 550A / 550B. For example, if content is shared in the spatial group 540 when a new user joins the multi-user communication session in a non-spatial state, the avatars corresponding to the users in the spatial group are repositioned in the same manner as described above (e.g., based on the average position of the users in the spatial state and the average orientation of their corresponding electronic devices), regardless of the position and / or orientation of the shared content.
[0132] Thus, one advantage of the disclosed method of automatically repositioning users in a spatial group in a multi-user communication session when shared content is displayed in a shared three-dimensional environment with a directionality based on the location of the shared content is that the spatial context of the arrangement of the users can be preserved when the shared content is displayed, while also providing an unobstructed view of the shared content in the shared three-dimensional environment and providing a visually seamless transition in the movement of the avatars corresponding to the users. As another benefit, automatically repositioning users in a spatial group in a multi-user communication session when the respective users have their avatars no longer displayed in the shared three-dimensional environment helps reduce the need for input for manually repositioning themselves in the spatial group after the avatars corresponding to the respective users are no longer displayed.
[0133] As described above, when electronic devices are communicatively linked in a multi-user communication session, displaying shared content in the multi-user communication session causes the relative positions of users of the electronic devices to be updated based on the location of the shared content, including moving avatars corresponding to the users in directions relative to the location of the shared content. Attention is now directed to examples regarding selectively updating multiple "seats" (e.g., unoccupied spatial vacancies) within a spatial group of users in a multi-user communication session.
[0134] As used herein, a space group within a multi-user communication session can be associated with a plurality of seats that determine the spatial arrangement of the space group. For example, the space group is configured to accommodate a plurality of users (e.g., from two users up to "n" users), and each of the plurality of users is assigned (e.g., occupies) one of the plurality of seats within the space group. In some examples, the number of seats in the space group is selectively changed when a user joins or leaves a multi-user communication session. For example, if a user joins a multi-user communication session, the number of seats in the space group is increased by one. On the other hand, if a user leaves the multi-user communication session, the number of seats in the space group is not reduced by one; instead, the number of seats in the space group is maintained until an event occurs that causes the number of seats to be reset to correspond to the current number of users in the multi-user communication session, as shown by way of the following example. Therefore, if a new user joins a multi-user communication session when a seat is unoccupied in the space group, the new user will be arranged at an unoccupied seat within the space group, which results in fewer and / or less noticeable changes in the arrangement of avatars corresponding to users in a shared three-dimensional environment.
[0135] FIG. 6A to FIG. 6I 1 shows example interactions between users in a multi-user communication session according to some examples of the present disclosure. In some examples, a first electronic device 660, a second electronic device 670, and a third electronic device (not shown) may be communicatively linked in a multi-user communication session, such as Fig. 6AIn some examples, when the first electronic device 660 is in a multi-user communication session with the second electronic device 670 and the third electronic device (not shown), the first electronic device 660 is used to present the three-dimensional environment 650A, and the second electronic device 670 is used to present the three-dimensional environment 650B. It should be understood that the third electronic device (not shown) is then displaying a three-dimensional environment (not shown) similar to the three-dimensional environment 650A / 650B. In some examples, the electronic devices 660 / 670 optionally correspond to the electronic devices 560 / 570 described above, 4A to 4F Electronic equipment 460 / 470 and / or Figure 3 In some examples, the three-dimensional environment 650A / 650B includes an optical see-through or video pass-through portion of the physical environment in which the electronic device 660 / 670 is located. For example, the three-dimensional environment 650A includes a window (e.g., a representation 609' of the window), and the three-dimensional environment 650B includes a coffee table (e.g., a representation 608' of the coffee table) and a floor lamp (e.g., a representation 607' of the floor lamp). In some examples, the three-dimensional environment 650A / 650B optionally corresponds to the three-dimensional environment 550A / 550B described above. 4A to 4F 3D environment 450A / 450B and / or Figure 3 As described above, the three-dimensional environment also includes an avatar 615 / 617 corresponding to the user of the electronic device 670 / 660. In some examples, the avatar 615 / 617 optionally corresponds to the above-mentioned avatar 515 / 517, 4A to 4F Incarnation 415 / 417 and / or Figure 3 Incarnation 315 / 317. In addition, Fig. 6A As shown, the three-dimensional environment 650A / 650B also includes an avatar 619 corresponding to a user of a third electronic device (not shown).
[0136] As discussed earlier in this article, Fig. 6A In the embodiment of the present invention, the user of the first electronic device 660, the user of the second electronic device 670, and the user of the third electronic device (not shown) can be arranged according to the spatial group 640 (e.g., the initial or baseline spatial group, such as the session spatial group) within the multi-user communication session. In some examples, the spatial group 640 optionally corresponds to the spatial group 540 discussed above, the spatial group 540 discussed above with reference to 4A to 4F The space groups discussed in 440 and / or above reference Figure 3 As similarly described above, when a user of the first electronic device 660, a user of the second electronic device 670, and a user of a third electronic device (not shown) are in the first spatial group 640 within a multi-user communication session, the users have a spatial arrangement (e.g., composed of Fig. 6AThe positions of the ellipses 615A, 617A, and 619A in the space group 640 and / or the distances between the ellipses are represented), so that the first electronic device 660, the second electronic device 670, and the third electronic device (not shown) maintain a consistent spatial relationship (e.g., spatial reality) between the position of the user's viewpoint (e.g., which corresponds to the position of the ellipses 617 / 615 / 619) and the virtual content at each electronic device. In addition, as Fig. 6A As shown, in spatial group 640 , avatars (eg, represented by their ellipses 615A, 619A, and 617A) are displayed with respective orientations such that the avatars face toward center 632 of spatial group 640 .
[0137] In some examples, as similarly discussed above, the spatial group 640 can be associated with a plurality of "seats" (e.g., predetermined spatial vacancies) in a shared three-dimensional environment that are configured to be occupied by one or more users in a multi-user communication session. For example, the plurality of seats determine the spatial arrangement of the spatial group 640 described above. In some examples, the plurality of seats in the shared three-dimensional environment can be generally arranged radially around a center 632 of the spatial group 640, wherein each seat of the plurality of seats is positioned an equal distance from the center 632 and is spaced an equal distance, angle, and / or arc length from the center 632 by adjacent seats. Fig. 6A , the location of each user in spatial group 640 (e.g., represented by ellipses 515A / 517A / 519A) corresponds to one of the plurality of seats in the shared three-dimensional environment. In some examples, as described herein, a seat remains established in spatial group 640 in a multi-user communication session, regardless of whether a user (e.g., represented by their avatar) is currently occupying the seat, until an event occurs that causes the seat to be reset (e.g., cleared) in spatial group 640.
[0138] from FIG. 6A to FIG. 6B , the first electronic device 660 and the second electronic device 670 detect an indication that a user of a third electronic device (not shown) has left the multi-user communication session. Figure 6B , the third electronic device (not shown) is no longer communicatively linked with the first electronic device 660 and the second electronic device 670 in the multi-user communication session. Figure 6B As shown, the first electronic device 660 and the second electronic device 670 update the three-dimensional environment 650A / 650B respectively to no longer include the avatar 619 corresponding to the user of the third electronic device. Figure 6B , spatial group 640 no longer includes the user of the third electronic device (eg, represented by ellipse 619A).
[0139] In some examples, as described above, even though the user of the third electronic device (not shown) is no longer in the multi-user communication session, the seat 638 associated with the user of the third electronic device (e.g., previously occupied by the user of the third electronic device) remains established in the spatial group 640. Figure 6B As shown, seat 638 is still included in space group 640, even though seat 638 is not occupied by the user (e.g., occupied by an avatar corresponding to the user, such as a user of the third electronic device described above). In some examples, the unoccupied seat 638 can be visually represented in the shared three-dimensional environment. For example, the electronic device displays a visual indicator, such as a virtual ring, a virtual sphere / ball, or other virtual object or user interface element, at a position in the three-dimensional environment corresponding to seat 638 in its corresponding three-dimensional environment. Alternatively, in some examples, the unoccupied seat 638 is visually represented by an open space at a position corresponding to seat 638 in the shared three-dimensional environment (e.g., rather than being represented by a virtual user interface element).
[0140] In some examples, if a new user joins the multi-user communication session when seat 638 is unoccupied in spatial group 640, the new user is placed in seat 638 in spatial group 640 (e.g., an avatar corresponding to the new user is displayed in a location corresponding to seat 638 in spatial group 640 in the shared three-dimensional environment). FIG. 6B to FIG. 6C , the first electronic device 660 and the second electronic device 670 detect an indication that a user of a fourth electronic device (not shown) has joined the multi-user communication session. Figure 6C , a fourth electronic device (not shown) is communicatively linked with the first electronic device 660 and the second electronic device 670 in the multi-user communication session.
[0141] In some examples, such as Figure 6C As shown, when a user of a fourth electronic device (not shown) joins the multi-user communication session, the first electronic device 660 and the second electronic device 670 update the three-dimensional environment 650A / 650B, respectively, to include an avatar 621 corresponding to the user of the fourth electronic device (not shown). In some examples, as described above, when a user of the fourth electronic device joins the multi-user communication session, the user represented by the ellipse 621A is arranged / assigned to Figure 6B The avatar 621 corresponding to the user of the fourth electronic device (not shown) is displayed at a position corresponding to the seat 638 in the spatial group 640 in the shared three-dimensional environment.
[0142] As described above, in some examples, if space group 640 includes an unoccupied seat (e.g., such as seat 638), the seat remains established (e.g., included) in space group 640 until an event occurs that causes the seat to be reset (e.g., cleared) in space group 640. In some examples, one such event includes displaying shared content in a multi-user communication session. Fig.6D In FIG. 6 , when seat 638 is unoccupied in space group 640, second electronic device 670 detects an input corresponding to a request to display shared content in three-dimensional environment 650B. Fig.6D As shown, the three-dimensional environment 650B includes a user interface object 630 (e.g., corresponding to the user interface object 530 and / or the user interface object 430 described above) associated with an application running on the second electronic device 670. In some examples, the user interface object 630 represented by rectangle 630A is private to the user of the second electronic device 670, such that the user interface object 630 is visible only to the user of the first electronic device as a representation 630" of the user interface object in the three-dimensional environment 650A. In some examples, as previously discussed herein, the user interface object 630 includes an option 623A that can be selected to display the shared content (e.g., "Content A") in the three-dimensional environment 650B. As shown in FIG. Fig.6D As shown, display of private content (such as user interface object 630 ) does not cause seat 638 to be reset (eg, cleared) in space group 640 .
[0143] exist Fig.6D , when displaying user interface object 630 including option 623A, second electronic device 670 detects selection input 672A directed to option 623A in three-dimensional environment 650B. For example, as similarly discussed above, second electronic device 670 detects that the user of second electronic device 670 provides an air pinch gesture, an air tap or touch gesture, a gaze dwell, a verbal command, etc. corresponding to a request to select option 623A.
[0144] In some examples, such as Fig. 6EAs shown, in response to detecting the selection of option 623A, the second electronic device 670 displays a playback user interface 647 associated with the user interface object 630. In some examples, the playback user interface 647 corresponds to the playback user interface 547 and / or the playback user interface 447 described above. In some examples, the playback user interface 647 includes a playback control 656 and a grabber or manipulation bar that can be selected to initiate movement of the playback user interface 657 in the three-dimensional environment 650B. As described above, the playback user interface 647 is optionally displayed as a shared object in the three-dimensional environment 650B. Therefore, the three-dimensional environment 650A at the first electronic device 660 is updated to include the playback user interface 647.
[0145] In some examples, when playback user interface 647 is displayed in three-dimensional environment 650A / 650B, the spatial arrangement of space group 640 is updated according to any of the exemplary methods discussed above herein. Additionally, as described above, when playback user interface 647 represented by rectangle 647A is displayed in three-dimensional environment 650A / 650B, space group 640 is updated to reset any unoccupied seats in space group 640. In particular, as described above, Fig. 6E As shown, when the playback user interface 647 represented by rectangle 647A is displayed, the space group 640 is updated to no longer include Fig.6D The number of seats is 638. Therefore, Fig. 6E , space group 640 is updated to include two seats, each seat being occupied by a user of first electronic device 660 and second electronic device 670, respectively (eg, represented by ellipses 615A and 617A).
[0146] from FIG. 6E to FIG. 6F , when the playback user interface 647 is displayed in the three-dimensional environment 650A / 650B, the first electronic device 660 and the second electronic device 670 detect that a user of a fourth electronic device (not shown) has joined the multi-user communication session, as similarly discussed above. Fig. 6F As shown, the first electronic device 660 and the second electronic device 670 update the three-dimensional environment 650A / 650B, respectively, to include an avatar 621 corresponding to a user of a fourth electronic device (not shown). In some examples, when the user of the fourth electronic device represented by ellipse 621A joins the multi-user communication session, the spatial group 640 is updated to include a third seat occupied by the user of the fourth electronic device (e.g., by avatar 621 in the shared three-dimensional environment), as shown in FIG. Fig. 6F For example, in spatial group 640, the position of the user of first electronic device 660 represented by ellipse 617A and the position of the user of second electronic device 670 represented by ellipse 615A are shifted to accommodate the user of fourth electronic device represented by ellipse 621A and occupying a new third seat in spatial group 640.
[0147] exist Figure 6G In the embodiment of the present invention, when the user of the first electronic device 660, the user of the second electronic device 670, and the user of the fourth electronic device (not shown) are in a multi-user communication session, the second electronic device 670 detects an input corresponding to a request to leave the multi-user communication session. Figure 6G As shown, the three-dimensional environment 650B includes a user interface element 623, which includes a selectable option 623B for initiating the process of leaving the multi-user communication session. Figure 6G As shown, the second electronic device 670 can receive a selection input 672B directed to a selectable option 623B in the user interface element 623. For example, as similarly discussed above, the second electronic device 670 detects that the user of the second electronic device 670 provides an air pinch gesture, a tap or touch gesture, a gaze dwell, a verbal command, etc. corresponding to a request to select the selectable option 623B in the three-dimensional environment 650B.
[0148] In some examples, such as Figure 6H As shown, in response to detecting the selection of the selectable option 623B, the second electronic device 670 terminates the communication with the first electronic device 660 and the fourth electronic device (not shown) in the multi-user communication session. Figure 6H As shown, in the space group 640, the user of the second electronic device 670 represented by the ellipse 615A is no longer associated with the space group 640 in the multi-user communication session. Figure 6H As shown, the second electronic device 670 updates the three-dimensional environment 650B to no longer include the playback user interface 647, the avatar 617 corresponding to the user of the first electronic device 660, and the avatar 621 corresponding to the user of the fourth electronic device (not shown). In some examples, because the user of the second electronic device 670 is no longer in the multi-user communication session, the first electronic device 660 updates the three-dimensional environment 650A to no longer include the avatar 615 corresponding to the user of the second electronic device 670.
[0149] In some examples, as similarly discussed above, when the user of second electronic device 670 is no longer associated with spatial group 640, spatial group 640 retains seat 638 that was previously occupied by the user of second electronic device 670 (e.g., by avatar 615). In some examples, as described above, seat 638 remains established (e.g., included) in spatial group 640 until an event occurs that causes seat 638 to be reset (e.g., cleared). In some examples, because Figure 6H The shared three-dimensional environment includes shared content (e.g., playback user interface 647), so one such event that causes seat 638 to be reset includes stopping display of the shared content, as described below.
[0150] exist Figure 6H In the example of , at first electronic device 660, playback user interface 647 may include an exit affordance 651 that can be selected to stop sharing and thus stop displaying playback user interface 647 in the shared three-dimensional environment. Figure 6H , when playback user interface 647 including exit affordance 651 is displayed, first electronic device 660 detects selection input 672C directed to exit affordance 651. For example, first electronic device 660 detects that the user of first electronic device 660 provides an air pinch gesture, a tap or touch gesture, a gaze dwell, a verbal command, etc. corresponding to a request to select exit affordance 651.
[0151] In some examples, such as Fig.6I As shown, in response to detecting a selection of exit affordance 651, first electronic device 660 stops displaying playback user interface 647 in three-dimensional environment 650A (e.g., this also causes playback user interface 647 to no longer be displayed in the three-dimensional environment at a fourth electronic device (not shown)). Fig.6I As shown, when the playback user interface 647 is no longer displayed in the shared three-dimensional environment, the spatial arrangement of the users in the spatial group 640 is updated to no longer include Figure 6H For example, as described above, before stopping the display of playback user interface 647, seat 638 was unoccupied in space group 640 (e.g., but had not yet been reset / cleared). Fig.6I As shown, after first electronic device 660 causes playback user interface 647 to no longer be displayed in shared three-dimensional environment (e.g., in response to detecting selection of exit affordance 651), unoccupied seat 638 is no longer included in space group 640. Fig.6I , when the positions of the users (e.g., and their corresponding avatars) represented by ellipses 617A and 621A in the multi-user communication session are updated in spatial group 640, at first electronic device 660, avatar 621 corresponding to the user of fourth electronic device (not shown) is shifted / moved to be displayed directly in three-dimensional environment 650A from the viewpoint of the user of first electronic device 660. In some examples, updating the positions of the users in spatial group 640 can be performed according to any of the methods previously described herein.
[0152] Thus, as described above, when users are associated with a spatial group in a multi-user communication session, seats belonging to users leaving the multi-user communication session will remain open, such that new users joining the multi-user communication session will automatically occupy the vacant seats until an event occurs that causes the vacant seats to be cleared in the spatial group. Thus, as an advantage, the disclosed method helps avoid frequent and / or unnecessary shifting of avatars and / or viewpoints of users in a spatial group in a multi-user communication session, which may be distracting and / or otherwise disruptive to users participating in a shared experience within the multi-user communication session. Another advantage of the disclosed method is that because the number of seats in the spatial group is reset in concert with a transition in the display of shared content in the multi-user communication session, one spatial arrangement update takes into account two transition events, which helps reduce power consumption.
[0153] It should be understood that the examples shown and described herein are merely exemplary, and additional and / or alternative elements for interacting with illustrative content may be provided within a three-dimensional environment. It should be understood that the appearance, shape, form, and size of each of the various user interface elements and objects shown and described herein are exemplary, and alternative appearances, shapes, forms, and / or sizes may be provided. For example, a virtual object representing a user interface (e.g., a private application window 330, user interface objects 430, 530, and 630, and / or user interfaces 445, 447, 547, and 647) may be provided in an alternative shape other than a rectangular shape (such as a circular shape, a triangular shape, etc.). In some examples, various selectable options (e.g., options 423A, 523A, 623A, and 623B and / or affordance 651), user interface elements (e.g., user interface elements 520 and / or 623), control elements (e.g., playback controls 456, 556, and / or 656), etc. described herein may be verbally selected via a user verbal command (e.g., a "select option" verbal command). Additionally or alternatively, in some examples, various options, user interface elements, control elements, etc. described herein may be selected and / or manipulated via user input received through one or more separate input devices in communication with the electronic device. For example, selection input may be received via a physical input device in communication with the electronic device (e.g., a mouse, trackpad, keyboard, etc.).
[0154] FIG. 7A to FIG. 7BA flowchart illustrating an example process for updating a spatial group of users in a multi-user communication session based on content displayed in a three-dimensional environment according to some examples of the present disclosure is shown. In some examples, process 700 begins at a first electronic device in communication with a display, one or more input devices, a second electronic device, and a third electronic device. In some examples, the first electronic device, the second electronic device, and the third electronic device are optionally each similar to or corresponding to Figure 2 The head mounted display of the device 260 / 270. Fig. 7A As shown, in some examples, at 702, when in a communication session with a second electronic device and a third electronic device, the first electronic device displays via a display a computer-generated environment including a three-dimensional representation corresponding to a user of the second electronic device and a three-dimensional representation corresponding to a user of the third electronic device, wherein the three-dimensional representation corresponding to the user of the second electronic device and the three-dimensional representation corresponding to the user of the third electronic device are separated by a first distance. For example, Figure 4A As shown, the first electronic device 460 displays a three-dimensional environment 450A including an avatar 415 corresponding to a user of the second electronic device 470 and an avatar 419 corresponding to a user of a third electronic device (not shown), and the avatar 415 represented by the ellipse 415A in the space group 440 and the avatar 419 represented by the ellipse 419A are separated by a first distance 431A.
[0155] In some examples, at 704, while displaying a computer-generated environment including a three-dimensional representation corresponding to a user of the second electronic device and a three-dimensional representation corresponding to a user of the third electronic device, the first electronic device receives, via one or more input devices, a first input corresponding to a request to display shared content in the computer-generated environment. Figure 4D As shown, second electronic device 470 detects selection input 472A directed to option 423A, which can be selected to display shared content (eg, "Content A") in three-dimensional environment 450B.
[0156] In some examples, in response to receiving the first input at 706, in accordance with determining that the shared content is a first type of content at 708, the first electronic device displays a first object corresponding to the shared content in a computer-generated environment via a display at 710. For example, Figure 4G As shown, in response to detecting Figure 4FIn the embodiment of the present invention, the first electronic device 460 and the second electronic device 470 display the playback user interface 447 in the three-dimensional environment 450A and 450B respectively. In some examples, at 712, the first electronic device updates the display of the three-dimensional representation corresponding to the user of the second electronic device and the three-dimensional representation corresponding to the user of the third electronic device, so that the three-dimensional representation corresponding to the user of the second electronic device and the three-dimensional representation corresponding to the user of the third electronic device are separated by a second distance different from the first distance. For example, Figure 4G As shown, the playback user interface 447 corresponds to a first type of content because the playback user interface 447 is larger than a threshold size (e.g., a threshold width, length, and / or area as previously discussed herein), which causes the spatial separation between adjacent users (such as between ellipses 415A and 421A representing users in spatial group 440) to be reduced to a second distance 431B.
[0157] In some examples, such as Figure 7B As shown, at 714, based on determining that the shared content is a second type of content different from the first type of content, at 716, the first electronic device displays a second object corresponding to the shared content in the computer-generated environment via the display. Figure 4E As shown, in response to detecting a selection of option 423A, first electronic device 460 and second electronic device 470 display media player user interface 445 in three-dimensional environments 450A and 450B, respectively. In some examples, at 718, the first electronic device maintains a display separation of a three-dimensional representation corresponding to a user of the second electronic device and a three-dimensional representation corresponding to a user of the third electronic device by a first distance. For example, Figure 4E As shown, the media player user interface 445 corresponds to the second type of content because the media player user interface 445 is smaller than a threshold size (e.g., a threshold width, length, and / or area as previously discussed herein), which enables the spatial separation between adjacent users (such as between ellipses 415A and 421A representing users in spatial group 440) to remain at the first distance 431A.
[0158] It should be understood that process 700 is an example, and more, fewer, or different operations may be performed in the same or different order. In addition, the operations in the above process 700 are optionally performed by running an information processing device such as a general-purpose processor (e.g., as described in relation to Figure 2 The one or more functional modules in the dedicated chip and / or Figure 2 other components to achieve this.
[0159] Figure 8A flowchart is shown showing an example process for moving a three-dimensional representation of a user within a multi-user communication session when sharing content in a three-dimensional environment according to some examples of the present disclosure. In some examples, process 800 begins at a first electronic device in communication with a display, one or more input devices, a second electronic device, and a third electronic device. In some examples, the first electronic device, the second electronic device, and the third electronic device are optionally each similar to or corresponding to Figure 2 The head mounted display of the device 260 / 270. Figure 8 As shown, in some examples, at 802, when in a communication session with a second electronic device and a third electronic device, the first electronic device displays a computer-generated environment via a display, the computer-generated environment including a three-dimensional representation corresponding to a user of the second electronic device at a first position relative to a viewpoint of the first electronic device in the computer-generated environment and a three-dimensional representation corresponding to a user of the third electronic device at a second position different from the first position. For example, Figure 5B As shown, the first electronic device 560 displays a three-dimensional environment 550A including an avatar 515 corresponding to a user of the second electronic device 570 and an avatar 519 corresponding to a user of a third electronic device (not shown), and the avatar 515 represented by an ellipse 515A is located at a first position in the spatial group 540, and the avatar 519 represented by an ellipse 519A is located at a second position in the spatial group 540.
[0160] In some examples, at 804, while displaying a computer-generated environment including a three-dimensional representation corresponding to a user of the second electronic device and a three-dimensional representation corresponding to a user of the third electronic device, the first electronic device receives, via one or more input devices, a first input corresponding to a request to display content in the computer-generated environment. Figure 5C As shown, first electronic device 560 detects selection input 572A pointing to option 523A, which can be selected to display content (e.g., "Content B") in three-dimensional environment 550A. In some examples, at 806, in response to receiving the first input, based on determining that the content corresponds to shared content, at 808, the first electronic device displays a first object corresponding to the shared content in the computer-generated environment via the display. For example, Fig. 5F As shown, in response to detecting selection of option 523A, first electronic device 560 and second electronic device 570 display playback user interfaces 547 in three-dimensional environments 550A / 550B, respectively.
[0161] In some examples, at 810, the first electronic device displays a three-dimensional representation corresponding to a user of the second electronic device at a first update position relative to a viewpoint in a computer-generated environment, and displays a three-dimensional representation corresponding to a user of a third electronic device at a second update position different from the first update position, including, at 812, moving the three-dimensional representation of the user of the second electronic device to the first update position and moving the three-dimensional representation of the user of the third electronic device to the second update position in a corresponding direction selected based on the position of the first object. For example, Fig. 5F As shown, the avatar 515 represented by the ellipse 515A is displayed at the first updated position in the space group 540, and the avatar 519 represented by the ellipse 519A is displayed at the second updated position in the space group 540, which includes Figure 5E Avatars 515 and 519 are shown being moved clockwise or counterclockwise relative to the placement position represented by square 541.
[0162] It should be understood that process 800 is an example, and more, fewer, or different operations may be performed in the same or different order. In addition, the operations in the above process 800 are optionally performed by running an information processing device such as a general-purpose processor (e.g., as described in relation to Figure 2 The one or more functional modules in the dedicated chip and / or Figure 2 other components to achieve this.
[0163] FIG. 9A to FIG. 9B A flowchart illustrating an example process for updating a spatial user group in a multi-user communication session based on content displayed in a three-dimensional environment according to some examples of the present disclosure is shown. In some examples, process 900 begins at a first electronic device in communication with a display, one or more input devices, and a second electronic device. In some examples, the first electronic device and the second electronic device are optionally respectively similar to or corresponding to Figure 2 The head mounted display of the device 260 / 270. Fig. 9A As shown, in some examples, at 902, while in a communication session with a second electronic device, the first electronic device displays via a display a computer-generated environment including a three-dimensional representation corresponding to a user of the second electronic device. Figure 4A As shown, the first electronic device 460 displays a three-dimensional environment 450A that includes an avatar 415 corresponding to a user of the second electronic device 470 , represented by an ellipse 415A in the spatial group 440 .
[0164] In some examples, at 904, while displaying a computer-generated environment including a three-dimensional representation corresponding to a user of the second electronic device, the first electronic device receives, via one or more input devices, a first input corresponding to a request to display shared content in the computer-generated environment. Figure 4D As shown, the second electronic device 470 detects a selection input 472A pointing to option 423A, which can be selected to display the shared content (e.g., "Content A") in the three-dimensional environment 450B. In some examples, at 906, in response to receiving the first input, at 908, based on determining that the shared content is a first type of content, at 910, the first electronic device displays a first object corresponding to the shared content in the computer-generated environment via the display. For example, Figure 4E As shown, in response to detecting a selection of option 423A, first electronic device 460 and second electronic device 470 display media player user interface 445 in three-dimensional environments 450A and 450B, respectively. In some examples, at 912, the first electronic device updates the display of the three-dimensional representation corresponding to the user of the second electronic device, so that the three-dimensional representation corresponding to the user of the second electronic device and the viewpoint of the first electronic device are separated by a first distance, and the three-dimensional representation corresponding to the user of the second electronic device and the first object are separated by a first distance. For example, Figure 4E As shown, the media player user interface 445 corresponds to a first type of content because the media player user interface 445 is smaller than a threshold size (e.g., a threshold width, length, and / or area as previously discussed herein), which results in the spatial separation between the viewpoint of the second electronic device 470 represented by the ellipses 415A and 417A in the spatial group 440, respectively, and the avatar 417 being a first distance 431A, and the spatial separation between the avatar 419 represented by the ellipse 419A and the rectangle 445A, respectively, and the media player user interface 445 being also the first distance 431A.
[0165] like Fig. 9B As shown, in some examples, at 914, based on determining that the shared content is a second type of content different from the first type of content, at 916, the first electronic device displays a second object corresponding to the shared content in a computer-generated environment via a display. Figure 4G As shown, in response to detecting Figure 4F 423B in the selection, the first electronic device 460 and the second electronic device 470 display the playback user interface 447 in the three-dimensional environment 450A and 450B, respectively. In some examples, at 918, the first electronic device updates the display of the three-dimensional representation corresponding to the user of the second electronic device, so that the three-dimensional representation corresponding to the user of the second electronic device and the viewpoint of the first electronic device are separated by a second distance, and the three-dimensional representation corresponding to the user of the second electronic device and the second object are separated by a third distance different from the second distance. For example, as Figure 4GAs shown, the playback user interface 447 corresponds to a second type of content because the playback user interface 447 is larger than a threshold size (e.g., a threshold width, length, and / or area as previously discussed herein), which causes the spatial separation between the viewpoint of the second electronic device 470 represented by the ellipses 415A and 417A in the spatial group 440, respectively, and the avatar 417 to decrease to a second distance 431B, and the spatial separation between the avatar 417 represented by the ellipse 417A and the rectangle 447A, respectively, and the playback user interface 447 to increase to a third distance greater than the second distance 431B.
[0166] It should be understood that process 800 is an example, and more, fewer, or different operations may be performed in the same or different order. In addition, the operations in the above process 800 are optionally performed by running an information processing device such as a general-purpose processor (e.g., as described in relation to Figure 2 The one or more functional modules in the dedicated chip and / or Figure 2 other components to achieve this.
[0167] Therefore, based on the above content, some examples of the present disclosure relate to a method, including: at a first electronic device that communicates with a display, one or more input devices, and a second electronic device: when in a communication session with the second electronic device, displaying a computer-generated environment including a three-dimensional representation corresponding to a user of the second electronic device via the display; when displaying the computer-generated environment including the three-dimensional representation corresponding to the user of the second electronic device, receiving a first input corresponding to a request to display shared content in the computer-generated environment via the one or more input devices; and in response to receiving the first input: based on determining that the shared content is a first type of content, displaying a first object corresponding to the shared content in the computer-generated environment via the display, and more A new three-dimensional representation corresponding to the user of the second electronic device is displayed, so that the three-dimensional representation corresponding to the user of the second electronic device is separated from the viewpoint of the first electronic device by a first distance, and the three-dimensional representation corresponding to the user of the second electronic device is separated from the first object by a first distance; and based on determining that the shared content is a second type of content different from the first type of content, a second object corresponding to the shared content is displayed via a display in the computer-generated environment, and the display of the three-dimensional representation corresponding to the user of the second electronic device is updated, so that the three-dimensional representation corresponding to the user of the second electronic device is separated from the viewpoint of the first electronic device by a second distance, and the three-dimensional representation corresponding to the user of the second electronic device is separated from the second object by a third distance different from the second distance.
[0168] Additionally or alternatively, in some examples, determining that the shared content is a second type of content is based on determining that a first object corresponding to the shared content is configured to have a size greater than a threshold size when the first object is displayed in a computer-generated environment. Additionally or alternatively, in some examples, determining that the shared content is a first type of content is based on determining that a second object corresponding to the shared content is configured to have a size within a threshold size when the second object is displayed in a computer-generated environment. Additionally or alternatively, in some examples, determining that the shared content is a first type of content is based on determining that the second object corresponding to the shared content corresponds to a two-dimensional representation of a user of the second electronic device or a two-dimensional representation of a user of a third electronic device. Additionally or alternatively, in some examples, the first object is a shared application window associated with an application operating on the first electronic device. Additionally or alternatively, in some examples, the second distance is less than the third distance. Additionally or alternatively, in some examples, the method also includes: when a second object corresponding to the shared content is displayed in a computer-generated environment in response to receiving the first input based on determining that the shared content is a second type of content, receiving a second input corresponding to a request to scale the second object in the computer-generated environment via one or more input devices; and in response to receiving the second input, based on determining that the request is to increase the size of the second object relative to the viewpoint of the first electronic device, increasing the size of the second object in the computer-generated environment relative to the viewpoint of the first electronic device based on the second input, and updating display of a three-dimensional representation corresponding to a user of the second electronic device so that the three-dimensional representation corresponding to the user of the second electronic device and the viewpoint of the first electronic device are separated by a fourth distance that is less than the second distance.
[0169] Additionally or alternatively, in some examples, prior to receiving the first input: the user of the first electronic device and the user of the second electronic device have a spatial group within the communication session such that the three-dimensional representation corresponding to the user of the second electronic device is positioned a first distance from a viewpoint of the first electronic device; and the three-dimensional representation corresponding to the user of the second electronic device has a first orientation facing the center of the spatial group. Additionally or alternatively, in some examples, in response to receiving the first input, based on determining that the shared content is a second type of content: the user of the first electronic device, the user of the second electronic device, and the second object have a second spatial group within the communication session that is different from the spatial group; and the three-dimensional representation corresponding to the user of the second electronic device has a first updated orientation facing the second object in the computer-generated environment. Additionally or alternatively, in some examples, the method also includes: when a second object corresponding to the shared content is displayed in a computer-generated environment in response to receiving the first input based on determining that the shared content is a second type of content, receiving a second input corresponding to a request to increase the size of the second object in the computer-generated environment via one or more input devices; and in response to receiving the second input: increasing the size of the second object in the computer-generated environment relative to the viewpoint of the first electronic device based on the second input; and based on determining that the second input causes the size of the second object to increase in the computer-generated environment to above a threshold size, updating the display of a three-dimensional representation corresponding to a user of the second electronic device so that the three-dimensional representation corresponding to the user of the second electronic device and the viewpoint of the first electronic device are separated by a minimum distance.
[0170] Additionally or alternatively, in some examples, the method further includes: receiving a third input corresponding to a request to further increase the size of the second object in the computer-generated environment to above a threshold size via one or more input devices; and in response to receiving the third input, further increasing the size of the second object in the computer-generated environment relative to the viewpoint of the first electronic device according to the third input to above the threshold size, and maintaining the display of the three-dimensional representation corresponding to the user of the second electronic device at a minimum distance from the viewpoint of the first electronic device. Additionally or alternatively, in some examples, displaying the second object corresponding to the shared content in the computer-generated environment includes displaying the second object corresponding to the shared content at a first position in the computer-generated environment relative to the viewpoint of the first electronic device. In some examples, the method further includes: when displaying the second object corresponding to the shared content at the first position in the computer-generated environment, receiving a second input corresponding to a request to scale the second object in the computer-generated environment via one or more input devices; and in response to receiving the second input, according to determining that the request is to increase the size of the second object relative to the viewpoint of the first electronic device, increasing the size of the second object in the computer-generated environment relative to the viewpoint of the first electronic device according to the second input, and updating the position of the second object in the computer-generated environment to a second position farther from the first position in the computer-generated environment relative to the viewpoint.
[0171] Additionally or alternatively, in some examples, the method further includes: when displaying a first object corresponding to the shared content in a computer-generated environment in response to receiving a first input based on determining that the shared content is a first type of content, detecting an indication that a user of a third electronic device has joined the communication session; and in response to detecting the indication, displaying a three-dimensional representation corresponding to the user of the third electronic device in the computer-generated environment via a display; wherein the three-dimensional representation corresponding to the user of the second electronic device and the three-dimensional representation corresponding to the user of the third electronic device are separated by a first distance. Additionally or alternatively, in some examples, the method further includes: when displaying a second object corresponding to the shared content in a computer-generated environment in response to receiving a first input based on determining that the shared content is a second type of content, detecting an indication of a change in the state of the second electronic device; and in response to detecting the indication, replacing the display of the three-dimensional representation corresponding to the user of the second electronic device with a two-dimensional representation of the user of the second electronic device, wherein the two-dimensional representation of the user of the second electronic device is displayed adjacent to the second object in the computer-generated environment, and updating the display of the three-dimensional representation of the user of the third electronic device to be positioned in the computer-generated environment based on the sum of the size of the second object and the size of the two-dimensional representation of the user of the second electronic device. Additionally or alternatively, in some examples, the first electronic device and the second electronic device each include a head-mounted display.
[0172] Some examples of the present disclosure relate to a method, the method comprising: at a first electronic device in communication with a display, one or more input devices, a second electronic device, and a third electronic device: while in a communication session with the second electronic device and the third electronic device, displaying a computer-generated environment via the display, the computer-generated environment comprising a three-dimensional representation corresponding to a user of the second electronic device at a first position relative to a viewpoint of the first electronic device in the computer-generated environment and a three-dimensional representation corresponding to a user of the third electronic device at a second position different from the first position; while displaying the computer-generated environment comprising the three-dimensional representation corresponding to the user of the second electronic device and the three-dimensional representation corresponding to the user of the third electronic device, receiving a first input corresponding to a request to display content in the computer-generated environment via the one or more input devices; and in response to receiving the first input, displaying a first object corresponding to the shared content in the computer-generated environment via the display based on determining that the content corresponds to shared content, and displaying a three-dimensional representation corresponding to the user of the second electronic device at a first update position relative to the viewpoint in the computer-generated environment and displaying a three-dimensional representation corresponding to the user of the third electronic device at a second update position different from the first update position, including moving the three-dimensional representation of the user of the second electronic device to the first update position and moving the three-dimensional representation of the user of the third electronic device to the second update position in a corresponding direction selected based on the position of the first object.
[0173] Additionally or alternatively, in some examples, the first object is a shared application window associated with an application operating on the first electronic device. Additionally or alternatively, in some examples, the first update position and the second update position are determined relative to a reference line in a computer-generated environment. Additionally or alternatively, in some examples, before receiving the first input, the user of the first electronic device, the user of the second electronic device, and the user of the third electronic device are arranged in a space group having a center point, and the reference line extends between the position of the first object in the computer-generated environment and the center point of the space group. Additionally or alternatively, in some examples, the center point is determined based on the calculated average of the viewpoint, the first position, and the second position of the first electronic device. Additionally or alternatively, in some examples, the corresponding movement direction of the three-dimensional representation corresponding to the user of the second electronic device is clockwise relative to the reference line in the computer-generated environment, and the corresponding movement direction of the three-dimensional representation corresponding to the user of the third electronic device is counterclockwise relative to the reference line in the computer-generated environment. Additionally or alternatively, in some examples, the method further includes: before receiving the first input, detecting an indication of a change in state of the second electronic device; and in response to detecting the indication, replacing display of a three-dimensional representation corresponding to the user of the second electronic device with a two-dimensional representation of the user of the second electronic device, and displaying the three-dimensional representation corresponding to the user of the third electronic device at a third updated position relative to the viewpoint, including moving the three-dimensional representation of the user of the third electronic device to a third updated position in a corresponding direction selected based on the position of the two-dimensional representation of the user of the second electronic device.
[0174] Additionally or alternatively, in some examples, the first electronic device, the second electronic device, and the third electronic device each include a head-mounted display. Additionally or alternatively, in some examples, the three-dimensional representation of the user of the second electronic device and the three-dimensional representation of the user of the third electronic device are moved to a first update position and a second update position in corresponding directions, respectively, using a moving animation. Additionally or alternatively, in some examples, the method further includes: in response to receiving a first input, based on determining that the content corresponds to private content, displaying a second object corresponding to the private content via a display in a computer-generated environment, and maintaining the three-dimensional representation corresponding to the user of the second electronic device at a first position in the computer-generated environment, and maintaining the three-dimensional representation corresponding to the user of the third electronic device at a second position. Additionally or alternatively, in some examples, the method further includes: when displaying a computer-generated environment including a three-dimensional representation corresponding to a user of a second electronic device, a three-dimensional representation corresponding to a user of a third electronic device, and a second object, receiving a second input corresponding to a request to share private content with a user of the second electronic device and a user of a third electronic device via one or more input devices; and in response to receiving the second input, redisplaying the second object as a shared object in the computer-generated environment, and displaying the three-dimensional representation corresponding to the user of the second electronic device at a third update position relative to the viewpoint in the computer-generated environment and displaying the three-dimensional representation corresponding to the user of the third electronic device at a fourth update position different from the third update position, including moving the three-dimensional representation of the user of the second electronic device to the third update position and moving the three-dimensional representation of the user of the third electronic device to the fourth update position in a corresponding direction selected based on the position of the second object.
[0175] Additionally or alternatively, in some examples, the method further includes: when displaying a computer-generated environment including a three-dimensional representation corresponding to a user of a second electronic device and a three-dimensional representation corresponding to a user of a third electronic device, detecting an indication of a request to display shared content in the computer-generated environment; and in response to detecting the indication, displaying a second object corresponding to the shared content in the computer-generated environment via the display, and updating the viewpoint of the first electronic device relative to the position of the second object in the computer-generated environment. Additionally or alternatively, in some examples, the viewpoint, the first position, and the second position of the first electronic device are arranged according to a spatial group in the computer-generated environment. In some examples, the method further includes: when displaying a computer-generated environment including a three-dimensional representation corresponding to a user of a second electronic device and a three-dimensional representation corresponding to a user of a third electronic device, detecting an indication that the user of the second electronic device is no longer in a communication session; and in response to detecting the indication, stopping displaying the three-dimensional representation corresponding to the user of the second electronic device in the computer-generated environment, and maintaining displaying the three-dimensional representation corresponding to the user of the third electronic device at the second position in the computer-generated environment. Additionally or alternatively, in some examples, the method further includes: while displaying a computer-generated environment including a three-dimensional representation corresponding to a user of a third electronic device, detecting an indication that a user of a fourth electronic device has joined the communication session; and in response to detecting the indication, displaying, via the display, the three-dimensional representation corresponding to the user of the fourth electronic device at a first position in the computer-generated environment.
[0176] Additionally or alternatively, in some examples, the method further includes: when displaying a computer-generated environment including a three-dimensional representation corresponding to a user of a third electronic device, receiving a second input corresponding to a request to display shared content in the computer-generated environment via one or more input devices; and in response to receiving the second input, displaying a corresponding object corresponding to the shared content in the computer-generated environment via the display, and displaying the three-dimensional representation corresponding to the user of the third electronic device at a third position in the computer-generated environment different from the first position and the second position. Additionally or alternatively, in some examples, before receiving the second input, the second position at which the three-dimensional representation corresponding to the user of the third electronic device is displayed is a first distance from a viewpoint of the first electronic device, and in response to receiving the second input, the third position at which the three-dimensional representation corresponding to the user of the third electronic device is displayed is a second distance from the viewpoint less than the first distance. Additionally or alternatively, in some examples, the computer-generated environment also includes a corresponding object corresponding to the shared content. In some examples, the method also includes: when displaying a computer-generated environment including a three-dimensional representation and a corresponding object corresponding to a user of a third electronic device, receiving a second input corresponding to a request to stop displaying shared content in the computer-generated environment via one or more input devices; and in response to receiving the second input, stopping displaying the corresponding object in the computer-generated environment, and displaying the three-dimensional representation corresponding to the user of the third electronic device at a third position in the computer-generated environment that is different from the first position and the second position.
[0177] Additionally or alternatively, in some examples, the viewpoint, the first position, and the second position of the first electronic device are arranged according to a spatial group in a computer-generated environment. In some examples, the method further includes: when displaying a computer-generated environment including a three-dimensional representation corresponding to a user of a second electronic device and a three-dimensional representation corresponding to a user of a third electronic device, detecting an indication that a user of a fourth electronic device has joined the communication session; and in response to detecting the indication, displaying a three-dimensional representation corresponding to the user of the fourth electronic device at a third position in the computer-generated environment via the display, moving the three-dimensional representation corresponding to the user of the second electronic device to a fourth position in the computer-generated environment different from the first position, and moving the three-dimensional representation corresponding to the user of the third electronic device to a fifth position in the computer-generated environment different from the second position.
[0178] Some examples of the present disclosure relate to a method, the method comprising: at a first electronic device in communication with a display, one or more input devices, a second electronic device, and a third electronic device: when in a communication session with the second electronic device and the third electronic device, displaying a computer-generated environment via the display, the computer-generated environment comprising a three-dimensional representation corresponding to a user of the second electronic device and a three-dimensional representation corresponding to a user of the third electronic device, wherein the three-dimensional representation corresponding to the user of the second electronic device and the three-dimensional representation corresponding to the user of the third electronic device are separated by a first distance; when displaying the computer-generated environment comprising the three-dimensional representation corresponding to the user of the second electronic device and the three-dimensional representation corresponding to the user of the third electronic device, receiving, via the one or more input devices, a request to display shared content in the computer-generated environment requesting a corresponding first input; and in response to receiving the first input: based on determining that the shared content is a first type of content, displaying a first object corresponding to the shared content via a display in a computer-generated environment, and updating the display of a three-dimensional representation corresponding to a user of the second electronic device and a three-dimensional representation corresponding to a user of the third electronic device, so that the three-dimensional representation corresponding to the user of the second electronic device and the three-dimensional representation corresponding to the user of the third electronic device are separated by a second distance different from the first distance; and based on determining that the shared content is a second type of content different from the first type of content, displaying a second object corresponding to the shared content via a display in a computer-generated environment, and maintaining the display interval of the three-dimensional representation corresponding to the user of the second electronic device and the three-dimensional representation corresponding to the user of the third electronic device by the first distance.
[0179] Additionally or alternatively, in some examples, determining that the shared content is a first type of content is based on determining that a first object corresponding to the shared content is configured to have a size greater than a threshold size when the first object is displayed in a computer-generated environment. Additionally or alternatively, in some examples, determining that the shared content is a second type of content is based on determining that a second object corresponding to the shared content is configured to have a size within a threshold size when the second object is displayed in a computer-generated environment. Additionally or alternatively, in some examples, determining that the shared content is a second type of content is based on determining that the second object corresponding to the shared content corresponds to a two-dimensional representation of a user of a second electronic device or a two-dimensional representation of a user of a third electronic device. Additionally or alternatively, in some examples, the first object is a shared application window associated with an application operating on the first electronic device. Additionally or alternatively, in some examples, the second distance is less than the first distance. Additionally or alternatively, in some examples, the method also includes: when a first object corresponding to the shared content is displayed in a computer-generated environment in response to receiving the first input based on determining that the shared content is a first type of content, receiving a second input corresponding to a request to scale the first object in the computer-generated environment via one or more input devices; and in response to receiving the second input, based on determining that the request is to increase the size of the first object relative to the viewpoint of the first electronic device, increasing the size of the first object in the computer-generated environment relative to the viewpoint of the first electronic device based on the second input, and updating the display of the three-dimensional representation corresponding to the user of the second electronic device and the three-dimensional representation corresponding to the user of the third electronic device so that the three-dimensional representation corresponding to the user of the second electronic device and the three-dimensional representation corresponding to the user of the third electronic device are separated by a third distance that is smaller than the second distance.
[0180] Additionally or alternatively, in some examples, prior to receiving the first input: the user of the first electronic device, the user of the second electronic device, and the user of the third electronic device have a spatial group within the communication session, such that the three-dimensional representation corresponding to the user of the second electronic device and the three-dimensional representation corresponding to the user of the third electronic device are positioned a first distance from the viewpoint of the first electronic device; and the three-dimensional representation corresponding to the user of the second electronic device has a first orientation facing the center of the spatial group, and the three-dimensional representation corresponding to the user of the third electronic device has a second orientation facing the center of the spatial group. Additionally or alternatively, in some examples, in response to receiving the first input, based on determining that the shared content is a first type of content: the user of the first electronic device, the user of the second electronic device, the user of the third electronic device, and the first object have a second spatial group different from the spatial group within the communication session; and the three-dimensional representation corresponding to the user of the second electronic device has a first updated orientation facing the first object in the computer-generated environment, and the three-dimensional representation corresponding to the user of the third electronic device has a second updated orientation facing the first object in the computer-generated environment.
[0181] Additionally or alternatively, in some examples, the method further includes: when displaying a first object corresponding to the shared content in a computer-generated environment in response to receiving the first input and determining that the shared content is a first type of content, receiving a second input corresponding to a request to increase the size of the first object in the computer-generated environment via one or more input devices; and in response to receiving the second input, increasing the size of the first object in the computer-generated environment relative to the viewpoint of the first electronic device according to the second input, and updating the display of the three-dimensional representation corresponding to the user of the second electronic device and the three-dimensional representation corresponding to the user of the third electronic device according to determining that the second input causes the size of the first object to increase to above a threshold size in the computer-generated environment, so that the three-dimensional representation corresponding to the user of the second electronic device and the three-dimensional representation corresponding to the user of the third electronic device are separated by a minimum distance. Additionally or alternatively, in some examples, the method further includes: receiving a third input corresponding to a request to further increase the size of the first object to above a threshold size in the computer-generated environment via one or more input devices, and in response to receiving the third input, further increasing the size of the first object relative to the viewpoint of the first electronic device according to the third input to above the threshold size in the computer-generated environment, and maintaining the display of the three-dimensional representation corresponding to the user of the second electronic device and the three-dimensional representation corresponding to the user of the third electronic device The minimum distance is kept apart.
[0182] Additionally or alternatively, in some examples, the method further includes: when in response to receiving the first input, a first object corresponding to the shared content is displayed at a first position in the computer-generated environment relative to the viewpoint of the first electronic device based on determining that the shared content is a first type of content, receiving a second input corresponding to a request to scale the first object in the computer-generated environment via one or more input devices; and in response to receiving the second input, based on determining that the request is to increase the size of the first object relative to the viewpoint of the first electronic device, increasing the size of the first object in the computer-generated environment relative to the viewpoint of the first electronic device based on the second input, and updating the position of the first object in the computer-generated environment to a second position in the computer-generated environment farther from the first position relative to the viewpoint.
[0183] Additionally or alternatively, in some examples, the method further includes: when displaying a second object corresponding to the shared content in a computer-generated environment in response to receiving the first input based on determining that the shared content is a second type of content, detecting an indication that a user of a fourth electronic device has joined the communication session; and in response to detecting the indication, displaying a three-dimensional representation corresponding to the user of the fourth electronic device in the computer-generated environment via the display; wherein the three-dimensional representation corresponding to the user of the second electronic device and the three-dimensional representation corresponding to the user of the third electronic device are separated by a first distance. Additionally or alternatively, in some examples, the method further includes: when displaying a first object corresponding to the shared content in a computer-generated environment in response to receiving the first input based on determining that the shared content is a first type of content, detecting an indication of a change in the state of the second electronic device; and in response to detecting the indication, replacing the display of the three-dimensional representation corresponding to the user of the second electronic device with a two-dimensional representation of the user of the second electronic device, wherein the two-dimensional representation of the user of the second electronic device is displayed adjacent to the first object in the computer-generated environment, and updating the display of the three-dimensional representation of the user of the third electronic device to be positioned in the computer-generated environment at a position based on the sum of the size of the first object and the size of the two-dimensional representation of the user of the second electronic device. Additionally or alternatively, in some examples, the first electronic device, the second electronic device, and the third electronic device each include a head-mounted display.
[0184] Some examples of the present disclosure relate to an electronic device comprising: one or more processors; a memory; and one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for executing any of the above methods.
[0185] Some examples of the present disclosure relate to a non-transitory computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by one or more processors of an electronic device, cause the electronic device to perform any of the above methods.
[0186] Some examples of the present disclosure relate to an electronic device comprising: one or more processors; a memory; and a device for performing any of the above methods.
[0187] Some examples of the present disclosure relate to an information processing apparatus for use in an electronic device, the information processing apparatus including means for performing any of the above methods.
[0188] For the purpose of explanation, the foregoing description is described by reference to specific embodiments. However, the above illustrative discussion is not intended to be exhaustive or to limit the invention to the precise form disclosed. Many modifications and variations are possible based on the above teachings. The examples are selected and described in order to best illustrate the principles of the invention and its practical application, so that other persons skilled in the art can best use the invention and the various described examples with various modifications suitable for the specific purposes contemplated.
Claims
1. A method, comprising: At a first electronic device in communication with a display, one or more input devices, and a second electronic device: while in a communication session with the second electronic device, displaying, via the display, a computer-generated environment including a three-dimensional representation corresponding to a user of the second electronic device; while displaying the computer-generated environment including the three-dimensional representation corresponding to the user of the second electronic device, receiving, via the one or more input devices, a first input corresponding to a request to display shared content in the computer-generated environment; and In response to receiving the first input: According to determining that the shared content is the first type of content: displaying, via the display, a first object corresponding to the shared content in the computer-generated environment; and updating display of the three-dimensional representation corresponding to the user of the second electronic device so that the three-dimensional representation corresponding to the user of the second electronic device is separated from a viewpoint of the first electronic device by a first distance, and the three-dimensional representation corresponding to the user of the second electronic device is separated from the first object by the first distance; and According to determining that the shared content is a second type of content different from the first type of content: displaying, via the display, a second object corresponding to the shared content in the computer-generated environment; and Update the display of the three-dimensional representation corresponding to the user of the second electronic device so that the three-dimensional representation corresponding to the user of the second electronic device and the viewpoint of the first electronic device are separated by a second distance, and the three-dimensional representation corresponding to the user of the second electronic device and the second object are separated by a third distance different from the second distance.
2. The method of claim 1, wherein the determining that the shared content is the second type of content is based on determining that the first object corresponding to the shared content is configured to have a size greater than a threshold size when the first object is displayed in the computer-generated environment.
3. The method of claim 1, wherein the determining that the shared content is the first type of content is based on determining that the second object corresponding to the shared content is configured to have a size within a threshold size when the second object is displayed in the computer-generated environment. 4 . The method of claim 1 , wherein the determining that the shared content is the first type of content is based on determining that the second object corresponding to the shared content corresponds to a two-dimensional representation of the user of the second electronic device. 5 . The method of claim 1 , wherein the first object is a shared application window associated with an application operating on the first electronic device. The method of claim 1 , wherein the second distance is smaller than the third distance.
7. The method according to claim 1, further comprising: when, in response to receiving the first input, the second object corresponding to the shared content is displayed in the computer-generated environment in accordance with a determination that the shared content is the second type of content, receiving, via the one or more input devices, a second input corresponding to a request to scale the second object in the computer-generated environment; as well as In response to receiving the second input, based on determining that the request is to increase the size of the second object relative to the viewpoint of the first electronic device: increasing a size of the second object in the computer-generated environment relative to the viewpoint of the first electronic device based on the second input; and Display of the three-dimensional representation corresponding to the user of the second electronic device is updated so that the three-dimensional representation corresponding to the user of the second electronic device and the viewpoint of the first electronic device are separated by a fourth distance that is less than the second distance.
8. The method of claim 1, wherein prior to receiving the first input: a user of the first electronic device and the user of the second electronic device having a spatial group within the communication session such that the three-dimensional representation corresponding to the user of the second electronic device is positioned a first distance from the viewpoint of the first electronic device; and The three-dimensional representation corresponding to the user of the second electronic device has a first orientation facing a center of the spatial group.
9. The method according to claim 8, wherein: In response to receiving the first input, according to the determination that the shared content is the second type of content: the user of the first electronic device, the user of the second electronic device, and the second object having a second spatial group within the communication session that is different from the spatial group; and The three-dimensional representation corresponding to the user of the second electronic device has a first updated orientation facing the second object in the computer-generated environment.
10. The method according to claim 1, further comprising: when, in response to receiving the first input, the second object corresponding to the shared content is displayed in the computer-generated environment in accordance with a determination that the shared content is the second type of content, receiving, via the one or more input devices, a second input corresponding to a request to increase a size of the second object in the computer-generated environment; as well as In response to receiving the second input: increasing a size of the second object in the computer-generated environment relative to the viewpoint of the first electronic device based on the second input; and Based on determining that the second input causes the size of the second object to be increased above a threshold size in the computer-generated environment: A display of the three-dimensional representation corresponding to the user of the second electronic device is updated so that the three-dimensional representation corresponding to the user of the second electronic device and the viewpoint of the first electronic device are separated by a minimum distance.
11. The method according to claim 10, further comprising: receiving, via the one or more input devices, a third input corresponding to a request to further increase the size of the second object above the threshold size in the computer-generated environment; and In response to receiving the third input: further increasing the size of the second object in the computer-generated environment relative to the viewpoint of the first electronic device above the threshold size based on the third input; and Display of the three-dimensional representation corresponding to the user of the second electronic device is maintained separated from the viewpoint of the first electronic device by the minimum distance.
12. The method of claim 1 , wherein displaying the second object corresponding to the shared content in the computer-generated environment comprises displaying the second object corresponding to the shared content at a first position in the computer-generated environment relative to the viewpoint of the first electronic device, and wherein the method further comprises: receiving, via the one or more input devices, a second input corresponding to a request to scale the second object in the computer-generated environment while the second object corresponding to the shared content is displayed at the first location in the computer-generated environment; as well as In response to receiving the second input, based on determining that the request is to increase the size of the second object relative to the viewpoint of the first electronic device: increasing a size of the second object in the computer-generated environment relative to the viewpoint of the first electronic device based on the second input; and The position of the second object in the computer-generated environment is updated to a second position in the computer-generated environment that is farther away from the first position relative to the viewpoint.
13. The method according to claim 1, further comprising: When displaying the first object corresponding to the shared content in the computer-generated environment in response to receiving the first input based on determining that the shared content is the first type of content, detecting an indication that a user of a third electronic device has joined the communication session; In response to detecting the indication: displaying, via the display, a three-dimensional representation corresponding to the user of the third electronic device in the computer-generated environment; The three-dimensional representation corresponding to the user of the second electronic device and the three-dimensional representation corresponding to the user of the third electronic device are separated by the first distance.
14. The method according to claim 13, further comprising: detecting an indication of a change in state of the second electronic device when the second object corresponding to the shared content is displayed in the computer-generated environment in response to receiving the first input based on determining that the shared content is the second type of content; as well as In response to detecting the indication: replacing display of the three-dimensional representation corresponding to the user of the second electronic device with a two-dimensional representation of the user of the second electronic device, wherein the two-dimensional representation of the user of the second electronic device is displayed adjacent to the second object in the computer-generated environment; as well as The display of the three-dimensional representation of the user of the third electronic device is updated to be positioned at a location in the computer-generated environment based on a sum of a size of the second object and a size of the two-dimensional representation of the user of the second electronic device.
15. The method of claim 1, wherein the first electronic device and the second electronic device each comprise a head mounted display.
16. A first electronic device, comprising: one or more processors; Memory; and One or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising instructions for executing the method according to any one of claims 1 to 15.
17. A non-transitory computer-readable storage medium storing one or more programs, wherein the one or more programs include instructions, which, when executed by one or more processors of a first electronic device, cause the first electronic device to perform the method according to any one of claims 1 to 15.
Citation Information
Patent Citations
Systems and methods of managing spatial groups in multi-user communication sessions
US12099695B1
Systems and methods of managing spatial groups in multi-user communication sessions
US12113948B1
