Updating a virtual space arrangement of a user in a multi
By detecting user input in multi-user communication sessions and dynamically adjusting the viewpoint and virtual seating arrangement, the problem of inflexible virtual seating arrangement in existing technologies is solved, achieving a more flexible user experience and space management.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-09-24
- Publication Date
- 2026-03-27
AI Technical Summary
In existing computer graphics environments, the virtual seating arrangement and space management of users in multi-user communication sessions are inflexible and difficult to update and reallocate in real time based on user input.
By detecting user input on a first electronic device and updating or reassigning virtual seating arrangements according to preset criteria, including dynamically adjusting the user's viewpoint and virtual seat in a multi-user communication session, interaction and display management are achieved using input devices and displays.
It enables real-time updating and reallocation of virtual seats based on user input in multi-user communication sessions, improving the flexibility of user experience and the adaptability of spatial layout.
Smart Images

Figure CN121742784A_ABST
Abstract
Description
Cross-references to related applications
[0001] This application claims the benefit of U.S. Provisional Application No. 63 / 700,351, filed September 27, 2024, and U.S. Patent Application No. 19 / 310,478, filed August 26, 2025, the entire disclosures of which are incorporated herein by reference for all purposes. Technical Field
[0002] This disclosure relates in its entirety to systems and methods for managing and updating the virtual spatial arrangement of users of electronic devices within a three-dimensional environment, including multi-user communication sessions of electronic devices. Background Technology
[0003] Some computer graphics environments provide two-dimensional and / or three-dimensional environments, in which at least some of the objects displayed for user viewing are virtual and computer-generated. In some examples, the three-dimensional environment is presented by multiple electronic devices communicating with each other. In some examples, the user associated with the multiple electronic devices communicating with each other is arranged according to the virtual spatial arrangement in the three-dimensional environment. Summary of the Invention
[0004] Some examples of this disclosure relate to systems and methods for updating virtual seating arrangements based on user input. In some examples, a method is performed at a first electronic device communicating with one or more input devices and one or more displays. In some examples, when the first electronic device corresponding to a first user is in a multi-user communication session with one or more electronic devices, including a second electronic device different from the first electronic device corresponding to a second user, the first electronic device presents a three-dimensional environment from a first viewpoint of the first electronic device corresponding to a first position in the three-dimensional environment, including presenting a representation of the second user at a second position in the three-dimensional environment different from the first position via one or more displays. In some examples, when presenting the representation of the second user at the second position, the first electronic device detects one or more inputs via one or more input devices, the one or more inputs including a request to change from the first viewpoint of the first electronic device to the second viewpoint of the first electronic device. In some examples, in response to detecting one or more inputs, and based on determining that one or more first criteria are met, including criteria satisfied when the one or more inputs point to the second position, the first electronic device presents a three-dimensional environment from a second viewpoint of the first electronic device to correspond to the second position in the three-dimensional environment via one or more displays. In some examples, the first electronic device presents a representation of the second user at a first position in the three-dimensional environment via one or more displays.
[0005] Some examples of this disclosure relate to systems and methods for reallocating virtual seats. In some examples, a method is performed at a first electronic device communicating with one or more input devices and one or more displays. In some examples, when the first electronic device corresponding to a first user is in a multi-user communication session with one or more electronic devices including a second electronic device different from the first electronic device corresponding to a second user, the first electronic device presents a three-dimensional environment via one or more displays according to a virtual seating arrangement for multiple participants in the multi-user communication session, wherein the virtual seating arrangement includes a first virtual seat assigned to the first user and a second virtual seat different from the first virtual seat assigned to the second user. In some examples, when presenting the three-dimensional environment according to the virtual seating arrangement in the multi-user communication session, the first electronic device detects an interaction of the first user. In some examples, after detecting an interaction, and based on determining that one or more criteria are met, including criteria that are met when the first user's interaction with the three-dimensional environment corresponds to a virtual seat other than the first virtual seat in the virtual seating arrangement, the first electronic device reallocates the first user from the first virtual seat to a virtual seat other than the first virtual seat. In some examples, when the first electronic device is in a multi-user communication session, the first electronic device detects one or more first inputs via one or more input devices. In some examples, in response to detecting one or more first inputs, a first electronic device updates the display of virtual content, including a representation of a second user, in a three-dimensional environment relative to the viewpoint of the first electronic device based on a virtual seating arrangement, including: displaying the virtual content in the three-dimensional environment with a first spatial arrangement relative to the viewpoint of the first electronic device based on a determination that the first user is assigned to a first virtual seat; and displaying the virtual content in the three-dimensional environment with a second spatial arrangement different from the first spatial arrangement relative to the viewpoint of the first electronic device based on a determination that the first user is reassigned to a virtual seat other than the first virtual seat.
[0006] A full description of these examples is provided in the accompanying drawings and detailed embodiments, and it should be understood that the content of this invention does not limit the scope of this disclosure in any way. Attached Figure Description
[0007] To better understand the various examples described herein, reference should be made to the following detailed embodiments and accompanying drawings. Throughout the drawings, similar reference numerals generally refer to corresponding parts.
[0008] Figure 1 Examples of electronic devices that present extended real-world environments according to some examples of this disclosure are illustrated.
[0009] Figures 2A to 2B Block diagrams illustrating example architectures for electronic devices or systems according to some examples of this disclosure are shown.
[0010] Figures 3A to 3N Examples of updating virtual seating arrangements are illustrated according to some examples of this disclosure.
[0011] Figures 4A to 4L Example methods for reallocating virtual seats are illustrated according to some examples of this disclosure.
[0012] Figure 5 A flowchart illustrating an example process for updating a virtual seating arrangement, according to some examples of this disclosure, is shown.
[0013] Figure 6 A flowchart illustrating an example process for reallocating virtual seats, according to some examples of this disclosure, is shown. Detailed Implementation
[0014] Some examples of this disclosure relate to systems and methods for updating virtual seating arrangements based on user input. In some examples, a method is performed at a first electronic device communicating with one or more input devices and one or more displays. In some examples, when the first electronic device corresponding to a first user is in a multi-user communication session with one or more electronic devices, including a second electronic device different from the first electronic device corresponding to a second user, the first electronic device presents a three-dimensional environment from a first viewpoint of the first electronic device corresponding to a first position in the three-dimensional environment, including presenting a representation of the second user at a second position in the three-dimensional environment different from the first position via one or more displays. In some examples, when presenting the representation of the second user at the second position, the first electronic device detects one or more inputs via one or more input devices, the one or more inputs including a request to change from the first viewpoint of the first electronic device to the second viewpoint of the first electronic device. In some examples, in response to detecting one or more inputs, and based on determining that one or more first criteria are met, including criteria satisfied when the one or more inputs point to the second position, the first electronic device presents a three-dimensional environment from a second viewpoint of the first electronic device to correspond to the second position in the three-dimensional environment via one or more displays. In some examples, the first electronic device presents a representation of the second user at a first position in the three-dimensional environment via one or more displays.
[0015] Some examples of this disclosure relate to systems and methods for reallocating virtual seats. In some examples, a method is performed at a first electronic device communicating with one or more input devices and one or more displays. In some examples, when the first electronic device corresponding to a first user is in a multi-user communication session with one or more electronic devices including a second electronic device different from the first electronic device corresponding to a second user, the first electronic device presents a three-dimensional environment via one or more displays according to a virtual seating arrangement for multiple participants in the multi-user communication session, wherein the virtual seating arrangement includes a first virtual seat assigned to the first user and a second virtual seat different from the first virtual seat assigned to the second user. In some examples, when presenting the three-dimensional environment according to the virtual seating arrangement in the multi-user communication session, the first electronic device detects an interaction of the first user. In some examples, after detecting an interaction, and based on determining that one or more criteria are met, including criteria that are met when the first user's interaction with the three-dimensional environment corresponds to a virtual seat other than the first virtual seat in the virtual seating arrangement, the first electronic device reallocates the first user from the first virtual seat to a virtual seat other than the first virtual seat. In some examples, when the first electronic device is in a multi-user communication session, the first electronic device detects one or more first inputs via one or more input devices. In some examples, in response to detecting one or more first inputs, a first electronic device updates the display of virtual content, including a representation of a second user, in a three-dimensional environment relative to the viewpoint of the first electronic device based on a virtual seating arrangement, including: displaying the virtual content in the three-dimensional environment with a first spatial arrangement relative to the viewpoint of the first electronic device based on a determination that the first user is assigned to a first virtual seat; and displaying the virtual content in the three-dimensional environment with a second spatial arrangement different from the first spatial arrangement relative to the viewpoint of the first electronic device based on a determination that the first user is reassigned to a virtual seat other than the first virtual seat.
[0016] In some examples, a space group or state representation in a multi-user communication session indicates a spatial arrangement or template indicating the location of users and content located within or otherwise associated with that space group. As used herein, a space group corresponds to one or more participants (e.g., users) in a multi-user communication session. In some examples, a space group in a multi-user communication session has a spatial arrangement indicating the location of users and content located within that space group. In some examples, users in the same space group within a multi-user communication session experience spatial real-time according to the spatial arrangement of the space group. In some examples, when a user of a first electronic device is in a first space group in a multi-user communication session and a user of a second electronic device is in a second space group in a multi-user communication session, the user experiences spatial real-time localized for their respective space group. In some examples, when users of a first electronic device and users of a second electronic device are grouped into separate space groups within a multi-user communication session, if the first and second electronic devices return to the same operating state, the users of the first and second electronic devices are regrouped into the same space group within the multi-user communication session.
[0017] As used herein, a hybrid space group corresponds to a group or number of participants (e.g., users) in a multi-user communication session in which at least a subset of the participants are not juxtaposed in a physical environment. For example, as described via one or more examples in this disclosure, a hybrid space group includes at least two participants juxtaposed in a first physical environment and at least one participant not juxtaposed with the at least two participants in the first physical environment (e.g., the at least one participant is located in a second physical environment different from the first physical environment). In some examples, the hybrid space group in the multi-user communication session has a spatial arrangement that determines the location of users and content within the space group. In some examples, users in the same hybrid space group within the multi-user communication session experience spatial realism according to the spatial arrangement of the space group, as discussed similarly above.
[0018] In some examples, managing the virtual spatial arrangement of multiple users in a multi-user communication session may include interaction with one or more user interface elements. In some examples, the electronic device may track a user's gaze as input for aiming at selectable options / capabilities within a corresponding user interface element displayed in a 3D environment. For example, a gaze may be used to identify one or more options / capabilities selected as a target using another selection input. In some examples, a corresponding option / capability may be selected using hand-tracking input detected via an input device communicating with the electronic device. In some examples, objects displayed in a 3D environment may be moved and / or reoriented in the 3D environment based on movement input detected via an input device.
[0019] Figure 1An electronic device 101 is illustrated according to some examples of this disclosure, which presents a three-dimensional environment (e.g., an extended reality (XR) environment or a computer-generated reality (CGR) environment that optionally includes representations of physical and / or virtual objects). In some examples, such as Figure 1 As shown, electronic device 101 is a head-mounted display or other head-mountable device configured to be worn on the head of a user of electronic device 101. See below for reference. Figure 2A An example of an architecture block diagram to describe electronic device 101. For example... Figure 1 As shown, electronic device 101 and table 106 are located in a physical environment. The physical environment may include physical features such as physical surfaces (e.g., floor, wall) or physical objects (e.g., table, lamp, etc.). In some examples, electronic device 101 may be configured to detect and / or capture images of the physical environment including table 106 (exemplified in the field of view of electronic device 101).
[0020] In some examples, such as Figure 1 As shown, electronic device 101 includes one or more internal image sensors 114a oriented toward the user's face (e.g., referred to below). Figures 2A to 2B (The described eye-tracking camera). In some examples, an internal image sensor 114a is used for eye tracking (e.g., detecting the user's gaze). The internal image sensor 114a is optionally arranged on the left and right portions of the display 120 to enable eye tracking of the user's left and right eyes. In some examples, the electronic device 101 also includes external image sensors 114b and 114c facing outwards from the user to detect and / or capture the physical environment of the electronic device 101 and / or movement of the user's hand or other body parts.
[0021] In some examples, display 120 has a field of view visible to the user. In some examples, the user-visible field of view is the same as the field of view of external image sensors 114b and 114c. For example, when display 120 is optionally part of a head-mounted device, the field of view of display 120 is optionally the same as or similar to the field of view of the user's eyes. In some examples, the user-visible field of view is different from the field of view of external image sensors 114b and 114c (e.g., narrower than the field of view of external image sensors 114b and 114c). In other examples, the field of view of display 120 may be smaller than the field of view of the user's eyes. The user's viewpoint determines what is visible in the field of view, and the viewpoint typically specifies the position and orientation relative to the three-dimensional environment. As the user's viewpoint shifts, the field of view of the three-dimensional environment also shifts accordingly. In some examples, electronic device 101 may be an optically transparent device, through which display 120 is a transparent or translucent display through which parts of the physical environment can be directly viewed. In some examples, display 120 may be included within a transparent lens and may overlap entirely or only partially with the transparent lens. In other examples, the electronics may be a video pass-through device, wherein display 120 is an opaque display configured to display images of the physical environment captured by external image sensors 114b and 114c. Although Figure 1 A single display is shown, but it should be understood that display 120 optionally includes more than one display. For example, display 120 optionally includes displays that are merged (e.g., merged by the user's brain) to create Figure 1 The view of the content shown is displayed on a pair of stereoscopic displays (e.g., a left display panel and a right display panel for the user's left and right eyes, respectively). In some examples, see the following references. Figures 2A to 2B In more detail, the display 120 includes or corresponds to a transparent or translucent surface (e.g., a lens) that does not have display capabilities (e.g., and therefore cannot generate and display virtual objects 104), and alternatively presents a direct view of the physical environment in the user's field of view (e.g., the user's eye's field of view).
[0022] In some examples, electronic device 101 is configured to display virtual object 104 in a three-dimensional environment (e.g., in response to a trigger). Virtual object 104 is... Figure 1 The illustrated cube represents a cube that does not exist in the physical environment but is displayed in a three-dimensional environment positioned on top of table 106 (e.g., a real-world table or a representation thereof). Optionally, in response to detecting a flat surface of table 106 in the physical environment 100, virtual object 104 is displayed on the surface of table 106 in the three-dimensional environment displayed via display 120 of electronic device 101.
[0023] It should be understood that virtual object 104 is a representative virtual object and may include and render one or more different virtual objects (e.g., virtual objects with various dimensions, such as two-dimensional or other three-dimensional virtual objects) in a three-dimensional environment. For example, a virtual object may represent an application or user interface displayed in a three-dimensional environment. In some examples, a virtual object may represent content corresponding to an application and / or displayed via a user interface in a three-dimensional environment. In some examples, virtual object 104 may optionally be configured to be interactive and responsive to user input (e.g., air gestures, such as air pinch gestures, air tap gestures, and / or air touch gestures), allowing the user to virtually touch, tap, move, rotate, or otherwise interact with virtual object 104.
[0024] As discussed in this article, by the user (e.g., using Figure 1 One or more air pinch gestures performed by the hand (103) are detected by one or more input devices of the electronic device 101 and interpreted as one or more user inputs pointing to content displayed by the electronic device 101. Additionally or alternatively, in some examples, one or more user inputs interpreted by the electronic device 101 as pointing to content displayed by the electronic device 101 (e.g., virtual object 104) are detected via one or more hardware input devices (e.g., controllers, touchpads, proximity sensors, buttons, sliders, knobs, etc.) rather than via one or more input devices configured to detect air gestures (such as one or more air pinch gestures) performed by the user. This description is intended to be exemplary and not restrictive; the user may optionally use different air gestures and / or other forms of input to provide user input.
[0025] In some examples, electronic device 101 may be configured to communicate with a second electronic device, such as a companion device. For example, as Figure 1 As illustrated, electronic device 101 optionally communicates with electronic device 160. In some examples, electronic device 160 corresponds to a mobile electronic device, such as a smartphone, tablet computer, smartwatch, laptop computer, or other electronic device. In some examples, electronic device 160 corresponds to a non-mobile electronic device, which is typically stationary and not easily moved within a physical environment (e.g., a desktop computer, server, etc.). See below for reference. Figure 2B The following are additional examples of architectural diagrams used to describe electronic device 160. In some examples, electronic device 101 and electronic device 160 are associated with the same user. For example, in Figure 1In this configuration, electronic device 101 may be positioned (e.g., mounted on) a user's head, and electronic device 160 may be positioned near electronic device 101, such as being positioned on the user's hand 103 (e.g., a hand holding electronic device 160), in the user's pocket or bag, or on a surface near the user. Electronic devices 101 and 160 may optionally be associated with the same user account (e.g., the user logs into the user account on both electronic devices 101 and 160). See below for further details. Figures 2A to 2B Additional details regarding the communication between electronic device 101 and electronic device 160 are provided.
[0026] In some examples, displaying an object in a 3D environment is caused by or enables interaction with one or more user interface objects in the 3D environment. For example, initiating the display of an object in a 3D environment may include interaction with one or more virtual option / power representations displayed in the 3D environment. In some examples, when initiating the display of an object in a 3D environment, the electronic device may track the user's gaze as input for identifying one or more virtual option / power representations as a target for selection. For example, a gaze may be used to identify one or more virtual option / power representations as a target for selection using another selection input. In some examples, a virtual option / power representation may be selected using hand-tracking input detected via an input device communicating with the electronic device. In some examples, an object displayed in a 3D environment may move and / or reorient itself in the 3D environment based on movement input detected via an input device.
[0027] In the following description, an electronic device that communicates with one or more displays and one or more input devices is described. It should be understood that the electronic device optionally communicates with one or more other physical user interface devices, such as touch-sensitive surfaces, physical keyboards, mice, joysticks, hand-tracking devices, eye-tracking devices, styluses, etc. Furthermore, as described above, it should be understood that the described electronic device, display, and touch-sensitive surface are optionally distributed among two or more devices. Therefore, as used in this disclosure, information on or displayed by the electronic device may optionally be used to describe information output by the electronic device for display on a separate display device (touch-sensitive or non-touch-sensitive). Similarly, as used in this disclosure, input received on the electronic device (e.g., touch input received on a touch-sensitive surface of the electronic device, or touch input received on the surface of a stylus) may optionally be used to describe input received on a separate input device from which the electronic device receives input information.
[0028] The device typically supports a variety of applications, such as one or more of the following: drawing applications, presentation applications, word processing applications, website creation applications, disk editing applications, spreadsheet applications, game applications, telephone applications, video conferencing applications, email applications, instant messaging applications, fitness support applications, photo management applications, digital camera applications, digital video camera applications, web browsing applications, digital music player applications, TV channel browsing applications, and / or digital video player applications.
[0029] Figures 2A to 2B Block diagrams illustrating example architectures for electronic devices or systems according to some examples of this disclosure are provided. In some examples, electronic device 201 and / or electronic device 260 include one or more electronic devices. For example, electronic device 201 may be a portable device, an auxiliary device for communicating with another device, a head-mounted display, a head-mounted speaker, etc. In some examples, electronic device 201 corresponds to the above reference. Figure 1 The described electronic device 101. In some examples, electronic device 260 corresponds to the above reference. Figure 1 The described electronic device 160.
[0030] like Figure 2A As illustrated, the electronic device 201 optionally includes one or more sensors, such as one or more hand tracking sensors 202, one or more position sensors 204A, and one or more image sensors 206A (optionally corresponding to...). Figure 1 The electronic device 201 may include an internal image sensor 114a and / or external image sensors 114b and 114c, one or more touch-sensitive surfaces 209A, one or more motion and / or orientation sensors 210A, one or more eye-tracking sensors 212, one or more microphones 213A or other audio sensors, one or more body tracking sensors (e.g., torso and / or head tracking sensors), etc. The electronic device 201 may optionally include one or more output devices, such as one or more display generating components 214A (optionally corresponding to...). Figure 1 The electronic device 201 may include a display 120, one or more speakers 216A, one or more tactile output devices (not shown), etc. The electronic device 201 optionally includes one or more processors 218A, one or more memories 220A, and / or communication circuitry 222A. One or more communication buses 208A are optionally used for communication between the components of the electronic device 201 mentioned above.
[0031] Additionally, electronic device 260 optionally includes components that are the same as or similar to those of electronic device 201. Furthermore, as... Figure 2BAs shown, electronic device 260 optionally includes one or more position sensors 204B, one or more image sensors 206B, one or more touch-sensitive surfaces 209B, one or more orientation sensors 210B, one or more microphones 213B, one or more display generating components 214B, one or more speakers 216B, one or more processors 218B, one or more memories 220B, and / or communication circuitry 222B. One or more communication buses 208B are optionally used for communication between the aforementioned components of electronic device 260.
[0032] Electronic devices 201 and 260 are optionally configured to communicate via a wired or wireless connection between the two electronic devices (e.g., via communication circuits 222A, 222B). For example, as Figure 2A As indicated, electronic device 260 can be used as an accessory device to electronic device 201. For example, in some examples, electronic device 260 processes sensor inputs from electronic devices 201 and 260, and / or uses the display generation component 214A of electronic device 201 to generate content for display.
[0033] Communication circuits 222A and 222B optionally include circuitry for communicating with electronic devices and networks such as the Internet, intranets, wired and / or wireless networks, cellular networks, and wireless local area networks (LANs). Communication circuits 222A and 222B optionally include circuitry for using near-field communication (NFC) and / or short-range communication such as Bluetooth. ® The communication circuits 222A and 222B include or support Wi-Fi (e.g., the 802.11 protocol), Ethernet, Ultra Wideband (“UWB”), high-frequency systems (e.g., 900MHz, 2.4GHz, and 5.6GHz communication systems), or any other communication protocol or any combination thereof.
[0034] One or more processors 218A, 218B include one or more general-purpose processors, one or more graphics processors, and / or one or more digital signal processors. In some examples, one or more processors 218A, 218B include one or more microprocessors, one or more central processing units, one or more application-specific integrated circuits, one or more field-programmable gate arrays, one or more programmable logic devices, or combinations of such devices. In some examples, memories 220A and / or 220B are non-transitory computer-readable storage media (e.g., flash memory, random access memory, or other volatile or non-volatile memory or storage device) that store computer-readable instructions configured to be executed by one or more processors 218A, 218B to perform the techniques, processes, and / or methods described herein. In some examples, memories 220A and / or 220B may include more than one non-transitory computer-readable storage medium. A non-transitory computer-readable storage medium can be any medium (e.g., excluding signals) that can tangibly contain or store computer-executable instructions for use by or in connection with an instruction execution system, apparatus, and device. In some examples, the storage medium is a transient computer-readable storage medium. In some examples, the storage medium is a non-transitory computer-readable storage medium. Non-transitory computer-readable storage media may include, but are not limited to, magnetic storage devices, optical storage devices, and / or semiconductor storage devices. Examples of such storage devices include magnetic disks, optical discs based on compact disc (CD), digital versatile optical disc (DVD), or Blu-ray technology, and persistent solid-state storage devices such as flash memory, solid-state drives, etc.
[0035] In some examples, one or more display generating components 214A, 214B include a single display (e.g., a liquid crystal display (LCD), an organic light-emitting diode (OLED), or other type of display). In some examples, one or more display generating components 214A, 214B include multiple displays. In some examples, one or more display generating components 214A, 214B may include a touch-enabled display (e.g., a touchscreen), a projector, a holographic projector, a retinal projector, a transparent or translucent display, etc. In some examples, the electronic device does not include one or more display generating components 214A or 214B. For example, instead of one or more display generating components 214A or 214B, some electronic devices include transparent or translucent lenses or other surfaces not configured to display or present virtual content. However, it should be understood that in such cases, electronic device 201 and / or electronic device 260 are optionally equipped with Figure 2A and Figure 2BOne or more of the other components illustrated and described herein, such as one or more hand-tracking sensors 202, one or more eye-tracking sensors 212, one or more image sensors 206A, and / or one or more motion and / or orientation sensors 210A. Alternatively, in some examples, one or more display generation components 214A or 214B are provided separately from electronic devices 201 and / or 260. For example, one or more display generation components 214A, 214B communicate with electronic device 201 (and / or electronic device 260) but are not integrated with electronic device 201 and / or electronic device 260 (e.g., within the housing of electronic devices 201, 260). In some examples, electronic devices 201 and 260 respectively include one or more touch-sensitive surfaces 209A and 209B for receiving user input, such as tap input and swipe input or other gestures (e.g., hand-based gestures or finger-based gestures). In some examples, one or more display generating components 214A, 214B and one or more touch-sensitive surfaces 209A, 209B form one or more touch-sensitive displays (e.g., touchscreens integrated with each of the electronic devices 201 and 260 or touchscreens external to each of the electronic devices 201 and 260 that communicate with each of the electronic devices 201 and 260).
[0036] Electronic devices 201 and 260 optionally include one or more image sensors 206A and 206B, respectively. The image sensors 206A and 206B optionally include one or more visible light image sensors (such as charge-coupled device (CCD) sensors) and / or complementary metal-oxide-semiconductor (CMOS) sensors operable to obtain images of physical objects from a real-world environment. The image sensors 206A and 206B also optionally include one or more infrared (IR) sensors, such as passive or active IR sensors, for detecting infrared light from the real-world environment. For example, an active IR sensor includes an IR emitter for emitting infrared light into the real-world environment. The image sensors 206A and 206B also optionally include one or more cameras configured to capture movement of physical objects in the real-world environment. The image sensors 206A and 206B may optionally include one or more depth sensors configured to detect the distance between the physical object and the electronic devices 201 and 260. In some examples, information from one or more depth sensors allows a device to identify objects in a real-world environment and distinguish them from other objects in the real-world environment. In some examples, one or more depth sensors allow a device to determine the texture and / or shape of objects in a real-world environment. In some examples, one or more image sensors 206A or 206B are included in an electronic device different from electronic devices 201 and / or 260. For example, one or more image sensors 206A, 206B communicate with electronic devices 201, 260 but are not integrated with electronic devices 201, 260 (e.g., within the housing of electronic devices 201, 260). Specifically, in some examples, one or more cameras of one or more image sensors 206A, 206B are integrated with and / or coupled to one or more separate devices from electronic devices 201 and / or 260 (e.g., but communicate with electronic devices 201 and / or 260), such as one or more input and / or output devices including one or more image sensors 206A, 206B (e.g., one or more speakers and / or one or more microphones, such as headphones or headsets). In some examples, electronic device 201 or electronic device 260 corresponds to a headphone speaker (e.g., headphones or earbuds). In such cases, electronic device 201 or electronic device 260 is equipped with Figure 2A and Figure 2B A subset of other components illustrated and described herein. In some such examples, electronic device 201 or electronic device 260 is equipped with one or more image sensors 206A, 206B, one or more motion and / or orientation sensors 210A, 210B, and / or speakers 216A, 216B.
[0037] In some examples, electronic devices 201 and 260 combine a CCD sensor, an event camera, and a depth sensor to detect the physical environment surrounding them. In some examples, one or more image sensors 206A and 206B include a first image sensor and a second image sensor. The first and second image sensors work cooperatively and are optionally configured to capture different information about physical objects in the real-world environment. In some examples, the first image sensor is a visible light image sensor, and the second image sensor is a depth sensor. In some examples, electronic devices 201 and 260 use one or more image sensors 206A and 206B to detect the location and orientation of electronic devices 201 and 260 and / or one or more display generating components 214A and 214B in the real-world environment. For example, electronic devices 201 and 260 use one or more image sensors 206A and 206B to track the location and orientation of one or more display generating components 214A and 214B relative to one or more stationary objects in the real-world environment.
[0038] In some examples, electronic devices 201 and 260 include one or more microphones 213A and 213B or other audio sensors, respectively. Electronic devices 201 and 260 optionally use one or more microphones 213A and 213B to detect sound from a user and / or the user's real-world environment. In some examples, the one or more microphones 213A and 213B include optional cooperative microphone arrays (e.g., multiple microphones) to identify ambient noise or locate sound sources in the space of the real-world environment.
[0039] Electronic devices 201 and 260 each include one or more position sensors 204A and 204B for detecting the positions of electronic device 201 and / or one or more display generating components 214A and electronic device 260 and / or one or more display generating components 214B, respectively. For example, the one or more position sensors 204A, 204B may include a Global Positioning System (GPS) receiver that receives data from one or more satellites and allows electronic devices 201, 260 to determine the absolute position of the electronic device in the physical world.
[0040] Electronic devices 201 and 260 each include one or more orientation sensors 210A and 210B for detecting the orientation and / or movement of electronic device 201 and / or one or more display generating components 214A and the orientation and / or movement of electronic device 260 and / or one or more display generating components 214B, respectively. For example, electronic devices 201 and 260 use one or more orientation sensors 210A and 210B to track changes in the positioning and / or orientation of electronic devices 201 and 260 and / or one or more display generating components 214A and 214B, such as changes relative to physical objects in a real-world environment. The one or more orientation sensors 210A and 210B optionally include one or more gyroscopes and / or one or more accelerometers.
[0041] In some examples, electronic device 201 includes one or more hand-tracking sensors 202 and / or one or more eye-tracking sensors 212. It should be understood that, although referred to as hand-tracking or eye-tracking sensors, electronic device 201 additionally or optionally includes one or more other body tracking sensors, such as one or more leg, one or more torso, and / or one or more head tracking sensors. The one or more hand-tracking sensors 202 are configured to track the localization and / or position of one or more portions of a user's hand, and / or the movement of one or more portions of the user's hand relative to a three-dimensional environment, relative to one or more display generation components 214A, and / or relative to another defined coordinate system. The one or more eye-tracking sensors 212 are configured to track the localization and movement of a user's gaze (e.g., the user's attention, more generally including the eyes, face, or head) relative to the real world or three-dimensional environment and / or relative to one or more display generation components 214A. In some examples, one or more hand-tracking sensors 202 and / or one or more eye-tracking sensors 212 are implemented together with one or more display generation components 214A. In some examples, one or more hand-tracking sensors 202 and / or one or more eye-tracking sensors 212 are implemented separately from one or more display generation components 214A. In some examples, the electronic device 201 optionally does not include one or more hand-tracking sensors 202 and / or one or more eye-tracking sensors 212. In some such examples, one or more display generation components 214A may be used by the electronic device 260 to provide a three-dimensional environment, and the electronic device 260 may utilize input and other data collected via one or more other sensors of the electronic device 201 (e.g., one or more position sensors 204A, one or more image sensors 206A, one or more touch-sensitive surfaces 209A, one or more motion and / or orientation sensors 210A, and / or one or more microphones 213A or other audio sensors) as input and data processed by one or more processors 218B of the electronic device 260. Additionally or alternatively, the electronic device 260 optionally does not include Figure 2B Other components shown include one or more position sensors 204B, one or more image sensors 206B, one or more touch-sensitive surfaces 209B, etc. In some such examples, one or more display generation components 214A may be used by electronic device 260 to provide a three-dimensional environment, and electronic device 260 may use input and other data collected via one or more motion and / or orientation sensors 210A (and / or one or more microphones 213A) of electronic device 201 as input.
[0042] In some examples, one or more hand-tracking sensors 202 (and / or other body-tracking sensors, such as leg, torso, and / or head-tracking sensors) may use one or more image sensors 206 (e.g., one or more IR cameras, 3D cameras, depth cameras, etc.) that capture 3D information from the real world, including one or more body parts (e.g., a human user's hand, leg, or torso). In some examples, sufficient resolution is available to distinguish the hand to differentiate the fingers and their corresponding positions. In some examples, one or more image sensors 206A are positioned relative to the user to define a field of view and interaction space for one or more image sensors 206A, in which the finger / hand positions, orientations, and / or movements captured by the image sensors are used as input (e.g., to differentiate from the user's resting hand or other hands of other people in the real-world environment). Tracking the fingers / hands used for input (e.g., gestures, touches, taps, etc.) may be advantageous because it does not require the user to touch, hold, or wear any type of beacon, sensor, or other marker.
[0043] In some examples, one or more eye-tracking sensors 212 include at least one eye-tracking camera (e.g., an IR camera) and / or an illumination source (e.g., an IR light source, such as an LED) that emits light toward the user's eyes. The eye-tracking camera may be pointed at the user's eyes to receive reflected IR light from the light source directly or indirectly from the eyes. In some examples, both eyes are tracked separately by the respective eye-tracking camera and illumination source, and focus / gaze can be determined by tracking both eyes. In some examples, one eye (e.g., the dominant eye) is tracked by one or more respective eye-tracking cameras / illumination sources.
[0044] Electronic devices 201 and 260 are not limited to Figures 2A to 2B The components and configurations may not be limited to a single type of electronic device, but may include fewer, additional, or supplementary components in various configurations. In some examples, electronic device 201 and / or electronic device 260 may each be implemented among multiple electronic devices (e.g., as a system). In some such examples, each (or more) electronic device may include one or more of the same components discussed above, such as various sensors, one or more display generation components, one or more speakers, one or more processors, one or more memories, and / or communication circuitry. One or more persons using electronic device 201 and / or electronic device 260 are optionally referred to herein as one or more users of the devices.
[0045] In some examples, it may be advantageous to provide mechanisms for facilitating multi-user communication sessions that include co-located users (e.g., co-located electronic devices associated with users).
[0046] Some examples of this disclosure relate to the allocation and modification of virtual seating arrangements in a three-dimensional environment. For example, an electronic device communicating with one or more other electronic devices may display a representation of the user of the other electronic device (and / or that electronic device). In some examples, to simulate the experience of being physically juxtaposed with another user represented by the user's representation, the electronic devices may send and / or receive information such that some or all of the electronic devices in a communication session may display the representation of the other user in a specific location and / or in a specific orientation relative to each other in a shared virtual reality (VR), mixed reality (MR), and / or extended reality (XR) environment.
[0047] In some examples, electronic devices participating in a communication session may be associated with virtual seats. A virtual seat may, for example, have a location mapped to a physical portion of the electronic device's three-dimensional environment and / or a virtual portion of that environment. In some examples, electronic devices may facilitate the exchange of virtual seats. For example, some or all electronic devices in a communication session may establish virtual locations relative to a virtual environment shared via the communication session. In some examples, electronic devices may each provide input to exchange and / or swap virtual seats assigned to another electronic device in the communication session. In response to receiving an instruction to request a swap of virtual seats, an electronic device may swap its virtual seats. In some examples, swapping virtual seats includes displaying virtual content based on an updated spatial relationship between the newly reassigned virtual seat and virtual content shared in the communication session. For example, similar to physically exchanging or swapping physical seats in a physical environment, electronic devices may update the positioning and / or orientation of virtual objects, representations by other users, visual representations of virtual seats, and / or some combination thereof when swapping virtual seats to reflect that the electronic device has been newly assigned a new virtual seat. It should be understood that the examples described above are merely exemplary, and additional or alternative examples are contemplated without departing from the scope of this disclosure. By altering the positioning and / or orientation of virtual content in response to input and / or by meeting criteria, electronic devices can improve and / or newly provide the visibility of virtual content based on the updated positioning and / or orientation, optionally without detecting changes in the user's viewpoint that would otherwise be operable to perform similar changes in the positioning and / or orientation of the virtual content. Therefore, electronic devices can reduce user input and / or the processing required to perform actions in response to such input, thereby improving the efficiency and functionality of the electronic device.
[0048] In some examples, electronic device 101 may be a first electronic device used by a first user (user 328) to access and participate in a communication session. For example, electronic device 101 may be a mobile device (e.g., a tablet, smartphone, media player, or wearable device) or a computer or other electronic device. In some examples, electronic device 101 communicates with and / or includes one or more displays (e.g., display 120) and one or more input devices. In some examples, display 120 is a display integrated with an electronic device (optionally a touchscreen display), an external display such as a monitor, projector, television, and / or a hardware component (optionally integrated or external) for projecting a user interface or making the user interface visible to one or more users. In some examples, the one or more input devices include electronic devices or components capable of receiving user input (e.g., capturing user input, detecting user input) and sending information associated with that user input to the electronic device. Examples of input devices include touchscreens, mice (e.g., external), trackpads (optionally integrated or external), touchpads (optionally integrated or external), remote control devices (e.g., external), another mobile device (e.g., separate from the electronic device), handheld devices (e.g., external), controllers (e.g., external), cameras, depth sensors, eye-tracking devices, and / or motion sensors (e.g., hand-tracking devices, hand motion sensors). In some examples, the electronic device communicates with a hand-tracking device (e.g., one or more cameras, depth sensors, proximity sensors, touch sensors (e.g., touchscreens or touchpads)). In some examples, the hand-tracking device is a wearable device, such as a smart glove. In some examples, the hand-tracking device is a handheld input device, such as a remote control or stylus.
[0049] In some examples, electronic device 101 includes one or more displays 120 and multiple image sensors 114a-114c (e.g., Figure 1 Image sensor 114. The image sensor optionally includes one or more of the following: a visible light camera; an infrared camera; a depth sensor; or any other sensor that the electronic device 101 can use to capture one or more images of the user or a portion of the user (e.g., one or more of the user's hands) when the user interacts with the electronic device 101. In some examples, the user interface illustrated and described below may also be implemented on a head-mounted display including one or more displays that present the user interface or a three-dimensional environment to the user, and sensors (e.g., external sensors facing outward from the user) for detecting the physical environment and / or movement of the user's hands and / or sensors (e.g., gaze-based sensors) for detecting the user's attention (e.g., gaze-based sensors).
[0050] User 328 is located within three-dimensional environment 302, as illustrated in the top-down view of three-dimensional environment 302. Some examples described herein refer to the viewpoint of electronic device 101 having a position and orientation relative to three-dimensional environment 302. However, it should be understood that the viewpoint of electronic device 101 may be similar to or the same as the viewpoint of user 328.
[0051] In some examples, the three-dimensional environment 302 is generated, displayed, or otherwise made viewable through a device (e.g., a computer-generated reality (CGR) environment, such as a virtual reality (VR) environment, a mixed reality (MR) environment, and / or an augmented reality (AR) environment). For example, the three-dimensional environment 302 may include the physical and / or virtual environment of the user 328 and the electronic device 101. In some examples, Figure 3A User 328 has a spatial arrangement with respect to the physical aspects of the user's physical environment. In some examples, the three-dimensional environment 302 includes virtual content, such as virtual content shared via a communication session. Figure 3A As shown, user 328 may have a spatial arrangement relative to virtual content (such as virtual object 314 (described further herein)). Figure 3A As shown, the spatial arrangement of the virtual content, including virtual objects 314, avatars 308 and 310, and the viewpoint of user 328 can be a first spatial arrangement. The spatial arrangement can be changed in response to movement of user 328, receiving an instruction for movement corresponding to avatars 308 and / or 310, receiving an input requesting a swap and / or exchange of virtual seats, and / or receiving an input requesting shared alignment of virtual content with the viewpoint of electronic device 101 (e.g., as further described herein with reference to the term "recentering" of virtual content).
[0052] exist Figure 3A In the text, a portion of the shared virtual environment included in the three-dimensional environment 302 is illustrated using top-down view glyphs (e.g., "virtual environment top-down"). The glyphs may represent a portion of the virtual environment and may illustrate the spatial arrangement between user 328, virtual object 314, avatar 308, and avatar 310. It should be understood that the glyphs do not necessarily represent the physical spatial arrangement between user 328 and portions of the physical environment, such as the positioning and / or orientation of user 328 relative to physical walls, floors, and ceilings visible beyond the dimensions of electronic device 101.
[0053] In some examples, the 3D environment 302 includes virtual content, such as virtual objects. For example, virtual object 314 could be a 3D billiard table object. In some examples, virtual objects may optionally be included content of an application (e.g., including multiple selectable options), 3D objects (e.g., a virtual clock, a virtual ball, a virtual car, and / or a fictional entity such as a virtual dragon), or a user interface of any other element not included in the physical environment of the display 120 and displayed by the electronic device 101.
[0054] In some examples, the 3D environment 302 includes 3D virtual content, such as virtual objects 316. Virtual objects 316 can be displayed with a simulated 2D appearance, having one or two surfaces including content such as a user interface for a software application. Figure 3A As shown, for example, virtual object 316 is a user interface for a media player application that presents and interacts with photos, videos, animations, music, recordings, and / or some combination thereof.
[0055] In some examples, users of user 328 and other electronic devices (e.g., another user participating in a real-time multi-user communication session with user 328) may participate in the communication session via a first electronic device (e.g., electronic device 101) and / or other electronic devices. In some examples, real-time communication with participants includes real-time or near-real-time communication of participants' voice and / or expressions. For example, the first computer system optionally initiates and / or receives requests to initiate and / or join a multi-user session, and in response, initiates the display of virtual content (e.g., in at least a partially immersive virtual environment) to facilitate communication with participants within the shared virtual environment.
[0056] In some examples, electronic device 101 displays a virtual environment that occupies some or all of the viewports of electronic device 101. For example, Figure 3A An example is illustrated by a dotted fill pattern indicating the internal dimensions of the display 120. In some examples, the virtual environment may overlay or replace the visibility of physical objects and features included in the 3D environment 302. For example, the electronic device 101 may stop displaying an image of the physical environment detected by the electronic device 101 (e.g., a computer-generated representation or transparent representation), and may replace such an image with the display of virtual content included in the virtual environment, such as virtual trees, ground textures, virtual rocks, and / or virtual sky. Additionally or alternatively, the electronic device 101 may render virtual content included in the virtual environment that overlays visible physical aspects of the 3D environment 302, such as overlaying the visibility of a physical table visible to an observer via a transparent sheet of material included in the display 120.
[0057] In some examples, electronic device 101 and / or other electronic devices participating in the communication session display representations of the other electronic devices in the communication session. For simplicity, references are made to the representations of users of the electronic devices, such as avatars. It should be understood that a given electronic device can represent a user of another device and / or represent the other device itself by displaying a corresponding visual representation. Furthermore, it should be understood that the “user” of an electronic device participating in the communication session is sometimes referred to as a participant in the communication session.
[0058] In some examples, the user's visual representation includes a virtual avatar and / or additional or alternative information related to the user and / or the user's electronic device. For example, Figure 3A Several representations are illustrated, including avatar 308 and avatar 310. Sometimes, user 328 is referred to herein as "first user." Sometimes, the user corresponding to avatar 308 is referred to as "second user." Sometimes, the user corresponding to avatar 310 is referred to as "third user."
[0059] In some examples, each of the first, second, and third users participates in multi-user communication via a different corresponding device. For example, user 328 participates via a first electronic device (e.g., electronic device 101), the second user participates via a second electronic device different from electronic device 101, and / or the third user participates via a third electronic device different from the first electronic device (e.g., electronic device 101) and / or the second electronic device. In some examples, the first, second, and / or third electronic devices share one or more features. For example, some or all of the electronic devices may be head-mounted computing devices that include circuitry for collecting spatial data, sharing spatial data via a communication session, and / or displaying virtual content (e.g., avatars 308 and / or 310) based on spatial data received from other electronic devices. Sharing spatial data improves the possibility that, if the electronic devices are not juxtaposed, there can be consistency and / or spatial reality regarding the arrangement of avatars and / or virtual content communicated via a communication session, which improves the methods by which electronic devices can present simulations of shared physical objects and / or physical environments with other electronic devices.
[0060] In some examples, one or more electronic devices have characteristics that differ from other electronic devices. For example, electronic device 101 may be a head-mounted computing device, and the second electronic device may be a cellular device, a tablet device, a desktop computing device, and / or a laptop computing device. In such examples, the second electronic device does not include and / or omits circuitry for collecting spatial data, rendering images to simulate an immersive experience, and / or displaying virtual content that overlays images of the physical environment used by electronic device 101 during a communication session.
[0061] In some examples, while displaying avatars 308 and 310 simultaneously, electronic device 101 also displays information such as information 304 and / or information 306, which correspond to the identifiers of the users of the devices corresponding to avatars 308 and 310, respectively. For example, avatar 308 may correspond to a second user of a second electronic device that is different from electronic device 101 and different from user 328, to participate in a communication session. Additionally, avatar 310 may correspond to a third user of a third electronic device that is different from electronic device 101, user 328, the second electronic device, and the second user, to participate in a communication session.
[0062] In some examples, the user's visual representation includes one or more virtual avatars corresponding to the user of the device (e.g., one or more visual characteristics corresponding to one or more physical characteristics of the participant, such as the user's height, posture, skin color, eye color, hair color, relative physical size, facial features, and / or positioning in a three-dimensional environment). In some examples, the electronic device 101 displays the user's representation with a visual appearance that has a certain degree of visual salience relative to the three-dimensional environment. This degree of visual salience optionally corresponds to the form of the participant's representation (e.g., an avatar with a humanoid form and / or appearance or an abstract avatar including less humanoid forms (e.g., corresponding to a generic two-dimensional or three-dimensional object, such as a virtual coin or a virtual sphere)). Additionally or alternatively, one or more portions of the participant's representation are optionally displayed with one or more visual characteristics (e.g., with a certain level of opacity, saturation, brightness, contrast, blur effect, and / or the radius of the blur effect), which are included in displaying a first degree of visual salience.
[0063] In some examples, electronic device 101 presents (e.g., plays back) audio corresponding to audio detected by a participant's electronic device and conveyed by a second and / or third user, respectively, corresponding to avatars 308 and 310. In some examples, the audio is acoustically processed to provide simulated localization of one or more sound sources that provide the audio to the user, thereby simulating the effect of sound emanating from one or more corresponding locations in the three-dimensional environment 302. For example, the audio is optionally configured to sound as if a participant's visual representation is speaking, such as from a location relative to the floor of the three-dimensional environment and the user's viewpoint corresponding to the location where the visual representation is displayed. In some examples, the audio is modified to sound as if the audio is emanating from the head and / or center of the body of the avatar. In some examples, electronic device 101 detects audio generated by user 328 (e.g., speech detected via one or more microphones of electronic device 101) and conveys that audio to other participating electronic devices in the communication session, and the receiving electronic device may present the audio in a manner similar to that described with reference to electronic device 101.
[0064] As described above, users can be positioned within spatial templates when participating in a communication session, such as including... Figure 3A The templates for virtual seats and virtual objects 314 are shown. In some examples, the first spatial arrangement includes the arrangement of one or more representations of users participating in a multi-user communication session relative to each other, optionally corresponding to a time slot in a first predefined template that specifies a first number of virtual locations within the three-dimensional environment (e.g., virtual seats where the corresponding users of the first number of users are placed).
[0065] In some examples, the template is associated with a shape having a perimeter (e.g., a circle with a specific radius, a square with sides of a specific length, an arc with a specific radius, a line, or another shape), on which a specific number of virtual seats are arranged and where user representations and / or viewpoints can be placed (e.g., automatically placed by electronic device 101). For example, a first annular template may optionally be associated with a circle of a first radius, which includes a first number of virtual seats (e.g., virtual positions) that can be used to arrange a first number of user representations and / or viewpoints along the perimeter of the circle. A second annular template may be associated with a circle of a second radius and / or a different number of time slots that may optionally be used to arrange a different number of user representations and / or viewpoints.
[0066] In some examples, the spatial arrangement includes the distance and / or orientation of the second user's representation relative to the first user's viewpoint and / or relative to any additional users in the multi-user communication session. As an example, participants arranged in a circular template may face each other and / or face the center point inside the circular shape. In some examples, the second user's first virtual position is optionally a first distance from a first virtual position associated with the first user's viewpoint, and / or the second user's representation faces the first user's viewpoint such that the second user's representation appears to face the first user (e.g., as displayed via a display of electronic device 101). Optionally, the second user's representation is not oriented towards the first user's representation, but instead faces the same virtual position as the first user's viewpoint (e.g., the focal point and / or center of the template).
[0067] Optionally, the electronic device associates (e.g., assigns) a first virtual location associated with the first user's viewpoint with a first physical location of the first user in the first user's physical environment (e.g., the user's physical location when the representation of the second user is initially displayed). For example, when the electronic device initiates the display of the second user's representation at the second user's first virtual location and selects and / or changes the first virtual location associated with the first user's viewpoint according to a first spatial arrangement, the electronic device optionally associates the first virtual location associated with the first user's viewpoint with the first user's current physical location, such that when the first user changes physical location (e.g., by walking to another physical location), the first user's viewpoint changes from the first virtual location associated with the first user's viewpoint to a different virtual location based on the change in physical location.
[0068] In some examples, shared activities include activities in which virtual content (such as movies, games, maps, images, application windows, or other content) can be accessed (e.g., seen, heard, and / or viewed, heard, and / or interacted with) by multiple participants in the session. In some examples, the virtual content has already been shared by one or more participants. In some examples, the first type of shared activity corresponds to activities in which participants are viewing and / or interacting with content displayed in a vertical orientation (such as media content or application windows). In some examples, the first type of shared activity corresponds to activities in which participants are viewing and / or interacting with content displayed in a horizontal orientation (e.g., horizontally oriented), such as board games or horizontal maps. In some examples, the electronic device selects a template (e.g., for arranging participants) based on the type of shared activity. For example, if the first type of shared activity corresponds to viewing a movie (e.g., vertically oriented content), the electronic device optionally selects a first template, i.e., a content viewing template, which arranges participants in a line or arc facing the movie. For example, if the first type of shared activity corresponds to playing a horizontally oriented game, the electronic device optionally selects a second template, i.e., a circular template arranging participants around the game. In some examples, if a participant is not engaged in a shared activity (e.g., no virtual content is shared) or is engaged in a second type of shared activity different from the first type, the participant is placed in a different virtual location corresponding to a time slot in a different template (such as a time slot in a circular template and / or a time slot in a template corresponding to the second type of shared activity). In some examples, sharing virtual content allows electronic devices to interact with virtual content from the same or similar groups that would be impossible or more difficult to share if the electronic devices were not juxtaposed.
[0069] The realignment of shared virtual content is sometimes referred to in this article as “recentering” and / or the recentering of virtual content. (See reference...) Figure 3HFurther described, electronic device 101 optionally performs recentering in response to detecting one or more inputs, such as an input requesting a virtual seat swap and / or a quick request for recentering (e.g., optionally not swapping virtual seats)). Recentering inputs may include, for example, pressing a button included in electronic device 101, a voice command requesting recentering, performing an air gesture, and / or some combination thereof. In some examples, electronic device 101 performs recentering in response to detecting a first input modality (e.g., touch, air gesture, voice command, pressing a specific button, pressing a button with a force and / or duration greater than a threshold amount), and electronic device 101 performs a virtual seat swap or another operation in response to detecting a second input modality different from the first input modality (e.g., touch, air gesture, voice command, pressing a specific button, pressing a button with a force and / or duration greater than a threshold amount). For example, electronic device 101 may perform a virtual seat swap in response to the detection of an air gesture when attention is directed at a virtual avatar, or may recenter the shared virtual content to align with the center of view of electronic device 101 in response to the detection of a button being pressed for a period of time greater than a threshold amount.
[0070] As described above, a communication session may be associated with a virtual environment, shared virtual content, and / or a virtual seating arrangement. In some examples, a virtual seat includes the location within a shared virtual environment to which a user participating in the communication session is assigned. As an example, a virtual seat may define the location of user 328 relative to other virtual seats and shared virtual content when a communication session is initiated. Thus, a virtual seat may define the spatial arrangement of the virtual content displayed relative to the viewpoint of electronic device 101 (e.g., when user 328 joins the communication session and / or when the virtual environment and / or shared virtual content are initially displayed).
[0071] Additionally or alternatively, virtual seat allocation may define the spatial arrangement of virtual content displayed in response to the detection of an event associated with returning a user to the virtual seat allocation. In some examples, the event includes detecting that one or more users are entering or leaving a communication session. In some examples, the event is a different event than one or more users entering or leaving a communication session. Thus, input initiating a swap or exchange of virtual seats may allow electronic devices to present virtual content from a perspective corresponding to the new seat relative to the user's viewpoint (e.g., in response to a recenter input).
[0072] In some examples, events include detecting one or more inputs and / or one or more indications to one or more inputs received from other electronic devices interacting with shared virtual content in a communication session. For example, events may include detecting that a user has changed the shared virtual content, changed the space template and / or virtual seating arrangement while maintaining the display of the shared virtual content, requested to stop sharing the shared virtual content, or added or removed virtual objects and / or some combination thereof included in the shared virtual content. In some examples, events differ from detecting movement of the user's viewpoint (e.g., the positioning and / or orientation of electronic device 101 relative to the physical environment).
[0073] like Figure 3A As illustrated in the top-down view of the three-dimensional environment 302, user 328 may occupy and / or be assigned a first virtual seat, such as first virtual seat 303 in a virtual seating arrangement. Avatar 308 may be assigned a second virtual seat corresponding to second virtual seat 330, and avatar 310 may be assigned a third virtual seat corresponding to third virtual seat 326, as shown in the diagram. Figure 3A As shown. Virtual seat assignment is optionally determined automatically when a communication session is initiated, and / or can be dynamically assigned when one or more users join the communication session, optionally resulting in Figure 3A The layout shown.
[0074] In some examples, virtual seating arrangement includes the number, location, and / or orientation of virtual seats. In some examples, virtual seating arrangement includes assigning users to virtual seats and / or not assigning one or more users to one or more virtual seats, and / or vice versa. In some examples, virtual seating arrangement includes the spatial distribution of virtual seats relative to each other and / or sharing virtual content.
[0075] In some examples, electronic device 101 detects input that displays information about the user in the communication session and / or related to seats in the virtual seating arrangement. For example, in Figure 3A In this device, electronic device 101 detects input performed by hand 322, including air pinch gestures. Air pinch gestures may include contact of two or more fingers of user 328's hand 322.
[0076] In some examples, electronic device 101 detects additional or alternative input. For example, electronic device 101 may detect air gestures, including positional movement, contact, holding, and changes in the spatial arrangement of fingers, hands, and / or other body parts moving within the physical environment. As examples, air gestures may include the air separation of one or more fingers, the air curling of one or more fingers, the air pointing of one or more fingers, and the air posing of one or more hands and / or fingers in a predetermined posture (e.g., a pair of fingers nearly pinched together, a group of fingers fully extended, and / or one or more fingers resting on the palm).
[0077] In some examples, additional or alternative inputs include inputs pointing to peripheral devices communicating with electronic device 101. For example, a peripheral device may be a stylus, electronic pointing device, touchpad, glove, pin, ring, controller, and / or some combination of such devices. In some examples, one or more inputs may include contact with the housing of the peripheral device, pressing a button on the peripheral device, contact with the device's touchpad, pointing the peripheral device to a location corresponding to virtual content relative to the viewpoint of electronic device 101, voice commands, movement of the peripheral device, and / or some combination thereof. For example, electronic device 101 may directly detect and / or detect indications of button pressing, or indications of contact and / or indications of movement of contact on the housing of a rectangular electronic pointing device (e.g., when the end of the pointing device is pointed at head 308). In response to the detection of inputs and / or indications, electronic device 101 may perform one or more operations described with reference to air pinching and / or air gestures performed by hand 322 as described herein. Additionally or alternatively, the electronic device 101 may display a cursor that overlays a location in the three-dimensional environment 302 corresponding to the user's gaze target and / or a position rapidly specified by a peripheral controller device (e.g., by moving a touchpad and / or moving a joystick). When the cursor overlays an image 308, the electronic device 101 may detect input indicating selection from the controller and / or indication of input (e.g., pressing a button, one or more consecutive and / or simultaneous contacts with the housing and / or touchpad, and / or voice commands). In response to the detection of input and / or indication, the electronic device 101 may perform one or more operations described with reference to the air pinch described herein by the hand 322.
[0078] It should be understood that the input provided by hand 322 is described as in reference Figure 3A The described air pinch gesture is just one example among many possible inputs. For example, electronic device 101 detects one or more of the following: air pinch, pressing a button at a pointing device, and / or touching a touchpad at a controller. In response to detecting one or more of the aforementioned inputs, electronic device 101 optionally initiates a reference... Figure 3BThe described operation. In some examples, this operation includes requesting the display of information about users in a communication session and / or seats related to a virtual seating arrangement.
[0079] In some examples, electronic device 101 displays an identifying avatar and / or visually indicates the position of the user and / or the avatar relative to a virtual seat shared in a communication session. For example, from Figures 3A to 3B Electronic device 101 responds to detecting such Figure 3A The air pinch input performed by hand 322 is shown to display visual instructions 324 and 305. Additionally, electronic device 101 responds to detecting a viewpoint of a second user corresponding to avatar 308 from... Figures 3A to 3B The movement is indicated relative to the 3D environment 302, moving the avatar 308.
[0080] Visual indicator 324 may correspond to a virtual shadow on the virtual floor of the virtual environment in the 3D environment 302. The virtual shadow may be virtually projected based on the positioning and / or orientation of the avatar 308 relative to the virtual environment (such as based on one or more simulated light sources pointing above the avatar 308's head). For example, as the avatar 308 moves relative to the virtual environment and / or the 3D environment 302, the electronic device 101 may move the visual indicator 324 in one or more directions and / or move the visual indicator by one or more distances corresponding (e.g., the same) to the movement of the avatar 308. In some examples, the virtual shadow may be between the corresponding virtual avatar and the floor of the 3D environment 302. In some examples, the virtual shadow may be offset from the floor of the 3D environment 302.
[0081] As described above with respect to a communication session, electronic device 101, as well as the second and / or third electronic devices, can send and / or receive data and / or other information to indicate the position and / or movement of the viewpoint of the respective user of the electronic device relative to its respective three-dimensional environment. For example, from Figures 3A to 3B Electronic device 101 can receive information from a second electronic device regarding the movement of the viewpoint of the second electronic device relative to a second three-dimensional environment (e.g., relative to a physical environment different from three-dimensional environment 302). As an example, viewpoint movement may include movement of a second user within the second three-dimensional environment, and the information may indicate updated positioning, orientation, velocity and / or acceleration, and / or distance of movement of the second user. In response to receiving information from the second electronic device, 101 may move the avatar 308 relative to the three-dimensional environment 302 and / or the virtual environment, as if the second user were physically moving within the physical environment of user 328. Additionally or alternatively, electronic device 101 simultaneously displays visual indication 324 from the avatar 308, as if... Figure 3A Move to the position shown in the image. Figure 3B As shown.
[0082] Similarly, the third electronic device can receive the same or similar information indicating the movement of the second user's viewpoint, and can move the displayed avatar corresponding to avatar 308 relative to the third user's third-dimensional environment. Therefore, in real-time or near real-time, the electronic devices participating in the communication session can update the position and / or orientation of the displayed visual representation for other users. By facilitating real-time or near real-time updates of the position and / or orientation of the visual representation relative to the three-dimensional environment of the electronic device based on the movement of the viewpoint of other electronic devices corresponding to the visual representation, the electronic device can simulate the experience of a shared physical space, thereby reducing the user input required for rapidly moving the visual representation, and consequently reducing the processing required for the electronic device to detect and perform operations based on user input.
[0083] In some examples, in response to detecting such as Figure 3A As shown in the input, electronic device 101 can display visual indications of the virtual seating arrangement. For example, by displaying virtual seat 330, electronic device 101 can indicate that avatar 308 is assigned to virtual seat 330 and / or that virtual seat 330 exists in the three-dimensional environment 302 and / or in the communication session. As described above, virtual seat 330 may correspond to a second virtual seat that is different from the first virtual seat of user 328 (e.g., different from virtual seat 303). Therefore, as Figure 3B As shown, the electronic device 101 can display the location of virtual seats, thereby illustrating the intended target of a virtual seat swapping or exchange operation. In some examples, the virtual seat 330 is displayed within a three-dimensional environment 302 as having a boundary, color, fill pattern, simulated lighting, and / or some combination thereof.
[0084] like Figure 3B As shown, visual indicator 305 covers the position corresponding to a third virtual seat 326 that is different from the first and second virtual seats (e.g., different from virtual seats 303 and 330). In some examples, in response to detecting, such as Figure 3A Based on the input shown, and based on the determination that the avatar corresponds to a virtual seat, the electronic device 101 may display a visual indication of the presence and / or location of the virtual seat. For example, the electronic device 101 may display a boundary around the visual indication 305, thereby indicating that the virtual seat 326 exists and the avatar 310 is currently located on the virtual seat 326. Additionally or alternatively, the electronic device 101 may change one or more visual characteristics of the visual indication 305 (e.g., opacity level, saturation level, brightness, color, and / or fill pattern), and / or may display information such as text and / or images covering the visual indication 305.
[0085] like Figure 3BAs shown, the electronic device 101 can detect input performed by the hand 322 when attention 312 is directed at the image 308. In some examples, Figure 3B The input shown may alternatively point to information 304, virtual seat 330, and / or visual indication 324. In response to detecting one or more of these inputs, the electronic device 101 may initiate an operation to swap or exchange virtual seats, which may include updating the virtual seat assigned to the user. Figure 3B As shown, the input pointing to avatar 308 and / or virtual seat 330 (e.g., the seat to which avatar 308 is assigned) is a request to exchange the assigned seat or includes a request to exchange the assigned seat; in Figure 3B In the process, user 328 requests that the first electronic device (e.g., electronic device 101) and / or user 328 be reassigned to virtual seat 330, and requests that avatar 308 be reassigned to virtual seat 303.
[0086] Figure 3C Examples of completed virtual seat swaps or exchanges are illustrated. In some examples, electronic device 101 displays virtual content (and / or other virtual content not shared in the communication session) relative to the virtual seat targeted by user 328 when completing the virtual seat swap operation, which is shared in the communication session. For example, in response to detecting such... Figure 3B The input shown is the virtual seat assigned by the electronic device 101. Figure 3C In this system, electronic device 101, user 328, and the viewpoint of electronic device 101 are assigned to virtual seat 330. To reflect the updated seat assignment, electronic device 101 can update the display of virtual content in response to detecting an input requesting a virtual seat swap. For example, as... Figure 3C As shown, the electronic device 101 displays virtual content, including virtual object 314, virtual seat 303, avatar 308, and visual indicator 324, relative to the viewpoint of the electronic device 101 seated at virtual seat 330. Therefore, the positioning and / or orientation of shared virtual content such as virtual object 314 is updated, as if the electronic device 101 has physically moved to its physical equivalent of virtual seat 330, to the second end of the pool table represented by virtual object 314.
[0087] In some examples, electronic device 101 displays visual feedback in response to detecting an input requesting a virtual seat swap, instructing the execution of a virtual seat swap. For example, electronic device 101 may display visual feedback such as... Figure 3CThe visual indicator 334 shown may include text, media, and / or animation indicating that the virtual seat exchange is complete. In some examples, the electronic device 101 may present additional or alternative feedback to convey that the allocation of the new virtual seat has altered the spatial arrangement of the user and the virtual content. For example, the electronic device 101 may display a virtual glow effect at a location that is typically oriented towards or precisely located where the virtual seat is situated. As an example, the electronic device 101 may display a virtual glow effect emanating from the virtual seat 303 on the floor of the three-dimensional environment 302. In some examples, displaying a virtual glow effect includes displaying a portion of the three-dimensional environment 302 as having brightness, saturation, opacity, color, and / or some combination thereof, the brightness, saturation, opacity, color, and / or some combination thereof having values that make the portion appear lit or glowing, particularly the visual appearance composition values relative to the visual attributes prior to displaying the virtual glow effect.
[0088] In some examples, the electronic device 101 displays a virtual glowing effect at the portion of the viewport corresponding to the undisplayed virtual seat. For example, Figure 3C The electronic device 101 in the middle does not display virtual seat 326 (e.g., it has stopped displaying virtual seat 326 in response to detecting an input requesting a virtual seat swap). This is to indicate that virtual seat 326 is relatively located... Figure 3C On the left-hand side of the viewpoint of the electronic device 101 shown, the electronic device 101 may display simulated light-emitting effects at one or more portions to the left of the center of the viewport of the electronic device 101 and / or to the left of the center of the display 120.
[0089] In some examples, electronic device 101 presents spatial audio corresponding to the location of the virtual seat. For example, in response to detecting an input requesting a virtual seat swap, electronic device 101 may generate audio such as one or more pitches, chords, arpeggios, and / or non-musical sound effects. In some examples, electronic device 101 applies one or more time delays, digital filters, and / or additional or alternative techniques to simulate the feel of audio generated by a point audio source located at the virtual seat. For example, Figure 3C The electronic device 101 can generate audio corresponding to virtual seat 303, which is configured to have a first or more time delays between one or more audio channels, such that the generated audio sounds like a bell emanating from virtual seat 303. Additionally or alternatively, simultaneously or continuously, the electronic device 101 can generate different audio corresponding to virtual seat 326, wherein there is a second or more time delay between one or more audio channels, such that the generated audio sounds like a bell of different pitches emanating from virtual seat 326.
[0090] As described above, in some examples, the physical location and / or orientation of electronic device 101 are maintained before, during, and after the virtual seat swapping operation. For example, from Figures 3B to 3C The electronic device 101 does not move relative to the physical ceiling, floor, and / or walls visible in the three-dimensional environment. Therefore, changes in the viewpoint of the electronic device 101 relative to the three-dimensional environment 302 can be attributed to the updated spatial arrangement between the electronic device 101 and virtual content (e.g., virtual object 314 and / or virtual seat 303), and are less attributable to (or not attributable to) the change in the viewpoint of the electronic device 101 from... Figures 3B to 3C The spatial relationships between the physical environments that are maintained.
[0091] In some examples, electronic device 101 resets the spatial arrangement among participants in a communication session in response to detecting user input. In some examples, user input is touch input (e.g., on a touchscreen), pressing and / or rotating a physical button, air gestures (e.g., an air pinch gesture or another gesture), verbal requests (e.g., detected using a microphone), gaze direction (e.g., detected by an eye-tracking camera), or another type of user input. In some examples, resetting the spatial arrangement includes setting or resetting the virtual positions of the representations and / or viewpoints of the participating users according to a template associated with the number of users participating in the multi-user activity. In some examples, displaying the representation of a second user at the initial or updated virtual seat of the second user includes moving the second user's representation from the corresponding virtual position to the initial or updated virtual seat such that the second user's representation is displayed in the spatial template at a slot corresponding to the current number of participants.
[0092] In some examples, electronic device 101 detects user input requesting a virtual seat swap when the corresponding user assigned to the target virtual seat is located away from the target virtual seat. In some examples, the result of a virtual seat swap or exchange may include being assigned to the target seat. Additionally or alternatively, when performing a virtual seat swap, electronic device 101 may display virtual content as if the viewpoint of electronic device 101 presents the departure position and / or location of the other user assigned to the target virtual seat. Thus, electronic device 101 may be assigned to the target virtual seat and may display virtual content as if the user's viewpoint is not located at the target virtual seat.
[0093] Figure 3D An example of an electronic device 101 is shown that detects an input requesting a virtual seat swap with avatar 308. For example, in Figure 3DIn this context, electronic device 101 detects that hand 322 performs an air pinch gesture when attention 307 and / or 332 is directed at image 308 and / or information 304. In some examples, the input has one or more characteristics similar to or the same as those described herein with reference to air gestures, peripheral devices, etc.
[0094] from Figure 3D to Figure 3E The electronic device 101 performs virtual seat swapping and / or exchange operations, which include assigning virtual seats and presenting a virtual view of the user's off-seat location (e.g., the location of the avatar 308 away from virtual seat 330).
[0095] from Figure 3D to Figure 3E Electronic device 101 responds to detecting Figure 3D The inputs shown are used to update the virtual seating arrangement and / or update the display of virtual content. As described above, in some examples, electronic device 101 reallocates the virtual seating arrangement based on a seat swap request. For example, in Figure 3E In response to detection Figure 3D As illustrated, electronic device 101 and user 328 are assigned to virtual seat 330, and a second electronic device corresponding to avatar 308 is assigned to virtual seat 303.
[0096] As described above, in some examples, in response to detecting an input requesting a virtual seat swap, electronic device 101 displays virtual content corresponding to the viewpoint (e.g., position and / or orientation) of the user assigned to the virtual seat targeted by the virtual seat swap input. Alternatively, the spatial arrangement between user 328 and virtual object 314 may be as follows: Figure 3D The top view of the 3D environment 302 shows the same spatial arrangement between the avatar 308 and the virtual object. As described above, the electronic device 101 can be assigned to a virtual seat 330, but the virtual content shared in the communication session can be located relative to the distance of the electronic device 101. Figure 3E The virtual seat 330 is displayed in the position shown. In some examples, the spatial arrangement of the virtual content is "re-centered" to correspond to the center of the user's viewpoint, as further described herein. For example, Figure 3E Electronic device 101 in the virtual environment is in relation to... Figure 3D The virtual object 314 is positioned and oriented in the same location and orientation as the virtual avatar 308. Therefore, in response to detecting an input requesting a virtual seat swap, the electronic device 101 displays the virtual object 314 as if it were located on the side of the pool table included in the virtual object 314 facing the virtual seat 303. Figure 3E As shown.
[0097] Therefore, in response to detecting an input requesting a virtual seat swap, electronic device 101 may update the virtual seat arrangement associated with the communication session. In some examples, the update may include swapping or exchanging the seat assigned to user 328 with another seat assigned to another user of another device participating in the communication session. In some examples, in response to detecting the input, electronic device 101 displays virtual content with an updated spatial arrangement. In some examples, the updated spatial arrangement corresponds to the spatial relationship between the newly assigned virtual seat and the virtual content. In some examples, the updated spatial arrangement corresponds to the spatial relationship between the viewpoint of the user targeted by the virtual seat swap request (e.g., the viewpoint previously assigned to the target virtual seat) and the virtual content.
[0098] It should be understood, for reference Figures 3A to 3E The described examples are merely illustrative and can be repeated, replaced, etc., depending on different inputs, different targets of the inputs, different virtual content, different virtual seating arrangements, etc. For example, electronic device 101 can detect input, such as an air pinch provided by hand 322 when attention is directed at avatar 310, and in response, can perform a virtual seat swap similar to that described above but relative to virtual seat 326 and / or avatar 310. In this example, electronic device 101 can abandon the virtual seat swap between user 328 and avatar 308 because avatar 308 and / or virtual seat 330 are not the target of the virtual seat swap operation.
[0099] In some examples, virtual seat swaps depend on the approval of the target of the virtual seat swap operation. For example, see reference... Figure 3J As described, electronic device 101 receives a request to exchange seats (e.g., from a second or third user) and may display a prompt to approve or reject the exchange. In this example, electronic device 101 may send an indication of approval or rejection to the communication session. In response to receiving an indication of approval, electronic device 101 and / or other electronic devices involved in the virtual seat exchange may initiate the virtual seat exchange operation described above. In some examples, in response to detecting input indicating rejection of the virtual seat exchange request, electronic device 101 (and / or other electronic devices) may abandon the execution of the virtual seat exchange operation.
[0100] Similarly, from the perspective of electronic device 101, virtual seat swaps can be approved or rejected by the target user. For example, electronic device 101 can respond to, for example... Figure 3B The input shown is used to send a request to approve the virtual seat swap, and optionally, the virtual seat swap can be abandoned if the request is rejected by a second user corresponding to avatar 308 (e.g., abandoning the display as shown). Figure 3C(The virtual content shown). Additionally or alternatively, virtual seat swaps may be performed based on a second user approval request.
[0101] It should be understood that electronic device 101 and / or other electronic devices participating in the communication session may perform some or all of the operations described above, without limitation. For example, electronic device 101 may repeatedly request a series of virtual seat swaps and may continuously perform virtual seat swaps. Additionally or alternatively, electronic device 101 may perform virtual seat swaps with empty seats (e.g., no device and / or user has been assigned to that seat). In such an example, electronic device 101 may reassign the previously empty seat to user 328 and leave user 328's previous seat vacant.
[0102] Figures 3F to 3N An example is given of electronic device 101 that promotes and differs from others. Figures 3A to 3E Examples of virtual seat swapping or exchange associated with a spatial template are shown. In some examples, the spatial template may correspond to a presentation template, where the presenter user is oriented towards one or more audience users, and may include shared virtual content that the presenter can interact with. In some examples, the electronic device 101 recenters the virtual content, including a visual representation of the user, such as the user's avatar. In some examples, recentering is performed in response to detecting input requesting a virtual seat swap. In some examples, recentering is performed in response to detecting additional or alternative input. In some examples, the electronic device 101 displays visual indications that other users in the communication session are performing virtual seat swapping and updates the displayed virtual seating arrangement based on activity from other users. In some examples, the electronic device 101 facilitates virtual seat swapping by displaying an interactive view of the virtual seating arrangement. In some examples, the electronic device 101 allows or disallows virtual seat swapping based on the role associated with the user within the virtual seating arrangement.
[0103] Figure 3F This demonstrates a virtual seating arrangement using a demo template. For example, Figure 3F The three-dimensional environment 302 includes physical portions of the physical environment (e.g., physical window 336) that are visible through reproduction via one or more image sensors 114a-114c and / or through at least partially transparent material. Figure 3FThe three-dimensional environment 302 further includes virtual content 340 shared in a communication session with users corresponding to avatars 308, 310 (shown in top-down view), 348 (shown in top-down view), 350 (shown in top-down view), and 352 (shown in top-down view). The virtual content 340 may correspond to virtual objects including user interfaces for viewing and / or interacting via the communication session, such as a presentation user interface for an application presenting a slideshow. Figure 3F As shown, virtual content 340 is shared in a communication session, indicated by visual indicator 338, and users in the communication session can move virtual content 340 by interacting with a grabber 356 associated with virtual content 340. In some examples, the "grabber" is an optional option, which, when selected, initiates movement of at least the corresponding virtual content.
[0104] As illustrated in the top-down view of the three-dimensional environment 302 (e.g., "top-down view"), the electronic device 101 is oriented at the center of the user's arc. Figure 3F As shown, the spatial arrangement of virtual content and users includes a virtual seating arrangement comprising arcs, and also includes a presenter's seat (e.g., occupied by avatar 308). Figure 3F In this context, avatar 308 is assigned to a presenter seat located below visual indicator 342. As further described herein, in some examples, electronic device 101 allows for virtual seat swapping with virtual seats that meet one or more criteria, such as criteria that are met when the virtual seat corresponds to a first role (and / or does not correspond to a second type of role).
[0105] In some examples, virtual seats are associated with roles. In some examples, roles are associated with and / or define a set of allowed interactions with a communication session that can be used by users assigned to those roles and / or virtual seats. In some examples, roles include one or more of the following: audience member, presenter, gamer, observer, performer, coach, referee, and / or host.
[0106] As an example, Figures 3A to 3E The illustrated virtual seats can be associated with a game player character. In this example, the user can interact sequentially with the virtual pool table. In some examples, the virtual seats include a game observer who cannot interact with the virtual pool table. Figure 3FAs shown, electronic device 101 and / or other avatars can be assigned virtual seats corresponding to audience member roles. Therefore, electronic device 101 can restrict (e.g., abstain from) performing operations that interact with virtual content 340, such as moving virtual content when a second user corresponding to avatar 308 is speaking and / or changing corresponding content included in virtual content 340. In contrast, when avatar 308 is assigned to a presenter's virtual seat, a second electronic device corresponding to avatar 308 can detect input directed at virtual content 340 and can perform operations that electronic device 101 does not allow (e.g., at least temporarily), such as advancing presentation slides.
[0107] In some examples, limitations associated with a role linked to a virtual seat include the ability to perform virtual seat swaps. For example, in Figure 3F In this process, electronic device 101 detects input performed by hand 322 (e.g., air pinch) when attention 344 is directed at image 308. Figures 3F to 3G Electronic device 101 abandons the virtual seat swap. In some examples, electronic device 101 abandons the virtual seat swap because the presenter role at least temporarily restricts the virtual seat swap. For example, any electronic device corresponding to avatars 310 and / or 348 to 352 may abandon the virtual seat swap when avatar 308 provides voice input, and / or before the positioning within the slide set included in the virtual content 340 is before a threshold positioning in the slide set presentation. For example, electronic device 101 may abandon the virtual seat swap before the end of the presentation and / or before reaching the slide prompting the audience to interact and / or respond. By allowing or restricting operations based on the role assigned to the virtual seat, electronic device 101 can control the operations that electronic device 101 can perform based on the role, thereby potentially suppressing the execution of operations.
[0108] In some examples, electronic device 101 displays virtual content based on its viewpoint relative to the three-dimensional environment 302. For example, from Figure 3G to Figure 3H The electronic device 101 detects the user's movement relative to the physical rotation of the three-dimensional environment 302, and in response, initiates and / or stops displaying virtual content that corresponds to or does not correspond to the rotated viewpoint. For example, in Figure 3H In this process, electronic device 101 initiates the display of avatars 310 and 348, which can be displayed simultaneously with information 346. Additionally, electronic device 101 initiates the display of visual indication 354, which covers the virtual seat corresponding to avatar 310. Figure 3H In this process, electronic device 101 stops displaying avatar 308 and / or virtual content 340 in response to detecting a rotation of the viewpoint, because the rotating viewpoint is moving away from the orientation of the virtual content.
[0109] In some examples, electronic device 101 allows virtual seat swapping with virtual seats that do not meet one or more criteria. For example, in Figure 3H In this process, electronic device 101 detects air pinch input performed by hand 322 when attention is directed at avatar 310. Because avatar 310 is assigned to a virtual seat that is not a presenter's seat and / or an audience member role, electronic device 101 can facilitate a virtual seat swap with avatar 310.
[0110] For example, from Figures 3H to 3I Electronic device 101 according to such Figure 3H The requested virtual seat swap input is used to change the seat assigned to electronic device 101. Figure 3I In the top-down view, as illustrated, the electronic device 101 is assigned to the leftmost virtual seat on one side of the arc facing the virtual content 340. Additionally, the avatar 310 is reassigned to the center virtual seat (e.g., Figure 3H (The seats occupied by user 328).
[0111] As described above, electronic device 101 can display virtual content in response to input such as a request to switch virtual seats, thereby re-centering the virtual content using the viewpoint of electronic device 101. Figure 3I As shown, electronic device 101 updates the spatial arrangement based on the updated virtual seating allocation; virtual content 340 and avatar 308 are displayed with updated positioning and orientation relative to the user's viewpoint (e.g., relative to the center of the virtual seats). Figure 3I In this process, electronic device 101 detects input when attention 358 is directed at grasper 356, and in response to detecting the input, initiates movement of virtual content 340.
[0112] from Figures 3I to 3J Electronic device 101 maintains Figure 3I The movement of the hand 322 is detected during the air pinch gesture, and in response, the virtual content 340 is moved relative to the three-dimensional environment 302. For example, in Figure 3J In this embodiment, electronic device 101 moves virtual content to be virtually fixed (e.g., world-locked) within a 3D environment 302, parallel to physical walls included in the 3D environment 302. In some examples, electronic device 101 moves the virtual content to correspond to physical features in the 3D environment 302, such as along a physical wall and / or sitting on a physical table. In such examples, electronic device 101 may maintain the positioning of the virtual object as if it were coupled to a physical object. In some examples, when the virtual object is world-locked as previously described, electronic device 101 abandons the movement of the virtual object (e.g., in response to detecting input that recenters the virtual content and / or requests a virtual seat swap).
[0113] exist Figure 3J In this context, electronic device 101 detects input including an air pinch performed by hand 322 when attention 366 is directed to menu 360. Menu 360 may include a prompt to approve or reject a request to exchange seats. For example, menu 360 may be displayed in response to receiving an indication of a request to virtually exchange seats with electronic device 101 (e.g., by an electronic device corresponding to "George"). In some examples, electronic device 101 may approve or reject a virtual seat exchange request and may perform or abandon a virtual seat exchange based on input directed to menu 360. Specifically, in Figure 3J In this context, attention 366 points to optional option 362 (e.g., "Yes"), which, when selected, approves the request. In contrast, optional option 364 could be included in menu 360 and could be selected to reject the request and forfeit the virtual seat swap. Figure 3J In the process, electronic device 101 detects the air pinch performed by hand 322, thereby approving the virtual seat swap.
[0114] exist Figure 3K In this context, electronic device 101 updates the display of avatar 308 based on an updated allocation relative to the virtual seating arrangement. For example, as shown in the top-down view of the 3D environment 302, electronic device 101 corresponds to the right end of the arc of the audience character's virtual seating arrangement, on the side facing the orientation of avatar 308. However, virtual content 340 does not move (e.g., electronic device 101 abandons updating the positioning and / or orientation of virtual content 340) because virtual content 340 is world-locked based on previous input provided by user 328. As shown in the top view, due to the virtual seating swap, avatar 352 is reassigned to the leftmost seat in the arc-shaped virtual seating arrangement, corresponding to the virtual seat vacated by user 328 when performing the virtual seating swap.
[0115] exist Figure 3L In the process, when electronic device 101 changes to view the results of the virtual seat swap, electronic device 101 receives an indication that other users in the communication session have already swapped virtual seats. For example, Figure 3K to Figure 3L Electronic device 101 detects a leftward rotation of the viewpoint, making the virtual seat occupied by avatar 352 visible. As described above, participants in the communication session (e.g., users of the electronic device) can request and / or perform virtual seat swaps, and indicate updates to the virtual seat arrangement based on the virtual seat swaps. In response to receiving an instruction from the electronic device in the communication session (e.g., corresponding to “Anne” and “Betty”), electronic device 101 displays notification 368, which includes text describing the users involved in the virtual seat swap operation (e.g., “Anne and Betty swapped seats”). Figure 3K to Figure 3LAs shown in the top view, avatars 310 and 348 exchange virtual seats while maintaining the arrangement of virtual seats in other ways. Therefore, similar to what is described with reference to a virtual seat swap initiated by electronic device 101, the electronic devices corresponding to avatars 310 and 348 can facilitate virtual seat swaps, update the display of shared virtual content, etc., in response to input requesting and / or approving virtual seat swaps.
[0116] In some examples, electronic device 101 displays an interactive view of the virtual seat allocation. For example, electronic device 101 detects input, such as a voice command requesting the display of a view of the virtual seat allocation. In response to detecting this input, electronic device 101 may display a view 370 of the virtual seat arrangement. In some examples, view 370 includes a graphical view of the virtual seat allocation, including representations of users in a communication session. In some examples, view 370 visually indicates the virtual seat assigned to user 328. For example, visual representation 374 corresponds to user 328 and is displayed with one or more visual characteristics that distinguish visual representation 374 from other representations of the user in the virtual seat arrangement. For example, visual representation 376 may correspond to avatar 308. In some examples, electronic device 101 facilitates virtual seat swapping based on interaction with interactive view 370, such as by including attention pointing at 372. Figure 3M The visual representation in the image is the input of the air pinch formed by the hand 322 at time 376.
[0117] from Figures 3M to 3N Electronic device 101 according to Figure 3M The input shown is used to update the virtual seating arrangement. For example, electronic device 101 can present a virtual seat corresponding to the presenter role, which can face an arc of virtual seats corresponding to the audience member roles. For example, electronic device 101 responds to detecting... Figure 3M The input shown is used to display avatars 308 and 310, and 348 through 352. In some examples, in response to... Figure 3M When the input pointing to avatar 308 is detected, the following additional or alternative display will be shown. Figure 3N The updated virtual seating arrangement is shown. For example, electronic device 101 can detect an air pinch when attention is directed at avatar 308, such as... Figure 3M As shown, and in response, the virtual seating arrangement can be updated and virtual content can be displayed, such as... Figure 3N As shown.
[0118] Besides reference Figures 3A to 3N In addition to or as an alternative to the described examples, electronic device 101 may additionally or alternatively perform the functions described herein. Figures 4A to 4LOne or more operations are described. In some examples, the operations include implicitly and / or rapidly requesting virtual seats, and reallocating electronic devices and / or users based on the request (e.g., initiating a new allocation and stopping a previous allocation). Therefore, broadly speaking, electronic device 101 can detect interactions with the 3D environment and / or virtual seats and can update the virtual seat arrangement based on such interactions. In some examples, an interaction is detected at an initial time, and at a later time (e.g., automatically and / or not immediately in response to the detected interaction), electronic device 101 updates the virtual seat arrangement. In some examples, the interaction includes moving toward or away from a virtual seat. In some examples, the interaction includes leaving a virtual seat for a period of time greater than a threshold time period. In some examples, electronic device 101 abandons updating the virtual seat arrangement when the virtual seat arrangement and / or 3D environment 402 includes certain characteristics. In some examples, electronic device 101 resolves contention requests to perform virtual seat swaps. In some examples, electronic device 101 changes or maintains at least some or all of the virtual seat arrangements in response to detecting a user entering or leaving a multi-user communication session. These and other examples are further described herein. By facilitating virtual seat swaps that may not be immediately based on user input, electronic device 101 can change roles, permitted operations, and / or the way virtual seats are reassigned, thereby potentially reducing the amount of user input required to manually request seat swaps. In this way, electronic device 101 can reduce the processing required to detect such input and can improve the efficiency of interaction and / or the management of virtual seat allocation when participating in multi-user communication sessions.
[0119] In some examples, the electronic device 101 is located within a three-dimensional environment 402. In some examples, the three-dimensional environment 402 has a reference... Figures 3A to 3N The described three-dimensional environment has one or more similar or identical characteristics. For example, three-dimensional environment 402 includes multiple users participating in a multi-user communication session, in which they exchange information to simulate the physical juxtaposition of multiple users. User 428 may be, for example, a first user of electronic device 101 (e.g., a first electronic device). Avatar 410 may be a second user participating in a multi-user communication session using a second electronic device different from electronic device 101. Similarly, avatar 412 may be a third user participating in a multi-user communication session using a third electronic device different from electronic device 101 and the second electronic device.
[0120] For reference Figures 3A to 3N As described, avatars 410 and 412 can be visual representations of users in a multi-user communication session, or can be included therein. It should be understood that avatars 410 and 412 can have the same characteristics as referenced... Figures 3A to 3NThe described avatar has one or more characteristics similar to or identical to those of the avatar. It should also be understood that the avatar may be displayed via display 120 (e.g., displayed and / or visible via at least partially passive and / or transparent material).
[0121] Returning to the 3D environment 402, such as Figure 4A As shown, the three-dimensional environment 402 includes a spatial template and / or a virtual seating arrangement and / or is rendered based on the spatial template and / or the virtual seating arrangement. Figure 4A As illustrated in the top-down view of the three-dimensional environment 402, electronic device 101 and user 428 can be assigned to the first virtual seat 404. Similarly, avatar 410 can be assigned to the second virtual seat 411, and avatar 412 can be assigned to the third virtual seat 408. It should be understood that... Figure 4A The illustrated fill pattern example illustrates the assignment of users to corresponding virtual seats. For example, virtual seat 404 includes a solid white fill pattern, virtual seat 411 includes a striped fill pattern, and virtual seat 408 includes a dotted fill pattern, respectively indicating assignment to user 428, avatar 410, and avatar 412, and may not be displayed as virtual elements in the three-dimensional environment 402 by the electronic device 101.
[0122] In some examples, reference Figures 4A to 4L The described virtual seat has the same characteristics as the reference. Figures 3A to 3N The described virtual seats possess one or more similar or identical characteristics. For example, virtual seats 408, 411, and 404 may have spatial relationships relative to each other and / or relative to the three-dimensional environment 402. In some examples, the positioning and / or orientation of the virtual seats may define how virtual content is displayed when a user returns to their assigned virtual seat, as shown in the reference. Figures 3A to 3N As described. In Figure 4A In the image, the dashed arrow indicates the future movement of the electronic device 101 relative to the three-dimensional environment 402.
[0123] from Figures 4A to 4B Electronic device 101 detects requests and / or inputs corresponding to movement of electronic device 101 relative to three-dimensional environment 402. Therefore, electronic device 101 detects interactions with three-dimensional environment 402 and / or with virtual seating arrangements. Figure 4B In this context, after detecting an interaction including movement of electronic device 101 relative to the three-dimensional environment 402, the viewpoint of electronic device 101 is positioned near virtual seat 408. In some examples, electronic device 101 and / or electronic devices in the communication session may potentially initiate a reallocation of virtual seats when the user's viewpoint is within a threshold distance of the virtual seat. However, as... Figure 4BAs shown, timer 414 (indicating the dwell time for the viewpoint of electronic device 101 to remain within a threshold distance (e.g., 0.5m, 1m, 1.25m, 1.5m, 1.75m, 2m, 2.5m, 3m, or 5m) of virtual seat 408) has not yet been started because, in some examples, the reallocation of virtual seats depends on the availability of virtual seats. Additionally or alternatively, a dwell timer may be started in response to detecting that a user assigned to a virtual seat has moved to a location outside the area defined by the virtual seat, such as... Figure 4C As shown. For example, as Figure 4C As shown, when a user assigned to a virtual seat moves beyond a threshold distance of the virtual seat and / or moves away from the virtual seat, a dwell timer 414 can be started.
[0124] from Figures 4B to 4C Electronic device 101 detects an indication that the avatar 412 has moved beyond a threshold 418 of the virtual seat 404 (e.g., as indicated by...). Figure 4D (As shown). In response to detecting this indication, electronic device 101 may start dwell timer 414, as shown. Figure 4C As shown. As indicated by the fill pattern occupying virtual seat 408, virtual seat 408 remains assigned to avatar 412 (e.g., assigned to the use represented by avatar 412) because dwell timer 414 has not yet exceeded threshold 416. Therefore, in some examples, electronic device 101 abandons the immediate assignment of virtual seat in response to detecting an interaction (such as movement of the viewpoint of electronic device 101 relative to the virtual seat). In other words, electronic device 101 may abandon the reassignment of virtual seat to user 428 if one or more criteria are not met, such as when the corresponding user assigned to the corresponding virtual seat overlaps with the virtual seat and / or is within a threshold distance of the virtual seat.
[0125] from Figures 4C to 4D The electronic device 101 detects an indication that the avatar 412 is moving away from the virtual seat 408. Therefore, as Figure 4D As shown, dwell timer 414 continues to advance. Figure 4D In this context, based on determining that one or more criteria are met (e.g., avatar 412 does not overlap with virtual seat 408 and / or is not within a threshold distance 418 of that virtual seat), electronic device 101 can potentially reassign virtual seat 408 to user 428 and / or electronic device 101. However, in Figure 4D In the meantime, electronic device 101 has not yet reassigned virtual seat 408 (e.g., because dwell timer 414 has not yet exceeded threshold 416).
[0126] from Figures 4D to 4EElectronic device 101 detects that the viewpoint of electronic device 101 remains within a threshold 418 for a period of time greater than a threshold 416, as indicated by dwell timer 414. In response to detecting that dwell timer 414 has exceeded threshold 416, electronic device 101 may reassign virtual seat 408 to user 428, as... Figure 4E The solid white fill pattern within virtual seat 408 indicates this. Additionally or alternatively, such as... Figure 4E As shown, virtual seat 408 is reassigned to avatar 412, as indicated by the dot pattern in virtual seat 408.
[0127] Therefore, in some examples, electronic device 101 may reassign virtual seats without detecting input corresponding to a quick request for reassignment, and / or may automatically reassign virtual seats after an interaction with the 3D environment 402 and / or the virtual seats has been detected. For example, electronic device 101 may reassign virtual seats from sources such as... Figure 4A As shown Figure 4B The movement shown may differ from the input for quickly requesting a virtual seat swap (e.g., as referenced). Figures 3A to 3N As described herein, such as air pinching when attention is directed at a virtual seat. Therefore, the electronic device 101 can perform virtual seat swapping without requiring additional processing associated with air pinching or other rapid inputs, thereby reducing the power consumption and processing required to detect rapid inputs. Furthermore, the virtual seat swapping scheme described herein provides more flexible virtual seat arrangements, allowing users greater freedom to exchange virtual seats and reducing the potential for disorientation when the user of the electronic device returns to a virtual seat in a different part of the three-dimensional environment 402 than they currently occupy.
[0128] It should be understood that interaction with the 3D environment 402 and / or the virtual seat 408 may additionally or alternatively differ from movement within a threshold distance of the virtual seat 408. For example, interaction may include gazing at a displayed virtual display (such as a button labeled "swap") for a period of time greater than a threshold time period (e.g., 0.5 seconds, 1 second, 1.5 seconds, 3 seconds, 5 seconds, or 10 seconds). Additionally or alternatively, interaction may include a voice command requesting to exchange virtual seats at a later time, and / or presenting an expression of preference for the virtual seat when a user assigned to a virtual seat moves beyond a threshold distance from the virtual seat (e.g., threshold 418).
[0129] In some examples, electronic device 101 reassigns virtual seats after a delayed period following the detection of an interaction. For example, electronic device 101 may detect an air pinch when attention is directed at a virtual seat; in response to detecting an air pinch, and based on determining that one or more criteria are not met, electronic device 101 may abandon the requested reassignment. Based on determining that one or more criteria are met at a later time, electronic device 101 may perform a virtual seat swap, optionally without detecting intermediate input from a rapid request for another virtual seat swap. For example, electronic device 101 may detect an air pinch and may wait to perform a reassignment until the user occupying the requested virtual seat exits the communication session and / or leaves the virtual seat (e.g., moves beyond a threshold distance corresponding to the virtual seat's location).
[0130] In some examples, electronic device 101 reassigns virtual seats based on the determination that the requester of the virtual seat swap previously requested it has moved away from their most recently assigned virtual seat. For example, electronic device 101 may detect a request to perform a virtual seat swap and may approve the virtual seat swap (e.g., swapping the assignment of virtual seat 404 with the assignment of the user to virtual seat 408). In response to detecting that the viewpoint of the electronic device requesting the virtual seat swap is away from the virtual seat (e.g., beyond a threshold distance, and / or remaining beyond the threshold distance for a period of time greater than a threshold (e.g., 0.5 seconds, 1 second, 1.25 seconds, 1.5 seconds, 2 seconds, 2.5 seconds, 3 seconds, or 5 seconds), electronic device 101 reverts to the previous virtual seat swap (e.g., reassigning electronic device 101 back to virtual seat 404 and reassigning the requesting user back to virtual seat 408).
[0131] For reference Figures 3A to 3N As described, electronic device 101 can detect input requesting that a user in multi-user communication be returned to their virtual seat and / or that virtual content shared via a communication session be displayed relative to the virtual seat assigned to electronic device 101. For example, electronic device 101 can detect input requesting that virtual content be displayed relative to virtual seat 408 (e.g., when user 428 is assigned to virtual seat 408, such as...). Figure 4E(As shown). In some examples, the spatial arrangement of virtual content displayed in response to input may correspond to the spatial relationship between the virtual seat assigned to user 428 and other virtual content shared in the communication session. For example, the spatial arrangement of virtual content displayed in response to input and when user 428 is assigned to virtual seat 408 may be a first spatial arrangement. Additionally or alternatively, the spatial arrangement of virtual content displayed in response to detecting input and when user 428 is assigned to virtual seat 404 may be a second spatial arrangement different from the first spatial arrangement. It should be understood that the spatial arrangement may be an additional or alternative viewpoint (e.g., corresponding to virtual seat 411) and may present any suitable arrangement simulating any suitable virtual seat arrangement. As described above, it should be understood that the virtual seat arrangement may include the number, location, orientation, spatial distribution, and / or spatial arrangement of virtual seats.
[0132] In some examples, virtual seat swaps are performed or abandoned based on the type of space template and / or virtual seat allocation. For example, see reference. Figures 3A to 3N As described, the space template may include virtual content shared via a multi-user communication session, such as a virtual game board, a media player's user interface, a virtual stereoscopic model, etc. In some examples, the multi-user communication session and / or shared virtual content may be configured to prevent virtual seat swapping, such as... Figures 4F to 4G The top-down view of the three-dimensional environment 402 is illustrated in the image.
[0133] from Figures 4A to 4F Electronic device 101 detects movement within a threshold 418 from electronic device 101 to virtual seat 408. Figures 4A to 4F Virtual content 420 is shared via a multi-user communication session (e.g., and thus displayed in a three-dimensional environment 402). As described above, the shared virtual content can be displayed at each electronic device in the multi-user communication session and can be a two-dimensional or three-dimensional virtual object corresponding to (e.g., occupying) a location in the shared virtual space. Therefore, the shared virtual content is interactive (e.g., some or all of the content displayed in the shared virtual content can be modified by the electronic device), can be changed, and / or can be displayed at a location within the shared virtual space, which is understood by each electronic device to be at least temporarily static (e.g., static relative to the virtual environment shared via the multi-user communication session).
[0134] In some examples, initiating the display of virtual content leads to restrictions on virtual seat swapping operations. For example, such as... Figures 4F to 4G As shown, electronic device 101 can detect the movement of the viewpoint of electronic device 101 within a threshold 418 and / or the maintenance of the position within the threshold 418 for a period of time indicated by dwell timer 414. From Figures 4F to 4GSpecifically, electronic device 101 detects that the electronic device 101 remains within a threshold 418 for a period of time greater than a threshold 416, as indicated by dwell timer 414. In response to detecting that the viewpoint is held within the threshold 418, electronic device 101 may abandon the reallocation of the virtual seat. For example, as Figure 4G As shown, electronic device 101 is assigned to virtual seat 404, and avatar 412 is assigned to virtual seat 408, as indicated by the fill pattern occupying the virtual seat. Giving up a virtual seat can improve the chances of getting a designated seat (e.g., with a reference seat). Figures 3A to 3N (Related to the described roles) The corresponding users may have the possibility of having a specific perspective of the shared virtual content, such as ensuring that the first team of players can see the first side of the vertically oriented game board, and / or ensuring that the second team of players can see the second side of the game board.
[0135] In some examples, electronic device 101 resolves contention requests to perform virtual seat swaps. For example, electronic device 101 and / or another electronic device may each detect input requesting a virtual seat swap for a target virtual seat. In some examples, the electronic device providing the most recent input requesting a virtual seat swap may inherit the virtual seat. In some examples, the electronic device providing the first input for a virtual seat within a time period (e.g., 0.005 seconds, 0.01 seconds, 0.05 seconds, 0.1 seconds, 0.5 seconds, 1 second, or 1.5 seconds) may inherit the target virtual seat. In some examples, electronic device 101 may automatically assign a virtual seat after a contention request for a virtual seat swap, thereby using historical information associated with the virtual seat swap request to facilitate the virtual seat swap.
[0136] For example, in Figure 4H Prior to the arrangement shown, electronic device 101 and / or the second electronic device corresponding to avatar 410 can respectively detect inputs requesting virtual seat swaps directed to virtual seat 408 and / or avatar 412. To reduce the likelihood of a user being quickly assigned and then quickly deassigned from a virtual seat, the electronic devices can individually or jointly determine which electronic device is assigned to the virtual seat. As described above, electronic device 101 can be the electronic device providing the most recent input (e.g., electronic device 101 detects an air pinch 0.5 seconds after the second electronic device detects it), or electronic device 101 can be the electronic device providing the earliest input to the virtual seat (e.g., electronic device 101 detects an air pinch 0.5 seconds before the second electronic device detects it). Depending on the example and / or setup of the communication session, the most recent or earliest input provider can be determined as the successor to the target virtual set. For example, as... Figure 4H As shown, electronic device 101 can be the successor of virtual seat, and avatar 410 can remain assigned to virtual seat 411.
[0137] from Figures 4H to 4I Electronic device 101 detects movement where the viewpoint of electronic device 101 moves away from virtual seat 408 and / or exceeds threshold 418. Figure 4I In this case, electronic device 101 is not within the threshold 422 of virtual seat 411. Therefore, Figure 4I The dwell timer 414 indicates the amount of time that electronic device 101 cumulatively spends outside the threshold 418, and is not necessarily related to the proximity of electronic device 101 to virtual seat 411. Figures 4I to 4J The electronic device 101 continues to move relative to the three-dimensional environment 402, remaining outside the thresholds 418 and 422. Therefore, from... Figures 4I to 4J The dwell timer 414 advances.
[0138] As described above, in some examples, electronic device 101 can automatically give up a virtual seat to another electronic device. For example, from Figure 4J to Figure 4K The dwell timer 414 exceeded the threshold 416. Figure 4K In the example, because the settings for a multi-user communication session stipulate that virtual seats can be reassigned to the "loser" of a competing virtual seat swap request, virtual seat 411 can be reassigned to user 428, and virtual seat 408 can be reassigned to avatar 410. For example, in Figure 4K In this case, because electronic device 101 has moved and remained outside threshold 418 for a period of time greater than threshold 416 as indicated by dwell timer 414, electronic device 101 can, according to a reference, Figure 4H The example shown describes the previously detected input, which is a previous request to reassign avatar 410.
[0139] In some examples, electronic device 101 can give up a virtual seat to another electronic device without detecting input that quickly requests a virtual seat swap. For example, from Figure 4J to Figure 4K The virtual seat swap shown can be performed in response to detecting that electronic device 101 has moved away from virtual seat 408, optionally regardless of whether avatar 410 has requested a virtual seat swap pointing to virtual seat 408. For example, electronic device 101 can determine that electronic device 101 has been away from virtual seat 408 for a period of time greater than a threshold 416, and can reallocate the virtual seat according to one or more rules, such as a rule that specifies that the user closest to a particular virtual seat should be assigned to that virtual seat. Additionally or alternatively, the rule may specify that the user who last interacted with the virtual seat (e.g., passed by the virtual seat, pointed input to the virtual seat, was within a part of the environment (e.g., the quadrant of the game room corresponding to the virtual seat) is reassigned to the virtual seat.
[0140] In some examples, electronic device 101 reassigns and / or maintains virtual seats in response to events such as user entry, exit, and / or modification of a communication session. For example, from Figure 4K to Figure 4L Electronic device 101 detects an indication that a third user corresponding to avatar 412 has exited a multi-user communication session. In some examples, a user may exit a multi-user communication session by selecting a button to exit the session, powering off the device, and / or by accepting an invitation to enter a different communication session. In response to the detected indication, electronic device 101 may maintain the virtual seat arrangement relative to virtual seats 411 and 408 (e.g., it may abandon the reassignment of those virtual seats). In response to the detected indication, electronic device 101 may update at least virtual seat 404, thereby leaving virtual seat 404 vacant without assigning the updated user (e.g., because avatar 412 has been assigned to virtual seat 404). In some examples, electronic device 101 may detect an indication that a user has exited the communication session, and in response, may display selectable options, such as buttons or graphics, which can be selected to display virtual content having a spatial arrangement corresponding to the spatial arrangement between the virtual seat assigned to electronic device 101 and the three-dimensional environment 402.
[0141] Therefore, when a user enters or exits a communication session, electronic device 101 can facilitate the updating and / or maintenance of the virtual seating arrangement. Although references... Figures 4A to 4L The operations described are based on operations primarily performed by a particular electronic device, but it should be understood that additional or alternative devices may also perform these operations. For example, the operations described with reference to electronic device 101 may be performed by a second and / or third electronic device herein, and / or vice versa.
[0142] It should be understood that the examples shown and described herein are merely exemplary and additional and / or alternative elements may be provided within a three-dimensional environment for initiating communication between users using a portal. It should be understood that the appearance, shape, form, and size of each of the various user interface elements and objects shown and described herein are exemplary and alternative appearances, shapes, forms, and / or sizes may be provided. For example, virtual objects representing user interfaces (e.g., virtual objects 316 and 340) may be provided with alternative shapes (such as circular shapes, triangular shapes, etc.) other than rectangular shapes. In some examples, the various selectable power representations described herein (e.g., selectable options 362 and / or 364) may be verbally selected via user verbal commands (e.g., verbal commands such as “select an option” or “select a virtual object”). Additionally or alternatively, in some examples, the various options, user interface elements, control elements, etc., described herein may be selected and / or manipulated via user input received through one or more separate input devices communicating with an electronic device. For example, selection input may be received via physical input devices communicating with an electronic device (e.g., mouse, touchpad, keyboard, etc.).
[0143] Figure 5 A flowchart illustrating an example process for updating virtual seat allocation according to some examples of this disclosure is shown. In some examples, process 500 begins at a first electronic device communicating with one or more displays and one or more input devices. In some examples, the first electronic device is optionally similar to or corresponding to electronic devices 260 and 270 of FIG. 2 and / or Figure 1 The head-mounted display of electronic device 101. For example... Figure 5 As shown, in some examples, at 502, when with the first user (such as...) Figure 3A The first electronic device corresponding to user 328 (shown) and including a second user (such as a user corresponding to...) Figure 3A When one or more electronic devices, corresponding to a second electronic device different from the first electronic device, are in a multi-user communication session, the first electronic device presents the three-dimensional environment from a first viewpoint corresponding to a first position in the three-dimensional environment, including presenting a representation of the second user at a second position in the three-dimensional environment different from the first position via one or more displays, such as... Figure 3A The avatar shown is 308.
[0144] In some examples, at 502, when a representation of a second user is presented at a second location, the first electronic device detects one or more inputs via one or more input devices, including a request to change from a first viewpoint of the first electronic device to a second viewpoint of the first electronic device, such as by... Figure 3A and / or Figure 3BThe input is performed by hand 322.
[0145] In some examples, at 506, in response to detecting one or more inputs, and based on determining that one or more first criteria are met, including criteria satisfied when the one or more inputs point to a second location, at 508, the first electronic device presents a three-dimensional environment from a second viewpoint of the first electronic device via one or more displays to correspond to a second location in the three-dimensional environment, such as... Figure 3C and / or Figure 3E The spatial arrangement of the three-dimensional environment 302 shown.
[0146] In some examples, at 510, the first electronic device presents a representation of the second user at a first location in a three-dimensional environment via one or more displays, such as Figure 3C The avatar shown is 308.
[0147] It should be understood that process 500 is an example, and more, fewer, or different operations may be performed in the same or different order. Furthermore, the operations in process 500 described above may optionally be implemented by running one or more functional modules in an information processing device such as a general-purpose processor (e.g., as described with respect to Figure 2) or a dedicated chip and / or by other components of Figure 2.
[0148] In some examples, the second viewpoint includes a corresponding orientation relative to the three-dimensional environment. In some examples, in response to detecting one or more inputs and according to determining that one or more first criteria are met: that the orientation of the first user's head is a first orientation relative to the three-dimensional environment when one or more inputs are detected, and that the corresponding orientation relative to the three-dimensional environment is a second orientation different from the first orientation relative to the three-dimensional environment. In some examples, the second position is associated with a virtual seat included in a virtual seating arrangement associated with a multi-user communication session, and in response to detecting one or more inputs and according to determining that one or more first criteria are met: that the orientation associated with the virtual seat is a first orientation relative to the three-dimensional environment, the second viewpoint relative to the three-dimensional environment includes the second orientation relative to the three-dimensional environment. In some examples, in response to detecting one or more inputs and according to determining that one or more first criteria are met: that the corresponding viewpoint of the electronic device corresponds to the first orientation relative to the three-dimensional environment during a time period prior to detecting one or more inputs, the second viewpoint relative to the three-dimensional environment includes the second orientation relative to the three-dimensional environment, and that the corresponding viewpoint corresponds to a third orientation relative to the three-dimensional environment during a time period prior to detecting one or more inputs, the second viewpoint relative to the three-dimensional environment includes a fourth orientation relative to the three-dimensional environment.
[0149] In some examples, where the first electronic device is in a multi-user communication session, the three-dimensional environment also includes a representation of a third user corresponding to a third electronic device at a third location different from the second location. Process 500 further includes, in response to detecting one or more inputs and based on determining that one or more inputs point to the third location: presenting the three-dimensional environment from a third viewpoint of the first electronic device via one or more displays, the third viewpoint corresponding to the third location in the three-dimensional environment; and presenting the representation of the third user at a first location in the three-dimensional environment via one or more displays. In some examples, displaying the representation of the second user at the first location in the three-dimensional environment includes: based on determining that the orientation of the second user's representation relative to the three-dimensional environment is a first orientation when one or more inputs are detected, displaying the representation of the second user relative to a second orientation of the three-dimensional environment. In some examples, the one or more inputs are different from the movement of the body of the first user of the first electronic device relative to the three-dimensional environment. In some examples, when one or more inputs are detected: virtual content including a representation of a second user has a spatial arrangement relative to a first viewpoint of a first electronic device, the spatial arrangement being the first spatial arrangement when one or more inputs are detected, and corresponding virtual content included in the virtual content has a second spatial arrangement relative to each other, the corresponding virtual content including the representation of the second user, and in some examples, process 500 further includes: when displaying the representation of the second user at a second location, detecting a second input different from the one or more inputs via one or more input devices, the second input including a request to change the spatial arrangement from the first spatial arrangement to a third spatial arrangement while maintaining the viewpoint of the first electronic device as the first viewpoint relative to the three-dimensional environment; and in response to detecting the second input, changing the spatial arrangement between the virtual content and the viewpoint of the first electronic device to the third spatial arrangement; and maintaining the spatial arrangement between the corresponding virtual content as the second spatial arrangement. In some examples, process 500 further includes: in response to detecting one or more inputs, and based on determining that one or more first criteria are met, displaying visual feedback via one or more displays indicating that the viewpoint of the first electronic device changes from the position corresponding to the first position to the position corresponding to the second position. In some examples, one or more inputs pointing to the second location include selection inputs pointing to a corresponding representation corresponding to the corresponding user of the multi-user communication session, and process 500 further includes: in response to detecting the selection input and based on determining that one or more second criteria are met, displaying one or more visual indications associated with the virtual seating arrangement associated with the multi-user communication session via one or more displays.In some examples, where the corresponding representation corresponds to a representation of a second user, one or more visual indicators include a first visual indicator corresponding to the second user, and the first visual indicator is displayed at the second position when the position of the second user's representation corresponds to a second position, process 500 further includes: in response to detecting an indication that the first user has moved from the second position to a third position corresponding to a position different from the second position, moving the first visual indicator from the second position to the third position in the three-dimensional environment. In some examples, where the second position is different from the third position corresponding to a virtual seat included in a virtual seating arrangement, and where a virtual seat is assigned to the second user when one or more inputs are detected. In some examples, where one or more first criteria include criteria satisfied when the configuration associated with the multi-user communication session is a first configuration, process 500 further includes: in response to detecting one or more inputs, according to determining that one or more first criteria are not satisfied, and a request to change the position corresponding to the first viewpoint associated with the virtual seat of the second user: updating the viewpoint of the first electronic device to correspond to the third position, which corresponds to the virtual seat in the three-dimensional environment; and displaying the representation of the second user at the first position in the three-dimensional environment via one or more displays. In some examples, one or more second criteria include criteria satisfied when the virtual seat corresponding to the second user is a first type of virtual seat. Process 500 further includes: in response to detecting selection input, and based on determining that one or more second criteria are not satisfied, abandoning the display of one or more visual indications. In some examples, when one or more inputs are detected, the three-dimensional environment includes virtual content having a first spatial arrangement relative to the three-dimensional environment, and the virtual content and a first viewpoint of the first electronic device have a second spatial arrangement within the three-dimensional environment different from the first spatial arrangement, wherein the virtual content includes a representation of the second user. In some examples, process 500 further includes: in response to detecting one or more inputs, changing the spatial arrangement between the virtual content and the first viewpoint of the first electronic device to a third spatial arrangement different from the second spatial arrangement relative to the first viewpoint of the first electronic device, and maintaining the first spatial arrangement of the virtual content relative to the three-dimensional environment. In some examples, where the second location is associated with a virtual seat included in a virtual seating arrangement shared via a multi-user communication session, process 500 further includes: detecting, via one or more input devices, a request from a second electronic device to change the virtual seat with a second user when the first electronic device is in a multi-user communication session and when the first viewpoint of the first electronic device is a first viewpoint; and in response to detecting the request from the second electronic device, initiating a process to exchange the virtual seat with the second user, wherein the process includes displaying a prompt approving the exchange of the virtual seat.In some examples, process 500 further includes: detecting input directed to the prompt via one or more input devices upon detecting a request from a second electronic device to display the prompt; and in response to detecting the input: approving the exchange of virtual seats based on determining the input; presenting a three-dimensional environment from a second viewpoint of the first electronic device via one or more displays such that the second viewpoint corresponds to a second position in the three-dimensional environment; and presenting a representation of the second user at a first position in the three-dimensional environment via one or more displays; and rejecting the exchange of virtual seats based on determining the input: abandoning the presentation of the first electronic device from the second viewpoint to correspond to the second position in the three-dimensional environment; and abandoning the presentation of the second user's representation at the first position in the three-dimensional environment.
[0150] In some examples, the second location is associated with a virtual seat included in a virtual seating arrangement within a multi-user communication session, one or more inputs include a request to exchange virtual seats with the second user, and one or more first criteria include criteria that are satisfied when one or more inputs are detected after a request to exchange virtual seats with the first user is detected from another electronic device in the multi-user communication session. In some examples, one or more first criteria include criteria that are satisfied when the three-dimensional environment includes shared virtual content shared via the multi-user communication session, wherein the shared virtual content differs from the corresponding representations of users in the multi-user communication session.
[0151] In some examples, process 500 further includes: in response to detecting one or more inputs, based on determining that one or more first criteria are met, and based on determining that the role of a first user associated with a multi-user communication session is a first role, fundamentally changing the role of the first user of the first electronic device to a first role, and changing the role of the first user to a second role. In some examples, process 500 further includes: when the first electronic device is in a multi-user communication session, displaying virtual content via one or more displays, wherein the virtual content and the physical environment included in the three-dimensional environment have a first spatial arrangement, and the virtual content and a first viewpoint of the first electronic device have a second spatial arrangement different from the first spatial arrangement; and in response to detecting one or more inputs, and based on determining that one or more first criteria are met: based on determining that the virtual content is world-locked in the physical environment: maintaining the first spatial arrangement; and changing the second spatial arrangement to a third spatial arrangement different from the second spatial arrangement; and based on determining that the virtual content is not world-locked in the physical environment: changing the first spatial arrangement to a fourth spatial arrangement different from the first spatial arrangement; and changing the second spatial arrangement to the third spatial arrangement.
[0152] Figure 6A flowchart illustrating an example process for reallocating virtual seats according to some examples of this disclosure is shown. In some examples, process 600 begins at a first electronic device communicating with one or more displays and one or more input devices. In some examples, the first electronic device is optionally similar to or corresponding to electronic devices 260 and 270 of FIG. 2 and / or Figure 1 The head-mounted display of electronic device 101. For example... Figure 6 As shown, in some examples, at 602, when a first electronic device (such as electronic device 101) corresponding to a first user is in a multi-user communication session with one or more electronic devices, including a second electronic device different from the first electronic device corresponding to a second user, the first electronic device presents a three-dimensional environment via one or more displays based on a virtual seating arrangement of the multiple participants in the multi-user communication session, such as... Figure 4A The illustrated three-dimensional environment 402 includes a virtual seating arrangement comprising a first virtual seat (such as...) assigned to a first user. Figure 4A The virtual seat shown is 404) and the second virtual seat assigned to the second user is different from the first virtual seat (such as...). Figure 4A The virtual seat 408 assigned to avatar 412 is shown.
[0153] In some examples, at 604, when presenting a three-dimensional environment based on a virtual seating arrangement in a multi-user communication session, the first electronic device detects the interaction of the first user, such as user 428 from... Figure 4A As shown Figure 4B The movement shown, and / or the position of user 428 from Figure 4D As shown Figure 4E As shown, maintain.
[0154] In some examples, at 606, after an interaction is detected, and based on the determination that one or more criteria are met, including criteria that are met when the interaction of the first user with the 3D environment corresponds to a virtual seat other than the first virtual seat in the virtual seating arrangement, the first electronic device reassigns the first user from the first virtual seat to a virtual seat other than the first virtual seat, such as virtual seat 408. Figures 4D to 4E The redistribution.
[0155] In some examples, at 608, when the first electronic device is in a multi-user communication session, the first electronic device detects one or more first inputs via one or more input devices, such as re-centering and / or calling users in the multi-user communication session to the corresponding virtual seats, such as causing electronic device 101 to present when detected. Figure 4A Input for the spatial arrangement of users and / or virtual seats.
[0156] In some examples, at 610, in response to detecting one or more first inputs, the first electronic device updates the display of virtual content, including a representation of a second user, in a three-dimensional environment relative to the viewpoint of the first electronic device based on a virtual seating arrangement, including: at 612, based on determining that a first user is assigned to a first virtual seat, displaying virtual content in the three-dimensional environment with a first spatial arrangement relative to the viewpoint of the first electronic device, such as causing electronic device 101 to render when detected. Figure 4A Input for the spatial arrangement of users and / or virtual seats.
[0157] In some examples, at 614, based on the determination that the first user has been reassigned to a virtual seat other than the first virtual seat, the first electronic device displays virtual content in a three-dimensional environment relative to the viewpoint of the first electronic device in a second spatial arrangement different from the first spatial arrangement, such as... Figure 4A The spatial arrangement of virtual seats 408 and 411 relative to the first virtual seat 404, or Figure 4H The spatial arrangement of virtual seats 404 and 411 relative to virtual seat 408 is shown.
[0158] It should be understood that process 600 is an example, and more, fewer, or different operations may be performed in the same or different order. Furthermore, the operations in process 600 described above may optionally be implemented by running one or more functional modules in an information processing device such as a general-purpose processor (e.g., as described with respect to Figure 2) or a dedicated chip and / or by other components of Figure 2.
[0159] In some examples, when the interaction is an input requesting the allocation of a virtual seat other than the first virtual seat for the first user, one or more criteria are not met. In some examples, the interaction includes an input requesting the allocation of a virtual seat other than the first virtual seat for the first user, and process 600 further includes: in response to detecting an input requesting the allocation of a virtual seat other than the first virtual seat for the first user, abandoning the allocation of the virtual seat other than the first virtual seat for the first user based on determining that the second electronic device requested the allocation of a virtual seat other than the first virtual seat a time before the input was detected and that the time is within a threshold time amount of the input detection. In some examples, the criteria are met when the interaction includes a viewpoint movement exceeding a threshold distance from the position corresponding to the first virtual seat in the three-dimensional environment. In some examples, the criteria are met when the interaction includes a viewpoint movement within a threshold distance from the position corresponding to the virtual seat other than the first virtual seat in the three-dimensional environment. In some examples, the interaction includes a viewpoint movement away from the position corresponding to the first virtual seat in the three-dimensional environment, and one or more criteria include criteria that are met when the viewpoint of the first electronic device moves away from that position for a time period greater than a threshold time amount. In some examples, one or more criteria include criteria satisfied when the type of virtual seating arrangement corresponds to a first type of seating arrangement associated with interaction with virtual objects shared in a multi-user communication session. In some examples, process 600 further includes, when presenting a three-dimensional environment based on virtual seating arrangements in a multi-user communication session, and when assigning a first virtual seat to a first user, and when assigning a second virtual seat to a second user: reassigning the first user from the first virtual seat to the corresponding virtual seat based on determining that one or more corresponding criteria are satisfied, including criteria satisfied when the interaction with the three-dimensional environment provided by the first user corresponds to the corresponding virtual seat, which is different from and distinct from the first virtual seat. In some examples, one or more criteria are not satisfied when virtual seats other than the first virtual seat are assigned to corresponding users of corresponding electronic devices different from the first user. In some examples, one or more criteria include criteria satisfied when virtual seats other than the first virtual seat cease to be assigned to corresponding users of corresponding electronic devices different from the first user during a threshold time period for detecting interaction with the three-dimensional environment. In some examples, process 600 further includes receiving an indication that a second electronic device exits a multi-user communication session when a first user is assigned to a first virtual seat; and in response to receiving the indication, abandoning the reassignment of the first virtual seat from the first virtual seat to a corresponding virtual seat different from the first virtual seat.In some examples, process 600 further includes: in response to receiving an instruction from the second electronic device to exit a multi-user communication session, displaying selectable options via one or more displays, the selectable options being able to display virtual content in a first spatial arrangement relative to the viewpoint of the first electronic device.
[0160] Some examples of this disclosure relate to an electronic device comprising: one or more processors; a memory; and one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing any of the methods described above.
[0161] Some examples of this disclosure relate to a non-transitory computer-readable storage medium that stores one or more programs, the one or more programs including instructions that, when executed by one or more processors of an electronic device, cause the electronic device to perform any of the methods described above.
[0162] Some examples of this disclosure relate to an electronic device that includes one or more processors, a memory, and components for performing any of the methods described above.
[0163] Some examples of this disclosure relate to an information processing apparatus used in an electronic device, the information processing apparatus including components for performing any of the methods described above.
[0164] For purposes of explanation, the foregoing description has been presented with reference to specific examples. However, the illustrative discussion above is not intended to be exhaustive or to limit this disclosure to the precise form disclosed. Many modifications and variations are possible based on the teachings above. The examples were chosen and described to best elucidate the principles of this disclosure and its practical application, thereby enabling others skilled in the art to make optimal use of this disclosure with various modifications suitable for the particular intended purpose, as well as the various described examples.
Claims
1. A method, the method comprising: At the first electronic device that communicates with one or more input devices and one or more displays: When the first electronic device corresponding to the first user is in a multi-user communication session with one or more electronic devices including a second electronic device different from the first electronic device corresponding to the second user, the three-dimensional environment is presented from a first viewpoint of the first electronic device corresponding to a first position in the three-dimensional environment, including presenting a representation of the second user in the three-dimensional environment at a second position different from the first position via the one or more displays; as well as When the representation of the second user is presented at the second location, one or more inputs are detected via the one or more input devices, the one or more inputs including a request to change from the first viewpoint of the first electronic device to the second viewpoint of the first electronic device; as well as In response to detecting the one or more inputs, and based on determining that one or more first criteria are met, the one or more first criteria include criteria that are met when the one or more inputs point to the second location: The three-dimensional environment is presented from the second viewpoint of the first electronic device via the one or more displays to correspond to the second position in the three-dimensional environment; as well as The representation of the second user is presented at the first location in the three-dimensional environment via the one or more displays.
2. The method of claim 1, wherein the second viewpoint includes a corresponding orientation relative to the three-dimensional environment.
3. The method according to claim 1, wherein, When the first electronic device is in the multi-user communication session, the three-dimensional environment also includes a representation of a third user corresponding to a third electronic device at a third location different from the second location, and the method further includes: In response to detecting the one or more inputs, and based on determining that the one or more inputs point to the third location: The three-dimensional environment is presented from a third viewpoint of the first electronic device via one or more displays, the third viewpoint corresponding to the third location in the three-dimensional environment; and The representation of the third user is presented at the first location in the three-dimensional environment via the one or more displays.
4. The method of claim 1, wherein displaying the representation of the second user at the first location in the three-dimensional environment comprises: Based on the determination that the orientation of the second user's representation relative to the three-dimensional environment is a first orientation when the one or more inputs are detected, the second user's representation is displayed in a second orientation relative to the three-dimensional environment.
5. The method of claim 1, wherein the one or more inputs are different from the movement of the body of the first user relative to the three-dimensional environment of the first electronic device.
6. The method according to claim 1, wherein: When one or more of the above inputs are detected: The virtual content represented by the second user has a spatial arrangement relative to the first viewpoint of the first electronic device, the spatial arrangement being a first spatial arrangement when the one or more inputs are detected, and The corresponding virtual content included in the virtual content has a second spatial arrangement relative to each other, the corresponding virtual content including the representation of the second user, and the method further includes: When the representation of the second user is displayed at the second location, a second input different from the one or more inputs is detected via the one or more input devices. This second input includes a request to change the spatial arrangement from the first spatial arrangement to a third spatial arrangement while maintaining the viewpoint of the first electronic device relative to the first viewpoint of the three-dimensional environment; and In response to the detection of the second input: Change the spatial arrangement between the virtual content and the viewpoint of the first electronic device to the third spatial arrangement; and The spatial arrangement between the corresponding virtual contents is maintained as the second spatial arrangement.
7. The method according to claim 1, further comprising: In response to detecting the one or more inputs, and based on determining that the one or more first criteria are met, visual feedback instructing the viewpoint of the first electronic device to change from corresponding to the first position to corresponding to the second position is displayed via the one or more displays.
8. The method of claim 1, wherein the one or more inputs pointing to the second location include selection inputs pointing to a corresponding representation corresponding to a corresponding user of the multi-user communication session, the method further comprising: In response to detecting the selection input and based on determining that one or more second criteria are met, one or more visual indications associated with a virtual seating arrangement associated with the multi-user communication session are displayed via the one or more displays.
9. The method of claim 8, wherein the corresponding representation corresponds to the representation of the second user, the one or more visual indications include a first visual indication corresponding to the second user, and the first visual indication is displayed at the second location when the position of the representation of the second user corresponds to the second location, the method further comprising: In response to detecting an indication that the first user has moved from the second position to a third position different from the second position, the first visual indication is moved from the second position to the third position in the three-dimensional environment.
10. The method of claim 8, wherein the second position is different from a third position corresponding to a virtual seat included in the virtual seating arrangement, and wherein the virtual seat is assigned to the second user when the one or more inputs are detected.
11. The method of claim 8, wherein the one or more first criteria include criteria satisfied when the configuration associated with the multi-user communication session is a first configuration, the method further comprising: In response to the detection of the one or more inputs, the request to change the position corresponding to the first viewpoint, based on the determination that the one or more first criteria are not met, is associated with the virtual seat of the second user: The viewpoint of the first electronic device is updated to correspond to a third position, which corresponds to the virtual seat in the three-dimensional environment; as well as The representation of the second user is displayed at the first location in the three-dimensional environment via the one or more displays.
12. The method of claim 8, wherein the one or more second criteria include criteria satisfied when the virtual seat corresponding to the second user is a first type of virtual seat, the method further comprising: In response to detecting the selection input, and based on determining that one or more of the second criteria are not met, the display of the one or more visual indications is abandoned.
13. The method according to claim 1, wherein: When the one or more inputs are detected, the three-dimensional environment includes virtual content having a first spatial arrangement relative to the three-dimensional environment, and the virtual content and the first viewpoint of the first electronic device have a second spatial arrangement within the three-dimensional environment different from the first spatial arrangement, wherein the virtual content includes the representation of the second user, and The method further includes: In response to the detection of the one or more inputs: The spatial arrangement between the virtual content and the first viewpoint of the first electronic device is changed to a third spatial arrangement, different from the second spatial arrangement, relative to the first viewpoint of the first electronic device. Maintain the first spatial arrangement of the virtual content relative to the three-dimensional environment.
14. The method of claim 1, wherein the second location is associated with a virtual seat included in a virtual seating arrangement shared via the multi-user communication session, the method further comprising: When the first electronic device is in the multi-user communication session, and when the first viewpoint of the first electronic device is the first viewpoint, a request to exchange virtual seats with the second user is detected from the second electronic device via the one or more input devices; and In response to the detection of the request from the second electronic device, a process is initiated to exchange virtual seats with the second user, wherein the process includes displaying a prompt to approve the exchange of virtual seats.
15. The method according to claim 1, wherein: The second position is associated with a virtual seat included in the virtual seating arrangement of the multi-user communication session. The one or more inputs include a request to exchange virtual seats with the second user, and The one or more first criteria include criteria that are satisfied when the one or more inputs are detected after a request to exchange the virtual seat with the first user is detected from another electronic device in the multi-user communication session.
16. The method of claim 1, wherein the one or more first criteria include criteria satisfied when the three-dimensional environment includes shared virtual content shared via the multi-user communication session, wherein the shared virtual content is different from the corresponding representation of the user in the multi-user communication session.
17. The method according to claim 1, further comprising: In response to the detection of the one or more inputs, based on determining that the one or more first criteria are met, and based on determining that the role of the first user associated with the multi-user communication session is a first role, the role of the first user of the first electronic device is substantially changed to the first role, and the role of the first user is changed to a second role.
18. The method according to claim 1, further comprising: When the first electronic device is in the multi-user communication session, virtual content is displayed via the one or more displays, wherein the virtual content and the physical environment included in the three-dimensional environment have a first spatial arrangement, and the virtual content and the first viewpoint of the first electronic device have a second spatial arrangement different from the first spatial arrangement. as well as In response to detecting the one or more inputs, and based on determining that the one or more first criteria are met: Based on the determination that the virtual content is locked in the physical environment: Maintain the arrangement of the first space; as well as The second spatial arrangement is changed to a third spatial arrangement that is different from the second spatial arrangement; as well as Based on the determination that the virtual content is not locked to the world in the physical environment: The first spatial arrangement is changed to a fourth spatial arrangement that is different from the first spatial arrangement; as well as Change the second spatial arrangement to the third spatial arrangement.
19. A first electronic device, the first electronic device comprising: One or more processors; Memory; as well as One or more programs, the programs being stored in the memory and configured to be executed by the one or more processors, the programs including instructions for performing the method according to any one of claims 1 to 18.
20. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by one or more processors of a first electronic device, cause the first electronic device to perform the method according to any one of claims 1 to 18.