Performing an operation based on the presence of a group of collocated users of an electronic device

Abstract

This disclosure relates to performing operations based on the presence of a group of collocated users of an electronic device. An electronic device can perform one or more operations based on the presence of a group of users that are collocated in a physical environment. In some examples, if a first electronic device detects that it is collocated with a first group of users in a physical environment, the first electronic device will perform one or more operations that are contextualized for the first group of users. In some examples, if the first electronic device detects that it is collocated with a second group of users in the physical environment that is different from the first group of users, the first electronic device will perform one or more operations that are contextualized for the second group of users. In some examples, if no group of users is collocated with the first user in the physical environment, the first electronic device will perform one or more default operations.

Description

Cross-references to related applications

[0001] This application claims the benefit of U.S. Patent Application No. 63 / 753,398, filed February 3, 2025, and U.S. Patent Application No. 19 / 453,964, filed January 20, 2026, the contents of which are incorporated herein by reference in their entirety for all purposes. Technical Field

[0002] This disclosure relates in its entirety to the performance of operations based on the presence of a group of users juxtaposed in a physical environment using electronic devices. Background Technology

[0003] Some computer graphics environments provide two-dimensional and / or three-dimensional environments in which at least some of the objects displayed for the user to view are virtual and computer-generated. Summary of the Invention

[0004] An electronic device may perform one or more operations based on the presence of a group of users juxtaposed with it in a physical environment. In some examples, if a first electronic device associated with a first user detects that it is juxtaposed with a first group of users in a physical environment, the first electronic device will perform one or more operations contextualized for the first group of users. In some examples, if the first electronic device detects that it is juxtaposed with a second group of users, different from the first group, in a physical environment, the first electronic device will perform one or more operations contextualized for the second group of users. In some examples, if no group of users is juxtaposed with the first user in the physical environment, the first electronic device will perform one or more default operations. In some examples, the one or more operations contextualized for the first group of users include the display of data and / or a user interface previously shared or used between the first user and the first group of users on the first electronic device. In some examples, the one or more operations contextualized for the second group of users include the display of data and / or a user interface previously shared or used between the first user and the second group of users on the first electronic device. In some examples, the one or more operations are performed relative to a first application. For example, if the first electronic device detects that it is juxtaposed with a first group of users in a physical environment, the first electronic device will perform one or more operations contextualized for the first group of users relative to the first application, and if the first electronic device detects that it is juxtaposed with a second group of users in a physical environment, the first electronic device will perform one or more operations contextualized for the second group of users relative to the first application. Therefore, in some examples, the first electronic device may enable the application to operate differently based on the group of users juxtaposed with the first user in the physical environment.

[0005] It should be noted that the various examples described above can be combined with any other examples described herein. The features and advantages described in this specification are not exhaustive; in particular, many additional features and advantages will be apparent to those skilled in the art from the accompanying drawings, description, and claims. Furthermore, it should be noted that the language used in this specification has been chosen in principle for readability and instruction purposes, and such choice may not be necessary to depict or define the disclosed subject matter. Additionally, it should be understood that this summary does not limit the scope of this disclosure in any way. Attached Figure Description

[0006] To better understand the various examples described herein, reference should be made to the following detailed embodiments and accompanying drawings. Throughout the drawings, similar reference numerals generally refer to corresponding parts.

[0007] Figure 1 Examples of electronic devices that present a three-dimensional environment according to some examples of this disclosure are illustrated.

[0008] Figures 2A to 2C A block diagram illustrating an example architecture of a system according to some examples of this disclosure is shown.

[0009] Figures 3 to 8B The general illustration shows a first electronic device associated with a first user, according to some examples of the present disclosure, detecting and responding to a second user being placed in a physical environment with a second electronic device.

[0010] Figures 9 to 14 The following are general examples illustrating a first electronic device associated with a first user, according to some examples of this disclosure, detecting and responding to a third user being co-located with a third electronic device in a physical environment.

[0011] Figures 15 to 20 The general illustration shows a first electronic device associated with a first user, according to some examples of this disclosure, detecting and responding to a second user in a physical environment and a third user in a second electronic device and a third electronic device.

[0012] Figures 20 to 30 The first electronic device, according to some examples of this disclosure, enables an application to perform different operations based on who is juxtaposed with the first user in the physical environment.

[0013] Figure 31 and Figure 32 The illustrations generally illustrate examples of how a first electronic device, according to some examples of this disclosure, visually emphasizes a first user of the first electronic device and an electronic device juxtaposed with it in a physical environment, representing a group of users.

[0014] Figures 33 to 37This generally illustrates another example of a first electronic device detecting and responding to another user being placed alongside another electronic device in a physical environment, according to some examples of this disclosure.

[0015] Figures 38 to 40 This generally illustrates another example of a first electronic device detecting and responding to a group of users juxtaposed with the electronic device in a physical environment, according to some examples of this disclosure.

[0016] Figure 41 A flowchart is illustrated, which illustrates a method for performing one or more user-contextualized operations juxtaposed in a physical environment for an electronic device, according to some examples of this disclosure.

[0017] Figure 42 Examples of spatial groups in a multi-user communication session comprising multiple electronic devices are illustrated according to some examples of this disclosure. Detailed Implementation

[0018] An electronic device may perform one or more operations based on the presence of a group of users juxtaposed with it in a physical environment. In some examples, if a first electronic device associated with a first user detects that it is juxtaposed with a first group of users in a physical environment, the first electronic device will perform one or more operations contextualized for the first group of users. In some examples, if the first electronic device detects that it is juxtaposed with a second group of users, different from the first group, in a physical environment, the first electronic device will perform one or more operations contextualized for the second group of users. In some examples, if no group of users is juxtaposed with the first user in the physical environment, the first electronic device will perform one or more default operations. In some examples, the one or more operations contextualized for the first group of users include the display of data and / or a user interface previously shared or used between the first user and the first group of users on the first electronic device. In some examples, the one or more operations contextualized for the second group of users include the display of data and / or a user interface previously shared or used between the first user and the second group of users on the first electronic device. In some examples, the one or more operations are performed relative to a first application. For example, if the first electronic device detects that it is juxtaposed with a first group of users in a physical environment, the first electronic device will perform one or more operations contextualized for the first group of users relative to the first application, and if the first electronic device detects that it is juxtaposed with a second group of users in a physical environment, the first electronic device will perform one or more operations contextualized for the second group of users relative to the first application. Therefore, in some examples, the first electronic device may enable the application to operate differently based on the group of users juxtaposed with the first user in the physical environment.

[0019] It should be understood that references to “juxtaposed” and / or “juxtaposed” herein may optionally refer to juxtaposed entities sharing physical space, and such references may optionally differ from the conventional meaning of “juxtaposed” (e.g., may optionally differ from objects placed side-by-side in a specific spatial relationship). Additionally, references to any new terms such as “juxtaposed” and / or “juxtaposed” herein are to be understood as similarly referring to entities located in the same location and sharing physical space. Furthermore, it should be noted that when a first electronic device is juxtaposed with a second electronic device in a physical environment, the users of both the first and second electronic devices are similarly identified as juxtaposed (e.g., detected as juxtaposed in the physical environment). Moreover, as used herein, the term “and / or” refers to and covers any and all possible combinations of one or more of the associated listed items (e.g., “A and / or B” means “A and B”, and optionally, “A or B”).

[0020] In some examples, a space group or state in a multi-user communication session indicates a spatial arrangement or template indicating the location of users and content within or otherwise associated with a space group. In some examples, users within the same space group within a multi-user communication session experience spatial real-time based on the spatial arrangement of the space group. In some examples, when a user of a first electronic device is in a first space group within a multi-user communication session and a user of a second electronic device is in a second space group within a multi-user communication session, the user experiences spatial real-time localized for their respective space group. In some examples, when users of a first electronic device and users of a second electronic device are grouped into separate space groups or states within a multi-user communication session, if the first and second electronic devices return to the same operating state, the users of the first and second electronic devices are regrouped into the same space group within the multi-user communication session.

[0021] As used herein, a hybrid space group corresponds to a group or number of participants (e.g., users) in a multi-user communication session in which at least a subset of the participants are not juxtaposed in a physical environment. For example, as described via one or more examples in this disclosure, a hybrid space group includes at least two participants juxtaposed in a first physical environment and at least one participant not juxtaposed with the at least two participants in the first physical environment (e.g., the at least one participant is located in a second physical environment different from the first physical environment). In some examples, the hybrid space group in the multi-user communication session has a spatial arrangement that determines the location of users and content within the space group. In some examples, users in the same hybrid space group within the multi-user communication session experience spatial realism according to the spatial arrangement of the space group, as discussed similarly above.

[0022] Figure 1An electronic device 101 according to some examples of this disclosure presents a three-dimensional environment (e.g., an extended reality (XR) environment or a computer-generated reality (CGR) environment, optionally including representations of physical and / or virtual objects). In some examples, such as Figure 1 As shown, electronic device 101 is a head-mounted display or other head-mountable device configured to be worn on the head of a user of electronic device 101. See below for reference. Figure 2A An example of an architecture block diagram to describe electronic device 101. For example... Figure 1 As shown, electronic device 101 and table 106 are located in a physical environment. The physical environment may include physical features such as physical surfaces (e.g., floor, wall) or physical objects (e.g., table, lamp, etc.). In some examples, electronic device 101 may be configured to detect and / or capture images of the physical environment including table 106 (exemplified in the field of view of electronic device 101).

[0023] In some examples, such as Figure 1 As shown, the electronic device 101 includes one or more internal image sensors 114a oriented toward the user's face (e.g., as referenced below). Figures 2A to 2B (The described eye-tracking camera). In some examples, an internal image sensor 114a is used for eye tracking (e.g., detecting the user's gaze). The internal image sensor 114a is optionally arranged on the left and right portions of the display 120 to enable eye tracking of the user's left and right eyes. In some examples, the electronic device 101 also includes external image sensors 114b and 114c facing outwards from the user to detect and / or capture the physical environment of the electronic device 101 and / or movement of the user's hands or other body parts.

[0024] In some examples, display 120 has a field of view visible to the user. In some examples, the field of view visible to the user is the same as the field of view of external image sensors 114b and 114c. For example, when display 120 is optionally part of a head-mounted device, the field of view of display 120 may be the same as or similar to the field of view of the user's eyes. In some examples, the field of view visible to the user is different from the field of view of external image sensors 114b and 114c (e.g., narrower than the field of view of external image sensors 114b and 114c). In other examples, the field of view of display 120 may be smaller than the field of view of the user's eyes. The user's viewpoint determines what is visible in the field of view, and the viewpoint typically specifies the position and orientation relative to the three-dimensional environment. As the user's viewpoint shifts, the field of view of the three-dimensional environment also shifts accordingly. In some examples, electronic device 101 may be an optically transparent device, through which display 120 is a transparent or translucent display through which parts of the physical environment can be directly viewed. In some examples, display 120 may be included within a transparent lens and may overlap entirely or only partially with the transparent lens. In other examples, the electronics may be a video pass-through device, wherein display 120 is an opaque display configured to display an image of the physical environment using images captured by external image sensors 114b and 114c. Although Figure 1 A single display is shown, but it should be understood that display 120 may optionally include more than one display. For example, display 120 may optionally include a pair of stereoscopic displays (e.g., left and right display panels for the user's left and right eyes, respectively), whose display outputs are combined (e.g., combined by the user's brain) to create Figure 1 The view showing the content. In some examples, see the references below. Figures 2A to 2B In more detail, the display 120 includes or corresponds to a transparent or translucent surface (e.g., a lens) that does not have display capabilities (e.g., therefore cannot generate and display virtual objects 104), but instead directly presents a view of the physical environment in the user's field of vision (e.g., the user's field of vision).

[0025] In some examples, electronic device 101 is configured to display (e.g., in response to a trigger) virtual object 104 in a three-dimensional environment. Virtual object 104 is... Figure 1 The illustrated cube represents a cube that does not exist in the physical environment but is displayed in a three-dimensional environment, positioned on top of table 106 (e.g., a real-world table or a representation thereof). Optionally, in response to detecting a flat surface of table 106 in the physical environment 100, virtual object 104 is displayed on the surface of table 106 in the three-dimensional environment displayed via display 120 of electronic device 101.

[0026] It should be understood that virtual object 104 is a representative virtual object and may include and render one or more different virtual objects (e.g., virtual objects with various dimensions, such as two-dimensional or other three-dimensional virtual objects) in a three-dimensional environment. For example, a virtual object may represent an application or user interface displayed in a three-dimensional environment. In some examples, a virtual object may represent content corresponding to the application and / or displayed in a three-dimensional environment via that user interface. In some examples, virtual object 104 may optionally be configured to be interactive and responsive to user input (e.g., air gestures, such as air pinch gestures, air tap gestures, and / or air touch gestures), allowing the user to virtually touch, tap, move, rotate, or otherwise interact with virtual object 104.

[0027] As discussed in this article, by the user (e.g., using Figure 1 One or more air pinch gestures performed by the hand (103) are detected by one or more input devices of the electronic device 101 and interpreted as one or more user inputs pointing to content displayed by the electronic device 101. Additionally or alternatively, in some examples, one or more user inputs interpreted by the electronic device 101 as pointing to content displayed by the electronic device 101 (e.g., virtual object 104) are detected via one or more hardware input devices (e.g., controllers, touchpads, proximity sensors, buttons, sliders, knobs, etc.) rather than via those one or more input devices configured to detect air gestures (such as one or more air pinch gestures) performed by the user. This description is intended to be exemplary and not restrictive; the user may optionally provide user input using different air gestures and / or other forms of input.

[0028] In some examples, electronic device 101 may be configured to communicate with a second electronic device, such as a companion device. For example, as Figure 1 As illustrated, electronic device 101 may optionally communicate with electronic device 160. In some examples, electronic device 160 corresponds to a mobile electronic device, such as a smartphone, tablet computer, smartwatch, laptop computer, or other electronic device. In some examples, electronic device 160 corresponds to a non-mobile electronic device, which is typically stationary and not easily moved within a physical environment (e.g., a desktop computer, server, etc.). See below for reference. Figure 2B The following are additional examples of architectural diagrams used to describe electronic device 160. In some examples, electronic device 101 and electronic device 160 are associated with the same user. For example, in Figure 1In this embodiment, electronic device 101 may be positioned (e.g., mounted on) a user's head, and electronic device 160 may be positioned near electronic device 101, such as in the user's hand 103 (e.g., the hand 103 holding electronic device 160), in the user's pocket or bag, or on a surface near the user. Electronic devices 101 and 160 may optionally be associated with the same user account (e.g., the user's account logged into both electronic devices 101 and 160). See below for further details. Figures 2A to 2C Additional details regarding the communication between electronic device 101 and electronic device 160 are provided.

[0029] In some examples, the display of an object in a 3D environment is caused by, or enables, interaction with one or more user interface objects in the 3D environment. For example, initiating the display of an object in a 3D environment may include interaction with one or more virtual option / function representations displayed in the 3D environment. In some examples, when initiating the display of an object in a 3D environment, the electronic device may track the user's gaze as input for identifying one or more virtual option / function representations as a target for selection. For example, a gaze may be used to identify one or more virtual option / function representations as a target for selection using another selection input. In some examples, a virtual option / function representation may be selected using hand-tracking input detected via an input device communicating with the electronic device. In some examples, an object displayed in a 3D environment may move and / or reorient itself in the 3D environment based on movement input detected via an input device.

[0030] In the following description, an electronic device communicating with one or more displays and one or more input devices is described. It should be understood that the electronic device may optionally communicate with one or more other physical user interface devices, such as touch-sensitive surfaces, physical keyboards, mice, joysticks, hand-tracking devices, eye-tracking devices, styluses, etc. Furthermore, as described above, it should be understood that the described electronic device, display, and touch-sensitive surface may optionally be distributed among two or more devices. Therefore, as used in this disclosure, information on or displayed by an electronic device may optionally be used to describe information output by the electronic device for display on a separate display device (touch-sensitive or non-touch-sensitive). Similarly, as used in this disclosure, input received on an electronic device (e.g., touch input received on a touch-sensitive surface of the electronic device, or touch input received on the surface of a stylus) may optionally be used to describe input received on a separate input device from which the electronic device receives input information.

[0031] The device typically supports a variety of applications, such as one or more of the following: drawing applications, presentation applications, word processing applications, website creation applications, disk editing applications, spreadsheet applications, game applications, phone applications, video conferencing applications, email applications, instant messaging applications, fitness support applications, photo management applications, digital camera applications, digital video camera applications, web browsing applications, digital music player applications, TV channel browsing applications, and / or digital video player applications.

[0032] Figures 2A to 2C Block diagrams illustrating example architectures for electronic devices or systems according to some examples of this disclosure are provided. In some examples, electronic device 201 and / or device 260 include one or more electronic devices. For example, electronic device 201 may be a portable device, an auxiliary device for communicating with another device, a head-mounted display, a head-mounted speaker, etc. In some examples, electronic device 201 corresponds to the above reference. Figure 1 The described electronic device 101. In some examples, electronic device 260 corresponds to the above reference. Figure 1 The described electronic device 160.

[0033] like Figure 2A As illustrated, electronic device 201 may optionally include one or more sensors, such as one or more hand tracking sensors 202, one or more position sensors 204A, and one or more image sensors 206A (optionally corresponding to...). Figure 1 The electronic device 201 may include an internal image sensor 114a and / or external image sensors 114b and 114c, one or more touch-sensitive surfaces 209A, one or more motion and / or orientation sensors 210A, one or more eye-tracking sensors 212, one or more microphones 213A or other audio sensors, one or more body tracking sensors (e.g., torso and / or head tracking sensors), etc. The electronic device 201 may optionally include one or more output devices, such as one or more display generation components 214A (optionally corresponding to...). Figure 1 The electronic device 201 may include a display 120, one or more speakers 216A, one or more tactile output devices (not shown), etc. The electronic device 201 may optionally include one or more processors 218A, one or more memories 220A, and / or communication circuitry 222A. One or more communication buses 208A may optionally be used for communication between the components of the electronic device 201 mentioned above.

[0034] Additionally, electronic device 260 may optionally include components that are the same as or similar to those of electronic device 201. For example, such as Figure 2BAs shown, the electronic device 260 optionally includes one or more position sensors 204B, one or more image sensors 206B, one or more touch-sensitive surfaces 209B, one or more orientation sensors 210B, one or more microphones 213B, one or more display generating components 214B, one or more speakers 216B, one or more processors 218B, one or more memories 220B, and / or communication circuitry 222B. One or more communication buses 208B are optionally used for communication between the components of the electronic device 260 mentioned above.

[0035] Electronic devices 201 and 260 are optionally configured to communicate via a wired or wireless connection between the two electronic devices (e.g., via communication circuits 222A, 222B). For example, as Figure 2A As indicated, electronic device 260 can be used as an accompanying device of electronic device 201. For example, in some examples, electronic device 260 processes sensor inputs from electronic devices 201 and 260 and / or uses the display generation component 214A of electronic device 201 to generate content for display.

[0036] Communication circuits 222A and 222B optionally include circuitry for communicating with electronic devices and networks such as the Internet, intranets, wired and / or wireless networks, cellular networks, and wireless local area networks (LANs). Communication circuits 222A and 222B optionally include circuitry for using near-field communication (NFC) and / or short-range communication (such as Bluetooth). ® The communication circuits 222A and 222B communicate with each other. In some examples, the communication circuits 222A and 222B include or support Wi-Fi (e.g., the 802.11 protocol), Ethernet, ultra-wideband (“UWB”), high-frequency systems (e.g., 900 MHz, 2.4 GHz, and 5.6 GHz communication systems), or any other communication protocol, or any combination thereof.

[0037] One or more processors 218A, 218B include one or more general-purpose processors, one or more graphics processors, and / or one or more digital signal processors. In some examples, one or more processors 218A, 218B include one or more microprocessors, one or more central processing units, one or more application-specific integrated circuits, one or more field-programmable gate arrays, one or more programmable logic devices, or combinations of such devices. In some examples, memories 220A and / or 220B are non-transitory computer-readable storage media (e.g., flash memory, random access memory, or other volatile or non-volatile memory or storage) whose storage is configured to contain computer-readable instructions executable by one or more processors 218A, 218B to perform the techniques, processes, and / or methods described herein. In some examples, memories 220A and / or 220B may include more than one non-transitory computer-readable storage medium. A non-transitory computer-readable storage medium can be any medium (e.g., excluding signals) that can tangibly contain or store computer-executable instructions for use by or in connection with an instruction execution system, apparatus, and device. In some examples, the storage medium is a transient computer-readable storage medium. In some examples, the storage medium is a non-transitory computer-readable storage medium. Non-transitory computer-readable storage media may include, but are not limited to, magnetic storage devices, optical storage devices, and / or semiconductor storage devices. Examples of such storage devices include magnetic disks, optical discs based on compact disc (CD), digital versatile optical disc (DVD), or Blu-ray technology, and persistent solid-state storage devices such as flash memory, solid-state drives, etc.

[0038] In some examples, one or more display generating components 214A, 214B include a single display (e.g., a liquid crystal display (LCD), an organic light-emitting diode (OLED), or other type of display). In some examples, one or more display generating components 214A, 214B include multiple displays. In some examples, one or more display generating components 214A, 214B may include a touch-enabled display (e.g., a touchscreen), a projector, a holographic projector, a retinal projector, a transparent or translucent display, etc. In some examples, the electronic device does not include one or more display generating components 214A or 214B. For example, instead of one or more display generating components 214A or 214B, some electronic devices include transparent or translucent lenses or other surfaces not configured to display or present virtual content. However, it should be understood that in such cases, electronic device 201 and / or electronic device 260 may optionally be equipped with Figure 2A and Figure 2BOne or more of the other components illustrated and described herein, such as one or more hand-tracking sensors 202, one or more eye-tracking sensors 212, one or more image sensors 206A, and / or one or more motion and / or orientation sensors 210A. Alternatively, in some examples, one or more display generation components 214A or 214B are provided separately from electronic devices 201 and / or 260. For example, one or more display generation components 214A, 214B communicate with electronic device 201 (and / or electronic device 260) but are not integrated with electronic device 201 and / or electronic device 260 (e.g., within the housing of electronic devices 201, 260). In some examples, electronic devices 201 and 260 respectively include one or more touch-sensitive surfaces 209A and 209B for receiving user input, such as tap input and swipe input or other gestures (e.g., hand-based gestures or finger-based gestures). In some examples, one or more display generating components 214A, 214B and one or more touch-sensitive surfaces 209A, 209B form one or more touch-sensitive displays (e.g., touchscreens integrated with each of the electronic devices 201 and 260 or touchscreens external to each of the electronic devices 201 and 260 that communicate with each of the electronic devices 201 and 260).

[0039] Electronic devices 201 and 260 optionally include one or more image sensors 206A and 206B, respectively. The one or more image sensors 206A, 206B optionally include one or more visible light image sensors (such as charge-coupled device (CCD) sensors) and / or complementary metal-oxide-semiconductor (CMOS) sensors operable to acquire images of physical objects from the real-world environment. The one or more image sensors 206A, 206B also optionally include one or more infrared (IR) sensors, such as passive or active IR sensors, for detecting infrared light from the real-world environment. For example, an active IR sensor includes an IR emitter for emitting infrared light into the real-world environment. The one or more image sensors 206A, 206B also optionally include one or more cameras configured to capture movement of physical objects in the real-world environment. The one or more image sensors 206A, 206B also optionally include one or more depth sensors configured to detect the distance between the physical object and the electronic devices 201, 260. In some examples, information from the one or more depth sensors may allow the device to identify objects in the real-world environment and distinguish them from other objects in the real-world environment. In some examples, one or more depth sensors allow a device to determine the texture and / or topography of objects in a real-world environment. In some examples, one or more image sensors 206A or 206B are included in an electronic device different from electronic devices 201 and / or 260. For example, one or more image sensors 206A, 206B communicate with electronic devices 201, 260 but are not integrated with them (e.g., within the housing of electronic devices 201, 260). Specifically, in some examples, one or more cameras of one or more image sensors 206A, 206B are integrated with and / or coupled to electronic devices 201 and / or 260 and to one or more devices separate from electronic devices 201 and / or 260 (e.g., but communicating with electronic devices 201 and / or 260), such as one or more input and / or output devices including one or more image sensors 206A, 206B (e.g., one or more speakers and / or one or more microphones, such as headphones or headsets). In some examples, electronic device 201 or electronic device 260 corresponds to a headphone speaker (e.g., headphones or earbuds). In such cases, electronic device 201 or electronic device 260 is equipped with Figure 2A and Figure 2B A subset of other components illustrated and described herein. In some such examples, electronic device 201 or electronic device 260 is equipped with one or more image sensors 206A, 206B, one or more motion and / or orientation sensors 210A, 210B, and / or speakers 216A, 216B.

[0040] In some examples, electronic devices 201 and 260 combine a CCD sensor, an event camera, and a depth sensor to detect the physical environment surrounding them. In some examples, one or more image sensors 206A and 206B include a first image sensor and a second image sensor. The first and second image sensors work cooperatively and are optionally configured to capture different information about physical objects in the real-world environment. In some examples, the first image sensor is a visible light image sensor, and the second image sensor is a depth sensor. In some examples, electronic devices 201 and 260 use one or more image sensors 206A and 206B to detect the location and orientation of electronic devices 201 and 260 and / or one or more display generating components 214A and 214B in the real-world environment. For example, electronic devices 201 and 260 use one or more image sensors 206A and 206B to track the location and orientation of one or more display generating components 214A and 214B relative to one or more stationary objects in the real-world environment.

[0041] In some examples, electronic devices 201 and 260 include one or more microphones 213A and 213B, or other audio sensors, respectively. Electronic devices 201 and 260 may optionally use one or more microphones 213A and 213B to detect sound from the user and / or the user's real-world environment. In some examples, the one or more microphones 213A and 213B include microphone arrays (e.g., multiple microphones) that optionally work in cooperation to identify ambient noise or locate sound sources in the space of the real-world environment.

[0042] Electronic devices 201 and 260 each include one or more position sensors 204A and 204B for detecting the positions of electronic device 201 and / or one or more display generating components 214A and electronic device 260 and / or one or more display generating components 214B, respectively. For example, the one or more position sensors 204A, 204B may include a Global Positioning System (GPS) receiver that receives data from one or more satellites and allows electronic devices 201, 260 to determine their absolute positions in the physical world.

[0043] Electronic devices 201 and 260 each include one or more orientation sensors 210A and 210B for detecting the orientation and / or movement of electronic device 201 and / or one or more display generation components 214A, and the orientation and / or movement of electronic device 260 and / or one or more display generation components 214B, respectively. For example, electronic devices 201 and 260 use one or more orientation sensors 210A and 210B to track changes in the positioning and / or orientation of electronic devices 201 and 260 and / or one or more display generation components 214A and 214B, such as relative to physical objects in a real-world environment. The one or more orientation sensors 210A and 210B may optionally include one or more gyroscopes and / or one or more accelerometers.

[0044] In some examples, electronic device 201 includes one or more hand tracking sensors 202 and / or one or more eye tracking sensors 212. It should be understood that although referred to as hand tracking or eye tracking sensors, electronic device 201 may optionally additionally or alternatively include one or more other body tracking sensors, such as one or more leg, one or more torso, and / or one or more head tracking sensors. One or more hand tracking sensors 202 are configured to track the localization and / or position of one or more portions of a user's hand, and / or the movement of one or more portions of the user's hand relative to a three-dimensional environment, relative to one or more display generation components 214A, and / or relative to another defined coordinate system. One or more eye tracking sensors 212 are configured to track the localization and movement of a user's gaze (e.g., the user's point of focus, more generally including the eyes, face, or head) relative to the real world or three-dimensional environment and / or relative to one or more display generation components 214A. In some examples, one or more hand tracking sensors 202 and / or one or more eye tracking sensors 212 are implemented together with one or more display generation components 214A. In some examples, one or more hand-tracking sensors 202 and / or one or more eye-tracking sensors 212 are implemented separately from one or more display generation components 214A. In some examples, the electronic device 201 alternatively does not include one or more hand-tracking sensors 202 and / or one or more eye-tracking sensors 212. In some such examples, one or more display generation components 214A may be used by the electronic device 260 to provide a three-dimensional environment, and the electronic device 260 may use input and other data collected via other one or more sensors of the electronic device 201 (e.g., one or more position sensors 204A, one or more image sensors 206A, one or more touch-sensitive surfaces 209A, one or more motion and / or orientation sensors 210A, and / or one or more microphones 213A or other audio sensors) as input and data processed by one or more processors 218B of the electronic device 260. Additionally or alternatively, the electronic device 260 may optionally not include... Figure 2B Other components shown include one or more position sensors 204B, one or more image sensors 206B, one or more touch-sensitive surfaces 209B, etc. In some such examples, one or more display generation components 214A may be used by electronic device 260 to provide a three-dimensional environment, and electronic device 260 may use input and other data collected via one or more motion and / or orientation sensors 210A (and / or one or more microphones 213A) of electronic device 201 as input.

[0045] In some examples, one or more hand-tracking sensors 202 (and / or other body-tracking sensors, such as leg, torso, and / or head-tracking sensors) may use one or more image sensors 206 (e.g., one or more IR cameras, 3D cameras, depth cameras, etc.) that capture three-dimensional information from the real world, including one or more body parts (e.g., a human user's hand, leg, or torso). In some examples, sufficient resolution is available to distinguish the hand to differentiate the fingers and their corresponding positions. In some examples, one or more image sensors 206A are positioned relative to the user to define the field of view of one or more image sensors 206A and the interaction space, wherein the finger / hand positions, orientations, and / or movements captured by the image sensors are used as input (e.g., to distinguish them from the user's stationary hand or the hands of other people in the real-world environment). Tracking the fingers / hands used for input (e.g., gestures, touches, taps, etc.) can be advantageous because it does not require the user to touch, hold, or wear any type of beacon, sensor, or other marker.

[0046] In some examples, one or more eye-tracking sensors 212 include at least one eye-tracking camera (e.g., an IR camera) and / or an illumination source (e.g., an IR light source, such as an LED) that emits light toward the user's eyes. The eye-tracking camera may be pointed at the user's eyes to receive reflected IR light from the light source directly or indirectly from the eyes. In some examples, both eyes are tracked separately by the respective eye-tracking camera and illumination source, and focus / gaze can be determined by tracking both eyes. In some examples, one eye (e.g., the dominant eye) is tracked by one or more respective eye-tracking cameras / illumination sources.

[0047] Electronic devices 201 and 260 are not limited to Figures 2A to 2B The components and configurations may include, but are not limited to, a few components, other components, or additional components in various configurations. In some examples, electronic device 201 and / or electronic device 260 may be implemented in various ways among multiple electronic devices (e.g., as a system). In some such examples, each(s) of these electronic devices may include one or more of the same components discussed above, such as various sensors, one or more display generation components, one or more speakers, one or more processors, one or more memories, and / or communication circuitry. One or more persons using electronic device 201 and / or electronic device 260 are optionally referred to herein as one or more users of the devices.

[0048] Figure 2C A block diagram illustrating an example architecture of a system 200 according to some examples of this disclosure is shown. In some examples, the system 200 includes multiple electronic devices. For example, in Figure 2CIn this system 200, a first electronic device 201A and a second electronic device 201B are included, wherein the first electronic device 201A and the second electronic device 201B communicate with each other. In some examples, the first electronic device 201A and the second electronic device 201B correspond to the above reference. Figure 2A The described electronic device 201 and / or having one or more characteristics of electronic device 201. In some examples, the first electronic device 201A and the second electronic device 201B correspond to the above reference. Figure 1 The described electronic device 101. For example, such as... Figure 2C As illustrated, the first electronic device 201A may optionally include the above-referenced... Figures 2A to 2B The various sensors described include, for example, one or more hand tracking sensors 202A, one or more position sensors 204A, one or more image sensors 206A, one or more touch-sensitive surfaces 209A, one or more motion and / or orientation sensors 210A, one or more eye tracking sensors 212A, one or more microphones 213A or other audio sensors, one or more body tracking sensors (e.g., torso and / or head tracking sensors), one or more display generation components 214A, one or more speakers 216A, one or more processors 218A, one or more memories 220A, and / or communication circuitry 222A. Similarly, in some examples, the second electronic device 201B may optionally include the above-referenced components. Figures 2A to 2B The description includes various sensors (e.g., one or more hand tracking sensors 202B, one or more position sensors 204B, one or more image sensors 206B, one or more touch-sensitive surfaces 209B, one or more motion and / or orientation sensors 210B, one or more eye tracking sensors 212B, one or more microphones 213B or other audio sensors, one or more body tracking sensors (e.g., torso and / or head tracking sensors), one or more display generation components 214B, one or more speakers 216B, one or more processors 218B, one or more memories 220B, and / or communication circuitry 222B). In some examples, one or more hand-tracking sensors 202B have one or more characteristics of one or more hand-tracking sensors 202A discussed above. In some examples, one or more eye-tracking sensors 212B have one or more characteristics of one or more eye-tracking sensors 212A. One or more communication buses 208A and 208B are optionally used for communication between the aforementioned components of the first electronic device 201A and the second electronic device 201B, respectively. The first electronic device 201A and the second electronic device 201B may optionally communicate via a wired or wireless connection between the two electronic devices (e.g., via communication circuits 222A, 222B).

[0049] System 200 is not limited to Figure 2C The system 200 may not consist of the components and configurations of the device, but may include fewer components / electronic devices, other components / electronic devices, or additional components / electronic devices in various configurations. In some examples, the system 200 may be implemented in a single device. One or more persons using the system 200 are optionally referred to herein as one or more users of the system and / or the device.

[0050] Attention now turns to the exemplary simultaneous display of a three-dimensional environment on a first electronic device (e.g., corresponding to electronic device 201A) and a second electronic device (e.g., corresponding to electronic device 201B). As discussed below, the first electronic device can communicate with the second electronic device in a multi-user communication session. In some examples, an avatar (e.g., a representation) of a user of the first electronic device can be displayed in the three-dimensional environment at the second electronic device, and an avatar of a user of the second electronic device can be displayed in the three-dimensional environment at the first electronic device. In some examples, the user of the first electronic device and the user of the second electronic device can be associated with spatial groups in the multi-user communication session. In some examples, interactions with content in the three-dimensional environment when the first and second electronic devices are in a multi-user communication session can cause the user of the first electronic device and the user of the second electronic device to become associated with different spatial groups in the multi-user communication session.

[0051] For the purposes of the discussion below, Figure 42 Examples of spatial groups in a multi-user communication session comprising multiple electronic devices according to some examples of this disclosure are illustrated. In some examples, a first electronic device 401A may present a three-dimensional environment 450A, and a second electronic device 401B may present a three-dimensional environment 450B. The first electronic device 401A and the second electronic device 401B may be similar to electronic devices 101 or 201A / 201B, and / or may be head-mounted systems / devices and / or projection-based systems / devices (including hologram-based systems / devices) configured to generate and / or present a three-dimensional environment, such as head-up displays (HUDs), head-mounted displays (HMDs), windows with integrated display capabilities, and displays formed as lenses (e.g., similar to contact lenses) designed to be placed on a person's eyes. Figure 42 In the example, a first user may optionally wear a first electronic device 401A and a second user may optionally wear a second electronic device 401B, such that the three-dimensional environment 450A / 450B may be defined by the X-axis, Y-axis, and Z-axis (in other three-dimensional coordinate space coordinates) viewed from the viewpoint of the electronic device (e.g., the viewpoint associated with the electronic device 401A / 401B, which may be, for example, a head-mounted display).

[0052] like Figure 42As shown, the first electronic device 401A may be situated in a first physical environment including a table 406 and a window 409. Therefore, the three-dimensional environment 450A presented using the first electronic device 401A may optionally include captured portions of the physical environment surrounding the first electronic device 401A, such as a representation of the table 406' and a representation of the window 409'. Similarly, the second electronic device 401B may be situated in a second physical environment different from the first physical environment (e.g., separated from the first physical environment in physical space), which includes a floor lamp 407 and a coffee table 408. Therefore, the three-dimensional environment 450B presented using the second electronic device 401B may optionally include captured portions of the physical environment surrounding the second electronic device 401B, such as a representation of the floor lamp 407' and a representation of the coffee table 408'. Additionally, the three-dimensional environments 450A and 450B may include representations of the floor, ceiling, and walls of the rooms in which the first electronic device 401A and the second electronic device 401B are respectively located.

[0053] In some examples, the first electronic device 401A and the second electronic device 401B may optionally engage in a multi-user communication session with a third electronic device 401C. In some examples, the third user 405 wears the third electronic device 401C, which may optionally be a head-mounted display, similar to the HMD discussed above. In some examples, when the first electronic device 401A, the second electronic device 401B, and the third electronic device 401C are in a multi-user communication session, the first electronic device 401A, the second electronic device 401B, and the third electronic device 401C are configured to collaboratively present (e.g., via communication circuitry, such as...) Figure 2C The communication circuits 222A / 222B in the document share a three-dimensional environment (e.g., via their respective three-dimensional environments, such as three-dimensional environments 450A / 450B), which includes one or more shared virtual objects (e.g., content such as images, videos, audio, etc., representations of the user interface of an application, etc.). As used herein, the term "shared three-dimensional environment" refers to a three-dimensional environment that is independently presented, displayed, and / or visible at multiple electronic devices, through which content, applications, data, etc., can be shared and / or presented to users of those multiple electronic devices.

[0054] In some examples, when the first electronic device 401A and the second electronic device 401B are in a multi-user communication session with the third electronic device 401C, the visual representation of the user at each electronic device is presented in a three-dimensional environment presented via the other electronic devices. In some examples, the type of visual representation presented at the corresponding electronic device within the multi-user communication session depends on whether the corresponding electronic device is juxtaposed or not juxtaposed with the other electronic devices in the multi-user communication session, as described in more detail below.

[0055] exist Figure 42 In this context, a first electronic device 401A and a third electronic device 401C are juxtaposed in a first physical environment. For example, both the first electronic device 401A and the third electronic device 401C are located in the same physical room, including a table 406 and a window 409. In some examples, determining that the first electronic device 401A and the third electronic device 401C are juxtaposed in the first physical environment is based on the distance between the first electronic device 401A and the third electronic device 401C. For example, in... Figure 42 In this context, a first electronic device 401A and a third electronic device 401C are juxtaposed in a first physical environment because the first electronic device 401A is within a threshold distance (e.g., 0.1 m, 0.5 m, 1 m, 2 m, 3 m, 5 m, 10 m, 15 m, 20 m, etc.) of the third electronic device 401C. In some examples, determining that the first electronic device 401A and the third electronic device 401C are juxtaposed in the first physical environment is based on communication between the first electronic device 401A and the third electronic device 401C. For example, in Figure 42 In this embodiment, the first electronic device 401A and the third electronic device 401C are configured to communicate with each other (e.g., wirelessly, such as via Bluetooth or other peer-to-peer communication networks, Wi-Fi, or a server (e.g., a wireless communication terminal)). In some examples, the first electronic device 401A and the third electronic device 401C are connected to and / or configured to communicate using the same wireless network in a first physical environment. In some examples, determining the juxtaposition of the first electronic device 401A and the third electronic device 401C in the first physical environment is based on the strength of the wireless signals transmitted between the first electronic device 401A and the third electronic device 401C. For example, in Figure 42 In this context, the first electronic device 401A and the third electronic device 401C are juxtaposed in a first physical environment because the strength of the Bluetooth signal (or other wireless signal) transmitted between the first electronic device 401A and the third electronic device 401C is greater than a threshold strength. In some examples, determining that the first electronic device 401A and the third electronic device 401C are juxtaposed in the first physical environment is based on visual detection of the first electronic device 401A and the third electronic device 401C in the first physical environment. For example, as... Figure 42 As shown, the third electronic device 401C is positioned within the field of view of the first electronic device 401A (e.g., because the third user 405 is standing within the field of view of the first electronic device 401A), enabling the first electronic device 401A to visually detect (e.g., identify or scan, such as via object detection or other image processing techniques) the third electronic device 401C (e.g., in one or more images captured by the first electronic device 401A, such as via external image sensors 114b-i and 114c-i). Similarly, in Figure 42In some examples, the first electronic device 401A may be optionally positioned within the field of view of the third electronic device 401C (e.g., because, from the viewpoint of the third electronic device 401C, the first user is standing within the field of view of the third electronic device 401C), enabling the third electronic device 401C to visually detect the first electronic device 401A (e.g., in one or more images captured by the third electronic device 401C). In some examples, determining the juxtaposition of the first electronic device 401A and the third electronic device 401C in a first physical environment is based on the visual detection of one or more identical (e.g., overlapping) features or portions of the first physical environment. For example, as described above, the first physical environment includes one or more physical objects, such as window 409 and table 406, and / or one or more physical surfaces, such as the walls, floor, and ceiling of the room where the electronic devices 401A / 401C are located. Figure 42 In the example, the first electronic device 401A and the third electronic device 401C determine the juxtaposition of these electronic devices in a first physical environment based on visual detection of windows 409, tables 406 and / or the walls and floors of the room that are visible in the fields of view of both electronic devices 401A / 401C (e.g., in one or more images captured by the first electronic device 401A and the third electronic device 401C).

[0056] On the other hand, Figure 42 In this configuration, the second electronic device 401B is not placed alongside the first electronic device 401A or the third electronic device 401C. For example, as... Figure 42 As shown and as described above, the second electronic device 401B (e.g., together with the second user) is located in a second physical environment (e.g., including the floor lamp 407 and the coffee table 408), which is different from the first physical environment in which both the first electronic device 401A and the third electronic device 401C are located. In some examples, when the second electronic device 401B is in the second physical environment, the second electronic device 401B is outside the threshold distance (e.g., as discussed above) between the first electronic device 401A and the third electronic device 401A. Additionally or alternatively, in some examples, such as Figure 42 As shown, the second electronic device 401B is not in the field of view of the first electronic device 401A and / or the third electronic device 401C.

[0057] As described above, when electronic devices are communicatively linked in a multi-user communication session, users of the electronic devices can be visually represented within a shared three-dimensional environment, at least in part, based on the determination of whether the electronic devices are juxtaposed or not. Figure 42In this context, because the first electronic device 401A and the third electronic device 401C are juxtaposed in the first physical environment as described above, users of the first electronic device 401A and the third electronic device 401C are represented in a multi-user communication session via their physical personas (e.g., bodies) that are directly visible or transparently visible in the first physical environment (e.g., rather than virtual representations generated and displayed by the electronic devices). For example, as... Figure 42 As shown, when the first electronic device 401A and the third electronic device 401C are in a multi-user communication session, the third user 405 is visible in the field of view of the first electronic device 401A (e.g., and the first user is visible in the field of view of the third electronic device 401C in the first physical environment). In some examples, because the second electronic device 401B is not juxtaposed with the first electronic device 401A and the third electronic device 401C in the first physical environment, the second user of the second electronic device 401B is visually represented in the three-dimensional environment 450A via an avatar 415. Similarly, at the second electronic device 401B, an avatar 417 corresponding to the first user of the first electronic device 401A and an avatar 419 corresponding to the third user 405 of the third electronic device 401C are displayed in the three-dimensional environment 450B (e.g., because the first electronic device 401A and the third electronic device 401C are not juxtaposed with the second electronic device 401B in the second physical environment, as discussed above).

[0058] In some examples, the presentation of avatars 415 / 417 / 419 as part of a shared 3D environment may optionally be accompanied by audio effects corresponding to the speech of a user of electronic devices 401A / 401B / 401C. For example, avatar 415 displayed in 3D environment 450A using first electronic device 401A may optionally be accompanied by audio effects corresponding to the speech of a user of second electronic device 401B. In some such examples, when the user of second electronic device 401B speaks, the user's speech may be detected by second electronic device 401B (e.g., in...). Figure 2CThe detected speech of the user of the second electronic device 401B is transmitted to the first electronic device 401A (e.g., via communication circuits 222B / 222A) via one or more microphones 213B, so that the speech can be presented as audio (e.g., using one or more speakers 216A) to the user of the first electronic device 401A in the three-dimensional environment 450A. In some examples, the audio effect corresponding to the speech of the user of the second electronic device 401B can be spatialized (e.g., output as spatial audio) so that it sounds to the user of the first electronic device 401A as emanating from the location of the avatar 415 in the shared three-dimensional environment 450A (e.g., although output from the speaker of the first electronic device 360). Similarly, the avatars 417 / 419 displayed in the three-dimensional environment 450B using the second electronic device 401B may optionally be accompanied by audio effects corresponding to the speech of the users of the first electronic device 401A and the third electronic device 401C, respectively. For example, when a user of the first electronic device 401A speaks, the user's voice can be detected by the first electronic device 401A (e.g., via one or more microphones 213A) and transmitted to the second electronic device 401B (e.g., via communication circuits 222A / 222B), so that the detected voice of the user of the first electronic device 401A can be presented as audio in the three-dimensional environment 450B (e.g., using one or more speakers 216B) to the user of the second electronic device 401B. In some examples, the audio effects corresponding to the voices of the users of the first electronic device 401A and the third electronic device 401C can be spatialized so that to the user of the second electronic device 401B it sounds as if it is emanating from the location of avatar 417 and / or avatar 419 in the three-dimensional environment 450B (e.g., although output from the speaker of the second electronic device 401B).

[0059] In some examples, when in a multi-user communication session, avatars 415 / 417 / 419 are displayed in a shared 3D environment corresponding to the orientation of electronic devices 401A / 401B / 401C (and / or the users of electronic devices 401A / 401B / 401C) in the physical environment surrounding electronic devices 401A / 401B / 401C, and / or corresponding orientations based on these orientations. For example, as... Figure 42 As shown, in three-dimensional environment 450A, avatar 415 is optionally oriented towards the viewpoint of the user of the first electronic device 401A, and in three-dimensional environment 450B, avatar 417 is optionally oriented towards the viewpoint of the user of the second electronic device 401B. When a particular user moves the electronic device (and / or itself) in the physical environment, the user's viewpoint changes according to the movement, which also changes the orientation of the user's avatar in the three-dimensional environment. For example, see reference... Figure 42If the user of the first electronic device 401A looks to the left in the three-dimensional environment 450A, causing the first electronic device 401A to rotate to the left (e.g., counterclockwise) (e.g., by a corresponding amount), then the user of the second electronic device 401B will see the avatar 417 corresponding to the user of the first electronic device 401A rotated to the right (e.g., clockwise) relative to the viewpoint of the user of the second electronic device 401B according to the movement of the first electronic device 401A.

[0060] Additionally, in some examples, when in a multi-user communication session, the field of view of the 3D environment 450A / 450B and / or the position of the viewpoint within the 3D environment 450A / 450B may optionally change according to the movement of the electronic devices 401A / 401B / 401C (e.g., by the user of the electronic devices 401A / 401B / 401C). For example, when in a communication session, if the first electronic device 401A moves closer toward the table representation 406' and / or the avatar 415 (e.g., because the user of the first electronic device 401A moves forward in the physical environment surrounding the first electronic device 401A), the field of view of the 3D environment 450A will change accordingly, making the table representation 406', the window representation 409', and the avatar 415 appear larger in the field of view. In some examples, each user can interact independently with the three-dimensional environment 450A / 450B, such that changes in viewpoint within the three-dimensional environment 450A and / or interactions between the first electronic device 401A and virtual objects in the three-dimensional environment 450A may optionally not affect the content displayed in the three-dimensional environment 450B at the second electronic device 401B, and vice versa.

[0061] In some examples, avatars 415 / 417 / 419 are virtual representations (e.g., full-body renderings) of the user of electronic devices 401A / 401B / 401C. In some examples, the corresponding avatars are representations of one or more parts of the user of these electronic devices (e.g., renderings of the head, face, head and torso, etc.). In some examples, an avatar is a user-personified, user-selected, and / or user-created representation displayed in a 3D environment 450A / 450B, representing the user of electronic devices 401A / 401B / 401C. It should be understood that, although Figure 42 The avatars 415 / 417 / 419 shown correspond to the physical representation of the user of electronic devices 401A / 401B / 401C, but alternative avatars, such as those mentioned above and / or those with various dimensions (e.g., three-dimensional or two-dimensional), may be provided.

[0062] As used herein, co-located users correspond to local users relative to a first electronic device, while non-co-located users correspond to remote users. As discussed similarly above, the shared 3D environment may optionally include avatars (e.g., avatars 415 / 417 / 419) corresponding to remote users of electronic devices not co-located in a multi-user communication session. In some examples, the avatars corresponding to remote users are generated and presented in the shared 3D environment based on (e.g., using) skeleton data associated with the remote user. For example, the skeleton data is used to at least partially define one or more visual characteristics of the avatar in the 3D environment (e.g., the size (e.g., height) and / or relative thickness of parts of the avatar such as hands and / or limbs). Additionally, the skeleton data may optionally be used to track the movement of remote users, as discussed below, resulting in their corresponding avatars being shifted and / or moved in the 3D environment relative to the viewpoint of the first electronic device. In some examples, as discussed below, skeleton data associated with a local user can also be tracked and shared between co-located electronic devices in a multi-user communication session to help facilitate the presentation of virtual objects (e.g., avatars and shared virtual content) in a 3D environment and interaction with those virtual objects.

[0063] As described above, when the first electronic device 401A, the second electronic device 401B, and the third electronic device 401C are in a multi-user communication session, their respective three-dimensional environments form and / or correspond to a shared three-dimensional environment presented using electronic devices 401A / 401B / 401C. In some examples, in a multi-user communication session, content viewed by a user at one electronic device can be shared with another user at another electronic device. In some such examples, content can be experienced (e.g., viewed and / or interacted with) by multiple users (e.g., via their respective electronic devices) in a shared three-dimensional environment. For example, as... Figure 42 As shown, the three-dimensional environment 450A / 450B includes a shared virtual object 410 (e.g., optionally a horizontally oriented board game associated with application B), which can be viewed and interacted with by users of electronic devices 401A / 401B / 401C. Figure 42 As shown, the shared virtual object 410 may optionally be displayed together with a movement element 435 (e.g., a grabber indicator or manipulation bar or other user interface element), which may be selected to initiate the movement of the shared virtual object 410 within the shared 3D environment.

[0064] In some examples, the three-dimensional environment presented by an electronic device includes non-shared content that is private to one or more users in a multi-user communication session. For example, in Figure 42In this context, a first electronic device 401A is displaying a private application window 430, which may optionally be a virtual object in a multi-user communication session that is not shared between the first electronic device 401A, the second electronic device 401B, and the third electronic device 401C. In some examples, the private application window 430 may be associated with a corresponding application (e.g., application A) operating on the first electronic device 401A (e.g., a media player application, a web browsing application, a messaging application, etc.). Because the private application window 430 is not shared with the second electronic device 401B (e.g., or the third electronic device 401C), the second electronic device 401B may optionally display a representation 430'' of the private application window in a three-dimensional environment 450B. Figure 42 As shown, in some examples, the representation 430'' of the private application window may be a faded, obscured, discolored, and / or semi-transparent representation of the private application window 430, which prevents the user of the second electronic device 401B (e.g., and the user of the third electronic device 401C) from viewing the contents of the private application window 430.

[0065] As previously described above, in some examples, users of the first electronic device 401A, the second electronic device 401B, and the third electronic device 401C are in and / or form a spatial group within the multi-user communication session. In some examples, the spatial group may be a baseline (e.g., a first or default) spatial group within the multi-user communication session. For example, when users of the first electronic device 401A, the second electronic device 401B, and / or the third electronic device 401C initially join the multi-user communication session, they are automatically (and initially) associated with (e.g., assigned to) a spatial group within the multi-user communication session. In some examples, when users in... Figure 42In the spatial group shown, the users of the first electronic device 401A, the second electronic device 401B, and the third electronic device 401C have a first spatial arrangement within the shared 3D environment (e.g., arranged and / or defined according to a first spatial template). For example, the users of the first electronic device 401A, the second electronic device 401B, and the third electronic device 401C (including objects shared and displayed in the shared 3D environment) have a spatial reality within the spatial group. In some examples, spatial reality requires a consistent spatial arrangement between the user (or its representation) and the shared virtual objects. For example, the distance between the viewpoint of the user of the first electronic device 401A and the avatar 415 corresponding to the user of the second electronic device 401B may be the same as the distance between the viewpoint of the user of the second electronic device 401B and the avatar 417 corresponding to the user of the first electronic device 401A. Similarly, in Figure 42 From the viewpoint of the first electronic device 401A, the distance between the physical positions of the avatar 415 corresponding to the user of the second electronic device 401B and the third electronic device 401C (e.g., including the third user 405) in the three-dimensional environment 450A can be the same as the distance between the viewpoint of the user of the second electronic device 401B and the avatar 419 corresponding to the user of the third electronic device 401C in the three-dimensional environment 450B. As described herein, if the position of the viewpoint of the user of the first electronic device 401A moves, the avatar 417 corresponding to the user of the first electronic device 401A moves in the three-dimensional environment 450B according to the movement of the user's viewpoint relative to the viewpoint of the user of the second electronic device 401B. As another example, if a user of the first electronic device 401A interacts with the shared virtual object 410 (e.g., moves the virtual object 410 in the 3D environment 450A), then the second electronic device 401B (e.g., and the third electronic device 401C) changes or updates the display of the shared virtual object 410 in the 3D environment 450B based on that interaction (e.g., moves the virtual object 410 in the 3D environment 450B by a corresponding (same) amount). Figure 42 In the example, the spatial group established between the first electronic device 401A, the second electronic device 401B, and the third electronic device 401C is a hybrid spatial group. For example, as defined herein, a multi-user communication session includes co-located and non-co-located users and electronic devices. Maintaining spatial realism between user viewpoints in a multi-user communication session advantageously improves user interaction and the experience of shared virtual objects and content. For example, it may be desirable to enable users co-located in a first physical environment and participating in a multi-user communication session with one or more users not co-located in the first physical environment to coordinately move and / or reposition virtual content shared and presented in a three-dimensional environment, which optionally is viewable and / or interactive by both co-located and non-co-located users in the multi-user communication session.

[0066] It should be understood that in some examples, fewer and / or more than three electronic devices may be communicatively linked in a multi-user communication session. For example, in the case where two electronic devices are communicatively linked in a multi-user communication session, the first electronic device will present a single visual representation (e.g., a pass-through representation if juxtaposed, or a virtual representation (e.g., an avatar) if not juxtaposed), rather than Figure 42 The two visual representations shown correspond to the user of another single electronic device. Therefore, it should be understood that this document references... Figure 42 The various processes and exemplary interactions described for the first electronic device 401A, the second electronic device 401B, and the third electronic device 401C in the illustrated multi-user communication session are optionally applicable to situations where fewer or more than three electronic devices are communicatively linked in the multi-user communication session. It should also be understood that, although in Figure 42 This is illustrated, but a multi-user communication session does not necessarily need to include both co-located and non-co-located electronic devices (e.g., forming a hybrid space group). Alternatively, a multi-user communication session may be established between only co-located electronic devices (e.g., forming a local space group) or only non-co-located electronic devices (e.g., forming a remote space group).

[0067] An electronic device may perform one or more operations based on the presence of a group of users juxtaposed with it in a physical environment. In some examples, if a first electronic device associated with a first user detects that it is juxtaposed with a first group of users in a physical environment, the first electronic device will perform one or more operations contextualized for the first group of users. In some examples, if the first electronic device detects that it is juxtaposed with a second group of users, different from the first group, in a physical environment, the first electronic device will perform one or more operations contextualized for the second group of users. In some examples, if no group of users is juxtaposed with the first user in the physical environment, the first electronic device will perform one or more default operations. In some examples, the one or more operations contextualized for the first group of users include the display of data and / or a user interface previously shared or used between the first user and the first group of users on the first electronic device. In some examples, the one or more operations contextualized for the second group of users include the display of data and / or a user interface previously shared or used between the first user and the second group of users on the first electronic device. In some examples, the one or more operations are performed relative to a first application. For example, if the first electronic device detects that it is juxtaposed with a first group of users in a physical environment, the first electronic device will perform one or more operations contextualized for the first group of users relative to the first application, and if the first electronic device detects that it is juxtaposed with a second group of users in a physical environment, the first electronic device will perform one or more operations contextualized for the second group of users relative to the first application. Therefore, in some examples, the first electronic device may enable the application to operate differently based on the group of users juxtaposed with the first user in the physical environment.

[0068] Figures 3 to 8B The general illustration shows a first electronic device associated with a first user, according to some examples of the present disclosure, detecting and responding to a second user being placed in a physical environment with a second electronic device.

[0069] Figure 3 A first electronic device 101a according to some examples of this disclosure is illustrated, presenting an extended reality environment (e.g., a three-dimensional environment 303) when in a physical environment 305. Figure 3 In the diagram, as shown in top view 302a (e.g., top-down view), a first user 301a is wearing a first electronic device 101a. Note that... Figures 3 to 40 This includes corresponding top views 302a to 302ll, which are applicable to the corresponding accompanying drawings in which they appear. Figure 3 In the middle, the display 120 has a similar Figure 3 The content shown corresponds to the field of view (e.g., the field of view captured by external image sensors 114b and 114c and / or visible to the user via display 120). For example, in Figure 3 In this context, the viewing boundary of the first user 301a via the first electronic device 101a is defined by viewing boundary 311. Because the display 120 is optionally a head-mounted device, the field of view of the display 120 may be the same as or similar to the user's field of view. For example, the view of the three-dimensional environment 303 depicts the content (via the display 120) visible to the first user 301a when the viewpoint of the first electronic device 101a is positioned as shown in the top view 302a of the three-dimensional environment 303 and the first electronic device 101a is optionally oriented in the direction indicated by the directional arrows emanating from the first electronic device 101a in the top view 302a.

[0070] In addition, Figure 3 In this process, the first electronic device 101a optionally captures one or more images of the physical environment 305 surrounding the first electronic device 101a, including one or more objects and / or users (if they are in the physical environment 305 surrounding the first electronic device 101a). In some examples, the first electronic device 101a displays a representation of the physical environment 305 in a three-dimensional environment 303. For example, Figure 3 The three-dimensional environment 303 may optionally include a representation of the rear and side walls (e.g., including the glass window shown in the upper left corner of the display 120) of the room (e.g., physical environment 305) where the first electronic device 101a is located, and a representation of the table 304 (e.g., the physical table where the physical potted plant is located) located in the room where the first electronic device 101a is located.

[0071] exist Figure 3 In the first electronic device 101a, the display 120 shows a three-dimensional environment 303 including a photo user interface 308 (e.g., a user interface for a photo application). Figure 3 In the first electronic device 101a, a photo user interface 308 is being displayed, and a first user 301a can interact with the photo user interface 308 (e.g., via user input detected by the first electronic device 101a, such as via image sensors 114a-114c).

[0072] The first electronic device 101a may optionally include one or more features of electronic device 101, first electronic device 260, or second electronic device 270, and / or may be a head-mounted system / device configured to generate and present a three-dimensional environment and / or a projection-based system / device (including hologram-based systems / devices), such as a head-up display (HUD), a head-mounted display (HMD), a window with integrated display capabilities, or a display formed as a lens (e.g., similar to a contact lens) designed to be placed on a person's eye. Figure 3In the example, the first user 301a wears the first electronic device 101a, such that the three-dimensional environment 303 can be defined by the X-axis, Y-axis, and Z-axis as viewed from the perspective of the first electronic device 101a (e.g., a viewpoint associated with the first electronic device 101a, which may be, for example, a head-mounted display).

[0073] from Figures 3 to 4 The second user 301b of the second electronic device 101b enters the physical environment 305 where the first electronic device 101a is located. For example, the second user 301b may optionally enter the same room where the first electronic device 101a is located. The second electronic device 101b may optionally include a reference (e.g., Figure 1 The first electronic device 101a, the second electronic device 101b, the first electronic device 260 (e.g., FIG. 2), the first electronic device 270 (e.g., FIG. 2), and / or the first electronic device 101a, possess one or more of the features described therein. When the second user 301b of the second electronic device 101b is in the physical environment 305, the first electronic device 101a detects that the first electronic device 101a and the second electronic device 101b are juxtaposed in the physical environment 305 (e.g., the first electronic device 101a detects that the first user 301a of the first electronic device 101a and the second user 301b of the second electronic device 101b are juxtaposed in the physical environment 305), such as Figure 5 As shown, and as described below.

[0074] exist Figure 5 In this context, the first electronic device 101a and the second electronic device 101b are juxtaposed in the physical environment 305, as indicated by the notification 314a that indicates "Alice detected".

[0075] In some examples, the first electronic device 101a and the second electronic device 101b are determined to be side-by-side because they are located in the same physical room. In some examples, if the first electronic device 101a and the second electronic device 101b are not in the same physical room, then it will be determined that the first electronic device 101a and the second electronic device 101b are not side-by-side.

[0076] In some examples, determining the juxtaposition of the first electronic device 101a and the second electronic device 101b in physical environment 305 is based on the distance between the first electronic device 101a and the second electronic device 101b. For example, in Figure 5In this configuration, the first electronic device 101a and the second electronic device 101b are placed side-by-side in physical environment 305 because the first electronic device 101a is within a threshold distance (e.g., 0.1 m, 0.5 m, 1 m, 2 m, 3 m, 5 m, 10 m, 15 m, 20 m, etc.) of the second electronic device 101b (e.g., the first electronic device 101a detects that the second electronic device 101b is within the threshold distance). If the first electronic device 101a and the second electronic device 101b are not within the threshold distance (e.g., if the first electronic device 101a detects that the second electronic device 101b is not within the threshold distance), then the first electronic device 101a and the second electronic device 101b may not be placed side-by-side.

[0077] In some examples, determining that the first electronic device 101a and the second electronic device 101b are juxtaposed in physical environment 305 is based on communication between the first electronic device 101a and the second electronic device 101b. For example, in Figure 5 In this configuration, the first electronic device 101a and the second electronic device 101b can communicate with each other (e.g., wirelessly, such as via Bluetooth, Wi-Fi, or a server (e.g., a wireless communication terminal)). For example, one or more signals transmitted by the first electronic device 101a can be detected by a receiver at the second electronic device 101b, and / or one or more signals transmitted by the second electronic device 101b can be detected by a receiver at the first electronic device 101a. If no signal is transmitted from the first electronic device 101a or detected by the second electronic device 101b, it can be determined that the first electronic device 101a and the second electronic device 101b are not side-by-side. Similarly, if no signal is transmitted from the second electronic device 101b or detected by the first electronic device 101a, it can be determined that the first electronic device 101a and the second electronic device 101b are not side-by-side.

[0078] In some examples, determining that the first electronic device 101a and the second electronic device 101b are juxtaposed in physical environment 305 is based on the strength of wireless signals transmitted and detected between the first electronic device 101a and the second electronic device 101b. For example, in Figure 5In this configuration, the first electronic device 101a and the second electronic device 101b are juxtaposed in physical environment 305 because the strength of the Bluetooth signal (or other wireless signal) transmitted and detected between the first electronic device 101a and the second electronic device 101b is greater than a threshold strength. For example, if the second electronic device 101b detects a Bluetooth signal from the first electronic device 101a with a signal strength greater than the threshold, it can be determined that the first electronic device 101a and the second electronic device 101b are juxtaposed. Similarly, if the first electronic device 101a detects a Bluetooth signal from the second electronic device 101b with a signal strength greater than the threshold, it can be determined that the first electronic device 101a and the second electronic device 101b are juxtaposed. Furthermore, if the second electronic device 101b detects a Bluetooth signal from the first electronic device 101a with a signal strength less than the threshold, it can be determined that the first electronic device 101a and the second electronic device 101b are not juxtaposed, and / or the wireless transmission or reception features are turned off at the first electronic device 101a and / or the second electronic device 101b. Similarly, if the first electronic device 101a detects a Bluetooth signal with a signal strength less than a threshold from the second electronic device 101b, it can be determined that the first electronic device 101a and the second electronic device 101b are not side-by-side, and / or the wireless transmission or wireless reception features are turned off at the second electronic device 101b and / or the first electronic device 101a.

[0079] In some examples, determining the co-location of the first electronic device 101a and the second electronic device 101b is based on their connection to the same network (e.g., a wireless network) in the physical environment 305. For example, if it is determined that the first electronic device 101a and the second electronic device 101b are connected to the same wireless network, then it can be determined that the first electronic device 101a and the second electronic device 101b are co-located. Continuing with this example, if it is determined that the first electronic device 101a and the second electronic device 101b are not connected to the same wireless network, then it can be determined that the first electronic device 101a and the second electronic device 101b are not co-located.

[0080] In some examples, determining that the first electronic device 101a and the second electronic device 101b are juxtaposed in the physical environment 305 is based on visual detection of the first electronic device 101a and the second electronic device 101b in the physical environment 305. For example, as Figure 5As shown, the second electronic device 101b is positioned within the field of view of the first electronic device 101a, enabling the first electronic device 101a to visually detect (e.g., identify or scan, such as via object detection / recognition or other image processing techniques) the second electronic device 101b (e.g., in one or more images captured by the first electronic device 101a, such as via external image sensors 114b and 114c). Furthermore, if the first electronic device 101a is within the field of view of the second electronic device 101b, it can be determined that the first electronic device 101a and the second electronic device 101b are juxtaposed. Conversely, if the second electronic device 101b is not within the field of view of the first electronic device 101a, it can be determined that the first electronic device 101a and the second electronic device 101b are not juxtaposed. Similarly, if the first electronic device 101a is not within the field of view of the second electronic device 101b, it can be determined that the first electronic device 101a and the second electronic device 101b are not juxtaposed. It should be noted that if the first electronic device 101a detects the second electronic device 101b via its image sensor, but the second electronic device 101b does not detect the first electronic device 101a via its image sensor, then it can be determined that the first electronic device 101a and the second electronic device 101b are juxtaposed. Similarly, it should be noted that if the second electronic device 101b detects the first electronic device 101a via its image sensor, but the first electronic device 101a does not detect the second electronic device 101b via its image sensor, then it can be determined that the first electronic device 101a and the second electronic device 101b are juxtaposed.

[0081] In some examples, determining that the first electronic device 101a and the second electronic device 101b are juxtaposed in physical environment 305 is based on a user of one of them being in the other's contact list. For example, the first electronic device 101a and the second electronic device 101b may be juxtaposed in physical environment 305 because a first user 301a of the first electronic device 101a and a second user 301b of the second electronic device 101b are in physical environment 305 and the first user 301a of the first electronic device 101a is in the contact list of the second electronic device 101b (e.g., a contact list of an application accessible via the second electronic device 101b, such as a phone application, a contact list application, an email application, a communication application, or another type of application). Additionally or alternatively, as another example, the first electronic device 101a and the second electronic device 101b may be juxtaposed in physical environment 305 because the first user 301a of the first electronic device 101a and the second user 301b of the second electronic device 101b are in physical environment 305 and the second user 102b of the second electronic device 101b is in the contact list on the first electronic device 101a (e.g., the contact list of an application accessible via the first electronic device 101a, such as a phone application, contact list application, email application, communication application, or another type of application). In some examples, if the first user 301a of the first electronic device 101a is not in the contact list on the second electronic device 101b, and / or if the second user 301b of the second electronic device 101b is not in the contact list on the first electronic device 101a, it can be determined that the first electronic device 101a and the second electronic device 101b are not juxtaposed in physical environment 305, even though they are in physical environment 305. It should be noted that in some examples, if the second user 301b of the second electronic device 101b is in the contact list of the first electronic device 101a, while the first user 301a is not in the contact list of the second electronic device 101b, then it can be determined that the first electronic device 101a and the second electronic device 101b are juxtaposed. It should also be noted that in some examples, if the second user 301b of the second electronic device 101b is in the contact list of the first electronic device 101a, while the first user 301a is not in the contact list of the second electronic device 101b, then it can be determined that the first electronic device 101a and the second electronic device 101b are not juxtaposed.

[0082] It should be noted that, Figure 5 In this context, detecting the juxtaposition of the first electronic device 101a and the second electronic device 101b includes detecting the user associated with the second electronic device 101b. For example, in... Figure 5As shown in the representative indication or notification 314a (e.g., not necessarily shown), the first electronic device 101a senses that it is juxtaposed with a specific user (i.e., the second user 301b (e.g., “Alice”)) of the second electronic device 101b in the physical environment 305. Alice may optionally be the name or username of the user logged into the second electronic device 101b. In some examples, communication between the first electronic device 101a and the second electronic device 101b includes data indicating one or more identifiers of one or more corresponding users of one or more corresponding electronic devices, which indicate that one or more corresponding users are logged into one or more user accounts associated with one or more corresponding electronic devices, and the determination of juxtaposition of electronic devices may optionally be based on this detection. Furthermore, it should be noted that when it is determined (e.g., detected) that the first electronic device 101a and the second electronic device 101b are juxtaposed, the user of the first electronic device 101a and the user of the second electronic device 101b are also determined to be juxtaposed.

[0083] In some examples, a second user 301b of the second electronic device 101b has previously interacted with a first user 301a of the first electronic device 101a. For example, the first user 301a may have played a virtual game, sent an email, sent a text message and / or made a phone call, or made a video call with the second user 301b, and / or the second user 301b may have played a virtual game, sent an email, sent a text message and / or made a phone call, or made a video call with the first user 301a. As another example, the first user 301a and the second user 301b may have previously interacted with the application when they were juxtaposed in a physical environment (e.g., physical environment 305 or another physical environment). In some examples, the first electronic device 101a senses (e.g., from memory or storage device or from a remote server) the type of previous interaction between the first user 301a of the first electronic device 101a and the second user 301b of the second electronic device 101b. For example, the first electronic device 101a may optionally sense which applications (e.g., game applications, calling applications, internet applications, and / or other applications) were previously used between the first user 301a of the first electronic device 101a and the second user 301b of the second electronic device 101b. In some examples, in response to detecting that the first electronic device 101a and the second electronic device 101b are juxtaposed in physical environment 305, the first electronic device 101a displays one or more contextualized suggestions for the second user 301b (e.g., and optionally based on those previous interactions between the first user 301a and the second user 301b), such as from Figures 5 to 6 As shown.

[0084] Specifically, in presentation Figure 5When the view of the three-dimensional environment 303 is shown, and in response to detecting that the second electronic device 101b and the first electronic device 101a are juxtaposed in the physical environment 305, the first electronic device 101a displays suggestion elements 316 (e.g., suggestion user interface elements), such as Figure 6 As shown. In Figure 6 In this context, suggestion element 316 is a user interface element that can be selected to display a first user interface of the first application. In some examples, suggestion element 316 can also be selected to cause the second electronic device 101b to display the first user interface of the first application (e.g., the first electronic device 101a will share the first user interface with the second electronic device 101b, so that both the first user 301a and the second user 301b can experience and interact with the first user interface together). In some examples, suggestion element 316 indicates one or more of the ways in which the first user 301a of the first electronic device 101a previously interacted with the second user 301b of the second electronic device 101b.

[0085] In some examples, Figure 6 The suggested element 316 can be selected to display the user interface of an application previously shared or used between the first user 301a and the second user 301b, regardless of whether the two users were juxtaposed when that user interface was previously shared or used between them. In some examples, Figure 6 The suggested element 316 can be selected to display the user interface of an application previously shared or used between the first user 301a and the second user 301b when the first user 301a and the second user 301b were previously juxtaposed in a physical environment, such as an application previously shared or used between the two users in a multi-user communication session including the first user 301a and the second user 301b (e.g., a previously active multi-user communication session) and when the first user 301a and the second user 301b were juxtaposed in a physical environment. For example, in Figure 6In some examples, suggestion element 316 may be selected to display the user interface of a music application, optionally because the music application was previously shared or used between the first user 301a and the second user 301b when they were previously juxtaposed in a physical environment. In some examples, if the first user 301a and the second user 301b have previously interacted with multiple applications, the first electronic device 101a displays a corresponding suggestion element for each application they have previously interacted with, optionally with a priority order in a list based on previous usage and / or the recentity of interaction / use. In some examples, if the first user 301a and the second user 301b have previously interacted with multiple applications, the first electronic device 101a displays a corresponding suggestion element for each application, up to two, three, four, or another number of applications. In some examples, if the first user 301a and the second user 301b have previously interacted with multiple applications, the first electronic device 101a displays only suggestion elements for the applications most recently used between the first user 301a and the second user 301b. In some examples, Figure 6 The suggestion element 316 includes a list or other indication of how the first user 301a and the second user 301b previously interacted.

[0086] In some examples, the first electronic device 101a displays suggestion element 316 in the three-dimensional environment 303 at a location based on the spatial arrangement between the current viewpoint of the first electronic device 101a and the second user 301b. In some examples, if the spatial arrangement between the current viewpoint of the first electronic device 101a and the second user 301b is a first spatial arrangement, the first electronic device 101a may optionally display suggestion element 316 at a first location in the three-dimensional environment 303. In some examples, if the spatial arrangement between the current viewpoint of the first electronic device 101a and the second user 301b is a second spatial arrangement different from the first spatial arrangement, the first electronic device 101a will display suggestion element 316 at a second location in the three-dimensional environment 303 different from the first location in the three-dimensional environment 303.

[0087] exist Figure 6 In this context, from the viewpoint of the first electronic device 101a, the first electronic device 101a displays the suggestion element 316 in front of the second user 301b. In some examples, the first electronic device 101a displays the suggestion element 316 at a predetermined position relative to the second user 301b from the viewpoint of the first electronic device 101a. Figure 6 Suggested element 316, such as the position relative to the second user 301b from the current viewpoint of the first electronic device 101a, such as in front, to the left, to the right, above, below, above, or another predetermined position.

[0088] In presentation Figure 6 When viewing the three-dimensional environment 303 as shown, the first electronic device 101a detects the selection of the suggested element 316, such as... Figure 7 As shown. For example, in Figure 7 In this context, when the attention (e.g., gaze) of the first user 301a is directed to option 316a of suggestion element 316, as indicated by gaze point 310a, the first electronic device 101a may optionally detect the first user 301a's hand 319 performing an air pinch gesture (e.g., tapping the index finger with the thumb) towards suggestion element 316. In some examples, the first electronic device 101a detects the first user 301a's gaze and / or air gesture towards option 316a of suggestion element 316. Additionally or alternatively, the first electronic device 101a may optionally detect voice input, input via a mouse, touchscreen, or touchpad, or another type of input towards option 316a of suggestion element 316 as described herein. In response to detection Figure 7 In the selection, the first electronic device 101a (stops displaying suggestion element 316) and displays the user interface 312 of the music application, such as Figure 8A As shown. Figure 8A An example is given of a first electronic device 101a responding to the detection of... Figure 7 The selection in [the selection] is used to display the user interface 312 of the music application. In some examples, in response to detecting [the detection]... Figure 7 In addition to the selection, the first electronic device 101a also shares the user interface 312 of the music application with the second electronic device 101b, so that both the first user 301a of the first electronic device 101a and the second user 301b of the second electronic device 101b can experience virtual content together via their respective electronic devices, such as... Figure 8A and Figure 8B As shown. Figure 8A An example is given of a first electronic device 101a responding to the detection of... Figure 7 The selection in 312 is used to display the user interface 312 of the music application, and Figure 8B An example is shown where a second electronic device 101b displays a user interface 312 of a music application in response to a sharing request initiated by the first electronic device 101a. Note that in Figure 8B In the middle, the second electronic device 101b does not display the first electronic device 101a. Figure 8A The photo user interface 308 shown is not shared (for example, it is private to the first electronic device 101a).

[0089] It should be noted that if the first electronic device 101a detects a selection of option 316b for the suggested element 316 instead of... Figure 7If option 316a is selected for suggestion element 316, the first electronic device 101a will optionally stop displaying suggestion element 316 and will not display the user interface 312 of the music application.

[0090] Figures 9 to 14 Generally illustrating some examples of this disclosure, a first electronic device 101a detects and responds to being co-located with a third user 301c in a physical environment 305 (e.g., and not co-located with a second user 301b).

[0091] Figure 9 An example is shown of a first electronic device 101a presenting a three-dimensional view of the environment 303 when it is in a physical environment 305, such as a reference. Figure 3 As stated above.

[0092] from Figures 9 to 10 A third user 301c of the third electronic device 101c enters the physical environment 305 where the first electronic device 101a is located. For example, the third user 301c may optionally enter the same room where the first electronic device 101a is located. The third electronic device 101c may optionally include a reference (e.g., Figure 1 The electronic device 101, (e.g., the first electronic device 260 of FIG. 2), (e.g., the second electronic device 270 of FIG. 2), the first electronic device 101a and / or the second electronic device 101b, and one or more of the features described herein. The third electronic device 101c may optionally be different from the first electronic device 101a. The third user 301c may optionally be different from the second user 301b. When the third user 301c of the third electronic device 101c is in the physical environment 305, the first electronic device 101a detects that the first electronic device 101a and the third electronic device 101c are juxtaposed in the physical environment 305, such as Figure 11 As shown.

[0093] exist Figure 11In this context, a first electronic device 101a and a third electronic device 101c are determined to be juxtaposed in physical environment 305, as indicated by a notification 314b indicating "Charlie detected" (e.g., Charlie optionally corresponds to the name of a third user 301c). In some examples, the first electronic device 101a detects that it is juxtaposed with the third electronic device 101c, as described with reference to the first electronic device 101a detecting that it is juxtaposed with the second electronic device 101b. In fact, one or all of the examples described herein relating to ways in which the juxtaposition of the first electronic device 101a and the second electronic device 101b in physical environment 305 also apply to determining that the first electronic device 101a and the third electronic device 101c are juxtaposed in physical environment 305. For example, determining that the first electronic device 101a and the third electronic device 101c are juxtaposed in physical environment 305 may optionally be based on the user of one of them being in the other's contact list. For example, a first electronic device 101a and a third electronic device 101c may be juxtaposed in a physical environment 305 because a first user 301a of the first electronic device 101a and a third user 301c of the third electronic device 101c are in the physical environment 305, and the first user 301a of the first electronic device 101a is in a contact list on the third electronic device 101c (e.g., a contact list of an application accessible via the third electronic device 101c, such as a phone application, a contact list application, an email application, a communication application, or another type of application). Additionally or alternatively, as another example, a first electronic device 101a and a third electronic device 101c may be juxtaposed in a physical environment 305 because a first user 301a of the first electronic device 101a and a third user 301c of the third electronic device 101c are in the physical environment 305, and the third user 301c of the third electronic device 101c is in a contact list on the first electronic device 101a (e.g., a contact list of an application accessible via the first electronic device 101a, such as a phone application, a contact list application, an email application, a communication application, or another type of application). In some examples, if the first user 301a of the first electronic device 101a is not in the contact list on the third electronic device 101c, and / or if the third user 301c of the third electronic device 101c is not in the contact list on the first electronic device 101a, it can be determined that the first electronic device 101a and the second electronic device 101b are not juxtaposed in the physical environment 305, even if they are in the physical environment 305.It should be noted that in some examples, if a third user 301c of the third electronic device 101c is in the contact list of the first electronic device 101a, while the first user 301a is not in the contact list of the third electronic device 101c, then it can be determined that the first electronic device 101a and the third electronic device 101c are co-located. It should also be noted that in some examples, if a third user 301c of the third electronic device 101c is in the contact list of the first electronic device 101a, while the first user 301a is not in the contact list of the third electronic device 101c, then it can be determined that the first electronic device 101a and the third electronic device 101c are not co-located.

[0094] In addition, it should be noted that, Figure 11 In this context, detecting the juxtaposition of the first electronic device 101a and the third electronic device 101c includes detecting the user associated with the third electronic device 101c. For example, in... Figure 11 As illustrated in the figure, as indicated by instruction or notification 314b (e.g., not necessarily displayed by the first electronic device 101a), the first electronic device 101a senses that it is juxtaposed with a specific user of the third electronic device 101c (i.e., the third user 301c (e.g., "Charlie")). Charlie may optionally be the name or username of a user logged into the third electronic device 101c. In some examples, communication between the first electronic device 101a and the third electronic device 101c includes one or more identifiers of one or more corresponding users of one or more corresponding electronic devices, which indicate that one or more corresponding users are logged into one or more user accounts associated with one or more corresponding electronic devices, and the determination of juxtaposition of electronic devices may optionally be based on this detection. Furthermore, it should be noted that when the juxtaposition of the first electronic device 101a and the third electronic device 101c is determined, the first user 301a of the first electronic device 101a and the third user 301c of the third electronic device 101c are also determined to be juxtaposed.

[0095] In some examples, a third user 301c of the third electronic device 101c has previously interacted with a first user 301a of the first electronic device 101a. For example, the first user 301a may have played a virtual game, sent an email, sent a text message and / or made a phone call, or made a video call with the third user 301c, and / or the third user 301c may have played a virtual game, sent an email, sent a text message and / or made a phone call, or made a video call with the first user 301a. As another example, the first user 301a and the third user 301c may have previously interacted with the application when juxtaposed in a physical environment (e.g., physical environment 305 or another physical environment). In some examples, the first electronic device 101a senses the type of previous interaction between the first user 301a of the first electronic device 101a and the third user 301c of the third electronic device 101c. For example, the first electronic device 101a may optionally sense (e.g., from memory or storage device or from a remote server) which applications (e.g., game applications, calling applications, internet applications, and / or other applications) were previously used between the first user 301a of the first electronic device 101a and the third user 301c of the third electronic device 101c. In some examples, in response to detecting that the first electronic device 101a and the third electronic device 101c are juxtaposed in physical environment 305, the first electronic device 101a displays one or more contextualized suggestions for the third user 301c (e.g., and optionally based on those previous interactions between the first user 301a and the third user 301c), such as from Figures 11 to 12 As shown.

[0096] Specifically, in presentation Figure 11 When the view of the three-dimensional environment 303 is shown, and in response to the detection that the third electronic device 101c and the first electronic device 101a are juxtaposed in the physical environment 305, the first electronic device 101a displays suggestion elements 316 (e.g., suggestion user interface elements), such as Figure 12 As shown. In Figure 12 In this context, suggestion element 316 is a user interface element that can be optionally used to display the user interface of the application. In some examples, suggestion element 316 can also be selected to cause a third electronic device 101c to display the user interface of the application (e.g., a first electronic device 101a will share a first user interface with the third electronic device 101c, so that both the first user 301a and the third user 301c can experience and interact with the second user interface together).

[0097] In some examples, Figure 12The suggested element 316 can be selected to display the user interface of an application previously shared or used between the first user 301a and the third user 301c, regardless of whether the two users were juxtaposed when that user interface was previously shared or used between them. In some examples, Figure 12 The suggested element 316 can be selected to display the user interface of an application previously shared or used between the first user 301a and the third user 301c when they were previously juxtaposed in a physical environment. For example, in Figure 12 In some examples, suggested elements may be selected to display the user interface of a game application, optionally because the game application was previously shared or used between the first user 301a and the third user 301c when they were previously juxtaposed in a physical environment. In some examples, if the first user 301a and the third user 301c have previously interacted with multiple applications, the first electronic device 101a displays a corresponding suggested element for each application they have previously interacted with, optionally with a priority order in a list based on previous usage and / or the recentity of interaction / use. In some examples, if the first user 301a and the third user 301c have previously interacted with multiple applications, the first electronic device 101a displays a corresponding suggested element for each application, up to two, three, four, or another number of applications. In some examples, if the first user 301a and the third user 301c have previously interacted with multiple applications, the first electronic device 101a displays only suggested elements for the applications most recently used between the first user 301a and the third user 301c. In some examples, Figure 12 The suggestion element 316 includes a list or other indication of how the first user 301a and the third user 301c previously interacted.

[0098] In some examples, the first electronic device 101a is displayed in the three-dimensional environment 303 at a location based on the spatial arrangement between the current viewpoint of the first electronic device 101a and the third user 301c. Figure 12 The suggestion element 316 is used in the context of the environment. In some examples, if the spatial arrangement between the current viewpoint of the first electronic device 101a and the third user 301c is a first spatial arrangement, the first electronic device 101a may optionally display the suggestion element 316 at a first location in the three-dimensional environment 303. In some examples, if the spatial arrangement between the current viewpoint of the first electronic device 101a and the third user 301c is a second spatial arrangement different from the first spatial arrangement, the first electronic device 101a will display the suggestion element 316 at a second location in the three-dimensional environment 303 different from the first location in the three-dimensional environment 303.

[0099] exist Figure 12 In this context, from the viewpoint of the first electronic device 101a, the first electronic device 101a displays suggestion element 316 in front of the second user 301b. In some examples, the first electronic device 101a displays suggestion element 316 at a predetermined position relative to the third user 301c from the viewpoint of the first electronic device 101a, such as in front of, to the left of, to the right of, above, below, above, or another predetermined position relative to the third user 301c from the current viewpoint of the first electronic device 101a.

[0100] In presentation Figure 12 When viewing the three-dimensional environment 303 as shown, the first electronic device 101a detects the selection of the suggested element 316, such as... Figure 13 As shown. For example, in Figure 13 In this context, when the attention (e.g., gaze) of the first user 301a is directed towards option 316a of suggestion element 316, as indicated by gaze point 310b, the first electronic device 101a may optionally detect that the first user 301a's hand 319 performs an air pinch gesture (e.g., tapping the index finger with the thumb) towards option 316a of suggestion element 316. In some examples, the first electronic device 101a detects... Figure 13 The first user 301a's gaze and / or air gestures pointing to suggestion element 316. Additionally or alternatively, the first electronic device 101a may optionally detect voice input, input via a mouse, touchscreen, or touchpad, or another type of input to option 316a of suggestion element 316 as described herein. In response to detection... Figure 13 In the selection, the first electronic device 101a displays the user interface 317 of the game application, such as Figure 14 As shown. Figure 14 An example is given of a first electronic device 101a responding to the detection of... Figure 13 The selection in [the selection] is used to display the user interface 317 of the game application. In some examples, in response to detecting [the detection]... Figure 13 In addition to the choice of the first electronic device 101a, the third electronic device 101c also shares the user interface 317 of the game application, so that the first user 301a of the first electronic device 101a and the third user 301c of the third electronic device 101c can experience virtual content together via their respective electronic devices as described above, or otherwise make the third electronic device 101c part of the game shown in the user interface 317 of the game application.

[0101] Figures 15 to 20The following is a general illustration of a first electronic device 101a associated with a first user according to some examples of the present disclosure, which detects and responds to a third user 301c being juxtaposed with a second electronic device 101b and a third electronic device 101c in a physical environment. Figure 15 An example is shown of a first electronic device 101a presenting a three-dimensional view of the environment 303 when it is in a physical environment 305, such as a reference. Figure 3 and / or Figure 9 As stated above.

[0102] from Figures 15 to 16 The second user 301b of the second electronic device 101b and the third user 301c of the third electronic device 101c enter the physical environment 305 where the first electronic device 101a is located, and from Figures 16 to 17 The first electronic device 101a detects that the first electronic device 101a is juxtaposed with the second electronic device 101b and the third electronic device 101c in the physical environment 305, such as Figure 17 As shown. In Figure 17 In the example provided, such as notification 314c (e.g., not necessarily displayed by the first electronic device 101a), the first electronic device 101a senses that it is juxtaposed with a specific user of the second electronic device 101b (i.e., the second user 301b (e.g., "Alice")) and a specific user of the third electronic device 101c (i.e., the third user 301c (e.g., "Charlie")) in the physical environment 305.

[0103] In some examples, a second user 301b of the second electronic device 101b enters the physical environment 305 before a third user 301c. In some examples, if the second user 301b of the second electronic device 101b enters the physical environment 305 before the third user 301c, then the first electronic device 101a may detect the co-location of the first electronic device 101a and the second electronic device 101b in the physical environment 305 before detecting the co-location of the first electronic device 101a and the third electronic device 101c in the physical environment 305. In some examples, a third user 301c of the third electronic device enters the physical environment 305 before the second user 301b. In some examples, if the third user 301c of the third electronic device enters the physical environment 305 before the second user 301b, then the first electronic device 101a will detect the co-location of the first electronic device 101a and the third electronic device 101c in the physical environment 305 before detecting the co-location of the first electronic device 101a and the second electronic device 101b in the physical environment 305.

[0104] In some examples, the first user 301a of the first electronic device 101a, the second user 301b of the second electronic device 101b, and the third user 301c of the third electronic device 101c have previously interacted with each other. For example, the first user 301a of the first electronic device 101a, the second user 301b of the second electronic device 101b, and the third user 301c of the third electronic device 101c may have played virtual games together, been part of group email discussion threads, group text messaging sessions, three-way calls, and / or video call sessions, or previously shared content with each other in other ways, whether previously juxtaposed with each other or otherwise grouped together (e.g., in a three-way call). As another example, the first user 301a of the first electronic device 101a, the second user 301b of the second electronic device 101b, and the third user 301c of the third electronic device 101c may have previously interacted with the application when juxtaposed in a physical environment (e.g., physical environment 305 or another physical environment). In some examples, the first electronic device 101a senses the type of previous interactions between the first user 301a of the first electronic device 101a, the second user 301b of the second electronic device 101b, and the third user 301c of the third electronic device 101c. For example, the first electronic device 101a may optionally sense which applications (e.g., game applications, calling applications, internet applications, and / or other applications) were previously used between the first user 301a of the first electronic device 101a, the second user 301b of the second electronic device 101b, and the third user 301c of the third electronic device 101c. In some examples, in response to detecting that the first electronic device 101a is juxtaposed with the second electronic device 101b and the third electronic device 101c in physical environment 305, the first electronic device 101a displays one or more contextualized suggestions for the second user 301b and the third user 301c (e.g., and optionally based on those previous interactions between the first user 301a, the second user 102, and the third user 301c), such as from Figures 17 to 18 As shown.

[0105] In some examples, Figure 18 The suggested element 316 can be selected to display the user interface of an application previously shared or used among the first user 301a, the second user 102, and the third user 301c. In some examples, Figure 18 The suggested element 316 can be selected to display the user interface of an application that was previously shared or used among the first user 301a, the second user 102, and the third user 301c when they were previously juxtaposed in a physical environment. For example, in Figure 18In the illustrative examples, suggestion element 316 may be selected to display the user interface of a word processing application (e.g., a word document user interface), optionally because the word processing application was previously shared or used among the first user 301a, second user 102, and third user 301c when they were previously juxtaposed in a physical environment. In some examples, if the first user 301a, second user 102, and third user 301c have previously interacted with multiple applications, the first electronic device 101a displays a corresponding suggestion element for each application they have previously interacted with, optionally with a priority order in a list based on previous usage and / or the recentity of interaction / use. In some examples, if the first user 301a, second user 102, and third user 301c have previously interacted with multiple applications, the first electronic device 101a displays a corresponding suggestion element for each application, up to two, three, four, or another number of applications. In some examples, if the first user 301a, the second user 301b, and the third user 301c have previously interacted with multiple applications, the first electronic device 101a only displays suggested elements for the most recently used applications among the first user 301a, the second user 301b, and the third user 301c. Figure 18 In this context, element 316 is suggested to be selected to display a text document of a word processing application, optionally because the first user 301a, the second user 301b, and the third user 301c are collaborators on the text document and / or because the first user 301a, the second user 301b, and the third user 301c have previously used or interacted with the text document when they were previously juxtaposed in a physical environment.

[0106] In some examples, the first electronic device 101a is displayed in the three-dimensional environment 303 at a position based on the spatial arrangement between the current viewpoint of the first electronic device 101a and the second user 301b and the third user 301c. Figure 18The suggestion element 316 is displayed in the context of the three-dimensional environment 303. In some examples, if the spatial arrangement between the current viewpoint of the first electronic device 101a and the second user 301b and the third user 301c is a first spatial arrangement, the first electronic device 101a may optionally display the suggestion element 316 at a first location in the three-dimensional environment 303. In some examples, if the spatial arrangement between the current viewpoint of the first electronic device 101a and the second user 102 and the third user 301c is a second spatial arrangement different from the first spatial arrangement, the first electronic device 101a will display the suggestion element 316 at a second location in the three-dimensional environment 303 different from the first location in the three-dimensional environment 303. In some examples, the display position of the suggestion element 316 is between the second user 301b and the third user 301c in the viewpoint of the first electronic device 101a, and / or at or near (e.g., in front of) the midpoint between the second user 301b and the third user 301c as seen from the viewpoint of the first electronic device 101a.

[0107] In presentation Figure 18 When viewing the three-dimensional environment 303 as shown, the first electronic device 101a detects the selection of the suggested element 316, such as... Figure 19 As shown. For example, in Figure 19 In this context, when the attention (e.g., gaze) of the first user 301a is directed towards option 316a of suggestion element 316, as indicated by gaze point 310c, the first electronic device 101a may optionally detect that the first user 301a's hand 319 performs an air pinch gesture (e.g., tapping the index finger with the thumb) directed towards option 316a of suggestion element 316. In some examples, the first electronic device 101a detects... Figure 19 The first user 301a's gaze and / or air gestures towards option 316a of suggestion element 316. Additionally or alternatively, the first electronic device 101a may optionally detect voice input, input via mouse, touchscreen, or touchpad, or another type of input towards option 316a of suggestion element 316 as described herein. In response to detection... Figure 19 In the selection, the first electronic device 101a displays the user interface 318 of the word processing application, such as Figure 20 As shown. Figure 20 An example is given of a first electronic device 101a responding to the detection of... Figure 19 The selection in [the selection] is used to display the user interface 318 of the word processing application. In some examples, in response to detecting [the condition]... Figure 19In addition to the selection, the first electronic device 101a also shares the user interface 318 of the word processing application with the second electronic device 101b and the third electronic device 101c, so that the first user 301a of the first electronic device 101a, the second user 301b of the second electronic device 101b, and the third user 301c of the third electronic device 101c can all experience virtual content together through their respective electronic devices, as described above (for example, refer to...). Figure 8A and Figure 8B ).

[0108] Figures 20 to 30 The first electronic device 101a, according to some examples of the present disclosure, enables a text application to perform different operations based on who is juxtaposed with the first user 301a of the first electronic device 101a in the physical environment 305.

[0109] exist Figure 20 In this context, the first electronic device 101a is displaying a user interface 318 of a word processing application, showing a text document. A group of people, including a first user 301a, a second user 301b, a third user 301c, and eight others, can access the text document (e.g., are collaborators, editors, or otherwise authorized to view the text document). Figure 20 In the first electronic device 101a, the first user 301a is placed alongside the second user 301b and the third user 301c. Figure 20 In the user interface 318, it also indicates with whom the text document is shared. Figure 20 In this example, the user interface 318 includes instructions for the person authorized to access the text document, and the first electronic device 101a causes the user interface 318 to sort the instructions for collaborators of the text document based on whether the corresponding collaborator is currently juxtaposed with the first user 301a in the physical environment 305. For example, if the corresponding collaborator of the text document is not juxtaposed with the first user 301a in the physical environment 305, the corresponding collaborator will optionally occupy a later position in the collaborator list. Continuing with this example, if the corresponding collaborator of the text document is juxtaposed with the first user 301a in the physical environment 305, the corresponding collaborator will optionally occupy a earlier position in the collaborator list of the text document.

[0110] exist Figure 20 In the text document, the priority order of the collaborators' instructions is shown, with the second user 301b and the third user 301c occupying the first and second positions in the sorting, optionally because the second user 301b and the third user 301c are juxtaposed with the first user 301a of the first electronic device 101a in the physical environment 305. For example, in Figure 20In the text document, the first element 322a (e.g., an icon, photo, or other element representing the third user 301c) specifically indicates that the third user 301c (“Charlie”) is a collaborator in the document and is in the first position in the order, and the second element 322b specifically indicates that the second user 301b is a collaborator in the document and is in the second position in the order. The user interface 318 may also display the corresponding elements of the remaining eight people sharing the document with the first and second users in a position further back than the first and second positions, because the first and second positions are currently occupied by collaborators juxtaposed with the first user 301a in the physical environment 305. For example, in Figure 20 If all collaborators of the text document are to be displayed in the user interface 318, the display order of these collaborators will be based on whether the collaborators are currently juxtaposed with the first user 301a in the physical environment 305.

[0111] In some examples, the collaborator's indications have different appearances depending on whether the collaborator is juxtaposed with the first user 301a in the physical environment 305. For example, if the corresponding collaborator is juxtaposed with the first user 301a in the physical environment 305, the first electronic device 101a may optionally display its user interface 318 with the corresponding collaborator's indications having a first visual appearance. Continuing with this example, if the corresponding collaborator is not juxtaposed with the first user 301a in the physical environment 305, the first electronic device 101a may optionally display its user interface 318 with the corresponding collaborator's indications having a second visual appearance different from the first visual appearance.

[0112] Figure 21 An alternative example is shown where a first user 301a of a first electronic device 101a and different groups of users sharing a text document with the electronic device are juxtaposed in a physical environment 305, and in response, the first electronic device 101a causes the text document to be sorted according to whether the corresponding collaborator is currently juxtaposed with the first user 301a in the physical environment 305, based on the collaborator's indication. For example, in Figure 21 In the first electronic device 101a, the first user 301a is unlike Figure 20 Instead of being co-located with the second user 301b and the third user 301c as in the previous example, it is co-located with the fourth user 301d of the fourth electronic device 101d and the fifth user 301e of the fifth electronic device 101e in physical environment 305. Both of these are co-located with Figure 20 Collaborators in the same text document. Figure 21 In this context, the user interface 318 sorts the collaborators of the text document according to whether the collaborators are currently juxtaposed with the first user 301a in the physical environment 305 (e.g., the first electronic device 101a causes the user interface 318 to perform this sorting). Figure 21In this context, the first user 301a, the fourth user 301d of the fourth electronic device 101d, and the fifth user 301e of the fifth electronic device 101e are juxtaposed in physical environment 305. Figure 21 In the text document, the priority order of the collaborators' instructions is shown, with fourth user 301d and fifth user 301e occupying the first and second positions respectively in the sorting. For example, in Figure 21 In the document, the third element 322c (e.g., an icon, photo, or other element representing the fourth user 301d) specifically indicates that the fourth user 301d (“Paul”) is a collaborator in the document and is in the first position in the order, and the fifth user 301e (“Zoe”) specifically indicates that the fourth element 322d is a collaborator in the document and is in the second position in the order. The user interface 318 can also display the corresponding elements of the remaining eight people sharing the document with the user in a position further back than the first and second positions, because... Figure 21 The first and second positions are currently occupied by collaborators co-located with the first user 301a in physical environment 305. For example, if Figure 21 If all collaborators of a text document are to be displayed in the user interface 318, the display order of these collaborators will be based on whether the collaborator is currently juxtaposed with the first user 301a in the physical environment 305, such as references. Figure 20 As stated above.

[0113] Figure 22 Another alternative example is shown where the first user 301a of the first electronic device 101a and any users of the electronic device with which it shares the text document are not juxtaposed in the physical environment 305, and in response, the text document lists those users with which it shares the text document in a random order (e.g., the first electronic device 101a causes the text document to sort the list of these users) (e.g., the order is randomized by default or the juxtaposition state is not considered when listing those users with which it shares the text document). For example, the first corresponding element 322' and the second corresponding element 322'' may optionally correspond to two different users with which it shares the text document, and their order in the full list of users with which it shares the text document may optionally be randomized and / or the juxtaposition state is not considered. Thus, in some examples, the first electronic device 101a may cause the application to perform different operations based on who is juxtaposed with the first user 301a of the first electronic device 101a in the physical environment.

[0114] Additionally, it should be noted that if the first user 301a, the second user 301b, and the third user 301c are as follows: Figure 20The text document is juxtaposed in physical environment 305 as described above, and if a group of people sharing the text document are also juxtaposed in another physical environment, such as the sixth user of the sixth electronic device and the seventh user of the seventh electronic device in the other physical environment, and if the text document is displayed in both environments, the text document will optionally be sorted according to the collaborators' instructions based on whether the respective collaborators are currently juxtaposed in their respective physical environments (e.g., the corresponding electronic device displaying the text document will optionally cause the text document to be sorted), such as... Figure 20 and Figure 23 As shown. In Figure 20 In this context, the first electronic device 101a causes the user interface 318 to sort the collaborators' instructions for the text document based on whether the collaborators are currently juxtaposed with the first user 301a in the physical environment 305, as referenced above. Figure 20 Therefore, the user interface 318 shows the second user 301b and the third user 301c (even though the text document is also shared with other users including the fourth, fifth, and sixth users) occupying the two most prominent positions in the list, because only the second user 301b and the third user 301c are juxtaposed with the first user 301a of the first electronic device 101a in the physical environment 305. Figure 23 The figure shows a view of a three-dimensional environment 323, visible via a display 120 of an eighth user 301h (located in a physical environment 305 different from the physical environment 324) sharing the text document. The eighth electronic device 101h causes the user interface 318 of the word processing application to sort the collaborators' instructions for the text document based on whether the collaborators are currently juxtaposed with the eighth user 101h in the physical environment 324, and thus... Figure 23 User interface 318 shows that the sixth user 301f and the seventh user 301g occupy the first two positions in the list (by the position of the fifth element 322e in the list corresponding to the sixth user 301f and the position of the sixth element 322f corresponding to the seventh user 301g), even though the text document is also shared with other users including the first user 301a, the second user 301b, and the third user 301c, because Figure 23 The sixth user 301f and the seventh user 301g are juxtaposed with the eighth user 301h of the eighth electronic device 301h in physical environment 324.

[0115] Return to Figure 20 The first electronic device 101a is juxtaposed with the second electronic device 101b and the third electronic device 101c in the physical environment 305, and is presented in the form of... Figure 20When the view of the three-dimensional environment 303 shown is displayed, the first electronic device 101a detects input to the text input field of the text document, such as... Figures 20 to 24 As shown. For example, in Figure 24 In this context, when the attention (e.g., gaze) of the first user 301a is directed towards the keyboard, the first electronic device 101a optionally detects that the first user 301a's hand 319 performs an air pinch gesture pointing to a key on the keyboard (e.g., pointing to the "C" key, then pointing to the "H" key). Additionally or alternatively, the first electronic device 101a optionally detects voice input, input via a mouse, touchscreen, or touchpad, or another type of input pointing to the keyboard as described herein. In response to Figure 24 Upon input, the first electronic device 101a updates the display of the text document user interface to include the letters already typed by the first user 301a, such as... Figure 25 As shown. Therefore, Figure 24 The input includes the first user 301a typing the letter "Ch", and the first electronic device 101a updates the display of the text document user interface to include those letters, such as... Figure 25 As shown.

[0116] Furthermore, the word processing application suggests (e.g., the first electronic device 101a causes the word processing application to suggest) a word to complete the text containing the letters already typed by the first user 301a, such as Figures 25 to 26 As shown. In some examples, the suggestions made by the word processing application are based on a group of users juxtaposed with the first user 301a in the physical environment 305. For example, from Figures 25 to 26 The word processing application suggested the word "Charlie" (which is...) Figure 26 The first electronic device 101a (325) completes text containing letters already typed by the first user 301a (e.g., the first electronic device 101a causes the word processing application to suggest the word "Charlie"). In some examples, the word processing application suggests the word "Charlie" because it knows that the first user 301a of the first electronic device 101a is simultaneously juxtaposed with a third electronic device 101c, which is being used by a third user 301c named Charlie. For example, the first electronic device 101a may optionally send data to the word processing application instructing the first electronic device 101a to juxtapose with the third user 301c of the third electronic device 101c. As another example, if the first electronic device 101a is not juxtaposed with Charlie (e.g., the third user 301c of the third electronic device 102c) in physical environment 305, and the first electronic device 101a detects... Figure 22If input is received (e.g., "Ch" is detected), the first electronic device 101a will optionally suggest another word to complete the text with the letters already typed by the first user 301a, such as from Figures 27 to 28 to Figures 29 to 30 As shown. In Figure 27 In this context, the first electronic device 101a is not co-located with the third user 301c in the physical environment 305. Figures 27 to 28 The first electronic device 101a detected a connection with Figure 22 The same typing input, from Figures 28 to 29 The first electronic device 101a updates the display of the text document to include the requested letters, and from Figures 29 to 30 The first electronic device 101a suggests a word to complete a text containing letters (e.g., the letter "Ch") already typed by the first user 301a. Figure 30 In Chinese, word processing applications suggest the word "Chicken" (which is...) Figure 30 The second word (328) is used to complete the text that has been typed by the first user (301a) but is not "Charlie", because... Figure 30 In this context, the first electronic device 101a is not co-located with Charlie (e.g., the third user 301c of the third electronic device 101c) in the physical environment 305, and optionally is also not co-located with any other user in the physical environment 305 who has a name or other identifier that begins with "Ch".

[0117] Figure 31 and Figure 32 This is another example illustrating a first electronic device 101a according to some examples of the present disclosure, visually emphasizing the first user 301a of the first electronic device 101a and the group of users of the electronic device juxtaposed with it in the physical environment 305.

[0118] exist Figure 31In this scenario, although three electronic device users exist in the physical environment 305 where the first electronic device 101a is located, the first electronic device 101a detects that it is co-located with the second electronic device 101b and the third electronic device 101c in the physical environment 305, as indicated by notification 314d, and is not co-located with the fourth user 301d of the fourth electronic device 101d in the physical environment 305. For example, although the fourth user 301d of the fourth electronic device 101d is in the physical environment 305, the first user 301a and the fourth user 301d may not have interacted with each other before. For example, the fourth user 301d may not be in the contact list of the application on the first electronic device 101a. In response to detecting that the first electronic device 101a is juxtaposed with the second electronic device 101b and the third electronic device 101c in physical environment 305 (e.g., in response to detecting that the first user 301a is juxtaposed with the second user 301b and the third user 301c in physical environment), from the viewpoint of the first electronic device 101a, the first electronic device 101a visually emphasizes (e.g., enhances, increases visual salience, increases its apparent brightness) the second user 301b (as shown by glow 329b) and the third user 301c (as shown by glow 329a), thereby optionally allowing for more seamless interaction between the first user 301a and the second user 301b and the third user 301c in physical environment 305. Additionally, as Figure 32 As shown, the first electronic device 101a abandons visual emphasis on the fourth user 301d because the first user 301a and the fourth user 301d are not juxtaposed in the physical environment 305.

[0119] Figures 33 to 37 This generally illustrates another example of a first electronic device 101a detecting and responding to another user being placed alongside another electronic device in a physical environment, according to some examples of this disclosure.

[0120] exist Figure 33 In this context, the first electronic device 101a presents a view of the three-dimensional environment 303 when it is in the physical environment 305, such as a reference. Figure 3 , Figure 9 and / or Figure 15 As stated. From Figures 33 to 34 The first electronic device 101a displays a user interface 331 for a movie application (e.g., a content playback application). For example, in accordance with... Figure 33 When presenting a view of the three-dimensional environment 303, the first electronic device 101a optionally detects user input requesting the display of the user interface 331 of the movie application. In response, the first electronic device 101a displays the user interface 331 of the movie application, such as... Figure 34 As shown.

[0121] exist Figure 34 In the movie application, the user interface 331 includes multiple selectable options 332, which can be optionally selected to view information about different movies (e.g., different content) and / or initiate playback of different movies. For example, a first selectable option 332a can be optionally selected to view information corresponding to a first movie and / or initiate playback of the first movie; a second selectable option 332b can be optionally selected to view information corresponding to a second movie and / or initiate playback of the second movie; a third selectable option 332c can be optionally selected to view information corresponding to a third movie and / or initiate playback of the third movie; and a fourth selectable option 332d can be optionally selected to view information corresponding to a fourth movie and / or initiate playback of the fourth movie.

[0122] In display Figure 34 When the view of the three-dimensional environment 303 shown is displayed, the fifth user 301e of the fifth electronic device 101e enters the room where the first user 301a of the first electronic device 101a is located, as shown. Figure 35 As shown. From Figures 35 to 36 The first electronic device 101a detects that it and the fifth electronic device 101e are juxtaposed in physical environment 305, as indicated in notification 314e. In response, the first electronic device 101a causes the movie application to change (e.g., reduce) the number of movies that can be selected for playback, such as... Figures 36 to 37 As shown. For example, the fifth user 301e could be a child (e.g., a child ten years old or younger), and... Figure 34 In this context, the multiple selectable options may be associated with adult content or content that is otherwise unsuitable for children (e.g., content rated PG-13 or higher). In response to detecting that the first user 301a and the fifth user 301e are juxtaposed, the first electronic device 101a causes the movie application to update which movies are available for playback, and this update may optionally be based on the juxtaposition of the fifth user 301e and the first user 301a in the physical environment 305.

[0123] Figures 38 to 40 This generally illustrates another example of a first electronic device 101a detecting and responding to a group of users juxtaposed with the electronic device in a physical environment, according to some examples of this disclosure.

[0124] exist Figure 38 In the middle, the first electronic device 101a is displaying the messaging user interface 334 of a messaging application. Figure 38In the message transmission session, option 336 is included, which can be selected to perform a first operation relative to the second user 301b and the third user 301c, such as being selected to call and / or initiate real-time communication between the first user 301a of the first electronic device 101a, the second user 301b of the second electronic device 101b, and the third user of the third electronic device. It should be noted that in Figure 38 In the first electronic device 101a, the first user 301a is not placed alongside the second user 301b and the third user 301c.

[0125] from Figures 38 to 39 The second user 301b and the third user 301c of the second electronic device 101b enter the physical environment 305 where the first user 301a of the first electronic device 101a resides, and the first electronic device 101a detects that the first user 301a is juxtaposed with the second user 301b and the third user 301c in the physical environment 305, as similarly described herein, and as indicated by notification 314f. In response, the first electronic device 101a can select option 336 to perform the following actions: Figures 39 to 40 As shown. For example, when the first user 301a is not juxtaposed with the second user 301b and the third user 301c in physical environment 305, and when the first electronic device 101a is displaying... Figure 37 When option 336 is selected, this option can be chosen to perform a first operation (“Operation A”), and in response to detecting that the first user 301a is juxtaposed with the second user 301b and the third user 301c in the physical environment 305, the first electronic device 101a updates the operation that option 336 can be selected to perform. For example, when Figure 38 When the first user 301a is not co-located with the second user 301b and the third user 301c in physical environment 305, option 336 may optionally be selected to initiate a first type of multi-user communication session between the first user 301a, the second user 301b, and the third user 301c (e.g., a first type of communication session between the first electronic device 101a, the second electronic device 101b, and the third electronic device 101c, such as a multi-user communication session in which one or more of the first user 301a, the second user 301b, or the third user 301c will be displayed as virtual avatars or other visual representations). Continuing this example, in response to detecting that the first user 301a is co-located with the second user 301b and the third user 301c in physical environment 305... Figure 40In a scenario where the second user 301b and the third user 301c are juxtaposed, the first electronic device 101a updates option 336, making this option selectable to initiate a second type of multi-user communication session between the first user 301a, the second user 301b, and the third user 301c, which is different from the first type of multi-user communication session. For example, the second type of multi-user communication session may optionally be a communication session in which virtual avatars representing remote users of the multi-user communication session will not be displayed, because there will be no remote users (since the users are juxtaposed in a physical environment).

[0126] Figure 41 A flowchart illustrating a method 460, according to some examples of this disclosure, for performing one or more user-contextualized operations juxtaposed in a physical environment for an electronic device. (See above reference) Figures 3 to 40 One or more of the methods described below are used to illustrate and / or describe one or more examples of method 460. It should be understood that method 460 is an example and more, fewer, or different operations may be performed in the same or different order. Additionally, the operations in method 460 described below may optionally be performed by running an information processing device such as a general-purpose processor (e.g., as per [reference to...]). Figures 2A to 2C One or more functional modules in the (mentioned) or dedicated chip and / or through relative to Figures 2A to 2C The other components mentioned above are used to implement this.

[0127] Therefore, based on the above, some examples of this disclosure relate to a method (e.g., Figure 41 Method 460). In some examples, method 460 is performed at a first electronic device communicating with one or more first displays and one or more first input devices. In some examples, the first electronic device displays (462) a first user interface of a first application, such as [example application name], in a three-dimensional environment via the one or more first displays. Figure 8A The user interface 312 of the music application. In some examples, the first electronic device detects (464) a group of one or more corresponding users of one or more corresponding electronic devices different from the first electronic device, juxtaposed with the first user of the first electronic device in a physical environment, such as... Figure 5Notification 314a states that Alice is detected as being juxtaposed with the first user 301a of the first electronic device 101a in a physical environment. In some examples, detecting that the group of one or more corresponding users of one or more corresponding electronic devices are juxtaposed with the first user of the first electronic device in a physical environment includes: detecting one or more corresponding electronic devices juxtaposed with the first electronic device, and identifying one or more corresponding users associated with those corresponding electronic devices (e.g., via account information, such as username information and / or other information indicating the corresponding user associated with a specific electronic device juxtaposed with the first electronic device in a physical environment), and / or includes detecting the group of one or more corresponding users in the physical environment, such as via visual identification of the one or more corresponding users using a camera (e.g., the camera of the first electronic device (e.g., an image capture device)). In some examples, in response to detecting that the group of one or more corresponding users of the one or more corresponding electronic devices are juxtaposed with the first user of the first electronic device in a physical environment, based on determining that the group of one or more corresponding users of the one or more corresponding electronic devices includes a second user but not a third user, the first electronic device performs (466) one or more operations contextualized for the second user relative to the first application, such as in response to detecting... Figure 5 The second user 301b and the first user 301a are displayed side-by-side in physical environment 305. Figure 6 Recommended element 316. In some examples, in response to detecting that the group of one or more corresponding users of the one or more corresponding electronic devices are juxtaposed with the first user of the first electronic device in a physical environment, based on determining that the group of one or more corresponding users of the one or more corresponding electronic devices includes a third user but not a second user, the first electronic device performs one or more operations contextualized for the third user relative to the first application (468) (e.g., not performing one or more operations contextualized for the second user relative to the first application), such as in response to detecting Figure 12 The third user 301c and the first user 301a are displayed side-by-side in physical environment 305. Figure 12 Recommended element 316.

[0128] Additionally or alternatively, in some examples, the first electronic device detects that no user is physically paired with the first user of the first electronic device in the physical environment, and in response to detecting that no user is physically paired with the first user of the first electronic device, the first electronic device performs one or more default operations relative to the first application, such as referencing... Figure 22 As stated above.

[0129] Additionally or alternatively, in some examples, in response to detecting that the group of one or more corresponding users of the one or more corresponding electronic devices are juxtaposed with a first user of the first electronic device in a physical environment, and based on determining that the group of one or more corresponding users of the one or more corresponding electronic devices includes a second user and a third user, the first electronic device performs one or more operations contextualized for the second user and the third user relative to the first application, such as referencing... Figures 16 to 18 As stated above.

[0130] Additionally or alternatively, in some examples, performing the one or more operations includes displaying one or more suggestions instructing the group of one or more corresponding users of the one or more corresponding electronic devices via the one or more first displays, such that, based on determining that the group of one or more corresponding users of the one or more corresponding electronic devices includes a second user but not a third user, displaying the one or more suggestions via the one or more first displays includes displaying one or more first suggestions without displaying one or more second suggestions, such as... Figure 6 The suggestion element 316, and based on determining that the group of one or more corresponding users of the one or more corresponding electronic devices includes a third user but not a second user, displays the one or more suggestions via the one or more first displays, including displaying the one or more second suggestions without displaying the one or more first suggestions, such as Figure 12 Suggestion element 316. Additionally or alternatively, in some examples, displaying the one or more first suggestions without displaying the one or more second suggestions includes displaying the one or more first suggestions at a location spatially arranged between the viewpoint of the first electronic device and the position of the second user in the three-dimensional environment via the one or more first displays, such as a reference. Figure 6 The description, and displaying the one or more second suggestions without displaying the one or more first suggestions, includes displaying the one or more second suggestions via the one or more first displays at a location spatially arranged between the viewpoint of the first electronic device and the position of a third user in a three-dimensional environment, such as a reference. Figure 12 As stated above.

[0131] Additionally or alternatively, in some examples, the one or more first suggestions include a set of one or more user interface elements that indicate one or more prior interactions between the first user and the set of one or more corresponding users, including a second user but excluding a third user, of the one or more corresponding electronic devices, such as references Figure 6 The aforementioned, and the one or more second suggestions, include a set of one or more user interface elements that indicate one or more previous interactions between the first user and the set of one or more corresponding users, including a third user but excluding a second user, of the one or more corresponding electronic devices, such as references Figure 12 As stated above.

[0132] Additionally or alternatively, in some examples, in response to detecting that the group of one or more corresponding users of the one or more corresponding electronic devices are juxtaposed with a first user of the first electronic device in a physical environment, a first user interface displaying a first application is executed via the one or more first displays, such as references. Figure 5 and Figure 6 The above. Additionally or alternatively, in some examples, based on determining that the group of one or more corresponding users of the one or more corresponding electronic devices includes a second user but not a third user, the first user interface of the first application is the first corresponding user interface of the first corresponding application, such as... Figure 8A The user interface 312 of the music application. Additionally or alternatively, in some examples, based on determining that the group of one or more corresponding users of the one or more corresponding electronic devices includes a third user but not a second user, the first user interface of the first application is a second corresponding user interface of a second corresponding application that is different from the first corresponding user interface of the first corresponding application, such as... Figure 14 The user interface of the game application in 317.

[0133] Additionally or alternatively, in some examples, performing the one or more operations before displaying the first user interface of the first application includes displaying, via the one or more first displays, corresponding user interface elements that can be selected to display the first user interface of the first application, such as... Figure 6 Suggested element 316. Additionally or alternatively, in some examples, based on determining that the group of one or more corresponding users of the one or more corresponding electronic devices includes a second user but not a third user, a corresponding user interface element may be selected to display the first user interface of the first application, such as the first corresponding user interface of the first corresponding application. Figure 6 Suggested element 316. Additionally or alternatively, in some examples, based on determining that the group of one or more corresponding users of the one or more corresponding electronic devices includes a third user but not a second user, a corresponding user interface element may be selected to display a first user interface of a first application that is a second corresponding user interface of a second application that is different from the first corresponding user interface of the first corresponding application, such as... Figure 12 Suggested element 316. Additionally or alternatively, in some examples, in response to detecting a selection of a corresponding user interface element (such as a selection of a value) via the one or more first input devices. Figure 13 (Selection of option 316a) executes the first user interface of the first application.

[0134] Additionally or alternatively, in some examples, the first corresponding application is an application previously interacted with by the first user and the group of one or more corresponding users of the one or more corresponding electronic devices, including the second user but excluding the third user, and the second corresponding application is an application previously interacted with by the first user and the group of one or more corresponding users of the one or more corresponding electronic devices, including the third user but excluding the second user.

[0135] Additionally or alternatively, in some examples, the first corresponding application, as an application previously interacted by the first user and the group of one or more corresponding electronic devices, including the second user but excluding the third user, is: when the group of one or more corresponding users, including the second user but excluding the third user, were previously juxtaposed with the first user in a corresponding physical environment, such as references... Figure 6 The above. Additionally or alternatively, in some examples, the second corresponding application, as an application previously interacted by the first user and the group of one or more corresponding electronic devices, including a third user but excluding a second user, is: when the group of one or more corresponding users, including a third user but excluding a second user, were previously juxtaposed with the first user in a corresponding physical environment, such as reference... Figure 12 As stated above.

[0136] Additionally or alternatively, in some examples, detecting the juxtaposition of the group of one or more corresponding users of the one or more corresponding electronic devices with the first user of the first electronic device in a physical environment includes: detecting the spatial arrangement of the group of one or more corresponding users of the one or more corresponding electronic devices juxtaposed with the first user of the first electronic device in a physical environment. Additionally or alternatively, in some examples, performing the one or more operations is based on the spatial arrangement of the group of one or more corresponding users of the one or more corresponding electronic devices juxtaposed with the first user of the first electronic device in a physical environment. For example, Figure 13 The display position of the user interface 312 of the music application can optionally be based on the position of the third user 301c. Additionally, Figure 12 The display position of the suggested element 316 can optionally be based on the position of the third user 301c.

[0137] Additionally or alternatively, in some examples, before performing the one or more operations (or before detecting that the group of one or more corresponding users of the one or more corresponding electronic devices are juxtaposed with the first user of the first electronic device in a physical environment), displaying a first user interface of the first application includes: displaying a first user interface via the one or more first displays, the first user interface not having a first indication to the group of one or more corresponding users of the one or more corresponding electronic devices juxtaposed with the first user of the first electronic device in a physical environment, such as... Figure 36 The user interface 331 of the movie application. Additionally or alternatively, in some examples, performing the one or more operations (e.g., in response to detecting that the group of one or more corresponding users of the one or more corresponding electronic devices are juxtaposed with a first user of the first electronic device in a physical environment) includes displaying a first user interface of the first application, the first user interface having a first indication to the group of one or more corresponding users of the one or more corresponding electronic devices juxtaposed with the first user of the first electronic device in the physical environment, such as... Figure 37 The user interface 331 includes instructions for the first user 301a to be with the fifth user 301e of the fifth electronic device 101e in the physical environment 305.

[0138] Additionally or alternatively, in some examples, detecting the group of one or more corresponding users of the one or more corresponding electronic devices in a physical environment alongside the first user of the first electronic device includes: detecting one or more identifiers of the one or more corresponding users of the one or more corresponding electronic devices, the one or more identifiers indicating that the one or more corresponding users are logged into one or more user accounts associated with the one or more corresponding electronic devices, such as references Figure 5 As stated above.

[0139] Additionally or alternatively, in some examples, in response to detecting that the group of one or more corresponding users of the one or more corresponding electronic devices are juxtaposed with a first user of a first electronic device in a physical environment, based on determining that the group of one or more corresponding users of the one or more corresponding electronic devices includes a second user but not a third user, the first electronic device visually emphasizes the position of one or more corresponding users of the one or more corresponding electronic devices of the one or more corresponding electronic devices, including the second user's position relative to the viewpoint of the one or more corresponding users of the one or more corresponding electronic devices, such as by referencing... Figure 31 and Figure 32The above. Additionally or alternatively, in some examples, in response to detecting that the group of one or more corresponding users of the one or more corresponding electronic devices are juxtaposed with a first user of a first electronic device in a physical environment, based on determining that the group of one or more corresponding users of the one or more corresponding electronic devices includes a third user but not a second user, the position of one or more corresponding users of the one or more corresponding electronic devices, including the third user but not the second user, is visually emphasized, including via the one or more first displays, visually emphasizing the position of the third user relative to the viewpoint of the first electronic device, such as by reference. Figure 31 and Figure 32 As stated above.

[0140] Additionally or alternatively, in some examples, when displaying the first user interface of the first application, the detection of the group of one or more corresponding users of the one or more corresponding electronic devices being juxtaposed with the first user of the first electronic device in the physical environment is performed, such as... Figures 38 to 40 The user interface 334 of the messaging application is shown in the image.

[0141] Additionally or alternatively, in some examples, detection is performed before displaying the first user interface of the first application, juxtaposing the group of one or more corresponding users of the one or more corresponding electronic devices with the first user of the first electronic device in the physical environment, such as during the display. Figure 6 The suggested element 316 is mentioned before (and / or displayed in the context of) the suggestion element. Figure 8A (The user interface of the music application in 312) was detected before. Figure 5 The first user 301a and the second user 301b are shown side by side.

[0142] Some examples of this disclosure relate to a first electronic device including one or more processors and a memory, wherein the one or more processors are configured to execute one or more programs stored in the memory, and wherein the one or more programs include instructions for performing any of the methods described above. Some examples of this disclosure relate to a non-transitory computer-readable storage medium storing one or more programs, wherein the one or more programs include instructions that, when executed by one or more processors of the first electronic device, cause the first electronic device to perform any of the methods described above. Some examples of this disclosure relate to a first electronic device including one or more processors, a memory, and components for performing any of the methods described above. Some examples of this disclosure relate to an information processing apparatus for use in a first electronic device, wherein the information processing apparatus includes components for performing any of the methods described above.

[0143] It should be understood that the examples shown and described herein are merely exemplary and additional and / or alternative elements may be provided for performing operations based on the presence of a group of users juxtaposed in a physical environment of the electronic device. It should be understood that the appearance, shape, form, and size of each of the various user interface elements and objects shown and described herein are exemplary and alternative appearances, shapes, forms, and / or sizes may be provided. For example, virtual objects representing user interfaces may be provided in alternative shapes (such as circular shapes, triangular shapes, etc.) other than rectangular shapes. In some examples, the various selectable functional representations described herein may be verbally selected via user verbal commands (e.g., verbal commands such as "select an option" or "select a virtual object"). Additionally or alternatively, in some examples, the various options, user interface elements, control elements, etc., described herein may be selected and / or manipulated via user input received through one or more separate input devices communicating with the electronic device. For example, selection input may be received via physical input devices (such as mice, touchpads, keyboards, etc.) communicating with the electronic device.

[0144] For purposes of explanation, the foregoing description has been presented with reference to specific examples. However, the illustrative arguments above are not intended to be exhaustive or to limit this disclosure to the precise form disclosed. Many modifications and variations are possible in accordance with the foregoing teachings. The examples were chosen and described to best elucidate the principles of this disclosure and its practical application, thereby enabling others skilled in the art to make optimal use of this disclosure with various modifications suitable for the particular intended purpose, as well as the various described examples.

[0145] As described above, one aspect of this technology involves collecting and using data from various sources to improve the user's extended reality (XR) experience. This disclosure envisions that, in some instances, this collected data may include personal information that uniquely identifies or can be used to contact or locate specific individuals. Such personal information may include demographic data, location-based data, telephone numbers, email addresses, Twitter IDs, home addresses, data or records related to a user's health or fitness level (e.g., vital sign measurements, medication information, exercise information), date of birth, or any other identifying or personal information.

[0146] This disclosure recognizes that the use of such personal information data in the techniques of this invention can be beneficial to users. For example, personal information data can be used to improve a user's XR experience. Furthermore, this disclosure also anticipates other uses for personal information data that benefit users. For example, health and fitness data can be used to provide insights into a user's overall health status or can be used as positive feedback for individuals using the technology to pursue health goals.

[0147] This disclosure anticipates that entities responsible for the collection, analysis, disclosure, transmission, storage, or other use of such personal information data will comply with robust privacy policies and / or privacy measures. Specifically, such entities should implement and adhere to privacy policies and measures that are recognized as meeting or exceeding industry or governmental requirements for maintaining the privacy and security of personal information data. Such policies should be easily accessible to users and should be updated as the collection and / or use of data changes. Personal information from users should be collected for legitimate and reasonable entity purposes and should not be shared or sold outside of these legitimate purposes. Furthermore, such collection / sharing should be conducted only after receiving informed consent from users. Additionally, such entities should consider taking any necessary steps to protect and safeguard the right to access such personal information data and ensure that other entities with access to personal information data comply with the privacy policies and procedures of other entities. Furthermore, such entities may subject themselves to third-party assessments to demonstrate their compliance with widely accepted privacy policies and privacy practices. Moreover, policies and measures should be adapted to the specific types of personal information data collected and / or accessed, and to applicable laws and standards, including considerations of specific jurisdictions. For example, in the United States, the collection or acquisition of certain health data may be governed by federal and / or state laws, such as the Health Insurance Portability and Accountability Act (HIPAA); while in other countries, health data may be subject to other regulations and policies and should be handled accordingly. Therefore, different privacy measures should be advocated for different types of personal data in each country.

[0148] Regardless of the foregoing, this disclosure also envisions examples of users selectively blocking the use or access to their personal information data. That is, this disclosure anticipates providing hardware and / or software components to prevent or block access to such personal information data. For example, with respect to XR experiences, this technology can be configured to allow users to opt-in or opt-out at any time during or after service registration to participate in the collection of personal information data. In addition to providing opt-in and opt-out options, this disclosure also anticipates providing notifications related to access to or use of personal information. For example, users may be notified when downloading an application that their personal information data will be accessed, and then reminded again just before the application accesses the personal information data.

[0149] Furthermore, the intent of this disclosure is that personal information data should be managed and processed in a manner that minimizes the risk of unintentional or unauthorized access or use. Once data is no longer needed, this risk can be minimized by restricting data collection and deleting data. Additionally, and where applicable, including in certain health-related applications, data deidentification can be used to protect user privacy. Deidentification can be facilitated, where appropriate, by removing specific identifiers (e.g., date of birth), controlling the amount or specificity of stored data (e.g., collecting location data at the city level rather than the address level), controlling how data is stored (e.g., aggregating data among users), and / or other methods.

[0150] Therefore, while this disclosure broadly covers the use of personal information data to implement one or more of the various disclosed examples, it also contemplates that various examples can be implemented without access to such personal information data. That is, various examples of the inventive technology will not be rendered inoperable due to the lack of all or part of such personal information data. For example, XR experiences can be generated by inferring preferences based on non-personal information data or a minimal measure of personal information (such as content requested by a user's associated device, other non-personal information available to the service, or publicly available information).

Claims

1. A method, the method comprising: At a first electronic device that communicates with one or more first displays and one or more first input devices: A first user interface of a first application is displayed in a three-dimensional environment via the one or more first displays; Detecting one or more corresponding users of one or more corresponding electronic devices that are different from the first electronic device, juxtaposed with the first user of the first electronic device in a physical environment; as well as In response to detecting that one or more corresponding users of the one or more corresponding electronic devices are juxtaposed with the first user of the first electronic device in the physical environment: Based on determining that the group of one or more corresponding users of the one or more corresponding electronic devices includes a second user but not a third user, one or more operations contextualized for the second user are performed relative to the first application; as well as Based on determining that the group of one or more corresponding users of the one or more corresponding electronic devices includes the third user but not the second user, one or more operations contextualized for the third user are performed relative to the first application.

2. The method according to claim 1, wherein the method comprises: The system detects that no user is present in the physical environment alongside the first user of the first electronic device. as well as In response to detecting that no user is juxtaposed with the first user of the first electronic device in the physical environment, one or more default operations are performed relative to the first application.

3. The method of claim 1, further comprising, in response to detecting that the group of one or more corresponding users of the one or more corresponding electronic devices are juxtaposed with the first user of the first electronic device in the physical environment, performing one or more operations contextualized for the second user and the third user relative to the first application, based on determining that the group of one or more corresponding users of the one or more corresponding electronic devices includes the second user and the third user.

4. The method of claim 1, wherein performing the one or more operations comprises: Displaying one or more suggestions from one or more corresponding users of the one or more corresponding electronic devices via the one or more first displays, such that: According to the determination that the group of one or more corresponding users of the one or more corresponding electronic devices includes the second user but not the third user, displaying the one or more suggestions via the one or more first displays includes displaying one or more first suggestions but not displaying one or more second suggestions; as well as According to the determination that the group of one or more corresponding users of the one or more corresponding electronic devices includes the third user but not the second user, displaying the one or more suggestions via the one or more first displays includes displaying the one or more second suggestions but not displaying the one or more first suggestions.

5. The method according to claim 4, wherein: The one or more first suggestions include a set of one or more user interface elements, the set of one or more user interface elements indicating one or more previous interactions between the first user and the one or more corresponding users of the one or more corresponding electronic devices, including the second user but excluding the third user; and The one or more second suggestions include a set of one or more user interface elements that indicate one or more previous interactions between the first user and the one or more corresponding users of the one or more corresponding electronic devices, including the third user but excluding the second user.

6. The method according to claim 1, wherein: In response to detecting that the group of one or more corresponding users of the one or more corresponding electronic devices are juxtaposed with the first user of the first electronic device in the physical environment, the first user interface of the first application is displayed via the one or more first displays; Based on the determination that the group of one or more corresponding users of the one or more corresponding electronic devices includes the second user but not the third user, the first user interface of the first application is the first corresponding user interface of the first corresponding application; and According to the determination that the group of one or more corresponding users of the one or more corresponding electronic devices includes the third user but not the second user, the first user interface of the first application is the second corresponding user interface of the second corresponding application, which is different from the first corresponding user interface of the first corresponding application.

7. The method according to claim 6, wherein: The first corresponding application is an application previously interacted with by the first user and the one or more corresponding electronic devices, including the second user but excluding the third user; and The second corresponding application is an application previously interacted with by the first user and the one or more corresponding electronic devices, including the third user but excluding the second user.

8. The method according to claim 7, wherein: The first corresponding application, which was previously interacted with by the first user and the one or more corresponding electronic devices, including the second user but excluding the third user, is: an application previously interacted with by the first user and the one or more corresponding electronic devices, including the second user but excluding the third user, when the one or more corresponding users, including the second user but excluding the third user, were previously juxtaposed with the first user in a corresponding physical environment; and The second corresponding application, which is the application previously interacted by the first user and the one or more corresponding electronic devices, including the third user but excluding the second user, is: when the one or more corresponding users, including the third user but excluding the second user, were previously juxtaposed with the first user in the corresponding physical environment, the application was previously interacted by the first user and the one or more corresponding electronic devices, including the one or more corresponding users, including the third user but excluding the second user.

9. The method according to claim 1, wherein: Performing the one or more operations before displaying the first user interface of the first application includes displaying, via the one or more first displays, a corresponding user interface element that can be selected to display the first user interface of the first application; According to the determination that the group of one or more corresponding users of the one or more corresponding electronic devices includes the second user but not the third user, the first user interface of the first application whose corresponding user interface element can be selected to be displayed is the first corresponding user interface of the first corresponding application. Based on the determination that the group of one or more corresponding users of the one or more corresponding electronic devices includes the third user but not the second user, the first user interface element of the first application that can be selected to display is a second corresponding user interface of a second corresponding application that is different from the first corresponding user interface of the first corresponding application; and In response to detecting a selection of the corresponding user interface element via the one or more first input devices, the first user interface displaying the first application is executed.

10. The method according to claim 1, wherein: Detecting the juxtaposition of the group of one or more corresponding users of the one or more corresponding electronic devices with the first user of the first electronic device in the physical environment includes: detecting the spatial arrangement of the group of one or more corresponding users of the one or more corresponding electronic devices juxtaposed with the first user of the first electronic device in the physical environment; and The execution of the one or more operations is based on the spatial arrangement of the one or more corresponding users of the one or more corresponding electronic devices in the physical environment, where the first user of the first electronic device is juxtaposed with the first electronic device.

11. The method according to claim 1, wherein: Before detecting that the group of one or more corresponding users of the one or more corresponding electronic devices are juxtaposed with the first user of the first electronic device in the physical environment, displaying the first user interface of the first application includes: displaying the first user interface via the one or more first displays, the first user interface not having a first indication of the group of one or more corresponding users of the one or more corresponding electronic devices juxtaposed with the first user of the first electronic device in the physical environment; and Performing the one or more operations in response to detecting that the group of one or more corresponding users of the one or more corresponding electronic devices are juxtaposed with the first user of the first electronic device in the physical environment includes: displaying the first user interface of the first application, the first user interface having a first indication of the group of one or more corresponding users of the one or more corresponding electronic devices juxtaposed with the first user of the first electronic device in the physical environment.

12. The method of claim 1, wherein detecting the juxtaposition of the group of one or more corresponding users of the one or more corresponding electronic devices with the first user of the first electronic device in the physical environment comprises: Detect one or more identifiers of the one or more corresponding users of the one or more corresponding electronic devices, the one or more identifiers indicating that the one or more corresponding users are logged into one or more user accounts associated with the one or more corresponding electronic devices.

13. The method according to claim 1, wherein the method comprises: In response to detecting that one or more corresponding users of the one or more corresponding electronic devices are juxtaposed with the first user of the first electronic device in the physical environment: Based on the determination that the group of one or more corresponding users of the one or more corresponding electronic devices includes the second user but not the third user, visually emphasizing the position of one or more corresponding users of the one or more corresponding electronic devices including the second user but not the third user, including visually emphasizing the position of the second user relative to the viewpoint of the first electronic device via the one or more first displays; as well as Based on the determination that the group of one or more corresponding users of the one or more corresponding electronic devices includes the third user but not the second user, visually emphasizing the position of one or more corresponding users of the one or more corresponding electronic devices including the third user but not the second user, including visually emphasizing the position of the third user relative to the viewpoint of the first electronic device via the one or more first displays.

14. The method of claim 1, wherein when displaying the first user interface of the first application, the detection is performed to juxtapose the group of one or more corresponding users of the one or more corresponding electronic devices with the first user of the first electronic device in the physical environment.

15. The method of claim 1, wherein detecting the juxtaposition of the group of one or more corresponding users of the one or more corresponding electronic devices with the first user of the first electronic device in the physical environment is performed before displaying the first user interface of the first application.

16. A first electronic device, the first electronic device comprising: One or more processors; and A memory, wherein the one or more processors are configured to execute one or more programs stored in the memory, and wherein the one or more programs include instructions for performing the method according to any one of claims 1 to 15.

17. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by one or more processors of a first electronic device, cause the first electronic device to perform the method according to any one of claims 1 to 15.

Images