Initiating communications in three-dimensional environment based on user availability

Abstract

The present disclosure generally relates to initiating communications in a three-dimensional environment based on user availability. Some examples of the present disclosure relate to systems and methods for virtually initiating communication with a user in a three-dimensional environment based on user availability. Some examples of the present disclosure relate to systems and methods of virtually initiating communication with a user in a three-dimensional environment in response to receiving a request to initiate communication with the user.

Description

[0001] Cross-references to related applications

[0002] This application claims the benefit of U.S. Provisional Application No. 63 / 697,975, filed September 23, 2024, and U.S. Patent Application No. 19 / 292,003, filed August 6, 2025, the contents of which are incorporated herein by reference in their entirety for all purposes. Technical Field

[0003] The present invention relates to a system and method for virtually initiating communication between users in a three-dimensional environment based on user availability. Background Technology

[0004] Some computer graphics environments provide two-dimensional and / or three-dimensional environments in which at least some of the objects displayed for user viewing are virtual and computer-generated. In some examples, the three-dimensional environment is presented by multiple electronic devices communicating with each other. In some examples, a portal for visual communication with a specific user is displayed within the three-dimensional environment presented at the respective electronic device. Summary of the Invention

[0005] Some examples of this disclosure relate to systems and methods for virtually initiating communication with a user in a three-dimensional environment based on user availability. In some examples, a method is performed at a first electronic device communicating with one or more displays and one or more input devices. In some examples, when presenting a user interface including multiple representations of multiple users in a three-dimensional environment via one or more displays, wherein one or more of the multiple users meet one or more first criteria and one or more of the multiple representations of the one or more users are displayed with a first visual appearance, the first electronic device detects a first input directed to the user interface via one or more input devices, the first input corresponding to a request for communication initiated by the user with a second electronic device. In some examples, in response to receiving the first input, the first electronic device stops displaying the user interface and sends an indication to the user who initiated the request for communication with the second electronic device. In some examples, after sending the indication, the first electronic device receives an indication of a response to the request for communication initiated by the user with the second electronic device. In some examples, in response to receiving the indication, based on a determination that the response corresponds to accepting the request for communication initiated by the user with the second electronic device, the first electronic device establishes communication with the second electronic device, including displaying a visual representation of the user of the second electronic device in the three-dimensional environment via one or more displays. In some examples, based on the determination that the response corresponds to a request from a user to refuse communication with a second electronic device, the first electronic device displays a user interface object associated with the response in a three-dimensional environment.

[0006] Some examples of this disclosure relate to systems and methods for virtually initiating communication with a user in a three-dimensional environment in response to receiving a request to initiate communication with a user. In some examples, a method is performed at a first electronic device communicating with one or more displays and one or more input devices. In some examples, the first electronic device detects a first indication of a request to initiate communication with a user of a second electronic device. In some examples, in response to detecting the first indication, the first electronic device displays a notification corresponding to the first indication on an outward-facing surface of one or more displays. In some examples, while displaying the notification, the first electronic device detects a second indication via one or more input devices of accepting the request to initiate communication with the user of the second electronic device. In some examples, in response to detecting the second indication, the first electronic device establishes communication with the second electronic device. In some examples, based on a determination that the first electronic device is associated with a first portion of the user of the first electronic device when the second indication is detected, the first electronic device displays a visual representation of the user of the second electronic device in a three-dimensional environment via one or more displays. In some examples, based on a determination that the first electronic device is not associated with a first portion of the user of the first electronic device when the second indication is detected, the first electronic device outputs audio corresponding to the speech of a second user transmitted by the second electronic device via one or more speakers communicating with the first electronic device.

[0007] A full description of these examples is provided in the accompanying drawings and detailed embodiments, and it should be understood that the content of this invention does not limit the scope of this disclosure in any way. Attached Figure Description

[0008] To better understand the various examples described herein, reference should be made to the following detailed embodiments and accompanying drawings. Throughout the drawings, similar reference numerals generally refer to corresponding parts.

[0009] Figure 1 Examples of electronic devices that present extended real-world environments according to some examples of this disclosure are illustrated.

[0010] Figure 2 A block diagram illustrating an example architecture of a system according to some examples of this disclosure is shown.

[0011] Figure 3 Examples of spatial groups in a multi-user communication session including a first electronic device and a second electronic device are illustrated according to some examples of this disclosure.

[0012] Figures 4A to 4G Examples of facilitating the sending of requests to virtually initiate communication between users in a three-dimensional environment are illustrated according to some examples of this disclosure.

[0013] Figures 5A to 5JExamples of virtually facilitating communication between users in a three-dimensional environment are illustrated according to some examples of this disclosure.

[0014] Figure 6 A flowchart illustrating an example process for facilitating the sending of a request to virtually initiate communication between users in a three-dimensional environment, according to some examples of this disclosure.

[0015] Figure 7 A flowchart illustrating an example process for facilitating a response to a request to virtually initiate communication between users in a three-dimensional environment, according to some examples of this disclosure. Detailed Implementation

[0016] Some examples of this disclosure relate to systems and methods for virtually initiating communication with a user in a three-dimensional environment based on user availability. In some examples, a method is performed at a first electronic device communicating with one or more displays and one or more input devices. In some examples, when presenting a user interface including multiple representations of multiple users in a three-dimensional environment via one or more displays, wherein one or more of the multiple users meet one or more first criteria and one or more of the multiple representations of the one or more users are displayed with a first visual appearance, the first electronic device detects a first input directed to the user interface via one or more input devices, the first input corresponding to a request for communication initiated by the user with a second electronic device. In some examples, in response to receiving the first input, the first electronic device stops displaying the user interface and sends an indication to the user who initiated the request for communication with the second electronic device. In some examples, after sending the indication, the first electronic device receives an indication of a response to the request for communication initiated by the user with the second electronic device. In some examples, in response to receiving the indication, based on a determination that the response corresponds to accepting the request for communication initiated by the user with the second electronic device, the first electronic device establishes communication with the second electronic device, including displaying a visual representation of the user of the second electronic device in the three-dimensional environment via one or more displays. In some examples, based on the determination that the response corresponds to a request from a user to refuse communication with a second electronic device, the first electronic device displays a user interface object associated with the response in a three-dimensional environment.

[0017] Some examples of this disclosure relate to systems and methods for virtually initiating communication with a user in a three-dimensional environment in response to receiving a request to initiate communication with a user. In some examples, a method is performed at a first electronic device communicating with one or more displays and one or more input devices. In some examples, the first electronic device detects a first indication of a request to initiate communication with a user of a second electronic device. In some examples, in response to detecting the first indication, the first electronic device displays a notification corresponding to the first indication on an outward-facing surface of one or more displays. In some examples, while displaying the notification, the first electronic device detects a second indication via one or more input devices of accepting the request to initiate communication with the user of the second electronic device. In some examples, in response to detecting the second indication, the first electronic device establishes communication with the second electronic device. In some examples, based on a determination that the first electronic device is associated with a first portion of the user of the first electronic device when the second indication is detected, the first electronic device displays a visual representation of the user of the second electronic device in a three-dimensional environment via one or more displays. In some examples, based on a determination that the first electronic device is not associated with a first portion of the user of the first electronic device when the second indication is detected, the first electronic device outputs audio corresponding to the speech of a second user transmitted by the second electronic device via one or more speakers communicating with the first electronic device.

[0018] As used herein, a space group corresponds to a group or number of participants (e.g., users) in a multi-user communication session. In some examples, a space group in a multi-user communication session has a spatial arrangement indicating the location of users and content within the space group. In some examples, users in the same space group within a multi-user communication session experience spatial real-time according to the spatial arrangement of the space group. In some examples, when a user of a first electronic device is in a first space group in a multi-user communication session and a user of a second electronic device is in a second space group in a multi-user communication session, the user experiences spatial real-time localized for their respective space group. In some examples, when users of a first electronic device and users of a second electronic device are grouped into separate space groups within a multi-user communication session, if the first and second electronic devices return to the same operating state, the users of the first and second electronic devices are regrouped into the same space group within the multi-user communication session.

[0019] In some examples, initiating a multi-user communication session may include interaction with one or more user interface elements. In some examples, the electronic device may track a user's gaze as input for aiming at a selectable option / function representation within a corresponding user interface element displayed in a 3D environment. For example, a gaze may be used to identify one or more option / function representations being targeted for selection using another selection input. In some examples, a corresponding option / function representation may be selected using hand-tracking input detected via an input device communicating with the electronic device. In some examples, objects displayed in a 3D environment may be moved and / or reoriented within the 3D environment based on movement input detected via an input device.

[0020] Figure 1 An electronic device 101 is illustrated according to some examples of this disclosure, which presents an extended reality (XR) environment (e.g., a computer-generated environment that optionally includes representations of physical and / or virtual objects). In some examples, such as Figure 1 As shown, electronic device 101 is a head-mounted display or other head-mountable device configured to be worn on the head of a user of electronic device 101. An example of electronic device 101 is referenced below. Figure 2 Describe the architecture using a block diagram. For example... Figure 1 As shown, electronic device 101 and table 106 are located in a physical environment. The physical environment may include physical features such as physical surfaces (e.g., floor, wall) or physical objects (e.g., table, lamp, etc.). In some examples, electronic device 101 may be configured to detect and / or capture images of the physical environment including table 106 (exemplified in the field of view of electronic device 101).

[0021] In some examples, such as Figure 1 As shown, the electronic device 101 includes one or more internal image sensors 114a oriented toward the user's face (e.g., referred to below). Figure 2 (The described eye-tracking camera). In some examples, an internal image sensor 114a is used for eye tracking (e.g., detecting the user's gaze). The internal image sensor 114a is optionally arranged on the left and right portions of the display 120 to enable eye tracking of the user's left and right eyes. In some examples, the electronic device 101 also includes external image sensors 114b and 114c facing outwards from the user to detect and / or capture the physical environment of the electronic device 101 and / or movement of the user's hands or other body parts.

[0022] In some examples, display 120 has a field of view visible to the user (e.g., it may or may not correspond to the fields of view of external image sensors 114b and 114c). Because display 120 is optionally part of a head-mounted device, the field of view of display 120 is optionally the same as or similar to the field of view of the user's eyes. In other examples, the field of view of display 120 may be smaller than the field of view of the user's eyes. In some examples, electronics 101 may be an optical pass-through device, through which display 120 is a transparent or translucent display through which parts of the physical environment can be directly viewed. In some examples, display 120 may be included within a transparent lens and may overlap with all or only a portion of the transparent lens. In other examples, electronics may be a video pass-through device, through which display 120 is an opaque display configured to display images of the physical environment captured by external image sensors 114b and 114c. Although a single display 120 is shown, it should be understood that display 120 may include a stereoscopic display pair.

[0023] In some examples, in response to a trigger, electronic device 101 can be configured to display in an XR environment a [symbol / image / description]. Figure 1 The cube exemplified herein represents a virtual object 104 that does not exist in the physical environment but is displayed in an XR environment positioned on top of a real-world table 106 (or a representation thereof). Optionally, in response to detecting a flat surface of the table 106 in the physical environment 100, the virtual object 104 may be displayed on the surface of the table 106 in the XR environment displayed via a display 120 of the electronic device 101.

[0024] It should be understood that virtual object 104 is a representative virtual object and may include and render one or more different virtual objects (e.g., virtual objects with various dimensions, such as two-dimensional or other three-dimensional virtual objects) in a three-dimensional XR environment. For example, a virtual object may represent an application or user interface displayed in an XR environment. In some examples, a virtual object may represent content corresponding to an application and / or displayed via a user interface in an XR environment. In some examples, virtual object 104 is optionally configured to be interactive and responsive to user input (e.g., air gestures, such as air pinch gestures, air tap gestures, and / or air touch gestures), allowing the user to virtually touch, tap, move, rotate, or otherwise interact with virtual object 104.

[0025] In some examples, displaying an object in a 3D environment may include interaction with one or more user interface objects in the 3D environment. For example, initiating the display of an object in a 3D environment may include interaction with one or more virtual option / function representations displayed in the 3D environment. In some examples, when initiating the display of an object in a 3D environment, the electronic device may track the user's gaze as input for identifying one or more virtual option / function representations targeted for selection. For example, a gaze may be used to identify one or more virtual option / function representations targeted for selection using another selection input. In some examples, a virtual option / function representation may be selected using hand-tracking input detected via an input device communicating with the electronic device. In some examples, an object displayed in a 3D environment may be moved and / or reoriented in the 3D environment based on movement input detected via an input device.

[0026] In the following discussion, an electronic device communicating with a display generation component and one or more input devices is described. It should be understood that the electronic device optionally communicates with one or more other physical user interface devices, such as touch-sensitive surfaces, physical keyboards, mice, joysticks, hand-tracking devices, eye-tracking devices, styluses, etc. Furthermore, as described above, it should be understood that the described electronic device, display, and touch-sensitive surface are optionally distributed among two or more devices. Therefore, as used in this disclosure, information on or displayed by the electronic device is optionally used to describe information output by the electronic device for display on a separate display device (touch-sensitive or non-touch-sensitive). Similarly, as used in this disclosure, input received on the electronic device (e.g., touch input received on a touch-sensitive surface of the electronic device, or touch input received on the surface of a stylus) is optionally used to describe input received on a separate input device from which the electronic device receives input information.

[0027] The device typically supports a variety of applications, such as one or more of the following: drawing applications, presentation applications, word processing applications, website creation applications, disk editing applications, spreadsheet applications, game applications, telephone applications, video conferencing applications, email applications, instant messaging applications, fitness support applications, photo management applications, digital camera applications, digital video camera applications, web browsing applications, digital music player applications, TV channel browsing applications, and / or digital video player applications.

[0028] Figure 2A block diagram illustrating an example architecture of a system 201 according to some examples of this disclosure is provided. In some examples, system 201 includes multiple electronic devices. For example, system 201 includes a first electronic device 260 and a second electronic device 270, wherein the first electronic device 260 and the second electronic device 270 communicate with each other. In some examples, the first electronic device 260 and / or the second electronic device 270 are respectively a portable device, an auxiliary device for communicating with another device, a head-mounted display, etc. In some examples, the first electronic device 260 and the second electronic device 270 are related to the above references. Figure 1 The described electronic device 101 corresponds to this.

[0029] like Figure 2 As illustrated, the first electronic device 260 and the second electronic device 270 optionally include various sensors, such as one or more hand tracking sensors 202A / 202B, one or more position sensors 204A / 204B, and one or more image sensors 206A / 206B (optionally corresponding to...). Figure 1 The internal image sensor 114a and / or external image sensors 114b and 114c, one or more touch-sensitive surfaces 209A / 209B, one or more motion and / or orientation sensors 210A / 210B, one or more eye-tracking sensors 212A / 212B, one or more microphones 213A / 213B or other audio sensors, one or more body tracking sensors (e.g., torso and / or head tracking sensors), and one or more display generation components 214A / 214B (optionally corresponding to...) Figure 1 The electronic devices 260 and 270 include a display 120, one or more speakers 216A / 216B, one or more processors 218A / 218B, one or more memories 220A / 220B, and / or communication circuitry 222A / 222B. One or more communication buses 208A / 208B are optionally used for communication between the aforementioned components of the electronic devices 260 and 270.

[0030] Communication circuits 222A / 222B optionally include circuitry for communicating with electronic devices, networks (such as the Internet, intranets, wired and / or wireless networks, cellular networks, and wireless local area networks (LANs)). Communication circuits 222A / 222B optionally include circuitry for using near-field communication (NFC) and / or short-range communication such as... The circuit used for communication.

[0031] Processors 218A / 218B include one or more general-purpose processors, one or more graphics processors, and / or one or more digital signal processors. In some examples, memory 220A / 220B is a non-transitory computer-readable storage medium (e.g., flash memory, random access memory, or other volatile or non-volatile memory or storage device) storing computer-readable instructions configured to be executed by processor 218A / 218B to perform the techniques, processes, and / or methods described below. In some examples, memory 220A / 220B may include more than one non-transitory computer-readable storage medium. A non-transitory computer-readable storage medium can be any medium (e.g., excluding signals) that can tangibly contain or store computer-executable instructions for use by or in connection with an instruction execution system, apparatus, and device. In some examples, the storage medium is a transient computer-readable storage medium. In some examples, the storage medium is a non-transitory computer-readable storage medium. Non-transitory computer-readable storage media can include, but are not limited to, magnetic storage devices, optical storage devices, and / or semiconductor storage devices. Examples of such storage devices include hard disks, optical discs based on compact disc (CD), digital versatile optical disc (DVD), or Blu-ray technology, and persistent solid-state storage (such as flash memory, solid-state drives, etc.).

[0032] In some examples, display generating components 214A / 214B include a single display (e.g., a liquid crystal display (LCD), an organic light-emitting diode (OLED), or other types of display). In some examples, display generating components 214A / 214B include multiple displays. In some examples, display generating components 214A / 214B may include a touch-enabled display (e.g., a touchscreen), a projector, a holographic projector, a retinal projector, a transparent or translucent display, etc. In some examples, the first electronic device 260 and the second electronic device 270 each include a touch-sensitive surface 209A / 209B for receiving user input (such as tap input and swipe input or other gestures). In some examples, display generating components 214A / 214B and touch-sensitive surfaces 209A / 209B form a touch-sensitive display (e.g., a touchscreen integrated with electronic devices 260 and 270 or a touchscreen external to electronic devices 260 and 270 that communicates with electronic devices 260 and 270).

[0033] Electronic devices 260 and 270 optionally include image sensors 206A / 206B. Image sensors 206A / 206B optionally include one or more visible light image sensors (such as charge-coupled device (CCD) sensors) and / or complementary metal-oxide-semiconductor (CMOS) sensors capable of operating to acquire images of physical objects from the real-world environment. Image sensors 206A / 206B also optionally include one or more infrared (IR) sensors, such as passive or active IR sensors, for detecting infrared light from the real-world environment. For example, an active IR sensor includes an IR emitter for emitting infrared light into the real-world environment. Image sensors 206A / 206B also optionally include one or more cameras configured to capture movement of physical objects in the real-world environment. Image sensors 206A / 206B also optionally include one or more depth sensors configured to detect the distance between the physical object and electronic devices 260 and 270. In some examples, information from one or more depth sensors can allow a device to identify objects in a real-world environment and distinguish them from other objects in the real-world environment. In some examples, one or more depth sensors can allow a device to determine the texture and / or shape of objects in a real-world environment.

[0034] In some examples, electronic devices 260 and 270 use a combination of CCD sensors, event cameras, and depth sensors to detect the physical environment surrounding them. In some examples, image sensors 206A / 206B include a first image sensor and a second image sensor. The first and second image sensors work cooperatively and are optionally configured to capture different information about physical objects in the real-world environment. In some examples, the first image sensor is a visible light image sensor, and the second image sensor is a depth sensor. In some examples, electronic devices 260 and 270 use image sensors 206A / 206B to detect the location and orientation of electronic devices 260 and 270 and / or display generation components 214A / 214B in the real-world environment. For example, electronic devices 260 and 270 use image sensors 206A / 206B to track the location and orientation of display generation components 214A / 214B relative to one or more stationary objects in the real-world environment.

[0035] In some examples, electronic devices 260 and 270 include microphones 213A / 213B or other audio sensors. Electronic devices 260 and 270 optionally use microphones 213A / 213B to detect sound from a user and / or the user's real-world environment. In some examples, microphones 213A / 213B include an array (multiple microphones) of microphones that optionally operate cooperatively to identify ambient noise or locate sound sources in the space of a real-world environment.

[0036] Electronic devices 260 and 270 include position sensors 204A / 204B for detecting the position of electronic devices 260 and 270 and / or display generation components 214A / 214B. For example, position sensors 204A / 204B may include a Global Positioning System (GPS) receiver that receives data from one or more satellites and allows electronic devices 260 and 270 to determine the absolute position of the device in the physical world.

[0037] Electronic devices 260 and 270 include orientation sensors 210A / 210B for detecting the orientation and / or movement of electronic devices 260 and 270 and / or display generation components 214A / 214B. For example, electronic devices 260 and 270 use orientation sensors 210A / 210B to track changes in the positioning and / or orientation of electronic devices 260 and 270 and / or display generation components 214A / 214B, such as changes relative to physical objects in a real-world environment. Orientation sensors 210A / 210B optionally include one or more gyroscopes and / or one or more accelerometers.

[0038] In some examples, electronic devices 260 and 270 include hand-tracking sensors 202A / 202B and / or eye-tracking sensors 212A / 212B (and / or other body tracking sensors, such as leg, torso, and / or head tracking sensors). The hand-tracking sensors 202A / 202B are configured to track the localization / position of one or more portions of a user's hand, and / or the movement of one or more portions of the user's hand relative to the extended reality environment, relative to the display generation components 214A / 214B, and / or relative to another defined coordinate system. The eye-tracking sensors 212A / 212B are configured to track the localization and movement of a user's gaze (more generally, eyes, face, or head) relative to the real world or extended reality environment and / or relative to the display generation components 214A / 214B. In some examples, the hand-tracking sensors 202A / 202B and / or the eye-tracking sensors 212A / 212B are implemented together with the display generation components 214A / 214B. In some examples, the hand tracking sensors 202A / 202B and / or eye tracking sensors 212A / 212B are implemented separately from the display generation components 214A / 214B.

[0039] In some examples, hand tracking sensors 202A / 202B (and / or other body tracking sensors, such as leg, torso, and / or head tracking sensors) may use image sensors 206A / 206B (e.g., one or more IR cameras, 3D cameras, depth cameras, etc.) that capture 3D information from the real world, including one or more body parts (e.g., a human user's hand, leg, torso). In some examples, the hand can be resolved with sufficient resolution to distinguish the fingers and their corresponding positions. In some examples, one or more image sensors 206A / 206B are positioned relative to the user to define the field of view and interaction space of the image sensors 206A / 206B, in which the finger / hand positions, orientations, and / or movements captured by the image sensors are used as input (e.g., to distinguish them from the user's idle hand or other hands of other people in the real-world environment). Tracking the fingers / hands used for input (e.g., gestures, touches, taps, etc.) may be advantageous because it does not require the user to touch, hold, or wear any type of beacon, sensor, or other marker.

[0040] In some examples, the eye-tracking sensors 212A / 212B include at least one eye-tracking camera (e.g., an infrared (IR) camera) and / or an illumination source (e.g., an IR light source, such as an LED) that emits light toward the user's eyes. The eye-tracking camera may be pointed at the user's eyes to receive reflected IR light from the light source directly or indirectly from the eyes. In some examples, both eyes are tracked separately by the respective eye-tracking cameras and illumination sources, and focus / gaze can be determined by tracking both eyes. In some examples, one eye (e.g., the dominant eye) is tracked by one or more respective eye-tracking cameras / illumination sources.

[0041] Electronic devices 260 and 270 are not limited to Figure 2The components and configurations may include fewer components, other components, or additional components in multiple configurations. In some examples, system 201 may be implemented in a single device. One or more persons using electronic devices 260 / 270 are optionally referred to herein as one or more users of the device. Attention now turns to the exemplary simultaneous display of a three-dimensional environment on a first electronic device (e.g., corresponding to electronic device 260) and a second electronic device (e.g., corresponding to electronic device 270). As discussed below, the first electronic device may communicate with the second electronic device in a multi-user communication session. In some examples, an avatar (e.g., a representation) of a user of the first electronic device may be displayed in the three-dimensional environment at the second electronic device, and an avatar of a user of the second electronic device may be displayed in the three-dimensional environment at the first electronic device. In some examples, users of the first electronic device and users of the second electronic device may be associated with a spatial group in a multi-user communication session.

[0042] Figure 3 Examples of spatial groups 340 in a multi-user communication session including a first electronic device 360 ​​and a second electronic device 370 according to some examples of this disclosure are illustrated. In some examples, the first electronic device 360 ​​may present a three-dimensional environment 350A, and the second electronic device 370 may present a three-dimensional environment 350B. The first electronic device 360 ​​and the second electronic device 370 may be similar to electronic devices 101 or 260 / 270, and / or may be head-mounted systems / devices and / or projection-based systems / devices (including hologram-based systems / devices) configured to generate and present three-dimensional environments, such as head-up displays (HUDs), head-mounted displays (HMDs), windows with integrated display capabilities, and displays formed as lenses (e.g., similar to contact lenses) designed to be placed on a person's eyes. Figure 3 In the example, a first user optionally wears a first electronic device 360 ​​and a second user optionally wears a second electronic device 370, such that the three-dimensional environment 350A / 350B can be defined by the X-axis, Y-axis, and Z-axis viewed from the perspective of the electronic device (e.g., the viewpoint associated with the electronic device 360 / 370, which may be, for example, a head-mounted display).

[0043] like Figure 3As shown, the first electronic device 360 ​​may be situated in a first physical environment including a table 306 and a window 309. Therefore, the three-dimensional environment 350A presented using the first electronic device 360 ​​optionally includes captured portions of the physical environment surrounding the first electronic device 360, such as a representation of the table 306' and a representation of the window 309'. Similarly, the second electronic device 370 may be situated in a second physical environment different from the first physical environment (e.g., separate from the first physical environment), which includes a floor lamp 307 and a coffee table 308. Therefore, the three-dimensional environment 350B presented using the second electronic device 370 optionally includes captured portions of the physical environment surrounding the second electronic device 370, such as a representation of the floor lamp 307' and a representation of the coffee table 308'. Additionally, the three-dimensional environments 350A and 350B may include representations of the floor, ceiling, and walls of the rooms in which the first electronic device 360 ​​and the second electronic device 370 are respectively located.

[0044] As mentioned above, in some examples, the first electronic device 360 ​​is optionally in a multi-user communication session with the second electronic device 370. For example, the first electronic device 360 ​​and the second electronic device 370 (e.g., via communication circuits 222A / 222B) are configured to present a shared three-dimensional environment 350A / 350B including one or more shared virtual objects (e.g., content such as images, videos, audio, etc., representations of application user interfaces, etc.). As used herein, the term "shared three-dimensional environment" refers to a three-dimensional environment independently presented, displayed, and / or visible at two or more electronic devices, through which content, applications, data, etc., can be shared and / or presented to users of the two or more electronic devices. In some examples, when the first electronic device 360 ​​is in a multi-user communication session with the second electronic device 370, an avatar corresponding to a user of one electronic device is optionally displayed in the three-dimensional environment displayed via the other electronic device. For example, as Figure 3 As shown, at the first electronic device 360, an avatar 315 corresponding to the user of the second electronic device 370 is displayed in the three-dimensional environment 350A. Similarly, at the second electronic device 370, an avatar 317 corresponding to the user of the first electronic device 360 ​​is displayed in the three-dimensional environment 350B.

[0045] In some examples, the presentation of avatars 315 / 317 as part of a shared 3D environment is optionally accompanied by audio effects corresponding to the speech of a user of electronic devices 370 / 360. For example, avatar 315 displayed in 3D environment 350A using first electronic device 360 ​​is optionally accompanied by audio effects corresponding to the speech of a user of second electronic device 370. In some such examples, when a user of second electronic device 370 speaks, the user's speech can be detected by second electronic device 370 (e.g., via microphone 213B) and transmitted to first electronic device 360 ​​(e.g., via communication circuits 222B / 222A), such that the detected speech of the user of second electronic device 370 can be presented as audio (e.g., using speaker 216A) to the user of first electronic device 360 ​​in 3D environment 350A. In some examples, the audio effects corresponding to the speech of the user of second electronic device 370 can be spatialized so that they appear to the user of first electronic device 360 ​​to originate from the location of avatar 315 in shared 3D environment 350A (e.g., although output from a speaker of first electronic device 360). Similarly, the avatar 317 displayed in the three-dimensional environment 350B using the second electronic device 370 is optionally accompanied by audio effects corresponding to the voice of the user of the first electronic device 360. In some such examples, when the user of the first electronic device 360 ​​speaks, the user's voice can be detected by the first electronic device 360 ​​(e.g., via microphone 213A) and transmitted to the second electronic device 370 (e.g., via communication circuits 222A / 222B), so that the detected voice of the user of the first electronic device 360 ​​can be presented as audio (e.g., using speaker 216B) to the user of the second electronic device 370 in the three-dimensional environment 350B. In some examples, the audio effects corresponding to the voice of the user of the first electronic device 360 ​​can be spatialized so that they appear to the user of the second electronic device 370 to originate from the location of the avatar 317 in the shared three-dimensional environment 350B (e.g., although output from the speaker of the first electronic device 360).

[0046] In some examples, when in a multi-user communication session, avatars 315 / 317 are displayed in the three-dimensional environment 350A / 350B in an orientation corresponding to and / or based on the orientation of electronic devices 360 / 370 (and / or users of electronic devices 360 / 370) in the physical environment surrounding electronic devices 360 / 370. For example, as Figure 3As shown, in three-dimensional environment 350A, avatar 315 arbitrarily selects the user's viewpoint from the ground facing the first electronic device 360, and in three-dimensional environment 350B, avatar 317 arbitrarily selects the user's viewpoint from the ground facing the second electronic device 370. When a particular user moves the electronic device (and / or itself) in the physical environment, the user's viewpoint changes according to the movement, which can therefore also change the orientation of the user's avatar in the three-dimensional environment. For example, refer to... Figure 3 If the user of the first electronic device 360 ​​looks to the left in the three-dimensional environment 350A, causing the first electronic device 360 ​​to rotate to the left (e.g., counterclockwise) (e.g., by a corresponding amount), then the user of the second electronic device 370 will see the avatar 317 corresponding to the user of the first electronic device 360 ​​rotate to the right (e.g., clockwise) relative to the viewpoint of the user of the second electronic device 370 according to the movement of the first electronic device 360.

[0047] Additionally, in some examples, when in a multi-user communication session, the viewpoint of the 3D environment 350A / 350B and / or the position of the viewpoint of the 3D environment 350A / 350B may optionally change according to the movement of the electronic device 360 / 370 (e.g., by the user of the electronic device 360 / 370). For example, when in a communication session, if the first electronic device 360 ​​moves closer toward the table representation 306' and / or avatar 315 (e.g., because the user of the first electronic device 360 ​​moves forward in the physical environment surrounding the first electronic device 360), the viewpoint of the 3D environment 350A will change accordingly, making the table representation 306', the window representation 309', and the avatar 315 appear larger in the field of view. In some examples, each user can interact independently with the three-dimensional environment 350A / 350B, such that changes in the viewpoint of the three-dimensional environment 350A and / or interactions between the first electronic device 360 ​​and virtual objects in the three-dimensional environment 350A optionally do not affect the content shown in the three-dimensional environment 350B at the second electronic device 370, and vice versa.

[0048] In some examples, avatar 315 / 317 is a representation of the user of electronic device 370 / 360 (e.g., full-body rendering). In some examples, avatar 315 / 317 is a representation of a portion of the user of electronic device 370 / 360 (e.g., rendering of head, face, head and torso, etc.). In some examples, avatar 315 / 317 is a representation of user personalization, user selection, and / or user creation displayed in 3D environment 350A / 350B, representing the user of electronic device 370 / 360. It should be understood that, although Figure 3 The avatars 315 / 317 illustrated correspond to the full-body representation of the user of electronic devices 370 / 360, respectively, but alternative avatars, such as those described above, may be provided.

[0049] As mentioned above, when the first electronic device 360 ​​and the second electronic device 370 are in a multi-user communication session, the three-dimensional environment 350A / 350B can be a shared three-dimensional environment presented using electronic devices 360 / 370. In some examples, in a multi-user communication session, content viewed by a user at one electronic device can be shared with another user at another electronic device. In some such examples, content can be experienced (e.g., viewed and / or interacted with) by two users (e.g., via their respective electronic devices) in a shared three-dimensional environment. For example, as... Figure 3 As shown, the 3D environment 350A / 350B includes a shared virtual object 310 (e.g., optionally a 3D virtual sculpture) that can be viewed and interacted with by two users. Figure 3 As shown, the shared virtual object 310 can be displayed together with a grabber indication (e.g., a control bar) 335 that can be selected to initiate movement of the shared virtual object 310 within the three-dimensional environment 350A / 350B.

[0050] In some examples, the 3D environment 350A / 350B includes non-shared content that is private to one user in a multi-user communication session. For example, in Figure 3 In this context, the first electronic device 360 ​​is displaying a private application window 330 in a three-dimensional environment 350A. This private application window is optionally an object in a multi-user communication session that is not shared between the first electronic device 360 ​​and the second electronic device 370. In some examples, the private application window 330 may be associated with a corresponding application operating on the first electronic device 360 ​​(e.g., a media player application, a web browsing application, a messaging application, etc.). Because the private application window 330 is not shared with the second electronic device 370, the second electronic device 370 optionally displays a representation 330 of the private application window in a three-dimensional environment 350B. Figure 3 As shown, in some examples, the "representation 330" of the private application window can be a faded, obscured, discolored, and / or semi-transparent representation of the private application window 330, which prevents the user of the second electronic device 370 from viewing the content of the private application window 330.

[0051] As mentioned earlier, in some examples, users of the first electronic device 360 ​​and users of the second electronic device 370 are in space group 340 within a multi-user communication session. In some examples, space group 340 may be a baseline (e.g., first or default) space group within the multi-user communication session. For example, when users of the first electronic device 360 ​​and users of the second electronic device 370 initially join the multi-user communication session, users of the first electronic device 360 ​​and users of the second electronic device 370 are automatically (and initially, as discussed in more detail below) associated with (e.g., grouped into) space group 340 within the multi-user communication session. In some examples, when users in such... Figure 3 In the spatial group 340 shown, the user of the first electronic device 360 ​​and the user of the second electronic device 370 have a first spatial arrangement (e.g., a first spatial template) within a shared three-dimensional environment. For example, the user of the first electronic device 360 ​​and the user of the second electronic device 370 (including objects displayed in the shared three-dimensional environment) have a spatial reality within the spatial group 340. In some examples, spatial reality requires a consistent spatial arrangement between the user (or its representation) and virtual objects. For example, the distance between the viewpoint of the user of the first electronic device 360 ​​and the avatar 315 corresponding to the user of the second electronic device 370 can be the same as the distance between the viewpoint of the user of the second electronic device 370 and the avatar 317 corresponding to the user of the first electronic device 360. As described herein, if the position of the viewpoint of the user of the first electronic device 360 ​​moves, the avatar 317 corresponding to the user of the first electronic device 360 ​​moves within the three-dimensional environment 350B according to the movement of the user's viewpoint relative to the viewpoint of the user of the second electronic device 370. Additionally, if a user of the first electronic device 360 ​​interacts with the shared virtual object 310 (e.g., moves the virtual object 310 in the three-dimensional environment 350A), the second electronic device 370 changes the display of the shared virtual object 310 in the three-dimensional environment 350B based on the interaction (e.g., moves the virtual object 310 in the three-dimensional environment 350B).

[0052] It should be understood that in some examples, more than two electronic devices may be communicatively linked in a multi-user communication session. For example, in the case where three electronic devices are communicatively linked in a multi-user communication session, the first electronic device will display two avatars corresponding to the users of the other two electronic devices, instead of just one avatar. Therefore, it should be understood that the various processes and exemplary interactions described herein with reference to the first electronic device 360 ​​and the second electronic device 370 in a multi-user communication session are optionally applicable to cases where more than two electronic devices are communicatively linked in a multi-user communication session.

[0053] In some examples, it may be advantageous to provide mechanisms for facilitating the virtual initiation of communication between users in a three-dimensional environment based on user availability. For example, it may be desirable to provide a first user who wishes to virtually initiate communication with a second user in a three-dimensional environment (e.g., via a call) with an indication of the second user's availability prior to initiating communication. Additionally, in some examples, it may be advantageous to enable a second user receiving a request to initiate communication with a first user to receive visual indications (e.g., notifications) of the request without requiring the second user to be actively using (e.g., wearing) a head-mounted device associated with the second user. In some examples, as described herein, establishing communication between users virtually in a three-dimensional environment includes (e.g., via the user's corresponding electronic device) displaying a visual representation (e.g., a three-dimensional avatar or a two-dimensional user interface) corresponding to the user in the three-dimensional environment. In some examples, as described below, responding to a request to virtually initiate communication with a corresponding user in a three-dimensional environment is based on an "optional exit" response mode via an electronic device associated with the user receiving the request.

[0054] Figures 4A to 4G Examples of facilitating the sending of requests to virtually initiate communication between users in a three-dimensional environment are illustrated according to some examples of this disclosure. In some examples, a first electronic device 101a may present a three-dimensional environment 450A via a display 120a, and a second electronic device 101b may present a three-dimensional environment 450B via a display 120b. The first electronic device 101a and the second electronic device 101b may be similar to electronic device 101 or electronic device 260 / 270, respectively, and / or may be head-mounted systems / devices and / or projection-based systems / devices (including hologram-based systems / devices) configured to generate and present a three-dimensional environment, such as, for example, head-up displays (HUDs), head-mounted displays (HMDs), windows with integrated display capabilities, or displays formed as lenses (e.g., similar to contact lenses) designed to be placed on a person's eyes. In some examples, the first electronic device 101a is configured to communicate with the second electronic device 101b. Figures 4A to 4G In the example, a first user 402 optionally wears a first electronic device 101a, as shown in top view 410, and a second user 404 optionally wears a second electronic device 101b, as shown in top view 412, such that the three-dimensional environment 450A / 450B can be defined by the X-axis, Y-axis, and Z-axis as viewed from the perspective of the electronic device (e.g., the viewpoint associated with the user of the electronic device 101a / 101b).

[0055] like Figure 4AAs shown, the first electronic device 101a may be situated in a first physical environment including window 409 and indoor plant 408. Therefore, the three-dimensional environment 450A presented using the first electronic device 101a optionally includes a captured portion of the first physical environment surrounding the first electronic device 101a (e.g., captured via external image sensors 114b-i and 114c-i), such as a representation of window 409 and indoor plant 408. Similarly, the second electronic device 101b may be situated in a second physical environment different from the first physical environment (e.g., separate from the first physical environment), which includes table 406 and mobile electronic device 460 (e.g., smartphone, tablet, laptop, etc.). Therefore, the three-dimensional environment 450B presented using the second electronic device 101b optionally includes a captured portion of the second physical environment surrounding the second electronic device 101b (e.g., captured via external image sensors 114b-ii and 114c-ii), such as a representation of table 406 and mobile electronic device 460. Additionally, the three-dimensional environments 450A and 450B may include representations of the floor, ceiling, and walls of the rooms in which the first electronic device 101a and the second electronic device 101b are located, respectively. In some examples, the mobile electronic device 460 communicates with the second electronic device 101b.

[0056] In some examples, electronic devices 101a / 101b are configured to initiate communication with the corresponding user in the three-dimensional environment 450A / 450B based on user availability. Figure 4A In this context, the first electronic device 101a detects input corresponding to a request to display a user interface, and initiates communication with the corresponding user via this user interface based on user availability in the three-dimensional environment 450A. For example, as... Figure 4A As shown, the first electronic device 101a detects a press on a hardware element 440 (e.g., a physical button of the first electronic device 101a) provided by the hand 403 of the first user 402.

[0057] In some examples, such as Figure 4B As shown, in response to detecting a selection of hardware element 440, the first electronic device 101a displays a character pickup user interface 430 in a three-dimensional environment 450A. In some examples, the character pickup user interface 430 is associated with the main user interface of the first electronic device 101a. For example, as... Figure 4B As indicated, the character pickup user interface 430 corresponds to a tab 433 of the dashboard associated with the main user interface of the first electronic device 101a. In some examples, other tabs of the dashboard associated with the main user interface enable the first user 402 to launch applications at the first electronic device 101a and / or display a virtual environment within the 3D environment 450A. In some examples, such as Figure 4BAs shown, the character pickup user interface 430 enables the first user 402 to initiate communication with the corresponding user. For example, as Figure 4B As shown, the character pickup user interface 430 includes multiple representations of multiple users, and the first electronic device 101a is configured to initiate communication with these multiple users in a three-dimensional environment 450A. Figure 4B As shown, the character picker user interface 430 optionally includes multiple representations related to the first user (e.g., Sandy, corresponding to...). Figure 4A The first representation 431A associated with the second user (404), the second representation 431B associated with the second user (e.g., Joe), the third representation 431C associated with the third user (e.g., Sam), and the fourth representation 431D associated with the fourth user (e.g., Olivia). In some examples, such as Figure 4B As shown, multiple representations include the user's visual representation associated with the representation. For example, in Figure 4B In this context, multiple representations include images, photos, icons, avatars, sketches, and / or other visual representations of multiple users. In some examples, the multiple users included in the people picker user interface 430 correspond to users belonging to a contact list stored at the first electronic device 101a. In some examples, the multiple users included in the people picker user interface 430 correspond to users suggested to the first user 402 based on factors such as previous user activity (e.g., previous user communications), proximity to those users, and notifications received from those users.

[0058] In some examples, multiple representations of multiple users in the person picker user interface 430 are displayed along with visual indicators of the current status (e.g., availability) of the multiple users. In some examples, a corresponding user who meets one or more first criteria includes a first type of visual indicator indicating that the corresponding user is currently available (e.g., is idle or otherwise not currently occupied at their respective electronic device) to receive a communication request from a first user 402 (e.g., via a first electronic device 101a). For example, as Figure 4B As shown, a first representation 431A associated with user Sandy is displayed together with a visual indication 432A (e.g., a checkmark icon), which provides visual indications that user Sandy is currently able to use for communication. Additionally, as... Figure 4BAs shown, the representations of users Sal and Megan in the character picker user interface 430 are displayed together with a first type of visual indication (e.g., a checkmark icon), which provides visual indications that users Sal and Megan can use to communicate and thus meet one or more first criteria. Additionally or alternatively, in some examples, the first type of visual indication includes the display of a corresponding representation having a specific visual appearance (e.g., a first visual appearance). For example, in Figure 4B In this context, the first representation 431A associated with user Sandy may optionally be displayed with a specific color, brightness level, transparency level, saturation, and / or shadow without displaying any visual indications (such as the representations of users Matt and Will in the person picker user interface 430) to visually indicate that user Sandy is capable of communication.

[0059] In some examples, a corresponding user who does not meet one or more of the first criteria includes a second type of visual indication, different from the first type, indicating that the corresponding user is currently unable to receive communication requests from the first user 402 (e.g., via the first electronic device 101a) (e.g., because the device is currently occupied at its corresponding electronic device). For example, as Figure 4B As shown, a second representation 431B associated with user Joe is displayed together with a visual indication 432B (e.g., an X icon), which provides a visual indication that user Joe is currently unable to use for communication. Additionally, as... Figure 4B As shown, the representation of user Liz in the person picker user interface 430 is displayed along with a second type of visual indicator (e.g., an X icon), which provides visual indication that user Liz is currently unable to communicate and therefore does not meet one or more of the first criteria. Additionally or alternatively, in some examples, the second type of visual indicator includes the display of a corresponding representation with a specific visual appearance (e.g., a second visual appearance). For example, in Figure 4B In this context, the second representation 431B associated with user Joe may optionally be displayed with specific colors, brightness levels, transparency levels, saturation, and / or shadows without showing any visual indications (such as the representations of users Jung and Casey in the person picker user interface 430) to visually indicate that user Joe is unavailable for communication. It should be understood that although a particular user's representation may indicate that the user is unavailable for communication, such as user Joe's second representation 431B, the first user 402 may still initiate communication with that user, although the request to enter into communication may be rejected.

[0060] In some examples, a user is determined to be capable of communication based on the determination that a corresponding electronic device associated with a user among a plurality of users is connected (e.g., determining that one or more first criteria are met). For example, the user is actively using (e.g., wearing) the electronic device. In some examples, a user is determined to be capable of communication based on the determination that the electronic device associated with the user among a plurality of users is within the field of view of one or more cameras of the electronic device (such as internal or external image sensors of the electronic device (e.g., 114a-114c)). In some examples, a user is determined to be capable of communication based on the determination that the user among a plurality of users is within a threshold distance of the electronic device. For example, the proximity between the user and the electronic device may be determined based on the distance between the user and one or more cameras or other sensors of the electronic device and / or based on the distance between the electronic device and mobile electronic devices communicating with the electronic device (such as the distance between the electronic device and a smartphone, smartwatch, tablet, and / or laptop associated with the user and / or the strength of the signal shared between them). As discussed in more detail later herein, the determination that a user is currently capable of communication may not require that the electronic device is currently being worn by the user (e.g., on their head).

[0061] In some examples, alternatively, in addition to displaying or instead of displaying the first and / or second types of visual indicators discussed above, multiple representations for multiple users include visual indicators of the current state or activity of the respective electronic devices associated with the multiple users. For example, such as Figure 4BAs shown, the fourth representation 431D of user Olivia includes a visual indication 432D that indicates the current focus mode of the electronic device associated with user Olivia (e.g., the corresponding mode provided by control notifications), such as a work focus mode similar to the quiet time mode at the electronic device associated with user Olivia (e.g., user Olivia is currently at a work location and / or is actively working). In some examples, a specific focus mode is automatically activated at the electronic device (e.g., in response to detecting that the user is in a specific location specified by the user and / or is interacting with a specific application on the electronic device, which activates the focus mode), or is activated at the electronic device in response to detecting user input for activating the focus mode. As another example, user Erwin's indication is displayed along with a visual indication of a driving / driving focus mode (e.g., the electronic device associated with Erwin is currently in motion, optionally above a predefined threshold (e.g., 1 m / s, 2 m / s, 5 m / s, 10 m / s, 15 m / s, 20 m / s, 30 m / s, etc.), and user Jane's indication is displayed along with a visual indication of a do-not-disturb focus mode (e.g., the electronic device associated with Jane is set to mute incoming notifications). As mentioned above, in some examples, a specific focus mode activated at the electronic device controls whether notifications are muted and / or whether exceptions are applied. For example, a user could configure a specific focus mode to generate notifications for notification events associated with certain contacts (e.g., favorite contacts) and / or applications (e.g., user-selected applications), while muting all other contacts and / or applications. Figure 4BIn the person picker user interface 430, a visual indication of a focus mode active at the indicated electronic device provides an indication of the type of activity (e.g., work or driving) associated with the specific electronic device without providing an indication of the specific application and / or content the user is interacting with, thereby protecting user privacy while providing an indication of user availability. It should be understood that the visual indication of a focus mode does not necessarily indicate whether the corresponding user can or cannot use the device to receive communication requests, but rather provides an indication that the user is currently occupied in another way, which helps inform the user of decisions regarding whether to initiate communication with the device. Therefore, in some examples, the display of the visual indication of a focus mode is optionally independent of one or more of the first criteria relating to user availability discussed above. Alternatively, in some examples, the display of the visual indication of a focus mode is based on the determination that one or more of the first criteria are not met. For example, if a focus mode active at a specific electronic device associated with the user is determined by the first electronic device 101a as an indication that the user is engaged in an activity and therefore cannot currently use the device for communication, the first electronic device 101a displays the user's representation along with the visual indication of a focus mode instead of the first type of visual indication discussed above (e.g., a checkmark icon).

[0062] In some examples, the determination of whether a particular user meets one or more first criteria is based on data including indications of status / availability shared with the first electronic device 101a. For example, electronic devices associated with multiple users represented in the person picker user interface 430 send data to the first electronic device 101a providing indications of the current status (e.g., focus mode status and / or availability) of the multiple users. Figure 4B In one example, an electronic device associated with user Joe sends data to first electronic device 101a indicating that user Joe is currently unable to communicate with first user 402. This causes first electronic device 101a to display a second representation 431B along with a visual indication 432B when displaying the person picker user interface 430 in the 3D environment 450A. Similarly, in some examples, such as Figure 4B As shown, with user Sandy (for example, corresponding to the above) Figure 4A The electronic device associated with the second user (404) (e.g., the one mentioned above) Figure 4AThe second electronic device 101b sends data to the first electronic device 101a indicating that user Sandy is currently able to communicate with the first user 402, causing the first electronic device 101a to display the first indication 431A together with the visual indication 432A. In some examples, the first electronic device 101a receives the data discussed above from the electronic device periodically (e.g., at preset or regular time intervals, such as every 5 seconds, 10 seconds, 15 seconds, 30 seconds, 60 seconds, 90 seconds, 120 seconds, 180 seconds, 300 seconds, etc.). In some examples, the first electronic device 101a receives the data discussed above from the electronic device based on changes and / or updates to the status and / or availability of the user associated with the electronic device. For example, the corresponding electronic device sends updated data to the first electronic device 101a indicating that the focus mode at the corresponding electronic device has been deactivated or activated (e.g., deactivated or activated by the user associated with the corresponding electronic device), that the corresponding electronic device is currently in use or is no longer in use, etc.

[0063] exist Figure 4B In this process, the first electronic device 101a detects input corresponding to a request to initiate communication with the second user 404 of the second electronic device 101b. For example, as... Figure 4B As shown, the first electronic device 101a detects the selection of a first representation 431A among a plurality of representations in the person pickup user interface 430. In some examples, this selection is optionally provided via an air pinch gesture performed by the first user 402’s hand 403 while the first user 402’s gaze 426 is directed toward the first representation 431A in the three-dimensional environment 450A.

[0064] In some examples, such as Figure 4C As shown, in response to detecting a selection of the first representation 431A, the first electronic device 101a initiates communication with the second user 404 at the second electronic device 101b. For example, as Figure 4C As instructed, the first electronic device 101a initiates a call with the second electronic device 101b. In some examples, such as... Figure 4C As shown, initiating communication with the second user 404 includes displaying a user interface object 420 in a three-dimensional environment 450A, which indicates to the first user 402 that communication has been initiated. In some examples, when communication is initiated, the second electronic device 101b receives an indication of a request to initiate communication with the first user 402 at the first electronic device 101a. For example, as... Figure 4C As shown, the second electronic device 101b displays a user interface object 422 (e.g., a notification) corresponding to the incoming request in a three-dimensional environment 450B. In some examples, such as Figure 4CAs shown, the user interface object 422 includes a first option 423A that can be selected to accept an incoming request and a second option 423B that can be selected to reject an incoming request.

[0065] In some examples, when the second electronic device 101b displays the user interface object 422 in the three-dimensional environment 450B, the mobile electronic device 460 displays a notification 424 (e.g., via a display of the mobile electronic device 460, such as a touchscreen of the mobile electronic device 460). In some examples, the notification 424 corresponds to the user interface object 422 displayed at the second electronic device 101b. For example, as... Figure 4C As shown, notification 424 includes a first option 425A that allows selection to accept an incoming request to communicate with the first electronic device 101a and a second option 425B that allows selection to reject the incoming request. In some examples, mobile electronic device 460 displays notification 424 because mobile electronic device 460 is communicating with the second electronic device 101b (e.g., mobile electronic device 460 receives signals or other instructions from the second electronic device 101b to display notification 424). In some examples, mobile electronic device 460 displays notification 424 because mobile electronic device 460 and second electronic device 101b are associated with the same user account of the second user 404. For example, the second user 404 is logged into the same user account on the second electronic device 101b and mobile electronic device 460, causing mobile electronic device 460 to receive the same or similar requests from the first electronic device 101a as those from the second electronic device 101b.

[0066] In some examples, such as Figure 4C As shown, the second electronic device 101b detects an indication from the first electronic device 101a to accept a request to enter into communication with the first user 402 at the first electronic device 101a. For example, as Figure 4C As shown, the second electronic device 101b detects the selection of a first option 423A of the user interface object 422, such as via an air pinch gesture performed by the hand 403 while the gaze 426 points to the first option 423A. Alternatively, in some examples, detecting an indication to accept a request from the first electronic device 101a includes determining that a threshold amount of time (e.g., 1 second, 2 seconds, 3 seconds, 4 seconds, 5 seconds, 8 seconds, 10 seconds, etc.) has elapsed since the user interface object 422 was displayed in the three-dimensional environment 450B, without receiving any user input (e.g., via the selection of a second option 423B). For example, from Figures 4C to 4D As indicated in time bar 436, the second electronic device 101b determines that time 437 has elapsed since the user interface object 422 was displayed in the three-dimensional environment 450B.

[0067] In some examples, such as Figure 4D As shown, in response to detecting an indication to accept a request from the first electronic device 101a to enter into communication with the first user 402 at the first electronic device 101a, the first electronic device 101a and the second electronic device 101b enter into a communication session (e.g., as referenced above). Figure 3 (The multi-user communication session under discussion). For example, such as Figure 4D As shown, the first electronic device 101a displays an avatar 414 corresponding to the second user 404 in a three-dimensional environment 450A, and the second electronic device 101b displays an avatar 416 corresponding to the first user 402 in a three-dimensional environment 450B. In some examples, avatars 414 / 416 have the features described above. Figure 3 The description of one or more characteristics of the incarnation 315 / 317.

[0068] Figure 4E An alternative example is shown where the second user 404 denies a request to enter into communication with the first user 402. For example, as... Figure 4E As shown, when the second electronic device 101b is displaying a user interface object 422 including a first option 423A and a second option 423B in a three-dimensional environment 450B, the second electronic device 101b detects the selection of the second option 423B. Figure 4E As shown, prior to a threshold time interval 437 elapsed since the user interface object 422 was displayed in the 3D environment 450B, while the second user 404's gaze 426 is directed towards the second option 423B, the second electronic device 101b optionally detects an air pinch gesture performed by the second user 404's hand 405A. Alternatively, in some examples, such as Figure 4E As shown, the mobile electronic device 460 detects the selection of the second option 425B of the notification 424 displayed on the mobile electronic device 460. For example, as Figure 4E As shown, before a threshold time 437 has elapsed since the notification 424 was displayed on the mobile electronic device 460, the mobile electronic device 460 detects a tap pointing to the second option 425B displayed on the touchscreen of the mobile electronic device 460.

[0069] In some examples, such as Figure 4F As shown, in response to detecting an indication that a request to deny access to communication with the first user 402 has been detected, the second electronic device 101b displays a user interface 428 in the three-dimensional environment 450B. This user interface includes options for sending a response to the first user 402 without entering a communication session with the first electronic device 101a. For example, as... Figure 4FAs shown, the user interface 428 includes a first option 429A that can be selected to send a default response (e.g., specified by the second electronic device 101b) to the first user 402, a second option 429B that can be selected to send a message (e.g., "I'll call you later") to the first user, and a third option 429C that can be selected to send a custom reply (e.g., a message selected by the user) to the first user 402. In some examples, such as Figure 4F As shown, the mobile electronic device 460 displays a user interface 438 corresponding to the user interface 428, which includes the same or similar response options.

[0070] exist Figure 4F In this context, the second electronic device 101b detects the selection of the first option 429A in the user interface 428 within the three-dimensional environment 450B. For example, as... Figure 4F As shown, optionally, while the gaze 426 of the second user 404 is directed to the first option 429A in the three-dimensional environment 450B, the second electronic device 101b detects an air pinch gesture performed by the hand 405 of the second user 404. In some examples, in response to detecting a selection of the first option 429A, the second electronic device 101b sends a response to the first electronic device 101a based on the first option 429A. For example, as Figure 4G As shown, when the second electronic device 101b sends a reply to the first electronic device 101a, the first electronic device 101a displays a message element 418 in the three-dimensional environment 450A. This message element includes a default reply selected by the second user 404 (e.g., "User 2 is unavailable"). Additionally, as mentioned above, the second electronic device 101b abandons entering a communication session with the first electronic device 101a. For example, as... Figure 4G As shown, the first electronic device 101a abandons displaying the avatar corresponding to the second user 404 (e.g., avatar 414), and the second electronic device 101b abandons displaying the avatar corresponding to the first user 402 (e.g., avatar 416).

[0071] Now let’s turn our attention to examples of facilitating communication between users in a three-dimensional environment without one user actively wearing their electronic devices.

[0072] Figures 5A to 5J Examples of virtually facilitating communication between users in a three-dimensional environment are illustrated according to some examples of this disclosure. In some examples, the first user 502 and the second user 504 respectively correspond to... Figures 4A to 4G The first user is 402 and the second user is 404.

[0073] like Figure 5AAs shown, the first electronic device 101a is (e.g., via display 120a) presenting a three-dimensional environment 550A. Figure 5A In this context, as discussed similarly above, the three-dimensional environment 550A includes a representation (e.g., a transparent representation or a computer-generated representation) of the first physical environment of the first electronic device 101a. For example, as... Figure 5A As shown in the top view 510, the first physical environment includes indoor plants 508 and a window 509. Therefore, as Figure 5A As shown, the three-dimensional environment 550A presented using the first electronic device 101a includes representations of indoor plants 508 and windows 509 (e.g., indoor plants 508 and windows 509 are visible in the field of view of the first electronic device 101a). In some examples, the three-dimensional environment 550A has one or more of the characteristics of the three-dimensional environment 450A discussed above.

[0074] Additionally, in some examples, such as Figure 5A As shown, the second user 504 is located in a second physical environment 500, which is different from the first physical environment. This second physical environment includes a table 506 and a mobile electronic device 560. Additionally, as... Figure 5A As shown and indicated in top view 512, a second electronic device 101b, including a display 120b, is positioned on a table 506 in the second physical environment 500. In some examples, such as Figure 5A As shown, the second user 504 is not currently using (e.g., wearing) the second electronic device 101b in the second physical environment 500. Additionally, in Figure 5A In this configuration, the second user 504 is positioned in front of the table 506, facing the second electronic device 101b and the mobile electronic device 560. In some examples, the second electronic device 101b is configured to communicate with the mobile electronic device 560. In some examples, the second electronic device 101b and the mobile electronic device are associated with the same user account as the second user 504. For example, the second user 504 is logged into the same user account on both the second electronic device 101b and the mobile electronic device 560. Figure 5A In the example, the second electronic device 101b is turned on (e.g., in sleep or low power state).

[0075] exist Figure 5A In this context, the first electronic device 101a detects input corresponding to a request to display a user interface, and initiates communication with the corresponding user via this user interface based on user availability in the three-dimensional environment 550A. For example, as... Figure 5A As shown, the first electronic device 101a detects a press on a hardware element 540a (e.g., a physical button of the first electronic device 101a) provided by the hand 503 of the first user 502.

[0076] In some examples, such as Figure 5B As shown, in response to the detection of a selection of hardware element 540a, the first electronic device 101a displays a person picker user interface 530 in the three-dimensional environment 550A. In some examples, the person picker user interface 530 corresponds to the person picker user interface 430 described above. In some examples, as discussed similarly above, the person picker user interface 530 includes multiple representations of multiple users, with the first user 502 able to initiate communication with these multiple users in the three-dimensional environment 550A.

[0077] In some examples, such as Figure 5B As shown, the multiple representations of multiple users in the character picker user interface 530 include the first user (e.g., Sandy, corresponding to...). Figure 5A The first representation 531A is for the second user 504. In some examples, as previously discussed above, user Sandy (e.g., second user 504) meets one or more of the first criteria discussed above, indicating that user Sandy is capable of communicating with first user 502 in the three-dimensional environment 550A. For example, as previously discussed above, first electronic device 101a displays the first representation 531A together with a visual indication 532A indicating that second user 504 is capable of communicating. In some examples, although second electronic device 101b is not currently worn by second user 504, such as Figure 5B As indicated in top view 512, however, the second user 504 meets one or more of the first criteria discussed above. For example, as... Figure 5B As shown in top view 512, the second user 504 is positioned within the field of view of the second electronic device 101b (e.g., and therefore detectable by one or more sensors of the activated second electronic device 101b, such as image sensors, like a camera). Additionally or alternatively, in some examples, the second user 504 meets one or more first criteria because the second user 504 is positioned within a threshold distance 515 (e.g., 0.1 m, 0.2 m, 0.5 m, 1 m, 2 m, 3 m, 5 m, 10 m, 15 m, etc.) of the second electronic device 101b. Therefore, as mentioned above, the first representation 531A associated with the second user 504 optionally includes a visual indication 532A indicating that the second user 504 is capable of communication.

[0078] exist Figure 5B In this context, the first electronic device 101a detects input corresponding to a request to initiate communication with the second user 504 within the three-dimensional environment 550A. For example, such as... Figure 5B As shown, optionally while gazing 526 toward the first representation 531A in the three-dimensional environment 550A, the first electronic device 101a detects an air pinch gesture performed by the hand 503 of the first user 502.

[0079] In some examples, such as Figure 5C As shown, in response to detecting a selection of the first representation 531A in the person pickup user interface 530, the first electronic device 101a sends an instruction to the second electronic device 101b to request entry into a communication session with the first user 502. For example, as Figure 5C As shown, and similarly discussed above, the first electronic device 101a displays a user interface object 520 indicating that the first electronic device 101a has initiated communication with the second user 504 at the second electronic device 101b. In some examples, such as Figure 5C As shown, in response to receiving an instruction to enter a communication session with the first user 502, the second electronic device 101b displays a notification 524, which includes a first option 525A that can be selected to accept the request and a second option 525B that can be selected to reject the request (e.g., and abandon entry into the communication session with the first user 502). In some examples, such as Figure 5C As indicated in the instructions, because the second user 504 is not wearing the second electronic device 101b when the instruction to request is received (e.g., as determined by one or more sensors of the second electronic device 101b, such as internal image sensors and / or external image sensors 114a-114c, as discussed similarly above), the second electronic device 101b displays notification 524 on the outer surface of the display 120b (e.g., the surface facing the second user 504 from the viewpoint of the second user 504). For example, the second electronic device 101b displays notification 524 opposite to the inner surface of the display 120b (e.g., the surface facing the second user 504 from the viewpoint of the second user 504). Figures 4A to 4G The notification 524 is displayed on the surface of the display 120b (opposite to the surface of the display 120b) of the second electronic device 101b illustrated in the example. In some examples, such as Figure 5C As indicated, displaying notification 524 at the second electronic device 101b includes providing sound-based feedback at the second electronic device 101b. For example, the second electronic device 101b outputs audio 517 via one or more speakers of the second electronic device 101b, corresponding to an incoming request indicating entry into a communication session with the first user 502, such as a ringtone, melody, or chime. In some examples, displaying notification 524 at the second electronic device 101b includes providing haptic feedback (e.g., vibration feedback) at the second electronic device 101b.

[0080] Additional or alternative locations, in some examples, such as Figure 5C As shown, the mobile electronic device 560 displays a notification 524 including a first option 525A and a second option 525B (e.g., via the display of the mobile electronic device 560, such as a touchscreen). For example, as Figure 5CAs shown, because mobile electronic device 560 communicates with second electronic device 101b, when second electronic device 101b receives a request from first electronic device 101a, second electronic device 101b sends a signal of the request or other indication to mobile electronic device 560, causing mobile electronic device 560 to display notification 524 (e.g., in addition to or as an alternative to second electronic device 101b displaying notification 524). Alternatively, in some examples, mobile electronic device 560 displays notification 524 (e.g., in addition to or as an alternative to second electronic device 101b displaying notification 524) because mobile electronic device 560 and second electronic device 101b are associated with the same user account associated with second user 504, as discussed similarly above.

[0081] exist Figure 5C In the event that notification 524 is displayed at the second electronic device 101b and / or the mobile electronic device 560, the second electronic device 101b detects an interaction with itself, which corresponds to the association between the second electronic device 101b and the header of the second user 504. For example, as Figure 5C As illustrated, the second user 504 may pick up the second electronic device 101b, such as via the hand 505 of the second user 504, and place and / or attach the second electronic device 101b to the head of the second user 504, as... Figure 5D The top view 512 is shown in the figure.

[0082] In some examples, such as Figure 5D As shown, when the head of the second user 504 becomes associated with the second electronic device 101b (e.g., the second electronic device 101b is placed on the head of the second user 504), the second electronic device 101b presents a three-dimensional environment 550B via the display 120b. In some examples, such as Figure 5D As shown, the three-dimensional environment 550B presented using the second electronic device 101b optionally includes a captured portion of the second physical environment (e.g., the second physical environment 500 above) surrounding the second electronic device 101b (e.g., captured via external image sensors 114b-ii and 114c-ii), such as a representation of a table 506 and a representation of a mobile electronic device 560.

[0083] In some examples, such as Figure 5D As shown, in the display Figure 5CFollowing notification 524, the second electronic device 101b begins tracking the elapsed time indicated in time bar 536. As discussed earlier herein, in some examples, entering a communication session with the first user 502 at the first electronic device 101a can be based on an "opt-out" response model. For example, as discussed above, based on the determination of a threshold time amount 537 since notification 524 was displayed on the second electronic device 101b (e.g., and / or mobile electronic device 560), and without detecting input from the second user 504 indicating a refusal to enter the communication session with the first user 502, the second electronic device 101b enters the communication session with the first user 502 at the first electronic device 101a.

[0084] from Figures 5D to 5E The second electronic device 101b determines that a threshold time 537 has elapsed since the display notification 524, and no input indicating that the second user 504 has refused to enter a communication session with the first user 502 has been detected. Therefore, in some examples, the second electronic device 101b sends an indication to the first electronic device 101a to accept the request, which establishes communication between the first electronic device 101a and the second electronic device 101b, such as... Figure 5E As indicated in the text. In some examples, such as... Figure 5E As shown, and similarly discussed above, when the first electronic device 101a and the second electronic device 101b enter a communication session, the first electronic device 101a displays an avatar 514 corresponding to the second user 504 in a three-dimensional environment 550A, and the second electronic device 101b displays an avatar 516 corresponding to the first user 502 in a three-dimensional environment 550B. In some examples, avatars 514 / 516 have the features described above. Figure 3 The description refers to one or more characteristics of incarnation 315 / 317. In some examples, the communication session has the features mentioned above. Figure 3 One or more characteristics of a multi-user communication session are described.

[0085] In some examples, the second user 504 can provide instructions to respond to requests for communication with the first user 502 at the first electronic device 101a without wearing the second electronic device 101b. For example, in Figure 5F In this context, while the second electronic device 101b (e.g., and / or mobile electronic device 560) is displaying notification 524, the second electronic device 101b detects a selection of the first option 525A. In some examples, such as Figure 5F As shown, the second electronic device 101b detects the selection of the first option 525A via interaction with a hardware element 540B (e.g., a physical button or dial pad). For example, as Figure 5FAs shown, optionally when the first option 525A has focus (e.g., an indication of focus is displayed in notification 524), the second electronic device 101b detects a press (e.g., a single press) on the hardware element 540B provided by the hand 505A of the second user 504. Alternatively, in some examples, the second electronic device 101b detects the selection of the first option 525A via an air gesture performed by the hand 505B of the second user 504. For example, as Figure 5F As shown, the second electronic device 101b detects that the hand 505B performs an air tap gesture pointing to the first option 525A displayed on the outer surface of the display 120b, as discussed above. In some examples, the second electronic device 101b detects the air gesture performed by the hand 505B via one or more image sensors of the second electronic device 101b (e.g., one or more cameras, similar to the external image sensors 114b-ii and 114c-ii discussed above), which are activated when the notification 524 is displayed by the second electronic device 101b.

[0086] Alternatively, in some examples, the mobile electronic device 560 detects the selection of the first option 525A in the notification 524 (e.g., instead of the second electronic device 101b detecting the selection in the manner discussed above). In some examples, such as Figure 5F As shown, the mobile electronic device 560 detects selection of the first option 525A via a tap of a finger pointing to the first option 525A (such as a tap of the finger of the hand 505B on the touchscreen of the mobile electronic device 560 pointing to the first option 525A). It should be understood that the mobile electronic device 560 may also detect selection of the first option 525A via alternative methods (such as by clicking or pressing a button on an input device communicating with the mobile electronic device 560 (e.g., a mouse or touchpad press)).

[0087] In some examples, in response to detecting a selection of the first option 525A (e.g., at the second electronic device 101b or mobile electronic device 560), the second electronic device 101b sends an indication to the first electronic device 101a to accept a request to enter into communication with the first user 502, as discussed similarly above. In some examples, such as Figure 5G As shown, when the first electronic device 101a and the second electronic device 101b enter a communication session, the first user 502 and the second user 504 are non-spatially represented at their respective electronic devices. For example, as Figure 5G As shown, the first electronic device 101a and the second electronic device 101b refrain from displaying the user's avatar (e.g., a three-dimensional representation) in the communication session. Instead, as Figure 5GAs shown, the first electronic device 101a displays a virtual conference user interface 542 in a three-dimensional environment 550A, which includes a two-dimensional representation of the second user 504. For example, in Figure 5G In this virtual conference user interface 542, a two-dimensional image (e.g., photo, icon, cartoon, sketch, etc.) of the second user 504 is included. In some examples, the virtual conference user interface 542 includes a two-dimensional camera feed of the field of view of one or more cameras of the second electronic device 101b, the two-dimensional camera feed including the second user 504 positioned within the field of view of the one or more cameras. Additionally, in some examples, the virtual conference user interface 542 includes multiple controls that can be selected to perform one or more operations associated with a communication session. For example, such as... Figure 5G As shown, the virtual meeting user interface 542 includes options 543A for selecting to change and / or select an audio output source (e.g., speakers, headphones, etc.), 543B for selecting to turn the video feed of the first user 502 on or off (e.g., controlling one or more cameras of the first electronic device 101a), 543C for selecting to mute the voice of the first user 502 (e.g., controlling one or more microphones of the first electronic device 101a), 543D for selecting to share content with the second user 504 (e.g., performing a screen sharing operation), and / or 543E for selecting to end the communication session between the first user 502 and the second user 504.

[0088] Similarly, such as Figure 5G As shown, in some examples, the second electronic device 101b and / or the mobile electronic device 560 display a conference user interface 544, which corresponds to and / or includes a two-dimensional representation of the first user 502. For example, as Figure 5G As shown, the conference user interface 544 includes an image of the first user 502 or a video feed from one or more cameras of the first electronic device 101a, the video feed including the first user 502 (e.g., captured by image sensors 114a-i) or a representation of the first user 502 (e.g., a two-dimensional avatar of the first user 502). Additionally, in some examples, such as Figure 5G As shown, the conference user interface 544 includes multiple controls that can be selected to perform one or more operations associated with the communication session, such as options 545A to 545E (e.g., corresponding to options 543A to 543E discussed above). In some examples, such as Figure 5GAs shown, when the second electronic device 101b enters a communication session with the first electronic device 101a, the second electronic device 101b (e.g., and / or mobile electronic device 560) outputs audio 517 corresponding to the voice of the second user 504. For example, the audio 517 includes speech captured by one or more microphones of the first electronic device 101a, which is transmitted (e.g., wirelessly) to the second electronic device 101b for output at the second electronic device 101b (e.g., and / or mobile electronic device 560) during communication session activity.

[0089] exist Figure 5G In the communication session between the second electronic device 101b and the first electronic device 101a, the second electronic device 101b detects interactions with the first electronic device 101a, which correspond to the association between the second electronic device 101b and the second user 504's header. For example, as... Figure 5G As illustrated, the second user 504 may pick up the second electronic device 101b, such as via the hand 505 of the second user 504, and place and / or attach the second electronic device 101b to the head of the second user 504, as... Figure 5H The top view 512 is shown in the figure.

[0090] In some examples, such as Figure 5H As shown, when the head of the second user 504 becomes associated with the second electronic device 101b (e.g., the second electronic device 101b is placed on the head of the second user 504), the second electronic device 101b presents a three-dimensional environment 550B via the display 120b. In some examples, such as Figure 5H As shown, the three-dimensional environment 550B presented using the second electronic device 101b optionally includes a captured portion of a second physical environment (e.g., the second physical environment 500 above) surrounding the second electronic device 101b (e.g., captured via external image sensors 114b-ii and 114c-ii), such as a representation of a table 506 and a representation of a mobile electronic device 560. Additionally, in some examples, such as Figure 5H As illustrated, when the second electronic device 101b is positioned on the head of the second user 504, the communication session between the first electronic device 101a and the second electronic device 101b is converted to a spatial communication session. In some examples, the conversion to a spatial communication session includes representing the participants in the communication session as three-dimensional representations with spatial realism in a shared three-dimensional environment. For example, as... Figure 5HAs shown, the first electronic device 101a displays an avatar 514 of the second user 504 in a three-dimensional environment 550A (e.g., instead of the virtual conference user interface 542), and the second electronic device 101b displays an avatar 516 of the first user 502 in a three-dimensional environment 550B (e.g., and stops displaying the conference user interface 544 on the outer surface of the display 120b).

[0091] Figures 5I to 5J An example is shown where the second user 504 provides input corresponding to rejecting a request from the first user 502 to enter a communication session. For example, in Figure 5I In the event that the second electronic device 101b and / or mobile electronic device 560 is displaying a notification 524 corresponding to a request to enter a communication session with the first user 502, the second electronic device 101b and / or mobile electronic device 560 detects input corresponding to rejecting the request from the first user 502 to enter the communication session. In some examples, as discussed similarly above, the input includes or corresponds to an interaction with the hardware element 540B of the second electronic device 101b. For example, as... Figure 5I As shown, optionally when the second option 525B has focus in notification 524, the second electronic device 101b detects a press, rotation, and / or click on the hardware element 540B provided by the hand 505A of the second user 504. Alternatively, in some examples, such as Figure 5I As shown, the second electronic device 101b (e.g., and / or mobile electronic device 560) detects the selection of the second option 525B provided by the hand 505B of the second user 504. For example, as Figure 5I As shown, the second electronic device 101b detects air gestures performed by a hand 505B pointing at the second option 525B, such as an air tap or air pinch gesture (e.g., detected via one or more cameras of the second electronic device 101b). In some examples, the mobile electronic device 560 detects the selection of the second option 525B performed by the hand 505B via an input device of the mobile electronic device 560 (such as a touchscreen, touchpad, mouse, or other button of the mobile electronic device 560). For example, in Figure 5I In this process, the mobile electronic device 560 detects a touch (e.g., a finger of the hand 505B) pointing at the second option 525B on the touchscreen of the mobile electronic device 560. In some examples, such as Figure 5I As indicated in the text, the second electronic device 101b (e.g., and / or mobile electronic device 560) detects the selection of the second option 525B before the threshold time amount 537 in the time bar 536 has elapsed since the display notification 524, as discussed similarly above.

[0092] In some examples, such as Figure 5JAs shown, in response to detecting a selection of the second option 525B in notification 524 before a threshold time amount 537 has elapsed since notification 524 was displayed, the second electronic device 101b sends an indication to the first electronic device 101a to refuse entry into the communication session with the first user 502. Additionally, in some examples, such as Figure 5J As shown, the second electronic device 101b waives (e.g., on the outward-facing surface of the display 120b) the display of a visual representation (e.g., an avatar or a two-dimensional user interface) of the first user 502. In some examples, such as Figure 5J As shown, when the first electronic device 101a receives an indication of a rejection request from the second electronic device 101b, the first electronic device 101a displays a message element 518 in the three-dimensional environment 550A that includes a default response (e.g., “User 2 is unavailable”) that is not necessarily selected by the second user 504. Additionally, as discussed similarly above, because the second electronic device 101b abandons entering a communication session with the first electronic device 101a, the first electronic device 101a abandons displaying a visual representation of the second user 504 in the three-dimensional environment 550A.

[0093] Therefore, as outlined above, a method is provided for easily and efficiently initiating communication between users at their respective electronic devices without requiring the receiving user to actively wear their electronic device. This has the benefit of simplifying and / or reducing the user interaction required to initiate communication.

[0094] It should be understood that the examples shown and described herein are merely exemplary, and additional and / or alternative elements for initiating communication between users may be provided within a three-dimensional environment. It should be understood that the appearance, shape, form, and size of each of the various user interface elements and objects shown and described herein are exemplary, and alternative appearances, shapes, forms, and / or sizes may be provided. For example, virtual objects representing user interfaces (user interface objects 420 and 520 and / or conference user interfaces 542 and 544) may be provided in alternative shapes (such as circular shapes, triangular shapes, etc.) other than rectangular shapes. In some examples, various selectable power representations described herein (e.g., selectable options 425A, 425B, 525A, 525B, 543A-543E, and / or 545A-545E) may be verbally selected via user verbal commands (e.g., verbal commands such as “select an option” or “select a virtual object”). Additionally or alternatively, in some examples, the various options, user interface elements, control elements, etc., described herein can be selected and / or manipulated via user input received through one or more separate input devices in communication with the electronic device. For example, selection input can be received via a physical input device (such as a mouse, touchpad, keyboard, etc.) in communication with the electronic device.

[0095] Figure 6 Flowcharts illustrating example processes for facilitating the sending of requests to virtually initiate communication between users in a three-dimensional environment are shown, according to some examples of this disclosure. In some examples, process 600 begins at a first electronic device communicating with one or more displays and one or more input devices. In some examples, the first electronic device and the second electronic device are optionally similar to or corresponding to... Figure 2 Electronic devices 260 and 270 and / or Figure 1 The head-mounted display of electronic device 101. For example... Figure 6 As shown, in some examples, at 602, when a user interface comprising multiple representations of multiple users is presented in a three-dimensional environment via one or more displays, wherein one or more of the multiple users meet one or more first criteria and one or more of the multiple representations of the one or more users are displayed with a first visual appearance, a first electronic device detects a first input directed to the user interface via one or more input devices, the first input corresponding to a request from a user initiating communication with a second electronic device. For example, as... Figure 4B As shown, when the first electronic device 101a is displaying the person pickup user interface 430 in the three-dimensional environment 450A, the first electronic device 101a detects the interaction provided by the hand 403 of the first user 402 with the person pickup user interface 430. Figure 4A The selection of the first representation 431A corresponding to the second user 404, wherein the second user 404 is currently available for communication.

[0096] In some examples, at step 604, in response to receiving the first input, the first electronic device stops displaying the user interface and sends an instruction to initiate communication with the user of the second electronic device. For example, as... Figure 4C As shown, after stopping the display of the character pickup user interface 430 in the 3D environment 450A, the first electronic device 101a displays a user interface object 420 indicating that an instruction to initiate communication with the second user 404 has been sent to the second electronic device 101b. In some examples, at 606, after sending the instruction, the first electronic device 101a receives an instruction in response to the user's request to initiate communication with the second electronic device. For example, as... Figure 4C As shown, the second electronic device 101b detects input provided by the second user 504, which corresponds to a response to a request via the user interface object 422.

[0097] In some examples, at 608, in response to receiving an instruction, at 610, based on a determination corresponding to accepting a request to initiate communication with the second electronic device, the first electronic device 101a establishes communication with the second electronic device, including displaying a visual representation of the user of the second electronic device in a three-dimensional environment via one or more displays. For example, as... Figure 4D As shown, in response to receiving an instruction to select a first option 423A in user interface object 422 detected at the second electronic device 101b, the first electronic device 101a displays an avatar 414 of the second user 404 in a three-dimensional environment 450A. In some examples, at 612, based on a determination that the response corresponds to a request to refuse to initiate communication with the user of the second electronic device, the first electronic device displays a user interface object associated with the response in the three-dimensional environment. For example, as Figure 4G As shown, in response to receiving an address in Figure 4E Upon receiving an indication of selection of the second option 423B in the user interface object 422 from the second electronic device 101b, the first electronic device 101a displays a message element 418 indicating that the second user 404 cannot use it for communication.

[0098] It should be understood that process 600 is an example, and more, fewer, or different operations may be performed in the same or different order. Additionally, the operations in process 600 described above may optionally be performed by running an information processing device such as a general-purpose processor (e.g., as per [reference to...]). Figure 2 (as described) or one or more functional modules in a dedicated chip and / or by Figure 2 It is implemented using other components.

[0099] Figure 7Flowcharts illustrating example processes for facilitating a response to a request to virtually initiate communication between users in a three-dimensional environment are shown, according to some examples of this disclosure. In some examples, process 700 begins at a first electronic device communicating with one or more displays and one or more input devices. In some examples, the first electronic device and the second electronic device are optionally similar to or corresponding to... Figure 2 Electronic devices 260 and 270 and / or Figure 1 The head-mounted display of electronic device 101. For example... Figure 7 As shown, in some examples, at 702, the first electronic device detects a first indication of a request to initiate communication with the user of the second electronic device. For example, from Figures 5B to 5C The second electronic device 101b detects an indication of a request to initiate communication with the first user 502 of the first electronic device 101a.

[0100] In some examples, at 704, in response to detecting a first indication, the first electronic device displays a notification corresponding to the first indication on the outward-facing surface of one or more displays. For example, as... Figure 5C As shown, the second electronic device 101b displays notification 524 on the outward-facing surface of display 120b. In some examples, at 706, when displaying the notification, the first electronic device detects a second indication via one or more input devices to accept a request from a user initiating communication with the second electronic device. For example, as... Figure 5C As illustrated, the second electronic device 101b detects input provided by the hand 505 of the second user 504, which corresponds to accepting a request to initiate communication with the first user 502.

[0101] In some examples, at 708, in response to the detection of a second indication, the first electronic device establishes communication with the second electronic device. In some examples, at 710, based on a determination that the first electronic device is associated with a first portion of the user of the first electronic device when the second indication is detected, the first electronic device displays a visual representation of the user of the second electronic device in a three-dimensional environment via one or more displays. For example, as... Figure 5E As shown, in response to Figure 5D The system detects that the second user 504 has placed the second electronic device 101b on the head of the second user 504, and the second electronic device 101b displays the avatar 516 of the first user 502 in the three-dimensional environment 550B. In some examples, at 712, based on the determination that the first electronic device is not associated with the first part of the user of the first electronic device when the second instruction is detected, the first electronic device outputs audio corresponding to the voice of the second user transmitted by the second electronic device via one or more speakers communicating with the first electronic device. For example, as Figure 5G As shown, in response to Figure 5F If the selection of the first option 525A in the notification 524 provided by the second user 504 is detected when the second electronic device 101b is not detected to be placed on the head of the second user 504, the second electronic device 101b outputs audio 517 corresponding to the voice of the first user 502 sent by the first electronic device 101a.

[0102] It should be understood that process 700 is an example, and more, fewer, or different operations may be performed in the same or different order. Additionally, the operations in process 700 described above may optionally be performed by running an information processing device such as a general-purpose processor (e.g., as per [reference to...]). Figure 2 (as described) or one or more functional modules in a dedicated chip and / or by Figure 2 It is implemented using other components.

[0103] Therefore, based on the foregoing, some examples of this disclosure relate to a method comprising, at a first electronic device communicating with one or more displays and one or more input devices: while presenting a user interface comprising multiple representations of multiple users in a three-dimensional environment via one or more displays, wherein one or more of the multiple users satisfy one or more first criteria and one or more of the multiple representations of the one or more users are displayed with a first visual appearance, detecting, via one or more input devices, a first input pointing to the user interface, the first input corresponding to a request for communication initiated by a user with a second electronic device; in response to receiving the first input, stopping the display of the user interface and sending an indication to the user who initiated the request for communication with the second electronic device; after sending the indication, receiving an indication of a response to the request for communication initiated by the user with the second electronic device; and in response to receiving the indication, establishing communication with the second electronic device based on a determination that the response corresponds to accepting the request for communication initiated by the user with the second electronic device, including displaying the visual representation of the user of the second electronic device in the three-dimensional environment via one or more displays, and displaying a user interface object associated with the response in the three-dimensional environment based on a determination that the response corresponds to rejecting the request for communication initiated by the user with the second electronic device.

[0104] Additionally or alternatively, in some examples, one or more first criteria are based on indications of user availability. Additionally or alternatively, in some examples, one or more first criteria include criteria satisfied when a corresponding user among a plurality of users is using a corresponding electronic device configured to communicate with a first electronic device. Additionally or alternatively, in some examples, one or more first criteria include criteria satisfied when a corresponding user among a plurality of users is within the field of view of one or more cameras of a corresponding electronic device associated with the corresponding user, and wherein the corresponding electronic device is configured to communicate with the first electronic device. Additionally or alternatively, in some examples, one or more first criteria include criteria satisfied when a corresponding user among a plurality of users is within a threshold distance of a corresponding electronic device associated with the corresponding user, and wherein the corresponding electronic device is configured to communicate with the first electronic device. Additionally or alternatively, in some examples, one or more first criteria include criteria satisfied when the communication state of a corresponding user among a plurality of users is a first communication state and not satisfied when the communication state of the corresponding user is a second communication state different from the first communication state. Additionally or alternatively, in some examples, one or more second representations among a plurality of representations of one or more users among a plurality of users who do not satisfy one or more first criteria are displayed with a second visual appearance different from the first visual appearance. Additionally or alternatively, in some examples, displaying one or more first representations with a first visual appearance includes displaying a first type of visual indication, and displaying one or more second representations with a second visual appearance includes displaying a second type of visual indication different from the first type. Additionally or alternatively, in some examples, the first type of visual indication provides an indication that a corresponding user among a plurality of users can use it to receive a communication request, and the second type of visual indication provides an indication that a corresponding user among a plurality of users cannot use it to receive a communication request.

[0105] Additionally or alternatively, in some examples, in response to detecting interaction with hardware components of the first electronic device, a user interface including multiple representations of multiple users is displayed in a three-dimensional environment. Additionally or alternatively, in some examples, the visual representation of a user of the second electronic device corresponds to a three-dimensional avatar of the user of the second electronic device. Additionally or alternatively, in some examples, the user interface object associated with a response includes a response message selected by the user of the second electronic device. Additionally or alternatively, in some examples, the user interface object associated with a response includes an indication that the user of the second electronic device cannot be used for communication. Additionally or alternatively, in some examples, presenting the visual representation of the user of the second electronic device includes outputting audio corresponding to the voice of the user of the second electronic device via one or more speakers communicating with the first electronic device. Additionally or alternatively, in some examples, the first and second electronic devices include head-mounted displays.

[0106] Some examples of this disclosure relate to a method comprising, at a first electronic device communicating with one or more displays and one or more input devices: detecting a first indication of a request for communication with a user of a second electronic device; in response to detecting the first indication, displaying a notification corresponding to the first indication on an outward-facing surface of the one or more displays; while displaying the notification, detecting a second indication via the one or more input devices of accepting the request for communication with the user of the second electronic device; and in response to detecting the second indication, establishing communication with the second electronic device, including, based on a determination that the first electronic device is associated with a first portion of the user of the first electronic device when the second indication is detected, displaying a visual representation of the user of the second electronic device in a three-dimensional environment via the one or more displays, and based on a determination that the first electronic device is not associated with a first portion of the user of the first electronic device when the second indication is detected, outputting audio corresponding to the speech of the user of the second electronic device transmitted by the second electronic device via one or more speakers communicating with the first electronic device.

[0107] Additionally or alternatively, in some examples, when the first electronic device detects the first indication, the first electronic device communicates with the mobile electronic device, and when the first electronic device detects the first indication, concurrently displays a second notification corresponding to the first indication via the display of the mobile electronic device. Additionally or alternatively, in some examples, detecting the second indication to accept a request to initiate communication with the user of the second electronic device includes receiving a corresponding indication from the mobile electronic device for input pointing to the second notification detected by the mobile electronic device. Additionally or alternatively, in some examples, determining the association between the first electronic device and a first portion of the user of the first electronic device when the second indication is detected includes detecting that the first electronic device is worn on the head of the user of the first electronic device. Additionally or alternatively, in some examples, detecting the second indication to accept a request to initiate communication with the user of the second electronic device includes determining that a threshold time has elapsed since the detection that the first electronic device is worn on the head of the user of the first electronic device. Additionally or alternatively, in some examples, the method further includes: activating one or more microphones communicating with the first electronic device based on a determination that the first electronic device is not associated with a first part of the user of the first electronic device when the second indication is detected; detecting speech input provided by the user of the first electronic device via the one or more microphones when the one or more microphones are active; and in response to detecting the speech input, sending data indicating audio corresponding to the speech input to a second electronic device.

[0108] Additionally or alternatively, in some examples, detecting a second indication to accept a request for communication initiated by a user of the second electronic device includes detecting interaction with hardware components of the first electronic device. Additionally or alternatively, in some examples, detecting a second indication to accept a request for communication initiated by a user of the second electronic device includes detecting an air gesture performed by the user of the first electronic device pointing to a notification via one or more input devices. Additionally or alternatively, in some examples, the method further includes, based on a determination that the first electronic device is not associated with a first portion of the user of the first electronic device when the second indication is detected, displaying a user interface of a communication application on an outward-facing surface of one or more displays, the user interface including visual indications of the user of the second electronic device. Additionally or alternatively, in some examples, the method further includes: while displaying the user interface of the communication application including visual indications of the user of the second electronic device, detecting an air gesture performed by the user of the first electronic device pointing to the user interface via one or more input devices; and, in response to detecting the air gesture, performing an operation in the user interface based on the air gesture. Additionally or alternatively, in some examples, the method further includes: after establishing communication with the second electronic device and when the first electronic device is not associated with a first part of the user of the first electronic device, detecting the association between the first electronic device and the first part of the user of the first electronic device via one or more input devices; and in response to detecting the association between the first electronic device and the first part of the user, displaying a visual representation of the user of the second electronic device in a three-dimensional environment via one or more displays, while continuing to output audio corresponding to the speech of the user of the second electronic device transmitted by the second electronic device.

[0109] Additionally or alternatively, in some examples, the method further includes: when the first electronic device is associated with a first portion of a user of the first electronic device, detecting a third indication of a request to initiate communication with a user of a third electronic device different from the second electronic device; in response to detecting the third indication, displaying a second notification corresponding to the third indication via one or more displays; while displaying the second notification, detecting a fourth indication of a response to the request to initiate communication with the third electronic device via one or more input devices; and in response to detecting the fourth indication, establishing communication with the third electronic device based on a determination that the response corresponds to accepting the request to initiate communication with the third electronic device, including displaying a visual representation of the user of the third electronic device in a three-dimensional environment via one or more displays. Additionally or alternatively, in some examples, detecting the fourth indication of a response to the request to accept the request to initiate communication with the third electronic device includes determining that a threshold amount of time has elapsed since the display of the second notification corresponding to the third indication. Additionally or alternatively, in some examples, the method further includes, in response to detecting the fourth indication, displaying one or more options via one or more displays for sending a response to the user's choice of the request to the third electronic device based on a determination that the response corresponds to rejecting the request to initiate communication with the third electronic device. Additionally or alternatively, in some examples, detecting a fourth indication of a response to a request to refuse communication with a user of a third electronic device includes detecting, via one or more input devices, an input corresponding to the selection of a rejection option in the second notification within a threshold time period for displaying the second notification.

[0110] Some examples of this disclosure relate to an electronic device comprising: one or more processors; a memory; and one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing any of the methods described above.

[0111] Some examples of this disclosure relate to a non-transitory computer-readable storage medium that stores one or more programs, the one or more programs including instructions that, when executed by one or more processors of an electronic device, cause the electronic device to perform any of the methods described above.

[0112] Some examples of this disclosure relate to an electronic device that includes one or more processors, a memory, and components for performing any of the methods described above.

[0113] Some examples of this disclosure relate to an information processing apparatus used in an electronic device, the information processing apparatus including components for performing any of the methods described above.

[0114] This disclosure anticipates that, in some instances, the data utilized may include personal information that uniquely identifies or can be used to contact or locate specific individuals. Such personal information may include demographic data, content consumption activity, location-based data, telephone numbers, email addresses, Twitter IDs, home addresses, data or records relating to a user's health or fitness level (e.g., vital sign measurements, medication information, exercise information), date of birth, or any other identifying or personal information. Specifically, as described herein, one aspect of this disclosure is tracking user activity and / or availability.

[0115] This disclosure recognizes that the use of such personal information data in the techniques of this invention can be used to benefit users. For example, personal information data can be used to display visual indications of user availability that change based on changes in the user's current activity and / or device usage. For example, visual indications are updated visually based on changes in the user's location, activity level, device usage, and / or other user interactions.

[0116] This disclosure anticipates that entities responsible for the collection, analysis, disclosure, transmission, storage, or other use of such personal information data will comply with robust privacy policies and / or privacy measures. Specifically, such entities should implement and adhere to privacy policies and measures that are recognized as meeting or exceeding industry or governmental requirements for maintaining the privacy and security of personal information data. Such policies should be easily accessible to users and should be updated as the collection and / or use of data changes. Personal information from users should be collected for legitimate and reasonable entity purposes and should not be shared or sold outside of these legitimate purposes. Furthermore, such collection / sharing should be conducted only after receiving informed consent from users. Additionally, such entities should consider taking any necessary steps to protect and safeguard the right to access such personal information data and ensure that other entities with access to such personal information data comply with the privacy policies and procedures of those other entities. Additionally, such entities may subject themselves to third-party assessments to demonstrate their compliance with widely accepted privacy policies and privacy practices. Moreover, policies and practices should be adapted to the specific types of personal information data collected and / or accessed, and to applicable laws and standards, including considerations of specific jurisdictions. For example, in the United States, the collection or acquisition of certain health data may be governed by federal and / or state laws, such as the Health Insurance Portability and Accountability Act (HIPAA); while in other countries, health data may be subject to other regulations and policies and should be handled accordingly. Therefore, different privacy measures should be advocated for different types of personal data in each country.

[0117] Regardless of the foregoing, this disclosure also envisions examples of users selectively blocking the use or access to personal information data. That is, this disclosure anticipates providing hardware and / or software components to prevent or block access to such personal information data. For example, the inventive technology can be configured to allow a user to opt-in or opt-out during or at any time after registering for the service. In another example, a user can choose not to enable the recording of personal information data in a specific application (e.g., a first application and / or a second application). In addition to providing "opt-in" and "opt-out" options, this disclosure also anticipates providing notifications related to access to or use of personal information. For example, a user can be notified that their personal information data will be accessed after collection is initiated, and then reminded again just before the device accesses the personal information data.

[0118] Furthermore, the intent of this disclosure is that personal information data should be managed and processed in a manner that minimizes the risk of unintentional or unauthorized access or use. Once data is no longer needed, this risk can be minimized by restricting data collection and deleting data. Additionally, and where applicable, including in certain health-related applications, data deidentification can be used to protect user privacy. Deidentification can be facilitated, where appropriate, by removing specific identifiers (e.g., date of birth, etc.), controlling the amount or specificity of stored data (e.g., collecting location data at the city level rather than the address level), controlling how data is stored (e.g., aggregating data among users), and / or other methods.

[0119] For purposes of explanation, the foregoing description has been presented with reference to specific examples. However, the illustrative discussion above is not intended to be exhaustive or to limit this disclosure to the precise form disclosed. Many modifications and variations are possible based on the teachings above. The examples were chosen and described to best elucidate the principles of this disclosure and its practical application, thereby enabling others skilled in the art to make optimal use of this disclosure with various modifications suitable for the particular intended purpose, as well as the various described examples.

Claims

1. A method, the method comprising: At the first electronic device that communicates with one or more displays and one or more input devices: When a user interface comprising multiple representations of multiple users is presented in a three-dimensional environment via the one or more displays, wherein one or more of the multiple users meet one or more first criteria and one or more of the multiple representations of the one or more users are displayed with a first visual appearance, a first input directed to the user interface is detected via the one or more input devices, the first input corresponding to a request for communication initiated by a user with a second electronic device; In response to receiving the first input, the user interface is stopped from being displayed and an instruction is sent to the user who initiated the request to communicate with the second electronic device; After sending the instruction, receive an instruction in response to the request to initiate communication with the user of the second electronic device; as well as In response to receiving the instruction: Based on determining that the response corresponds to the request to initiate communication with the user of the second electronic device, communication is established with the second electronic device, including displaying a visual representation of the user of the second electronic device in the three-dimensional environment via the one or more displays; as well as Based on the determination that the response corresponds to the request to refuse to initiate communication with the user of the second electronic device, a user interface object associated with the response is displayed in the three-dimensional environment.

2. The method of claim 1, wherein the one or more first criteria are based on indications of user availability.

3. The method of claim 2, wherein the one or more first criteria include criteria satisfied when a respective user among the plurality of users is using a respective electronic device configured to communicate with the first electronic device.

4. The method of claim 2, wherein the one or more first criteria include criteria satisfied when a corresponding user among the plurality of users is located in the field of view of one or more cameras of a corresponding electronic device associated with the corresponding user, and wherein the corresponding electronic device is configured to communicate with the first electronic device.

5. The method of claim 2, wherein the one or more first criteria include criteria satisfied when a corresponding user among the plurality of users is within a threshold distance of a corresponding electronic device associated with the corresponding user, and wherein the corresponding electronic device is configured to communicate with the first electronic device.

6. The method of claim 2, wherein the one or more first criteria include criteria that are satisfied when the communication state of the corresponding user among the one or more users is a first communication state and are not satisfied when the communication state of the corresponding user is a second communication state different from the first communication state.

7. The method of claim 1, wherein one or more second representations of the plurality of representations of one or more users who do not meet the one or more first criteria are displayed with a second visual appearance different from the first visual appearance.

8. The method according to claim 7, wherein: Displaying the one or more first representations with the first visual appearance includes displaying a visual indication of a first type; and Displaying the one or more second representations with the second visual appearance includes displaying a second type of visual indication that is different from the first type.

9. The method according to claim 8, wherein: The visual indication of the first type provides an indication that the corresponding user among the plurality of users can use to receive a communication request; as well as The visual indication of the second type provides an indication that the corresponding user among the plurality of users is not available to receive communication requests.

10. The method of claim 1, wherein in response to detecting interaction with hardware elements of the first electronic device, the user interface comprising the plurality of representations of the plurality of users is displayed in the three-dimensional environment.

11. The method of claim 1, wherein the visual representation of the user of the second electronic device corresponds to a three-dimensional avatar of the user of the second electronic device.

12. The method of claim 1, wherein the user interface object associated with the reply includes a reply message selected by the user of the second electronic device.

13. The method of claim 1, wherein the user interface object associated with the response includes an indication that the user of the second electronic device is incapable of communicating.

14. The method of claim 1, wherein presenting the visual representation of the user of the second electronic device comprises outputting audio corresponding to the speech of the user of the second electronic device via one or more speakers communicating with the first electronic device.

15. The method of claim 1, wherein the first electronic device and the second electronic device comprise a head-mounted display.

16. A first electronic device, the first electronic device comprising: One or more processors; Memory; and One or more programs, the programs being stored in the memory and configured to be executed by the one or more processors, the programs including instructions for performing the method according to any one of claims 1 to 15.

17. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by one or more processors of a first electronic device, cause the first electronic device to perform the method according to any one of claims 1 to 15.

Images