Technology for participating in shared scenes

Abstract

According to some embodiments, an exemplary process for initializing members of a shared augmented reality setting is described. According to some embodiments, an exemplary process for forming a private subspace and exemplary characteristics of the private subspace are described.

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This patent application claims priority to U.S. Provisional Patent Application Serial No. 62 / 832,161, filed on April 10, 2019, entitled “TECHNIQUES FOR PARTICIPATION IN A SHARED COMPUTER-SIMULATED REALITY ENVIRONMENT,” the contents of which are incorporated herein by reference in their entirety. Technical Field

[0003] The present disclosure relates generally to augmented reality (ER) scenes, and more particularly to methods and techniques for managing members of a shared ER scene. Background Art

[0004] Augmented reality (ER) sets provide a convenient platform for multiple users to jointly experience and interact with a virtual AR set that is distinct from a physical set. However, existing techniques for managing members of a shared ER set can be cumbersome and inefficient. Therefore, a method is needed that enables users to quickly and easily enter a shared ER set and conveniently manage different types of sessions within the shared ER set. Summary of the Invention

[0005] According to some embodiments, a method performed at a first electronic device having one or more sensors and one or more displays and adapted to communicate with a second electronic device is described. The method includes receiving a request for presenting an augmented reality scene, and determining whether a first user of the first electronic device and a second user of the second electronic device meet physical interaction criteria. The method also includes presenting the augmented reality scene based on determining that the physical interaction criteria are met, wherein presenting the augmented reality scene includes displaying an avatar representing the second user in the augmented reality scene; and presenting the augmented reality scene without the avatar representing the second user based on determining that the physical interaction criteria are not met.

[0006] According to some embodiments, a first electronic device includes one or more sensors; one or more displays; a wireless communication radio configured to communicate with a second electronic device; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors. The one or more programs include instructions for performing the following operations: receiving a request for presenting an augmented reality scene; and determining whether a first user of the first electronic device and a second user of the second electronic device meet physical interaction criteria. The one or more programs also include instructions for performing the following operations: based on determining that the physical interaction criteria are met, presenting the augmented reality scene, wherein presenting the augmented reality scene includes displaying an avatar representing the second user in the augmented reality scene; and based on determining that the physical interaction criteria are not met, presenting the augmented reality scene without the avatar representing the second user.

[0007] According to some embodiments, a non-transitory computer-readable storage medium storing one or more programs is described, wherein the one or more programs are configured to be executed by one or more processors of a first electronic device having one or more sensors and one or more displays and suitable for communicating with a second electronic device. The one or more programs include instructions for performing the following operations: receiving a request for presenting an augmented reality scene; and determining whether a first user of the first electronic device and a second user of the second electronic device meet physical interaction criteria. The one or more programs also include instructions for performing the following operations: based on determining that the physical interaction criteria are met, presenting the augmented reality scene, wherein presenting the augmented reality scene includes displaying an avatar representing the second user in the augmented reality scene; and based on determining that the physical interaction criteria are not met, presenting the augmented reality scene without the avatar representing the second user.

[0008] According to some embodiments, a method is described. The method includes: displaying an augmented reality setting, wherein the augmented reality setting includes a plurality of avatars. The method further includes, while displaying the augmented reality setting: selecting a first avatar from the plurality of avatars as a recipient of received audio input; selecting a second avatar from the plurality of avatars as a non-recipient of the received audio input; receiving the audio input via a microphone; causing playback of audio corresponding to the audio input and corresponding visual avatar movement for the first avatar; and forgoing causing playback of the audio for the second avatar.

[0009] According to some embodiments, a system is described that includes one or more processors of one or more electronic devices and a memory storing one or more programs configured to be executed by the one or more processors. The one or more programs include instructions for performing the following operations: displaying an augmented reality scene, wherein the augmented reality scene includes multiple avatars. The one or more programs also include instructions for performing the following operations when displaying the augmented reality scene: selecting a first avatar from the multiple avatars as a recipient of the received audio input; selecting a second avatar from the multiple avatars as a non-recipient of the received audio input; receiving the audio input via a microphone; causing playback of audio corresponding to the audio input and corresponding visual avatar movement for the first avatar; and abandoning causing playback of the audio for the second avatar.

[0010] According to some embodiments, a non-transitory computer-readable storage medium storing one or more programs is described, wherein the one or more programs are configured to be executed by one or more processors of one or more electronic devices. The one or more programs include instructions for performing the following operations: displaying an augmented reality scene, wherein the augmented reality scene includes multiple avatars. The one or more programs also include instructions for performing the following operations when displaying the augmented reality scene: selecting a first avatar from the multiple avatars as a recipient of the received audio input; selecting a second avatar from the multiple avatars as a non-recipient of the received audio input; receiving the audio input via a microphone; causing playback of audio corresponding to the audio input and corresponding visual avatar movement for the first avatar; and abandoning causing playback of the audio for the second avatar. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] For a better understanding of the various embodiments, reference should be made to the following detailed description taken in conjunction with the following drawings, wherein like reference numerals designate corresponding parts throughout the several views.

[0012] Figure 1A to Figure 1B An exemplary system for use in various computer-augmented reality technologies, including virtual reality and mixed reality, is shown.

[0013] Figures 2A to 2G An example process for initializing members of a shared augmented reality setting is shown, according to some embodiments.

[0014] Figure 3 A flow chart for initializing members of a shared augmented reality setting according to some embodiments.

[0015] Figures 4A to 4I An exemplary process for forming a private subspace and exemplary characteristics of a private subspace are shown according to some embodiments.

[0016] Figure 5 is a flow chart for forming and maintaining a private subspace within an augmented reality setting, according to some embodiments. DETAILED DESCRIPTION

[0017] Various examples of electronic systems and techniques for using such systems in connection with various augmented reality techniques are described.

[0018] A physical setting refers to a world that individuals can sense and / or interact with without the use of electronic systems. A physical setting, such as a physical park, includes physical elements such as physical wildlife, physical trees, and physical plants. People can directly sense and / or otherwise interact with a physical setting, for example, using one or more senses, including sight, smell, touch, taste, and hearing.

[0019] In contrast to physical sets, augmented reality (ER) sets refer to fully (or partially) computer-generated sets that various people can sense and / or otherwise interact with using electronic systems. In ER, a person's movement is monitored, and in response, at least one property corresponding to at least one virtual object in the ER set is altered in a manner consistent with one or more laws of physics. For example, in response to the ER system detecting that a person is looking upward, the ER system may adjust various audio and graphics presented to the person in a manner consistent with how such sounds and appearances would change in a physical set. Adjustments to properties of virtual objects in the ER set may also be made, for example, in response to an indication of movement (e.g., a voice command).

[0020] A person can sense and / or interact with ER objects using one or more senses, such as sight, smell, taste, touch, and hearing. For example, a person can sense and / or interact with objects that create a multidimensional or spatial acoustic scape. A multidimensional or spatial acoustic scape provides a person with the perception of discrete sound sources in a multidimensional space. Such objects can also implement acoustic transparency, which selectively incorporates audio from the physical scape with or without computer-generated audio. In some ER scapes, a person can sense and / or interact with only audio objects.

[0021] Virtual reality (VR) is an example of ER. A VR setting refers to an augmented setting configured to include only computer-generated sensory input for one or more senses. A VR setting includes multiple virtual objects that a person can sense and / or interact with. A person can sense and / or interact with virtual objects in the VR setting by simulating at least some of their actions within the computer-generated setting and / or by simulating a person or their presence within the computer-generated setting.

[0022] Mixed reality (MR) is another example of ER. MR scenery refers to an augmented scenery configured to integrate computer-generated sensory input (e.g., virtual objects) with sensory input from a physical scenery, or a representation of sensory input from a physical scenery. On the reality spectrum, MR scenery lies between fully physical scenery at one end and VR scenery at the other, but does not include either of these.

[0023] In some MR settings, computer-generated sensory input can be adjusted based on changes in sensory input from the physical setting. Additionally, some electronic systems used to render MR settings can detect position and / or orientation relative to the physical setting to enable interaction between real objects (i.e., physical elements from the physical setting or their representations) and virtual objects. For example, the system can detect movement and adjust computer-generated sensory input accordingly, so that, for example, a virtual tree appears stationary relative to a physical structure.

[0024] Augmented reality (AR) is an example of MR. An AR set refers to an augmented set in which one or more virtual objects are superimposed on a physical set (or a representation thereof). For example, an electronic system may include an opaque display and one or more imaging sensors for capturing video and / or images of the physical set. For example, such video and / or images may be a representation of the physical set. The video and / or images are combined with virtual objects, where the combination is then displayed on the opaque display. The physical set can be viewed indirectly by a person via the image and / or video of the physical set. Thus, a person can observe virtual objects superimposed on the physical set. When a system captures an image of the physical set and uses the captured image to display the AR set on an opaque display, the displayed image is referred to as video pass-through. Alternatively, a transparent or translucent display may be included in the electronic system for displaying the AR set, allowing an individual to directly view the physical set through the transparent or translucent display. Virtual objects may be displayed on the translucent or transparent display, allowing an individual to observe the virtual objects superimposed on the physical set. In another example, a projection system may be utilized to project virtual objects onto the physical set. For example, virtual objects may be projected onto a physical surface, or as a hologram, such that an individual observes the virtual object superimposed on a physical setting.

[0025] An AR set may also refer to an augmented set in which the representation of a physical set is modified by computer-generated sensory data. For example, at least a portion of the representation of the physical set can be graphically modified (e.g., enlarged) so that the modified portion still represents the originally captured image (but not an exact replica). Alternatively, when providing video passthrough, one or more sensor images can be modified to impose a specific viewpoint different from the viewpoint captured by the image sensor. As another example, a portion of the representation of the physical set can be altered by graphically blurring or eliminating that portion.

[0026] Augmented Virtual (AV) is another example of MR. An AV set refers to an augmented set that combines a virtual or computer-generated set with one or more sensory inputs from a physical set. Such sensory inputs may include representations of one or more features of the physical set. Virtual objects may, for example, incorporate colors associated with physical elements captured by an imaging sensor. Alternatively, virtual objects may adopt features consistent with, for example, current weather conditions corresponding to the physical set, such as weather conditions identified via imaging, online weather information, and / or weather-related sensors. For another example, an AR park may include virtual structures, plants, and trees, although animals within the AR park set may include features accurately replicated from images of physical animals.

[0027] Various systems allow people to sense and / or interact with the ER scenery. For example, a head-mounted system may include one or more speakers and an opaque display. In another example, an external display (e.g., a smartphone) may be integrated into the head-mounted system. The head-mounted system may include a microphone for capturing audio of the physical scenery and / or an image sensor for capturing images / video of the physical scenery. The head-mounted system may also include a transparent or translucent display. A translucent or transparent display may, for example, include a substrate through which light (representing an image) is directed to a person's eye. The display may also include an LED, an OLED, a liquid crystal on silicon, a laser scanning light source, a digital light projector, or any combination thereof. The substrate through which light is transmitted may be an optical reflector, a holographic substrate, an optical waveguide, an optical combiner, or any combination thereof. The transparent or translucent display may, for example, selectively transition between a transparent / translucent state and an opaque state. In another example, the electronic system may be a projection-based system. In projection-based systems, retinal projection may be used to project images onto a person's retina. Alternatively, projection-based systems can also project virtual objects into a physical setting, such as, for example, projecting virtual objects as holograms or onto a physical surface. Other examples of ER systems include a window configured to display graphics, headphones, earphones, a speaker arrangement, a lens configured to display graphics, a head-up display, a car windshield configured to display graphics, an input mechanism (e.g., a controller with or without haptic capabilities), a desktop or laptop computer, a tablet computer, or a smartphone.

[0028] Figure 1A and Figure 1B An exemplary system 100 is shown for use in various augmented reality technologies.

[0029] In some examples, such as Figure 1AAs shown, system 100 includes device 100a. Device 100a includes various components, such as processor 102, RF circuit 104, memory 106, image sensor 108, orientation sensor 110, microphone 112, position sensor 116, speaker 118, display 120, and touch-sensitive surface 122. These components optionally communicate via a communication bus 150 of device 100a.

[0030] In some examples, elements of system 100 are implemented in a base device (e.g., a computing device such as a remote server, mobile device, or laptop), and other elements of system 100 are implemented in a second device (e.g., a head-mounted device). In some examples, device 100a is implemented in the base device or the second device.

[0031] like Figure 1B As shown, in some examples, system 100 includes two (or more) devices in communication, such as through a wired connection or a wireless connection. A first device 100b (e.g., a base station device) includes a processor 102, RF circuitry 104, and a memory 106. These components optionally communicate via a communication bus 150 of device 100b. A second device 100c (e.g., a head-mounted device) includes various components, such as a processor 102, RF circuitry 104, memory 106, an image sensor 108, an orientation sensor 110, a microphone 112, a position sensor 116, a speaker 118, a display 120, and a touch-sensitive surface 122. These components optionally communicate via a communication bus 150 of device 100c.

[0032] System 100 includes a processor 102 and a memory 106. Processor 102 includes one or more general-purpose processors, one or more graphics processors, and / or one or more digital signal processors. In some examples, memory 106 is one or more non-transitory computer-readable storage media (e.g., flash memory, random access memory) that stores computer-readable instructions configured to be executed by processor 102 to perform the techniques described below.

[0033] System 100 includes RF circuitry 104. RF circuitry 104 optionally includes circuitry for communicating with electronic devices, networks (such as the Internet, an intranet), and / or wireless networks (such as cellular networks and wireless local area networks (LANs)). RF circuitry 104 optionally includes circuitry for communicating using near field communication and / or short range communication (such as ) circuit for communication.

[0034] System 100 includes a display 120. Display 120 may have an opaque display. Display 120 may have a transparent or translucent display that may incorporate a substrate through which light representing an image is directed to the individual's eye. Display 120 may incorporate LEDs, OLEDs, digital light projectors, laser scanning light sources, liquid crystal on silicon, or any combination of these technologies. The substrate that transmits light may be a light waveguide, a light combiner, a light reflector, a holographic substrate, or any combination of these substrates. In one example, the transparent or translucent display may selectively switch between an opaque state and a transparent or translucent state. Other examples of display 120 include a head-up display, a car windshield capable of displaying graphics, a window capable of displaying graphics, eyeglasses capable of displaying graphics, a tablet computer, a smartphone, and a desktop or laptop computer. Alternatively, system 100 may be designed to receive an external display (e.g., a smartphone). In some examples, system 100 is a projection-based system that uses retinal projection to project images onto an individual's retina or to project virtual objects into a physical set (e.g., onto a physical surface or as a hologram).

[0035] In some examples, system 100 includes a touch-sensitive surface 122 for receiving user input, such as tap input and swipe input. In some examples, display 120 and touch-sensitive surface 122 form a touch-sensitive display.

[0036] System 100 includes an image sensor 108. Image sensor 108 optionally includes one or more visible light image sensors, such as charge-coupled device (CCD) sensors and / or complementary metal oxide semiconductor (CMOS) sensors, operable to capture images of physical elements from the physical set. The image sensor also optionally includes one or more infrared (IR) sensors, such as passive IR sensors or active IR sensors, for detecting infrared light from the physical set. For example, an active IR sensor includes an IR emitter, such as an IR point emitter, for emitting infrared light into the physical set. Image sensor 108 also optionally includes one or more event cameras configured to capture the movement of physical elements in the physical set. Image sensor 108 also optionally includes one or more depth sensors configured to detect the distance of physical elements from system 100. In some examples, system 100 uses a combination of CCD sensors, event cameras, and depth sensors to detect the physical set surrounding system 100. In some examples, image sensor 108 includes a first image sensor and a second image sensor. The first image sensor and the second image sensor are optionally configured to capture images of physical elements in the physical set from two different perspectives. In some examples, system 100 uses image sensor 108 to receive user input, such as gestures. In some examples, system 100 uses image sensor 108 to detect the position and orientation of system 100 and / or display 120 in the physical set. For example, system 100 uses image sensor 108 to track the position and orientation of display 120 relative to one or more fixed elements in the physical set.

[0037] In some examples, system 100 includes microphone 112. System 100 uses microphone 112 to detect sounds from the user and / or the user's physical set. In some examples, microphone 112 includes a microphone array (comprising a plurality of microphones) that optionally operate in conjunction to identify ambient noise or localize a sound source in the space of the physical set.

[0038] System 100 includes an orientation sensor 110 for detecting the orientation and / or movement of system 100 and / or display 120. For example, system 100 uses orientation sensor 110 to track changes in the position and / or orientation of system 100 and / or display 120, such as relative to physical elements in a physical set. Orientation sensor 110 optionally includes one or more gyroscopes and / or one or more accelerometers.

[0039] Figures 2A to 2GAn exemplary technique for initializing members of a shared ER scene using a first electronic device of a first user 202 and a second electronic device 208 of a second user 204 is shown. In some embodiments, the first electronic device 206 and the second electronic device 208 are similar to those described above with reference to FIG. Figure 1A to Figure 1B In some embodiments, the first electronic device 206 and / or the second electronic device 208 is a mobile electronic device, such as a smartphone or a tablet. In some embodiments, the first electronic device 206 and / or the second electronic device 208 is a head mounted device (HMD).

[0040] Figure 2A A physical setting 200 (e.g., an outdoor park) is shown with a first user 202 and a second user 204 in the physical setting 200, and with the first user 202 using a first electronic device 206 and the second user 204 using a second electronic device 208. Figure 2A In the example, the first user 202 and the second user 204 are more than a predetermined distance (eg, more than 5 meters, more than 3 meters, or more than 1 meter) from each other within the physical set 200 .

[0041] In some embodiments (e.g., when the first user 202 and the second user 204 are more than a predetermined distance away from each other), the first electronic device 206 displays the ER scene 214 (e.g., a room) on the display 210 of the first electronic device, such as Figure 2B Similarly (e.g., when the first user 202 and the second user 204 are more than a predetermined distance away from each other), the second electronic device 208 displays the ER scene 216 (e.g., a gym) on the display 212 of the second electronic device, also as shown. Figure 2B As shown. Figure 2B , ER set 214 and ER set 216 are different and separate augmented reality sets that are not shared by first user 202 and second user 204 .

[0042] exist Figures 2A to 2B , the first user 202 and the second user 204 do not share an ER scene. Figures 2C to 2G Different exemplary methods are shown for two or more users (eg, first user 202 and second user 204) to enter an ER scene shared by the two or more users.

[0043] exist Figure 2C In the example, the first user 202 and the second user 204 have already Figure 2A, so that the two users are within a threshold distance (e.g., 5 meters, 3 meters, 1 meter) of each other in the physical setting 200. In some embodiments, in response to detecting (e.g., using one or more sensors of the device, such as an image sensor, an orientation sensor, and / or a position sensor) that the two users are within a predetermined threshold distance from each other, thereby satisfying the proximity criterion, the first electronic device 206 displays the ER setting 218 (e.g., a desert) including the second avatar 222 corresponding to the second user 204 on the display 210 of the first electronic device, as shown in FIG. Figure 2G shown.

[0044] Likewise, in response to detecting (e.g., using one or more sensors of the device, such as an image sensor, an orientation sensor, and / or a position sensor) that the two users are within a predetermined threshold distance of each other, thereby satisfying the proximity criterion, the second electronic device 208 displays an ER scenery 218 (e.g., a desert) including a first avatar 220 corresponding to the first user 202 on the display 212 of the second electronic device, also as shown. Figure 2G Thus, when the first electronic device 206 and the second electronic device 208 determine that they are within a threshold distance of each other in a physical setting, the devices provide their respective users with a shared ER setting in which the users can interact with each other using avatars.

[0045] In some embodiments, providing a shared ER setting to respective users in which users can interact with each other using avatars includes the second user 204 appearing as an avatar in an existing ER setting (e.g., ER setting 214) provided by the first electronic device 206 to the first user 202. That is, in some embodiments, in response to detecting that the two users are within a predetermined threshold distance of each other, thereby satisfying a proximity criterion, the second electronic device 208 displays the ER setting 214 (e.g., a room) including the first avatar 220 corresponding to the first user 202 on the display 212 of the second electronic device. Thus, in some embodiments, the second user 204 appears as an avatar in the existing ER setting (e.g., ER setting 214) provided by the first electronic device 206 to the first user 202. In other embodiments, the devices 206 and 208 together provide a new ER setting (e.g., ER setting 218) in which both users 202 and 204 participate via avatars.

[0046] Optionally, in some embodiments (e.g., in response to detecting that two users are within a predetermined threshold distance of each other), the second electronic device 208 first displays a user interface affordance on the display 212 for prompting the second user 204 that the first user 202 of the first electronic device 206 is within the predetermined threshold distance in the physical setting, without displaying the shared ER setting. In some embodiments, in response to detecting a confirmation by the second user 204 (e.g., detecting a user selection of the user interface affordance), the second electronic device 208 enables the second user 204 to participate in the shared ER setting with the user 202 (e.g., sharing the ER setting 214 with the first user 202).

[0047] In some embodiments, the first electronic device 206 receives a request to initialize the ER scenery from the first user 202 when the device is not displaying the ER scenery (e.g., because the device is in a turned-off or inactive state). In some embodiments, in response to receiving the request to initialize the ER scenery from the first user 202 when the device is not already displaying the ER scenery, the first electronic device 206 detects whether another device (e.g., the second electronic device 208) is within a predetermined distance from the first electronic device 206 such that a proximity criterion is satisfied. In some embodiments, in response to detecting that the proximity criterion is satisfied with the other device (e.g., the second electronic device 208), the first electronic device 206 displays the ER scenery (e.g., the ER scenery 218) shared by the user of the other device (e.g., the second user 204), and accordingly includes an avatar corresponding to the user of the other device (e.g., the avatar 222 of the second user 204). Alternatively, in other embodiments, in response to detecting that a proximity criterion is met with another device (e.g., second electronic device 208), first electronic device 206 displays on display 210 a user interface affordance for continuing to initiate an ER scene (e.g., ER scene 218) shared by a user of the other device (e.g., second user 204) without first displaying the shared ER scene, and displays the shared ER scene (e.g., ER scene 218) in response to detecting a selection or activation of the user interface affordance by first user 202. In some embodiments, if a selection or activation of the user interface affordance by first user 202 is not detected (e.g., within a predetermined amount of time), first electronic device 206 abandons displaying the shared ER scene (e.g., ER scene 218). In some examples, the user interface affordance for continuing to initiate the shared ER scene includes an indication that the other user (e.g., second user 204) is nearby and inquires whether to initialize the shared ER scene including the other user detected nearby.

[0048] Figure 2DAnother exemplary method for two or more users (eg, first user 202 and second user 204) to enter an ER scene shared by the two or more users is shown. Figure 2D In the embodiment of the present invention, the first electronic device 206 (e.g., using an eye tracking sensor, an orientation sensor, and / or a position sensor) detects that the first user 202 is looking at the second user 204 (e.g., looking at the second user 204 for at least a predetermined period of time, such as 10 seconds, 5 seconds, or 3 seconds).

[0049] In some embodiments, in response to detecting the first user 202's gaze on the second user 204, if the first electronic device 206 is displaying an ER scene (e.g., ER scene 214) that is not shared with the second user 204, the first electronic device 206 transitions to displaying an ER scene (e.g., ER scene 218) shared with the second user 204 (the target of the first user 202's gaze) on the device's display 210, wherein the ER scene shared with the second user 204 includes an avatar (e.g., avatar 222) corresponding to the second user 204 within the shared ER scene. Alternatively, in other embodiments, in response to detecting first user 202's gaze at second user 204, if first electronic device 206 is currently displaying an ER scene (e.g., ER scene 214) that is not shared with second user 204, first electronic device 206 displays on display 210 a user interface affordance for transitioning to an ER scene (e.g., ER scene 218) shared with second user 204 (the target of first user 202's gaze) without first displaying the shared ER scene, and in response to detecting selection or activation of the user interface affordance by first user 202, transitions to displaying the shared ER scene (e.g., ER scene 218). In some embodiments, if selection or activation of the user interface affordance by first user 202 is not detected (e.g., within a predetermined amount of time), first electronic device 206 abandons transitioning to the shared ER scene (e.g., ER scene 218) and instead maintains displaying the ER scene (e.g., ER scene 214) that is currently being displayed. In some examples, the user interface affordance for continuing to initiate a shared ER scene includes an indication that another user (eg, second user 204) is nearby and asks whether to initialize the shared ER scene including the other user detected nearby.

[0050] On the other hand, in some embodiments, in response to detecting the first user 202's gaze on the second user 204, if the first electronic device 206 is not displaying an ER scene, the first electronic device 206 displays an ER scene (e.g., ER scene 218) shared with the second user 204 on the device's display 210.

[0051] Furthermore, in some embodiments, in response to detecting that the first user 202 is looking at the second user 204, the first electronic device 206 causes the second electronic device 208 to also display the ER scene (e.g., ER scene 218) shared between the first user 202 and the second user 204. Thus, from the perspective of the second user 204, the second electronic device 208 displays the ER scene (e.g., ER scene 218) shared with the first user 202 on the device's display 212, which includes an avatar (e.g., avatar 220) corresponding to the first user 202 within the shared ER scene.

[0052] Figure 2E Another exemplary method for two or more users (eg, first user 202 and second user 204) to enter an ER scene shared by the two or more users is shown. Figure 2E , the first electronic device 206 (e.g., using one or more cameras of the device; if the device is an HMD, using one or more downward-facing cameras of the device) detects that the first user 202 is shaking hands with the second user 204. In some embodiments, in response to detecting that the first user 202 is shaking hands with the second user 204, if the first electronic device 206 is displaying an ER scene that is not shared with the second user 204 (e.g., ER scene 214), the first electronic device 206 transitions to displaying an ER scene that is shared with the second user 204 (e.g., ER scene 218), wherein the ER scene shared with the second user 204 includes an avatar corresponding to the second user 204 within the shared ER scene (e.g., avatar 222).

[0053] On the other hand, in some embodiments, in response to detecting that the first user 202 is shaking hands with the second user 204, if the first electronic device 206 is not displaying an ER scene, the first electronic device 206 displays an ER scene (e.g., ER scene 218) shared with the second user 204 on the device's display 210.

[0054] Similarly, in Figure 2E, the second electronic device 208 (e.g., using one or more cameras of the device; if the device is an HMD, using one or more downward-facing cameras of the device) detects that the second user 204 is shaking hands with the first user 202. In some embodiments, in response to detecting that the second user 204 is shaking hands with the first user 202, if the second electronic device 208 is displaying an ER scenery that is not shared with the first user 202 (e.g., ER scenery 218), the second electronic device 208 transitions to displaying an ER scenery that is shared with the first user 202 (e.g., ER scenery 218), wherein the ER scenery shared with the first user 202 includes an avatar (e.g., avatar 220) corresponding to the first user 202 within the shared ER scenery.

[0055] On the other hand, in some embodiments, in response to detecting that the second user 204 is shaking hands with the first user 202, if the second electronic device 208 is not displaying the ER scene, the second electronic device 208 displays the ER scene (e.g., ER scene 218) shared with the first user 202 on the device's display 212.

[0056] Figure 2F Another exemplary method for two or more users (eg, first user 202 and second user 204) to enter an ER scene shared by the two or more users is shown. Figure 2F In some embodiments, in response to detecting that the first user 202 is engaging in a conversation with the second user 204, if the first electronic device 206 is displaying an ER scene that is not shared with the second user 204 (e.g., ER scene 214), the first electronic device 206 transitions to displaying an ER scene that is shared with the second user 204 (e.g., ER scene 218), wherein the ER scene shared with the second user 204 includes an avatar (e.g., avatar 222) corresponding to the second user 204 within the shared ER scene.

[0057] On the other hand, in some embodiments, in response to detecting that the first user 202 is having a conversation with the second user 204, if the first electronic device 206 is not displaying an ER scene, the first electronic device 206 displays an ER scene (e.g., ER scene 218) shared with the second user 204 on the device's display 210.

[0058] Similarly, in Figure 2F, the second electronic device 208 (e.g., using one or more microphones of the device) detects that the second user 204 is having a conversation with the first user 202. In some embodiments, in response to detecting that the second user 204 is having a conversation with the first user 202, if the second electronic device 208 is displaying an ER scene that is not shared with the first user 202 (e.g., ER scene 218), the second electronic device 208 transitions to displaying an ER scene that is shared with the first user 202 (e.g., ER scene 218), wherein the ER scene shared with the first user 202 includes an avatar (e.g., avatar 220) corresponding to the first user 202 within the shared ER scene.

[0059] On the other hand, in some embodiments, in response to detecting that the second user 204 is having a conversation with the first user 202, if the second electronic device 208 is not displaying the ER scene, the second electronic device 208 displays the ER scene (e.g., ER scene 218) shared with the first user 202 on the device's display 212.

[0060] As mentioned earlier, Figure 2G An ER scene 220 (e.g., a desert) is shown from the perspective of a first user 202 in a display 210 of a first electronic device 206 and from the perspective of a second user 204 in a display 212 of a second electronic device 208, including an avatar 220 corresponding to the first user 202 and an avatar 222 corresponding to the second user 204. The ER scene 218 is (e.g., as described above with reference to FIG. Figures 2C to 2G One or more of the processes described above) is initialized to include an augmented reality scene for both the first user 202 and the second user 204. Figure 2G As shown, Figure 2B Compared to the illustrated ER scene 214 and ER scene 216 , the first user 202 can see an avatar 222 corresponding to the second user 204 within the ER scene 218 , and similarly, the second user 204 can see an avatar 220 corresponding to the first user 202 within the ER scene 218 .

[0061] In addition, the ER scene 218 is not limited to being shared by two users. In some embodiments, the ER scene 218 can be shared by multiple users, including three or more users. For example, three or more users can share the ER scene 218 by meeting the above reference Figure 2C The described access criteria are used to initialize a shared ER scene, such as ER scene 218 .

[0062] Furthermore, the method of initializing a shared ER scene is not limited to the triggering events (e.g., meeting a proximity criterion, detecting a gaze, detecting a handshake, detecting an ongoing conversation). For another example, initialization of an ER scene (e.g., ER scene 218) shared by two or more users (e.g., first user 202 and second user 204) may be triggered by first electronic device 206 detecting (e.g., using an eye-tracking sensor of the device) that first user 202 winks at second user 204 and / or by second electronic device 208 detecting (e.g., using an eye-tracking sensor of the device) that second user 204 winks at first user 202. For another example, initialization of an ER scene (e.g., ER scene 218) shared by two or more users (e.g., first user 202 and second user 204) may be triggered by the first electronic device 206 (e.g., using the device's orientation sensor and / or motion sensor) detecting the first user 202 nodding to the second user 204 and / or by the second electronic device 208 (e.g., using the device's orientation sensor and / or motion sensor) detecting the second user 204 nodding to the first user 202.

[0063] Note that users of electronic devices 206 and 208 can opt in or out of sharing the ER scene. For example, in some embodiments, device 206 may allow its user to choose whether the device is discoverable by other devices, such as device 208. If device 206 is not discoverable, then even if the two devices are in proximity, device 208 will not indicate the presence of device 206 to its user 208. As another example, device 206 may allow user 202 to provide a list of trusted contacts with whom experiences in the ER scene may be shared. Conversely, device 206 may allow user 202 to specify restrictions on users for whom the ER scene is not permitted, such as a block list. As another example, device 206 may explicitly confirm with user 202 whether to allow or disallow a particular ER session. In these ways, the present technology preserves user privacy while improving the ability of users to easily invite others to appropriately share ER scenes.

[0064] Figure 3 FIG. 1 is a flow chart for initializing members of a shared ER scene according to some embodiments. In some embodiments, an electronic device (e.g., electronic device 100a, electronic device 206, electronic device 208; a mobile electronic device such as a smart phone or tablet; an HMD) is used to execute Figure 3 In the process, the electronic device communicates with another electronic device (e.g., electronic device 100a, electronic device 206, electronic device 208; mobile electronic device such as a smart phone or tablet; HMD) and / or an external server.

[0065] In some embodiments, at the first electronic device (e.g., 206), Figure 3In process 300, the first electronic device has one or more sensors and one or more displays suitable for presenting an ER scene (e.g., 212, 214, 218; a VR scene; an MR scene, including an AR scene) and communicates with a second electronic device (e.g., 208) suitable for presenting the ER scene.

[0066] At block 302 , a first electronic device (eg, 206 ) receives a request to present an ER scene (eg, 218 ).

[0067] The first electronic device (e.g., 206) determines at box 304 whether a first user (e.g., 202) of the first electronic device (e.g., 206) and a second user (e.g., 204) of a second electronic device (e.g., 208) meet physical interaction criteria (e.g., criteria based on user actions in the physical setting (e.g., 200), such as proximity between the first user and the second user or social actions (e.g., handshake, gaze) between the first user and the second user).

[0068] Based on determining at box 306 that the physical interaction criteria are met, the first electronic device (e.g., 206) presents the ER scene (e.g., 218) at box 308, where presenting the ER scene includes displaying an avatar (e.g., 222) representing the second user (e.g., 204) in the ER scene.

[0069] Based on determining at block 310 that the physical interaction criteria are not met, at block 312 the first electronic device (e.g., 206) presents the ER scene (e.g., 214) without an avatar (e.g., 222) representing the second user (e.g., 204).

[0070] In some embodiments, presenting the ER scene (e.g., 218) includes: displaying a confirmation indication at the first electronic device (e.g., 206) requesting confirmation of entry of the second user (e.g., 204) into the ER scene; and in response to detecting confirmation from the first user (e.g., 202), presenting the ER scene including an avatar (e.g., 222) representing the second user.

[0071] In some embodiments, the physical interaction criteria that are met include the first user (eg, 202) and the second user (eg, 204) being within a predetermined distance of each other within the physical set (eg, 200).

[0072] In some embodiments, the physical interaction criteria that are met include social signals between a first user (eg, 202) and a second user (eg, 204) detected within the physical set (eg, 200).

[0073] In some embodiments, the social signal is a handshake performed between a first user (eg, 202) and a second user (eg, 204) within a physical setting (eg, 200).

[0074] In some embodiments, the social signal is a conversation conducted between a first user (e.g., 202) and a second user (e.g., 204) within a physical setting (e.g., 200). In some embodiments, the conversation is an ongoing conversation, such that the first user and the second user have been in a continuous conversation for at least a predetermined amount of time.

[0075] In some embodiments, the social signal is a first user (e.g., 202) gazing (e.g., for at least a predetermined amount of time) at a second user (e.g., 204) within the physical set (e.g., 200). In some embodiments, the social signal is a nod from the first user to the second user within the physical set. In some embodiments, the social signal is a wink from the first user to the second user within the physical set.

[0076] In some embodiments, the first electronic device (e.g., 206) includes one or more sensors (e.g., one or more cameras, one or more motion sensors) for detecting motion corresponding to a signal action (e.g., a motion for performing a handshake, looking at a second user, winking at a second user, nodding to a second user) performed by a first user (e.g., 202) within a physical setting (e.g., 200).

[0077] Figures 4A to 4I An exemplary process for forming a private subspace within an ER set is shown, the private subspace including a subset of avatars within the ER set (e.g., a sub-augmented reality (sub-ER) set within the ER set) and exemplary characteristics of the private subspace.

[0078] Figure 4A ER scene 400 is shown (eg, using the above reference Figures 2A to 2G ), wherein the ER scene 400 includes a plurality of avatars, including a first avatar 402 corresponding to a first user of a first electronic device (e.g., similar to the first electronic device 206 and the second electronic device 208), a second avatar 404 corresponding to a second user of a second electronic device (e.g., similar to the first electronic device 206 and the second electronic device 208), and a third avatar 406 corresponding to a third user of a third electronic device (e.g., similar to the first electronic device 206 and the second electronic device 208). That is, the first avatar 402 is a virtual representation of the first user and is controlled by the first user, the second avatar 404 is a virtual representation of the second user and is controlled by the second user, and the third avatar 406 is a virtual representation of the third user and is controlled by the third user.

[0079] exist Figure 4A In FIG, a first avatar 402, a second avatar 404, and a third avatar 406 are included in the ER scene 400, so that the interactions supported by the ER scene 400 are available to the avatars 402, 404, and 406. Figure 4A , audio corresponding to audio input (e.g., verbal input, voice input) made by the second user (e.g., captured via a microphone of the second user's second electronic device) via the second avatar 404 is played at both the devices of the first user of the first avatar 402 and the third user of the third avatar 406. Figure 4A , the motion performed by the second avatar 404 within the ER scene 400 is displayed to the first user of the first avatar 402 via the display of the first device, and to the third user of the third avatar 406 via the display of the third device.

[0080] exist Figure 4B In some embodiments, when three avatars are included in the ER set 400, it is determined (e.g., by an external server in communication with a first device of a first user, a second device of a second user, and a third device of a third user and / or by one or more of the first device, the second device, and the third device) that the second avatar 404 is gazing (e.g., looking for at least a predetermined period of time, such as at least 10 seconds, 5 seconds, or 3 seconds) at the first avatar 402. In some embodiments, the gazing triggers the formation of a private subspace within the ER set (e.g., a sub-ER set within the ER set that includes a subset of the avatars present in the ER set, rather than all of them).

[0081] exist Figure 4C In response to determining that the second avatar 404 is looking at the first avatar 402, a private subspace 408 including the first avatar 402 and the second avatar 404 but not including the third avatar 406 is formed in the ER scene 400. In some embodiments, as Figure 4C As shown, a visual indication 410 of the formed private subspace is also provided (e.g., a halo or partially transparent cone encompassing the avatars within the private subspace) to indicate to users of other avatars within the ER setting 400 (e.g., the user of the third avatar 406) that the first avatar 402 and the second avatar 404 are conducting a private conversation within the subspace within the ER setting (e.g., the ER-equivalent of texting under the table).

[0082] Figure 4DAnother exemplary method for first avatar 402 and second avatar 404 to enter a private subspace (such as private subspace 408) within ER scene 400 is shown. In some embodiments, each of the plurality of avatars in ER scene 400 (e.g., first avatar 402, second avatar 404, and third avatar 406) has a corresponding selectable affordance (e.g., displayed above or near the respective avatar), such as Figure 4D For example, first avatar 402 has optional enable representation 402A, second avatar 404 has optional enable representation 404A, and third avatar 406 has optional enable representation 406A. Figure 4D , second avatar 404 selects / activates optional affordance 402A of first avatar 402. In some embodiments, selection / activation of optional affordance 402A of first avatar 402 by second avatar 404 triggers formation of private subspace 408 including first avatar 402 and second avatar 404 but not including third avatar 406, as previously described. Figure 4C shown.

[0083] The method for creating a private subspace (eg, private subspace 408) is not limited to Figure 4B and Figure 4D . Another exemplary method for forming a private subspace between the first avatar 402 and the second avatar 404 includes the first avatar 402 and the second avatar 404 performing a specific type of social interaction (e.g., nodding, winking, physical contact). For example, the formation of the private subspace between the first avatar 402 and the second avatar 404 can be triggered by the second avatar 404 nodding to the first avatar 402. For another example, the formation of the private subspace between the first avatar 402 and the second avatar 404 can be triggered by the second avatar 404 winking at the first avatar 402. For another example, the formation of the private subspace between the first avatar 402 and the second avatar 404 can be triggered by physical contact between the two avatars (e.g., the second avatar 404 places its hand on the shoulder of the first avatar 402).

[0084] Furthermore, another exemplary method for the first avatar 402 and the second avatar 404 to form a private subspace (e.g., private subspace 408) includes the first avatar 402 and the second avatar 404 satisfying a proximity criterion. For example, the formation of the private subspace can be triggered by the first avatar 402 and the second avatar 404 moving within the ER scene 400 to within a predetermined distance of each other (e.g., and also maintaining the proximity for at least a predetermined period of time).

[0085] Additionally, a private subspace within the ER setting (e.g., private subspace 408) is not limited to being shared by two avatars. In some embodiments, a private subspace can be shared by multiple avatars, including three or more avatars. For example, three avatars (e.g., first avatar 402, second avatar 404, and third avatar 406) can form a private subspace, such as private subspace 408, by moving within the ER setting to within a predetermined distance of one another, thereby satisfying a proximity criterion to trigger the formation of a subspace encompassing the three avatars.

[0086] Figure 4E An ER scene 400 is shown including a private subspace 408 that includes a first avatar 402 and a second avatar 404, but does not include a third avatar 406, as previously described in Figure 4C As depicted in Figure 4E , audio 412 corresponding to audio input (e.g., spoken input, voice input) made by the first user (e.g., captured via a microphone of the first user's first device) via first avatar 402 is played at the second device of the second user of second avatar 404 because first avatar 402 and second avatar 404 are included in private subspace 408. However, audio 412 is not played (e.g., it is prevented / blocked from playing) at the third device of the third user of third avatar 406 (and at the devices of any other users of any other avatars within ER scene 400) because third avatar 406 is not included in private subspace 408.

[0087] In some embodiments, as Figure 4E As shown, when audio 412 corresponding to audio input by the first user via first avatar 412 is played at the second device of the second user of second avatar 404 and not played at the third device of the third user of third avatar 406, the movement of first avatar 402 corresponding to audio 412 (e.g., moving lips and / or other physical gestures such as hand gestures) can still be seen by third avatar 406 (and any other avatars in ER scene 400) from outside private subspace 408. Thus, in some embodiments, the user of an avatar outside the private subspace (e.g., the third user of third avatar 406) cannot hear the audio 412 but can still see the movement (e.g., moving lips, hand gestures) corresponding to audio 412 via the user's device.

[0088] In some embodiments, as Figure 4FAs shown, when audio 412 corresponding to audio input by the first user via the first avatar 402 is played at the second device of the second user of the second avatar 404 and not played at the third device of the third user of the third avatar 406, the movement of the first avatar 402 corresponding to the audio 412 cannot be seen by the third avatar 406 (and any other avatars in the ER scene 400) from outside the private subspace 408. Therefore, in some embodiments, users of avatars outside the private subspace (e.g., the third user of the third avatar 406) cannot hear the audio corresponding to the audio 412, nor can they see the movement corresponding to the audio 412. Furthermore, in some embodiments, users of avatars outside the private subspace (e.g., the third user of the third avatar 406) cannot see any movement of the avatars (e.g., the first avatar 402 and the second avatar 404) within the private subspace via their devices.

[0089] Figure 4G ER scene 400 is shown, in which first avatar 402 and second avatar 404 are in private subspace 414, and third avatar 406 is not included in private subspace 414. In some embodiments, as Figure 4G As shown, private subspace 414 does not include visual indication 410 of private subspace 408 that indicates to external avatars (e.g., third avatar 406) that first avatar 402 and second avatar 404 are in the private subspace. Instead, in some embodiments, private subspace 414 includes visual indication 416A (e.g., a glowing / flashing light source) above or near first avatar 402 and similar visual indication 416B above or near second avatar 404, thereby indicating to external avatars (e.g., third avatar 406) that first avatar 402 and second avatar 404 are in the private subspace.

[0090] Figure 4H ER scene 420 is shown, which includes a first avatar 422 (corresponding to a first user of a first electronic device), a second avatar 424 (corresponding to a second user of a second electronic device), a third avatar 426 (corresponding to a third user of a third electronic device), and a fourth avatar 428 (corresponding to a fourth user of a fourth electronic device). Figure 4H As shown, the first avatar 422 and the second avatar 424 are in a first private subspace 430 within the ER scene 420 , and the third avatar 426 and the fourth avatar 428 are in a second private subspace 432 .

[0091] exist Figure 4I, audio 434 corresponding to audio input (e.g., verbal input, voice input) made by the second user (e.g., captured via a microphone of the second user's second device) via the second avatar 424 is played at the first device of the first user of the first avatar 422 because the first avatar 422 and the second avatar 424 are included in the same private subspace 430. However, the audio 434 is not played (e.g., it is prevented / blocked from playing) at the third device of the third user of the third avatar 426 and the fourth device of the fourth user of the fourth avatar 428 because both the third avatar 426 and the fourth avatar 428 are not included in the first private subspace 430 (but are included in different private subspaces 432).

[0092] In addition, Figure 4I , audio 436 corresponding to the audio input (e.g., verbal input, voice input) made by the third user (e.g., captured via a microphone of the third user's third device) via the third avatar 426 is played at the fourth device of the fourth user of the fourth avatar 428 because the third avatar 426 and the fourth avatar 428 are included in the same private subspace 432. However, the audio 436 is not played (e.g., it is prevented / blocked from playing) at the first device of the first user of the first avatar 422 and at the second device of the second user of the second avatar 424 because both the first avatar 422 and the second avatar 424 are not included in the second private subspace 432 (but are included in different private subspaces 430).

[0093] Figure 5 FIG. 1 is a flow chart for forming and maintaining a private subspace within an ER setting according to some embodiments. In some embodiments, Figure 5 Process 500 is performed by a system including one or more electronic devices (e.g., electronic device 100a, electronic device 206, electronic device 208; a mobile electronic device such as a smart phone or tablet; an HMD) and / or an external server, wherein the one or more electronic devices communicate with each other and / or with the external server.

[0094] At box 502, the system (e.g., 100a, 206, 208) displays an ER scene (e.g., 400, VR scene, MR scene, including AR scene) (e.g., at an electronic device such as electronic device 100a, 206, 208 of the system), where the ER scene includes multiple avatars (e.g., avatars of other users who share the same ER scene with the current user).

[0095] At box 504, when the ER scene (e.g., 400) is displayed, the system selects a first avatar (e.g., 404) of a plurality of avatars (e.g., 402, 404, 406) as a recipient of the received audio input (e.g., 412, audio input made by the user corresponding to a third avatar of the plurality of avatars) at box 506.

[0096] At block 504 , while displaying the ER scene (eg, 400 ), the system also selects, at block 508 , a second avatar (eg, 406 ) of the plurality of avatars (eg, 402 , 404 , 406 ) as a non-recipient of the received audio input.

[0097] At block 504 , while the ER scene (eg, 400 ) is displayed, the system also receives audio input (eg, 412 ) via a microphone (eg, a microphone of the current user's electronic device) at block 510 .

[0098] At block 504 , while displaying the ER scenery (eg, 400 ), the system also causes playback and corresponding visual avatar motion for the first avatar (eg, 404 ) at block 512 .

[0099] At block 504 , while displaying the ER scene (eg, 400 ), the system also forgoes causing playback of the audio (eg, 412 ) for the second avatar (eg, 406 ) at block 514 .

[0100] In some embodiments, causing playback and corresponding visual avatar movement for a first avatar (e.g., 404) includes causing playback and corresponding visual avatar movement for the first avatar based on determining that the first avatar is within a sub-ER set (e.g., 408) that includes the first avatar (e.g., shared with the current avatar) and does not include a second avatar (e.g., 406).

[0101] In some embodiments, determining that the first avatar (e.g., 404) is within a sub-ER set (e.g., 408) that includes the first avatar and does not include the second avatar is based on whether the first avatar meets the sub-ER set criteria (e.g., with a third avatar from the plurality of avatars). In some embodiments, meeting the sub-ER set criteria with the third avatar from the plurality of avatars enables the first avatar to enter and / or be associated with the sub-ER set with the third avatar.

[0102] In some embodiments, the satisfied sub-ER set criteria include the first avatar being within a predetermined distance from a third avatar (eg, 402 ) of the plurality of avatars within the ER set (eg, 400 ).

[0103] In some embodiments, the satisfied sub-ER scene criteria include detecting within the ER scene (eg, 400) a gaze of a first avatar (eg, 404) on a third avatar (eg, 402) of the plurality of avatars.

[0104] In some embodiments, the satisfied sub-ER scene criteria include detecting within the ER scene (eg, 400) a nod by the first avatar (eg, 404) to a third avatar (eg, 402) of the plurality of avatars.

[0105] In some embodiments, the satisfied sub-ER scene criteria include detecting within the ER scene (eg, 400) a wink by the first avatar (eg, 404) to a third avatar (eg, 402) of the plurality of avatars.

[0106] In some embodiments, a determination is made as to whether a first avatar (e.g., 404) has been selected (e.g., by a third avatar of the plurality of avatars) within a sub-ER set (e.g., 408) that includes the first avatar (e.g., 404) and does not include a second avatar (e.g., 406) based on an affordance (e.g., 404A) associated with the first avatar. In some embodiments, additionally or alternatively, a determination is made as to whether the first avatar has been selected by the first avatar within a sub-ER set that includes the first avatar and does not include the second avatar based on an affordance associated with a third avatar of the plurality of avatars.

[0107] In some embodiments, when displaying the ER backdrop (e.g., 400), the system presents (e.g., to a fourth avatar in the plurality of avatars) a visual indication of the first avatar (e.g., 416B, a light shown above or near the first avatar) indicating that the first avatar is the recipient of the received user input. In some embodiments, when displaying the ER backdrop, the system forgoes presenting (e.g., to a fourth avatar in the plurality of avatars) a visual indication for the second avatar (e.g., because the second avatar is not the recipient of the received user input).

[0108] In some embodiments, the visual indication of the first avatar (eg, 416B) is a light source shown within the ER set (eg, 400) near the first avatar (eg, 404) (eg, above its head).

[0109] The various processes defined herein contemplate the option of obtaining and utilizing users' personal information. For example, such personal information may be utilized to provide an enhanced experience for members of a shared augmented reality setting on one or more electronic devices. However, to the extent such personal information is collected, it should be obtained with the user's informed consent. As described herein, users should understand and control the use of their personal information.

[0110] Personal information will be used by appropriate parties only for legitimate and reasonable purposes. Parties utilizing such information will adhere to privacy policies and practices that, at a minimum, comply with applicable laws and regulations. Furthermore, such policies should be comprehensive, accessible, and recognized to meet or exceed government / industry standards. Furthermore, parties may not distribute, sell, or otherwise share such information except for any legitimate and lawful purpose.

[0111] However, users can limit the extent to which parties can access or otherwise obtain personal information. For example, settings or other preferences can be adjusted so that users can determine whether their personal information is accessible to various entities. Furthermore, while some features defined herein are described in the context of using personal information, aspects of these features can be implemented without requiring the use of such information. For example, if user preferences, account names, and / or location history are collected, this information can be obfuscated or otherwise generalized so that it does not identify the corresponding user.

Claims

1. A method comprising: At a first electronic device having one or more sensors and one or more displays and adapted to communicate with a second electronic device: determining whether a first user of the first electronic device and a second user of the second electronic device meet physical interaction criteria; determining, based on determining that the physical interaction criteria are met, whether the first electronic device is presenting a first augmented reality scene that is not shared with the second user; According to determining that the first electronic device is presenting the first augmented reality scene, causing the first electronic device to switch from presenting the first augmented reality scene to presenting a second augmented reality scene shared with the second user; while presenting the second augmented reality scene, determining whether a first avatar representing the first user and a second avatar representing the second user are engaging in a particular type of social interaction; as well as Based on determining that the first avatar and the second avatar are performing the specific type of social interaction, a private subspace is formed between the first avatar and the second avatar in the second augmented reality scene.

2. The method of claim 1 , wherein presenting the second augmented reality scene comprises: displaying a confirmation affordance at the first electronic device, the confirmation affordance requesting confirmation of entering the second augmented reality setting with the second user; as well as In response to detecting confirmation by the first user, presenting the second augmented reality scene including the second avatar representing the second user. 3 . The method of claim 1 , wherein satisfying the physical interaction criteria comprises the first user and the second user being within a predetermined distance of each other within a physical set. The method of claim 1 , wherein satisfying the physical interaction criteria comprises detecting a social signal between the first user and the second user within a physical setting. The method of claim 4 , wherein the social signal is a handshake performed between the first user and the second user within the physical setting. The method of claim 4 , wherein the social signal is a conversation conducted between the first user and the second user within the physical setting. The method of claim 4 , wherein the social signal is the first user's gaze on the second user within the physical set.

8. The method of claim 4, wherein the first electronic device comprises one or more sensors for detecting motion within the physical set corresponding to the signaling action by the first user.

9. A first electronic device, comprising: one or more sensors; one or more displays; a wireless communication radio configured to communicate with a second electronic device; one or more processors; as well as a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the following operations: determining whether a first user of the first electronic device and a second user of the second electronic device meet physical interaction criteria; determining, based on determining that the physical interaction criteria are met, whether the first electronic device is presenting a first augmented reality scene that is not shared with the second user; According to determining that the first electronic device is presenting the first augmented reality scene, causing the first electronic device to switch from presenting the first augmented reality scene to presenting a second augmented reality scene shared with the second user; while presenting the second augmented reality scene, determining whether a first avatar representing the first user and a second avatar representing the second user are engaging in a particular type of social interaction; as well as Based on determining that the first avatar and the second avatar are performing the specific type of social interaction, a private subspace is formed between the first avatar and the second avatar in the second augmented reality scene.

10. The first electronic device of claim 9, wherein presenting the second augmented reality scene comprises: displaying a confirmation affordance at the first electronic device, the confirmation affordance requesting confirmation of entering the second augmented reality setting with the second user; as well as In response to detecting confirmation by the first user, presenting the second augmented reality scene including the second avatar representing the second user.

11. The first electronic device of claim 9, wherein satisfying the physical interaction criteria comprises the first user and the second user being within a predetermined distance of each other within the physical setting. 12 . The first electronic device of claim 9 , wherein satisfying the physical interaction criteria comprises detecting a social signal between the first user and the second user within a physical setting. 13 . The first electronic device of claim 12 , wherein the social signal is a handshake performed between the first user and the second user within the physical setting.

14. The first electronic device of claim 12, wherein the social signal is a conversation conducted between the first user and the second user within the physical setting. 15 . The first electronic device of claim 12 , wherein the social signal is the first user's gaze on the second user within the physical setting.

16. The first electronic device of claim 12, wherein the first electronic device comprises one or more sensors for detecting motion within the physical setting corresponding to the signal action performed by the first user.

17. A computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a first electronic device having one or more sensors and one or more displays and adapted to communicate with a second electronic device, the one or more programs comprising instructions for performing the following operations: determining whether a first user of the first electronic device and a second user of the second electronic device meet physical interaction criteria; determining, based on determining that the physical interaction criteria are met, whether the first electronic device is presenting a first augmented reality scene that is not shared with the second user; According to determining that the first electronic device is presenting the first augmented reality scene, causing the first electronic device to switch from presenting the first augmented reality scene to presenting a second augmented reality scene shared with the second user; while presenting the second augmented reality scene, determining whether a first avatar representing the first user and a second avatar representing the second user are engaging in a particular type of social interaction; as well as Based on determining that the first avatar and the second avatar are performing the specific type of social interaction, a private subspace is formed between the first avatar and the second avatar in the second augmented reality scene.

18. The computer-readable storage medium of claim 17, wherein presenting the second augmented reality scene comprises: displaying a confirmation affordance at the first electronic device, the confirmation affordance requesting confirmation of entering the second augmented reality setting with the second user; as well as In response to detecting confirmation by the first user, presenting the second augmented reality scene including the second avatar representing the second user.

19. The computer-readable storage medium of claim 17, wherein satisfying the physical interaction criteria comprises the first user and the second user being within a predetermined distance of each other within a physical set.

20. The computer-readable storage medium of claim 17, wherein satisfying the physical interaction criteria comprises detecting a social signal between the first user and the second user within a physical set.

21. The computer-readable storage medium of claim 20, wherein the social signal is a handshake performed between the first user and the second user within the physical set.

22. The computer-readable storage medium of claim 20, wherein the social signal is a conversation conducted between the first user and the second user within the physical set.

23. The computer-readable storage medium of claim 20, wherein the social signal is the first user's gaze on the second user within the physical set.

24. The computer-readable storage medium of claim 20, wherein the first electronic device comprises one or more sensors for detecting motion within the physical set corresponding to the signaling action by the first user.

25. A computer program product comprising program code portions for performing the method according to any one of claims 1 to 8 when the computer program product is run on one or more computing devices.

Images