Synchronized display of content on multiple electronic devices

Abstract

Some examples of the present disclosure relate to systems and methods for synchronous display of content between multiple devices. In some examples, a first electronic device detects a second display in communication with a second electronic device at a first location in a physical environment of the first electronic device. In some examples, in response to detecting the second display, in accordance with a determination that one or more criteria are met, the first electronic device displays a first object at a first location in the computer-generated environment corresponding to the first location in the physical environment, where the first object includes first content. In some examples, in accordance with a determination that the one or more criteria are not satisfied, the first electronic device abandons displaying the first object at the first location in the computer-generated environment.

Description

[0001] Cross - Reference to Related Applications

[0002] This application claims the benefit of U.S. Provisional Application No. 63 / 625,526, filed on January 26, 2024, and U.S. Patent Application No. 19 / 033,259, filed on January 21, 2025, the entire disclosures of which are incorporated herein by reference for all purposes. Technical Field

[0003] The present invention generally relates to systems and methods for synchronously displaying content, such as video content, between electronic devices. Background Art

[0004] Some computer graphics environments provide two-dimensional and / or three-dimensional environments in which at least some of the objects displayed for a user to view are virtual and generated by a computer. In some examples, an electronic device displays a virtual user interface in a computer-generated environment, the virtual user interface being configured to playback content, such as video content. In some examples, the same content is also configured to be displayed on a two-dimensional display of a second electronic device different from the electronic device, the two-dimensional display being visible in the computer-generated environment. Summary of the Invention

[0005] Some examples of the present disclosure relate to systems and methods for synchronously displaying content between multiple devices. In some examples, a method is performed at a first electronic device in communication with one or more displays, one or more input devices, and one or more cameras. In some examples, the first electronic device detects, via the one or more cameras, a second display different from the one or more displays in communication with a second electronic device different from the first electronic device at a first location in the physical environment of the first electronic device. In some examples, in response to detecting the second display and based on a determination that one or more criteria are met, the first electronic device displays, via the one or more displays, a first object at a first location in a computer-generated environment corresponding to the first location in the physical environment, where the first object includes first content. In some examples, based on a determination that the one or more criteria are not met, the first electronic device abandons displaying the first object at the first location in the computer-generated environment.

[0006] In some examples, the one or more criteria include criteria that are met based on determining that the second display is displaying the first content. In some examples, the one or more criteria include criteria that are met based on determining that the first content is of a first type of content and that are not met based on determining that the first content is of a second type of content that is different from the first type. In some examples, the one or more criteria include criteria that are met based on determining that the gaze of a user of the first electronic device is directed at the second display when the second display is detected. In some examples, the one or more criteria include criteria that are met based on determining that content displayed via the second display can be visually detected via the one or more cameras based on one or more physical properties of the second display.

[0007] A full description of these examples is provided in the drawings and the detailed description, and it should be understood that the summary of the invention does not limit the scope of the disclosure in any way. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] To better understand the various examples described herein, reference should be made to the following detailed description and the following drawings. Throughout the drawings, like reference numerals generally refer to corresponding parts.

[0009] Figure 1 An electronic device presenting an extended reality environment in accordance with some examples of the present disclosure is illustrated.

[0010] Figures 2A to 2B A block diagram of an example architecture for an electronic device in accordance with some examples of the present disclosure is illustrated.

[0011] Figures 3A to 3J An example of an electronic device displaying a user interface including content in a computer-generated environment in response to detecting the display of the content in a physical environment in accordance with some examples of the present disclosure is illustrated.

[0012] Figures 4A to 4C An example of an electronic device causing content to be displayed at a second electronic device in a physical environment in accordance with some examples of the present disclosure is illustrated.

[0013] Figure 5 A flowchart of an example process for an electronic device to display a user interface including content in a computer-generated environment in response to detecting the display of the content in a physical environment in accordance with some examples of the present disclosure is shown. DETAILED DESCRIPTION

[0014] Some examples of the present disclosure relate to systems and methods for synchronously displaying content among multiple devices. In some examples, a method is performed at a first electronic device that communicates with one or more displays, one or more input devices, and one or more cameras. In some examples, the first electronic device detects, via the one or more cameras, at a first location in the physical environment of the first electronic device, a second display different from the one or more displays that communicates with a second electronic device different from the first electronic device. In some examples, in response to detecting the second display, and based on determining that one or more criteria are met, the first electronic device displays, via the one or more displays, a first object at a first location in a computer-generated environment corresponding to the first location in the physical environment, where the first object includes first content. In some examples, based on determining that the one or more criteria are not met, the first electronic device abandons displaying the first object at the first location in the computer-generated environment.

[0015] In some examples, the one or more criteria include criteria that are met based on determining that the second display is displaying the first content. In some examples, the one or more criteria include criteria that are met based on determining that the first content is of a first type and not met based on determining that the first content is of a second type different from the first type. In some examples, the one or more criteria include criteria that are met based on determining that, when the second display is detected, the gaze of a user of the first electronic device is directed at the second display. In some examples, the one or more criteria include criteria that are met based on determining that content displayed via the second display can be visually detected via the one or more cameras based on one or more physical properties of the second display.

[0016] In some examples, a three-dimensional object is displayed in a computer-generated three-dimensional environment in a particular orientation that controls one or more behaviors of the three-dimensional object (e.g., when the three-dimensional object moves within the three-dimensional environment). In some examples, the orientation of the three-dimensional object displayed in the three-dimensional environment is selected by a user of the electronic device or automatically selected by the electronic device. For example, when presenting the three-dimensional object in the three-dimensional environment is initiated, the user may select a particular orientation of the three-dimensional object, or the electronic device may automatically select the orientation of the three-dimensional object (e.g., based on the type of the three-dimensional object).

[0017] In some examples, 3D objects may be displayed in a 3D environment in a world-locked orientation, a body-locked orientation, a tilt-locked orientation, or a head-locked orientation, as described below. As used herein, an object displayed in a 3D environment in a body-locked orientation has a distance and orientation offset relative to a part of the user's body (e.g., the user's torso). Alternatively, in some examples, a body-locked object has a fixed distance from the user, and the orientation of the content is not referenced to any part of the user's body (e.g., it may be displayed in the same general direction relative to the user regardless of head and / or body movement). Additionally or alternatively, in some examples, a body-locked object may be configured to always maintain alignment with gravity or the horizon (e.g., perpendicular to gravity), such that changes in the head and / or body in the roll direction will not cause the body-locked object to move within the 3D environment. Instead, translational movement in either configuration will cause the body-locked object to reposition within the 3D environment to maintain the distance offset.

[0018] As used herein, an object displayed in a 3D environment in a head-locked orientation has a distance and orientation offset relative to the user's head. In some examples, the head-locked object moves within the 3D environment when the user's head moves (when the user's viewpoint changes).

[0019] As used herein, an object displayed in a 3D environment in a world-locked orientation does not have a distance or orientation offset relative to the user.

[0020] As used herein, an object displayed in a 3D environment in a tilt-locked orientation (referred to herein as a tilt-locked object) has a distance offset relative to the user (such as a part of the user's body (e.g., the user's torso) or the user's head). In some examples, the tilt-locked object is displayed in a fixed orientation relative to the 3D environment. In some examples, the tilt-locked object moves according to a polar (e.g., spherical) coordinate system centered on a pole passing through the user (e.g., the user's head). For example, based on movement of the user's head within a spherical space around the user's head (e.g., centered on the user's head), the tilt-locked object is moved within the 3D environment. Thus, if the user tilts their head relative to gravity (e.g., up or down in the pitch direction), the tilt-locked object will follow the head tilt and move radially along the sphere such that the tilt-locked object is repositioned within the 3D environment with the same distance offset relative to the user as before the head tilt, while optionally maintaining the same orientation relative to the 3D environment. In some examples, if the user moves their head relative to gravity in the roll direction (e.g., clockwise or counterclockwise), the tilt-locked object is not repositioned within the 3D environment.

[0021] Figure 1An electronic device 101 presenting an extended reality (XR) environment (e.g., a computer-generated environment optionally including representations of physical and / or virtual objects) in accordance with some examples of the present disclosure is shown. In some examples, as Figure 1 shown, the electronic device 101 is a head-mounted display or other head-mounted device configured to be worn on the head of a user of the electronic device 101. Examples of the electronic device 101 are described below with reference to Figure 2A the architecture block diagram. As Figure 1 shown, the electronic device 101 and the table 106 are located in a physical environment. The physical environment may include physical features such as physical surfaces (e.g., floors, walls) or physical objects (e.g., tables, lights, etc.). In some examples, the electronic device 101 may be configured to detect and / or capture an image of the physical environment including the table 106 (shown in the field of view of the electronic device 101).

[0022] In some examples, as Figure 1 shown, the electronic device 101 includes one or more internal image sensors 114a oriented towards the user's face (e.g., an eye-tracking camera described below with reference to Figure 2A ). In some examples, the internal image sensors 114a are used for eye tracking (e.g., detecting the user's gaze). The internal image sensors 114a are optionally arranged on the left and right portions of the display 120 to enable eye tracking of the user's left and right eyes. In some examples, the electronic device 101 further includes external image sensors 114b and 114c facing outward from the user to detect and / or capture the physical environment of the electronic device 101 and / or the movement of the user's hand or other body parts.

[0023] In some examples, the display 120 has a field of view visible to the user (e.g., which may or may not correspond to the field of view of the external image sensors 114b and 114c). Since the display 120 is optionally part of a head-mounted device, the field of view of the display 120 is optionally the same as or similar to the field of view of the user's eyes. In other examples, the field of view of the display 120 may be smaller than the field of view of the user's eyes. In some examples, the electronic device 101 may be an optical see-through device, where the display 120 is a transparent or semi-transparent display through which portions of the physical environment can be viewed directly. In some examples, the display 120 may be included within a transparent lens and may overlap all or only a portion of the transparent lens. In other examples, the electronic device may be a video see-through device, where the display 120 is an opaque display configured to display an image of the physical environment captured by the external image sensors 114b and 114c. Although a single display 120 is shown, it should be understood that the display 120 may include a pair of stereoscopic displays.

[0024] In some examples, in response to a trigger, the electronic device 101 may be configured to display, in an XR environment, a virtual object 104 represented by a cube as shown in Figure 1 . The virtual object does not exist in the physical environment but is displayed in the XR environment located on top of the real-world table 106 (or its representation). Optionally, in response to detecting the plane of the table 106 in the physical environment 100, the virtual object 104 may be displayed on the surface of the table 106 in the XR environment displayed via the display 120 of the electronic device 101.

[0025] It should be understood that the virtual object 104 is a representative virtual object and may include and render one or more different virtual objects (e.g., virtual objects having various dimensions, such as two-dimensional or other three-dimensional virtual objects) in a three-dimensional XR environment. For example, the virtual object may represent an application or a user interface displayed in the XR environment. In some examples, the virtual object may represent an application and / or content displayed via the user interface in the XR environment. In some examples, the virtual object 104 is optionally configured to be interactive and responsive to user input (e.g., air gestures such as air pinch gestures, air tap gestures, and / or air touch gestures), such that the user can virtually touch, tap, move, rotate, or otherwise interact with the virtual object 104.

[0026] In some examples, displaying an object in a three-dimensional environment may include interacting with one or more user interface objects in the three-dimensional environment. For example, initiating the display of an object in a three-dimensional environment may include interacting with one or more virtual options / affordance representations displayed in the three-dimensional environment. In some examples, when initiating the display of an object in a three-dimensional environment, the electronic device may track the user's gaze as an input for identifying one or more virtual options / affordance representations as targets for selection. For example, the gaze may be used to identify one or more virtual options / affordance representations as targets for selection using another selection input. In some examples, hand tracking input detected via an input device communicatively coupled to the electronic device may be used to select the virtual options / affordance representations. In some examples, an object displayed in a three-dimensional environment may move and / or reorient in the three-dimensional environment in accordance with movement input detected via the input device.

[0027] In the following discussion, an electronic device that communicates with a display generation component and one or more input devices is described. It should be understood that the electronic device optionally communicates with one or more other physical user interface devices, such as a touch-sensitive surface, a physical keyboard, a mouse, a joystick, a hand-tracking device, an eye-tracking device, a stylus, etc. Additionally, as described above, it should be understood that the described electronic device, display, and touch-sensitive surface are optionally distributed among two or more devices. Thus, as used in this disclosure, information displayed on or by the electronic device optionally describes information output by the electronic device for display on a separate display device (touch-sensitive or non-touch-sensitive). Similarly, as used in this disclosure, an input received on the electronic device (e.g., a touch input received on the touch-sensitive surface of the electronic device, or a touch input received on the surface of a stylus) optionally describes an input received on a separate input device from which the electronic device receives input information.

[0028] The device generally supports a variety of applications, such as one or more of the following: a drawing application, a presentation application, a word processing application, a website creation application, a disk editing application, a spreadsheet application, a game application, a telephone application, a video conferencing application, an email application, an instant messaging application, a fitness support application, a photo management application, a digital camera application, a digital video camera application, a web browsing application, a digital music player application, a television channel browsing application, and / or a digital video player application.

[0029] Figures 2A to 2B A block diagram of an example architecture for electronic devices 201 and 260 in accordance with some examples of the present disclosure is illustrated. In some examples, electronic device 201 includes one or more electronic devices. For example, electronic device 201 can be a portable device, an auxiliary device that communicates with another device, a head-mounted display, etc., respectively. In some examples, electronic device 201 corresponds to electronic device 101 described above with reference to Figure 1 the described electronic device 101.

[0030] As Figure 2A illustrated, electronic device 201 optionally includes various sensors, such as one or more hand-tracking sensors 202, one or more position sensors 204, one or more image sensors 206 (optionally corresponding to Figure 1the internal image sensor 114a and / or the external image sensors 114b and 114c), one or more touch-sensitive surfaces 209A, one or more motion and / or orientation sensors 210, one or more eye-tracking sensors 212, one or more microphones 213 or other audio sensors, one or more body-tracking sensors (e.g., torso and / or head-tracking sensors), one or more display generation components 214A (optionally corresponding to Figure 1 the display 120 in Figure 2B ), one or more speakers 216, one or more processors 218A, one or more memories 220A, and / or communication circuitry 222A. One or more communication buses 208A are optionally used for communication between the above-mentioned components of the electronic device 201. Additionally, as

[0031] shown in the electronic device 260 optionally includes one or more touch-sensitive surfaces 209B, one or more display generation components 214B, one or more processors 218B, one or more memories 220B, and / or communication circuitry 222B. One or more communication buses 208B are optionally used for communication between the above-mentioned components of the electronic device 260. The electronic devices 201 and 260 are optionally configured to communicate via a wired or wireless connection between the two electronic devices (e.g., via the communication circuitry 222A, 222B).

[0031] The communication circuitry 222A, 222B optionally includes circuitry for communicating with electronic devices, networks (such as the Internet, intranet, wired networks, and / or wireless networks, cellular networks, and wireless local area network (LAN)). The communication circuitry 222A, 222B optionally includes circuitry for communicating using near field communication (NFC) and / or short-range communication such as to communicate.

[0032] Processors 218A, 218B include one or more general-purpose processors, one or more graphics processors, and / or one or more digital signal processors. In some examples, memories 220A, 220B are non-transitory computer-readable storage media (e.g., flash memory, random access memory, or other volatile or non-volatile memory or storage devices) that store computer-readable instructions configured to be executed by processors 218A, 218B to perform the techniques, processes, and / or methods described below. In some examples, memories 220A, 220B may include more than one non-transitory computer-readable storage media. A non-transitory computer-readable storage media can be any media (e.g., excluding signals) that can tangibly contain or store computer-executable instructions for use by or in connection with an instruction execution system, apparatus, and device. In some examples, the storage media is a transitory computer-readable storage media. In some examples, the storage media is a non-transitory computer-readable storage media. Non-transitory computer-readable storage media can include, but are not limited to, magnetic storage devices, optical storage devices, and / or semiconductor storage devices. Examples of such storage devices include magnetic disks, optical discs based on compact disc (CD), digital versatile disc (DVD), or Blu-ray technology, and persistent solid-state memories (such as flash memory, solid-state drives, etc.).

[0033] In some examples, display generation components 214A, 214B include a single display (e.g., a liquid crystal display (LCD), an organic light-emitting diode (OLED), or other type of display). In some examples, display generation components 214A, 214B include multiple displays. In some examples, display generation components 214A, 214B can include a display with touch capabilities (e.g., a touch screen), a projector, a holographic projector, a retinal projector, a transparent or semi-transparent display, etc. In some examples, electronic devices 201 and 260 respectively include touch-sensitive surfaces 209A and 209B for receiving user inputs such as tap inputs and swipe inputs or other gestures. In some examples, display generation components 214A, 214B and touch-sensitive surfaces 209A, 209B form a touch-sensitive display (e.g., a touch screen integrated with each of electronic devices 201 and 260 or a touch screen external to each of electronic devices 201 and 260 and communicating with each of electronic devices 201 and 260).

[0034] The electronic device 201 optionally includes an image sensor 206. The image sensor 206 optionally includes one or more visible light image sensors (such as charge-coupled device (CCD) sensors) and / or complementary metal oxide semiconductor (CMOS) sensors operable to obtain images of physical objects from a real-world environment. The image sensor 206 also optionally includes one or more infrared (IR) sensors, such as passive IR sensors or active IR sensors, for detecting infrared light from the real-world environment. For example, an active IR sensor includes an IR emitter for emitting infrared light into the real-world environment. The image sensor 206 also optionally includes one or more cameras configured to capture movement of physical objects in the real-world environment. The image sensor 206 also optionally includes one or more depth sensors configured to detect the distance of physical objects from the electronic device 201. In some examples, information from one or more depth sensors may allow the device to identify objects in the real-world environment and distinguish them from other objects in the real-world environment. In some examples, one or more depth sensors may allow the device to determine the texture and / or topography of objects in the real-world environment.

[0035] In some examples, the electronic device 201 uses a combination of a CCD sensor, an event camera, and a depth sensor to detect the physical environment around the electronic device 201. In some examples, the image sensor 206 includes a first image sensor and a second image sensor. The first image sensor and the second image sensor work together and are optionally configured to capture different information about physical objects in the real-world environment. In some examples, the first image sensor is a visible light image sensor and the second image sensor is a depth sensor. In some examples, the electronic device 201 uses the image sensor 206 to detect the positioning and orientation of the electronic device 201 and / or the display generation component 214A in the real-world environment. For example, the electronic device 201 uses the image sensor 206 to track the positioning and orientation of the display generation component 214A relative to one or more fixed objects in the real-world environment.

[0036] In some examples, the electronic device 201 includes a microphone 213 or other audio sensor. The electronic device 201 optionally uses the microphone 213 to detect sounds from the user and / or the user's real-world environment. In some examples, the microphone 213 includes an array of microphones (multiple microphones) that optionally operate together, such as to identify ambient noise or to locate the sound source in the space of the real-world environment.

[0037] The electronic device 201 includes a position sensor 204 for detecting the position of the electronic device 201 and / or the display generation component 214A. For example, the position sensor 204 may include a Global Positioning System (GPS) receiver that receives data from one or more satellites and allows the electronic device 201 to determine its absolute location in the physical world.

[0038] The electronic device 201 includes an orientation sensor 210 for detecting the orientation and / or movement of the electronic device 201 and / or the display generation component 214A. For example, the electronic device 201 uses the orientation sensor 210 to track changes in the position and / or orientation of the electronic device 201 and / or the display generation component 214A (such as relative to physical objects in the real-world environment). The orientation sensor 210 optionally includes one or more gyroscopes and / or one or more accelerometers.

[0039] In some examples, the electronic device 201 includes a hand-tracking sensor 202 and / or an eye-tracking sensor 212 and / or other body-tracking sensors, such as a leg-tracking sensor, a torso-tracking sensor, and / or a head-tracking sensor. The hand-tracking sensor 202 is configured to track the position / location of one or more parts of the user's hand, and / or the movement of one or more parts of the user's hand relative to the extended reality environment, relative to the display generation component 214A, and / or relative to another defined coordinate system. The eye-tracking sensor 212 is configured to track the position and movement of the user's gaze (more generally, the eyes, face, or head) relative to the real world or the extended reality environment and / or relative to the display generation component 214A. In some examples, the hand-tracking sensor 202 and / or the eye-tracking sensor 212 are implemented together with the display generation component 214A. In some examples, the hand-tracking sensor 202 and / or the eye-tracking sensor 212 are implemented separately from the display generation component 214.

[0040] In some examples, the hand tracking sensor 202 (and / or other body tracking sensors, such as leg, torso, and / or head tracking sensors) may use an image sensor 206 (e.g., one or more IR cameras, 3D cameras, depth cameras, etc.) that captures three-dimensional information from the real world including one or more body parts (e.g., the hand, leg, torso of a human user). In some examples, there is sufficient resolution to distinguish the hand to distinguish the fingers and their respective positions. In some examples, one or more image sensors 206 are positioned relative to the user to define the field of view and interaction space of the image sensor 206, in which the finger / hand positions, orientations, and / or movements captured by the image sensor are used as input (e.g., to distinguish from the user's resting hand or the hands of others in the real-world environment). Tracking the finger / hand for input (e.g., gestures, touches, taps, etc.) may be advantageous because this does not require the user to touch, hold, or wear any type of beacon, sensor, or other marker.

[0041] In some examples, the eye tracking sensor 212 includes at least one eye tracking camera (e.g., an infrared (IR) camera) and / or a lighting source (e.g., an IR light source such as an LED) that emits light toward the user's eyes. The eye tracking camera may be pointed at the user's eyes to directly or indirectly receive reflected IR light from the light source from the eyes. In some examples, both eyes are tracked separately by respective eye tracking cameras and lighting sources, and the focus / gaze may be determined by tracking both eyes. In some examples, one eye (e.g., the dominant eye) is tracked by one or more respective eye tracking cameras / lighting sources.

[0042] The electronic devices 201 and 260 are not limited to Figures 2A to 2B the components and configurations described, but may include fewer components, other components, or additional components in a variety of configurations. In some examples, the electronic device 201 and / or the electronic device 260 may each be implemented among multiple electronic devices (e.g., as a system). In some such examples, each (or multiple) electronic device may each include one or more of the same components discussed above, such as various sensors, one or more display generation components, one or more speakers, one or more processors, one or more memories, and / or communication circuitry. One or more persons using the electronic device 201 and / or the electronic device 260 are optionally referred to herein as one or more users of the device.

[0043] Attention is now turned to examples of selectively displaying one or more user interfaces in a computer-generated environment, where the one or more user interfaces include content corresponding to content displayed on a physical display within the physical environment of the computer-generated environment.

[0044] Figures 3A to 3J Illustrated is an example of an electronic device in accordance with some examples of the present disclosure that displays a user interface including content in a computer-generated environment in response to detecting the display of the content in a physical environment. The electronic device 101 may correspond to or be similar to the electronic device 101 or 201 discussed above, and / or may be a head-mounted system / device and / or a projection-based system / device (including a hologram-based system / device) configured to generate and present a three-dimensional environment, such as, for example, a head-up display (HUD), a head-mounted display (HMD), a window with integrated display capabilities, or a display formed as a lens (e.g., similar to a contact lens) designed to be placed on a person's eye. In Figures 3A to 3J an example, the user optionally wears the electronic device 101 such that the three-dimensional environment 350 (e.g., a computer-generated environment) can be defined by an X-axis, a Y-axis, and a Z-axis viewed from the perspective of the electronic device (e.g., the viewpoint associated with the user of the electronic device 101). Thus, as used herein, the electronic device 101 is configured to be capable of moving in six degrees of freedom based on the movement of the user (e.g., the user's head) such that the electronic device 101 can move in a roll direction, a pitch direction, and / or a yaw direction.

[0045] As Figure 3A shown, the electronic device 101 may be located in a physical environment (e.g., an outdoor environment) that includes a plurality of real-world objects. For example, in Figure 3A an example, the electronic device 101 may be located in a physical environment 340 that includes a television 360 having a display 370 visible in the field of view of the electronic device 101. In some examples, the television 360 has Figure 2B one or more characteristics of the electronic device 260 in

[0046] As Figure 3AAs shown in the top view 310 in [document], user 304 of the electronic device 101 can be juxtaposed with a second user 305 in the physical environment 340. In some examples, as illustrated in the top view 310, the second user 305 optionally does not use (e.g., does not wear) an electronic device similar to the electronic device 101. For example, in Figure 3A the second user 305 does not wear a head-mounted display as the user 304 does. Additionally, as shown in the top view 310, the user 304 and the second user 305 face the television 360 in the physical environment 340, as indicated by the respective arrows extending from the users 304 and 305.

[0047] In some examples, the electronic device 101 facilitates a shared viewing experience of the content being presented in the physical environment 340 (such as the content being displayed on the display 370 of the television 360). For example, as discussed herein, the electronic device 101 can be configured to present virtual objects (e.g., virtual windows) in a three-dimensional environment 350 that include the content being displayed on the display 370 and / or correspond to or are otherwise associated with the content being displayed on the display 370 in the physical environment 340. As Figure 3A illustrated, the television 360 is not currently displaying content on the display 370 (e.g., because the television 360 is currently powered off, operating in a low-power mode or a sleep mode, or otherwise not displaying content on the display 370). Thus, as discussed in more detail below, the electronic device 101 forgoes presenting a virtual object of the content being displayed in the three-dimensional environment 350 (e.g., because there is no content being displayed in the physical environment 340 currently).

[0048] Receives from Figures 3A to 3B the television 360 a sequence of one or more inputs that cause the television 360 to initiate displaying content on the display 370. For example, as Figure 3B shown, the television 360 is displaying video content 315 (e.g., an episode of a television (TV) show, a movie, a short film, or other video content) accessible on the television 360 on the display 370 (e.g., via an application running on the television 360, via an auxiliary electronic device communicating with the television 360 such as a cable box, a digital media player, a console, or other set-top box, etc.). In some examples, the sequence of one or more inputs includes inputs to power on and / or activate (e.g., wake up) the television 360 and / or the display 370, one or more inputs to navigate to and / or through an application or other video delivery service (e.g., cable television), and / or inputs to select a specific content item (e.g., a movie, a TV episode, a channel, a clip, etc.) for playback on the display 370. In some examples, as Figure 3BAs shown, when the television 360 initiates playback of the video content 315, the video content 315 is included in the three-dimensional environment 350 (e.g., via a representation of the physical environment 340 or passthrough of the physical environment 340).

[0049] In Figure 3B , the electronic device 101 visually detects the video content 315 being played back (e.g., displayed) on the display 370 of the television 360. For example, the electronic device 101 scans and / or captures one or more images of the video content 315 being displayed in the physical environment 340 (e.g., using one or more cameras such as the external image sensors 114b and 114c). As mentioned above, in some examples, the electronic device 101 may be configured to present one or more virtual objects in the three-dimensional environment 350, the one or more virtual objects including content corresponding to or otherwise associated with the video content 315 detected by the electronic device 301. Specifically, in some examples, the electronic device 101 displays one or more virtual objects in the three-dimensional environment 350 based on determining that one or more criteria are met, as discussed below.

[0050] In some examples, the satisfaction of one or more criteria is based on the detectability of the video content 315 being displayed in the physical environment 340. For example, one or more physical attributes of the television 360 and / or the electronic device 101 may determine (e.g., enable or impede) the ability of one or more cameras of the electronic device 101 to visually detect the video content 315 being displayed on the display 370 (e.g., scan the video content and / or capture an image of the video content), the one or more physical attributes such as: the angle of the television 360 relative to the electronic device 101, the position of the television 360 in the physical environment 340 relative to the electronic device 101 (e.g., and / or the television 360 is within the field of view of the electronic device 101), the size of the display 370 of the television 360, and / or the orientation of the television 360 relative to the electronic device 101 (e.g., the video content 315 is aligned with the horizontal line of the field of view of the three-dimensional environment 350 (e.g., the horizontal line extending through the center of the field of view)). As an example, if the display 370 of the television 360 is oriented at an extreme angle relative to the viewing point of the electronic device 101 (e.g., oriented at greater than 45 degrees, 50 degrees, 55 degrees, 70 degrees, 8 degrees, 90 degrees, etc. relative to the viewing point) and / or is below a threshold size relative to the viewing point of the electronic device 101, the video content 315 being displayed on the display 370 may not be detectable by one or more cameras of the electronic device 101.

[0051] In some examples, satisfaction of one or more criteria is based on communication between the electronic device 101 and the television 360. For example, if the electronic device 101 communicates with the television 360 (e.g., or an auxiliary electronic device that communicates with the television 360, such as a cable box, digital media player, console, or other set-top box) and / or is configured to communicate with the television (e.g., via a wired or wireless communication link), then one or more criteria are satisfied. Additionally or alternatively, in some examples, if the television 360 (e.g., or an auxiliary electronic device that communicates with the television 360) and the electronic device 101 are associated with the same user account (e.g., having one or more authorized users) and the user is logged into the user account on both devices, then one or more criteria are satisfied. In some examples, satisfaction of one or more criteria is based on access to video content 315 being displayed on the display 370. For example, access to the video content 315 can be based on the association of the electronic device 101 with the same user account as the television 360, as discussed similarly above. In some examples, access to the video content 315 is based on one or more device permissions (e.g., user settings). For example, the electronic device 101 is associated with the same user account as the television 360, but the electronic device 101 is specifically not authorized to display the video content 315 (e.g., according to parental restrictions imposed by the electronic device 101). In some examples, access to the video content 315 is based on the availability of the video content 315 on the electronic device 101. For example, the video content 315 may not be downloaded to and / or stored in the media library or other repository of the electronic device 101, or the electronic device 101 currently does not have access to the video content 315 because the application through which the video content 315 is available is not currently running on the electronic device 101 or is not operable on the electronic device (e.g., due to Wi-Fi, data, or other wireless connection issues). In some examples, access to the video content 315 is based on the privacy of the content being displayed on the television 360. For example, if the content being displayed on the display 370 is publicly available content (e.g., content that is free to access via the Internet or via a paid subscription) via an application, website, etc., then one or more criteria are satisfied. Thus, if the video content 315 is private content, such as a video recording or image captured by a particular electronic device or a file stored on a particular electronic device (e.g., the personal device of a second user 305) that is not accessible via an application, website, etc., then one or more criteria are not satisfied. As another example, if the video content 315 corresponds to a digital video call with one or more other users (e.g., including the second user 305) who do not include the electronic device 101, then one or more criteria are not satisfied (e.g., because the electronic device 101 is not actually communicating with the other devices used for the call).

[0052] In some examples, satisfaction of one or more criteria is based on content type. For example, the electronic device 101 may be configured to render (e.g., generate and display) a particular type of content in the three-dimensional environment 350 but not other content. For example, if the content being displayed on the display 370 is a movie (e.g., video content) that is produced and distributed for mass consumption (e.g., by a particular media provider such as a production company, network, filmmaker, etc.), then one or more criteria are satisfied. On the other hand, in some cases, if the content corresponds to a still image (e.g., a single photo, screenshot, or other image file), then one or more criteria are not satisfied. As another example, if the content corresponds to the user interface of a particular application (e.g., an internet browsing application, a video game application, a music player application, etc.), then one or more criteria are satisfied, but if the content corresponds to the user interface of other applications (e.g., a note-taking application, a document viewing application, a messaging application (e.g., email, text, online messaging, etc.), etc.), then one or more criteria are not satisfied.

[0053] In some examples, satisfaction of one or more criteria is based on the identification of the video content 315. For example, the identification of the video content 315 controls whether the electronic device 101 can generate and display the same content in the three-dimensional environment 350. Thus, if the electronic device 101 cannot identify a particular video content 315 and / or locate the source for playing back the video content 315, then the electronic device 101 optionally cannot display a virtual object that includes the video content 315 (or content associated with the video content 315). In some examples, the identification of the video content 315 is based on one or more image processing techniques such as computer vision, optical character recognition, object recognition, and other possibilities. In some such examples, if such image processing techniques cannot produce results that match the video content 315 (e.g., above a certain threshold confidence level such as 85%, 88%, 90%, 95%, etc.), then one or more criteria are not satisfied. Additionally or alternatively, in some examples, the identification of the video content 315 is based on content identification data received from the television 360 (e.g., and / or an auxiliary electronic device in communication with the television 360 as similarly discussed above). For example, the electronic device 101 receives the content identification data from the television 360 and uses the content identification data to locate the source for playing back the video content 315.

[0054] In some examples, the electronic device 101 determines satisfaction of one or more criteria based on detecting the user's attention and / or interest in the video content 315. For example, in Figure 3BIn [the above], the electronic device 101 determines that one or more criteria are met based on determining the user's gaze direction towards the video content 315 displayed on the display 370. Similarly, the electronic device 101 determines that one or more criteria are met based on determining that the video content 315 remains visible and detectable in the field of view of the electronic device 101 for at least a threshold amount of time (e.g., 1 second, 2 seconds, 3 seconds, 4 seconds, 5 seconds, 10 seconds, 15 seconds, 30 seconds, 60 seconds, 90 seconds, etc.). In some examples, if the user's gaze points towards the video content 315 in the physical environment for at least a threshold amount of time, one or more criteria are met. In some examples, the electronic device 101 determines that one or more criteria are met in response to detecting an alternative form of user input indicating the user's interest in the video content 315 (such as a pointing gesture, a clapping gesture, a capturing gesture, or other gestures performed by one or more hands of the user 304 and pointing towards the video content 315). In some examples, the user input includes verbal input indicating the user's interest detected via the microphone of the electronic device 101 (e.g., the electronic device 101 detects the user 304 saying words such as "I like this movie" or "I've always wanted to watch this show" and other possibilities).

[0055] In Figure 3B [the above], in response to visually detecting the video content 315 in the physical environment 340, the electronic device 301 determines that one or more criteria discussed above are met. It should be understood that in Figure 3B [the] examples, the electronic device 301 determines that one or more criteria are met based on meeting any one of the criteria discussed above or a combination thereof.

[0056] In some examples, as Figure 3C [the above] shows, based on determining that one or more criteria are met, the electronic device 101 displays a virtual window 330 in the three-dimensional environment 350. Additionally, as Figure 3C [the above] shows, the virtual window 330 optionally displays the video content 315 discussed above and simultaneously on the display 370 of the television 360 in the physical environment 340. In some examples, the virtual window 330 corresponds to and / or includes a virtual playback user interface configured to play back virtual media (e.g., movies, TV shows, video clips, etc.). In some examples, the virtual window 330 is associated with a corresponding application running on the electronic device 101 (such as a media player application). As Figure 3C [the above] shows, in some examples, the virtual window 330 is displayed together with a gripper of a handle 335, which can be selected to initiate the movement of the virtual window 330 (and thus the video content 315) within the three-dimensional environment 350.

[0057] As Figure 3CAs shown in the top view 310 in [reference], when the electronic device 101 displays the virtual window 330 in the three-dimensional environment 350, the virtual window 330 is displayed in the three-dimensional environment 350 at a position corresponding to and / or overlapping with the position of the display 370 of the television 360 in the physical environment 340. Thus, as Figure 3C shown, when the virtual window 330 is displayed in the three-dimensional environment 350, the virtual window 330 occludes the display 370 and / or overlaps on the display relative to the viewpoint of the user 304 (e.g., from the viewpoint of the user 304, the virtual window 330 is positioned in front of the television 360), such that the video content 315 displayed on the display 370 is no longer visible in the three-dimensional environment 350. In some examples, the size of the virtual window 330 corresponds to (e.g., is the same as) the size of the display 370 of the television 360 in the physical environment 340, as illustrated in the top view 310. In some examples, the size of the virtual window 330 is larger than the size of the display 370 in the physical environment 340. In some examples, the virtual window 330 is displayed as a world-locked object in the three-dimensional environment 350. As indicated in the top view 310, since the virtual window 330 is only displayed by the electronic device 101, the video content 315 displayed on the display 370 of the television 360 remains visible to the second user 305 in the physical environment 340.

[0058] In some examples, the electronic device 101 is using the same source (e.g., media provider) as the source of the video content 315 that the television 360 is displaying on the display 370 to display the video content 315. For example, the electronic device 101 and the television 360 (e.g., or an auxiliary electronic device communicating with the television 360, as similarly discussed above) are using streaming and / or broadcast data provided by the same media provider and / or application to display the video content 315. In some examples, the electronic device 101 is using a different source (e.g., media provider) than the source of the video content 315 that the television 360 is displaying on the display 370 to display the video content 315. For example, the electronic device 101 and the television 360 (e.g., or an auxiliary electronic device communicating with the television 360, as similarly discussed above) are using streaming and / or broadcast data provided by different media providers and / or different applications to display the video content 315.

[0059] In some examples, the display of video content 315 in the virtual window 330 is synchronized with the display of video content 315 on the display 370 of the television 360. For example, the video content 315 is displayed in the virtual window 330 at the same playback position as the video content 315 displayed on the display 370 of the television 360 in the physical environment 340. Additionally, in some examples, the video content 315 is displayed at the same playback speed as the video content 315 displayed on the display 370 of the television 360 in the physical environment 340. In some examples, the output of the audio corresponding to the video content 315 is thus synchronized between the electronic device 101 and the television 360. For example, the audio of the video content 315 output by the electronic device 101 (e.g., via one or more speakers communicating with the electronic device 101) corresponds to the audio of the video content 315 output by the television 360 (e.g., via one or more speakers communicating with the television 360). Similarly, in some examples, the audio corresponding to the video content 315 is output by the devices (e.g., the electronic device 101 and the television 360) in the same format. For example, the audio may be presented as spatial audio, stereo audio, etc. at both the electronic device 101 and the television 360 (e.g., the audio may be spatialized relative to the television 360 in the three-dimensional environment 350). It should be understood that in some examples, one or more characteristics of the output of the audio corresponding to the video content 315 may be personalized and / or adjusted by its respective user at each device, such as the volume of the audio, the format of the audio, etc. Additionally, it should be understood that in some examples, the electronic device 101 abandons outputting the audio corresponding to the video content 315 based on determining that the audio is being alternately presented in a manner sufficient for the user 304 to hear the audio. For example, if the television 360 or the electronic device 101 is outputting audio via an external speaker or some other audio system, or if the audio is being output via open headphones (e.g., worn and / or used by the second user 305), the electronic device 101 abandons outputting the audio corresponding to the video content 315. Thus, for the user 304 and the second user 305 across the electronic device 101 and the television 360, the viewing experience of the video content 315 is synchronized and consistent.

[0060] Thus, in some examples, one benefit of presenting the virtual window 330 including the video content 315 in the manner discussed above is that the image quality of the content as viewed by the user 304 of the electronic device 101 may be improved compared to alternatively viewing the video content 315 via passthrough (as discussed below with reference to Figure 3D ), which improves the experience. For example, as discussed below, presenting the video content 315 as a passthrough representation to the user 304 may result in a degradation of the image quality due to the reliance on image capture by one or more cameras of the electronic device 101.

[0061] Alternatively, in some examples, the electronic device 101 displays content that supplements the video content 315 in a three-dimensional environment 350. For example, as Figure 3D shown, as a supplement to or alternative to displaying the virtual window 330 that includes the video content 315, the electronic device 101 displays supplementary content in the three-dimensional environment 350 in response to detecting the video content 315 and based on determining that one or more of the criteria discussed above are met. As Figure 3D shown, the electronic device 101 displays one or more user interface elements that include information and / or other content associated with the video content 315 being displayed on the display 370 of the television 360. For example, as Figure 3D shown, the electronic device 101 is displaying: a first user interface element 321 that includes information indicating an actor in the video content 315 (e.g., a lead actor, an actor currently in the scene, etc.); a second user interface element 322 that includes a description of the video content 315 (e.g., the name of the video content 315, the genre of the video content 315, and / or a summary or overview of the video content 315); and a third user interface element 323 that includes an indication of the content type of the video content 315 (e.g., episode content). Thus, as Figure 3D illustrated, the user 304 of the electronic device 101 can view the video content 315 being displayed on the display 370 (e.g., view a representation of the video content 315 or view the video content 315 in a passthrough manner) while obtaining additional insights into the video content 315 via the information presented in one or more user interface elements in the three-dimensional environment 350, thereby enhancing the user's viewing experience.

[0062] In some examples, as Figure 3D shown, one or more user interface elements are displayed in the three-dimensional environment 350 relative to the display 370 of the television 360. For example, one or more user interface elements are displayed at a location in the three-dimensional environment 350 surrounding the television 360, such as in front of the television 360 relative to the viewpoint of the user 304, below the television 360 relative to the viewpoint of the user 304, on one side of the television 360 relative to the viewpoint, and / or above the television 360 relative to the viewpoint. In some examples, the first user interface element 321, the second user interface element 322, and the third user interface element 323 are displayed as world-locked objects in the three-dimensional environment 350.

[0063] As mentioned above, in some examples, when video content 315 is displayed in virtual window 330 in a three-dimensional environment 350, electronic device 101 synchronizes the display and playback of video content 315 with the display and playback of video content 315 displayed on display 370 of television 360 in physical environment 340. Thus, as discussed below, a detected user input for adjusting the playback of video content 315 at one device optionally causes the playback of video content 315 to be adjusted at both devices (e.g., electronic device 101 and television 360).

[0064] In Figure 3E , when electronic device 101 is displaying virtual window 330 that includes video content 315 in a three-dimensional environment 350, electronic device 101 detects an input corresponding to a request to update the current playback position within video content 315 (e.g., an input to scrub video content 315). For example, as shown in Figure 3E , electronic device 101 detects a pinch and drag gesture performed by hand 303 of user 304 (e.g., where the index finger and thumb of hand 303 come together in contact and then hand 303 moves in the direction of arrow 371), while the gaze 325 of user 304 is directed at scrub bar 338 within playback timeline 337 in virtual window 330. In other words, the input provided by hand 303 corresponds to a request to rewind video content 315 relative to the current playback position within video content 315. In some examples, the input provided by user 304 includes only gaze-based interactions, verbal commands, selection of affordances (e.g., selection of a rewind arrow or fast forward arrow), etc. It should be understood that additional or alternative inputs may be detected for adjusting the playback of video content 315 in three-dimensional environment 350, such as selecting a pause option 336 in virtual window 330, which may be selected to pause the playback of video content 315. It should also be understood that the input may alternatively be directed at television 360 and detected by the television. For example, user 304 or second user 305 may provide the scrub input (or alternative input) discussed above via a remote input device (e.g., a remote controller that includes multiple buttons and / or a touch-sensitive surface) that communicates with television 360.

[0065] In some examples, as shown in Figure 3F , in response to detecting the above input provided by hand 303, electronic device 101 updates the current playback position within video content 315 in virtual window 330. For example, as shown in Figure 3F , electronic device 101 rewinds video content 315, which causes different scenes within video content 315 to be displayed (e.g., different from Figure 3Ethe specific scenario shown in). As described above, when the electronic device 101 updates the current playback position within the video content 315 in the virtual window 330 in response to detecting the input discussed above, the television 360 similarly updates the current playback position within the video content 315 displayed on the display 370 in the physical environment 340, as Figure 3F shown. For example, as Figure 3F shown, the television 360 rewinds the video content 315 such that the updated current playback position within the video content 315 displayed on the display 370 corresponds to (e.g., is the same as) the updated current playback position within the video content 315 displayed in the virtual window 330.

[0066] In some examples, in response to detecting an input to erase the video content 315, the electronic device 101 sends a signal, instruction set, command, or other data to the television 360 that causes and / or enables the television 360 to similarly respond to the input detected by the electronic device 101 (e.g., causes and / or enables the television 360 to similarly erase the video content 315). Alternatively, if the television 360 detects an input to update the current playback position within the video content 315, the television 360 sends a signal, instruction set, command, or other data to the electronic device 101 that causes and / or enables the electronic device 101 to similarly respond to the input detected by the television 360. As another example, the electronic device 101 can detect that the current playback position within the video content 315 has been updated and / or the playback of the video content 315 has been adjusted by visually detecting a change in the playback of the video content 315 on the display 370 in the physical environment 340 via one or more cameras of the electronic device 101. For example, the electronic device 101 determines based on the captured image that the television 360 is displaying a different scene in the video content 315, which causes the electronic device 101 to similarly or correspondingly update the playback of the video content 315.

[0067] It should be understood that alternative interactions with the devices are similarly maintained between the two devices (e.g., the electronic device 101 and the television 360) such that the playback of the video content 315 is updated and / or adjusted. For example, if one of the devices (e.g., the electronic device 101 or the television 360) receives / detects an input to pause the video content 315, fast forward the video content 315, change the video content 315 (e.g., initiate the playback of a different content item), stop the playback of the video content 315, etc., the two devices (e.g., the electronic device 101 and the television 360) perform a specific operation based on the input.

[0068] In Figure 3GIn [description], when the electronic device 101 is displaying a virtual window 330 including video content 315, the electronic device 101 detects a movement of the viewing point of the electronic device 101. In some examples, the movement of the viewing point of the electronic device 101 is caused by the movement of the user 304 of the electronic device 101. For example, as indicated in the top view 310, the user 304 (e.g., the user wearing the electronic device 101) moves in the direction of arrow 371 (e.g., turns and walks), which causes the viewing point of the electronic device 101 to move away from the television 360 in the physical environment 340. For example, as Figure 3H shown, when the viewing point of the electronic device 101 is updated according to the movement of the user 304, the television 360 (and thus the display 370 that is displaying the video content 315) is no longer visible in the current field of view of the electronic device 101. Instead, as Figure 3H shown, from the updated viewing point, different parts of the physical environment 340 are included in the three-dimensional environment 350, such as the physical window 309 and the left wall of the physical environment 340.

[0069] In some examples, as Figure 3H shown, in response to detecting a movement of the viewing point of the electronic device 101 that causes the display 370 of the television 360 to no longer be in the field of view of the electronic device 101, the electronic device 101 updates the display of the virtual window 330 in the three-dimensional environment 350 according to the movement of the viewing point. For example, as Figure 3H shown, the electronic device 101 moves the virtual window 330 in the three-dimensional environment 350 such that the virtual window 330 is no longer displayed relative to the display 370 of the television 360 in the three-dimensional environment 350 (e.g., overlapping the television 360 in the three-dimensional environment 350 and / or positioned in front of the television). As Figure 3H shown, the electronic device 101 moves and / or redisplay the virtual window 330 based on the updated viewing point of the electronic device 101. For example, the virtual window 330 is positioned relative to the viewing point of the electronic device 101 in the three-dimensional environment 350, optionally positioned at the center of the field of view. In some examples, in response to detecting a movement of the viewing point, the virtual window 330 maintains the same size relative to the viewing point of the user 304 in the three-dimensional environment 350. In some examples, in response to detecting a movement of the viewing point, the virtual window 330 changes from being displayed as a world-locked object in the three-dimensional environment 350 to being displayed as a head-locked, body-locked, or tilt-locked object in the three-dimensional environment 350.

[0070] In some examples, the movement of the viewpoint of the electronic device 101 causes the electronic device 101 to update the display of the virtual window 330 based on determining that the movement of the viewpoint causes the electronic device 101 to be positioned at a distance greater than a threshold distance (e.g., 1 meter, 2 meters, 3 meters, 5 meters, 10 meters, 15 meters, 20 meters, 30 meters, etc.) from the display 370 of the television 360 in the physical environment 340. Thus, in Figure 3H the example of, if the movement of the viewpoint of the electronic device 101 does not cause the display 370 of the television 360 to be outside the current field of view of the electronic device 101 and / or does not cause the display 370 of the television 360 to be at a distance greater than the threshold distance of the electronic device 101, the electronic device 101 abandons updating the display of the virtual window 330 in the three-dimensional environment 350. For example, the electronic device 101 maintains the display of the virtual window 330 relative to the television 360 in the three-dimensional environment 350 (e.g., overlapping on the display 370 and / or positioned in front of the display) and / or maintains the display of the virtual window as a world-locked object in the three-dimensional environment 350.

[0071] In some examples, when the electronic device 101 updates the display of the virtual window 330 in response to detecting the movement of the viewpoint of the electronic device 101 discussed above, the electronic device 101 alternatively reduces the size of the virtual window 330 in the three-dimensional environment 350. For example, as Figure 3I shown in, instead of maintaining the virtual window 330 at the same size when updating the viewpoint, the electronic device 101 minimizes the display of the virtual window 330 such that the video content 315 is displayed at a reduced size and / or at a reduced aspect ratio (e.g., as a picture-in-picture (PiP) representation). Additionally, in some examples, as Figure 3I shown in, the electronic device 101 moves the virtual window 330 to a different position on the display 120 (e.g., corresponding to a different position in the three-dimensional environment 350, as indicated in the top view 310). For example, as Figure 3I shown in, when the viewpoint of the electronic device 101 is updated (e.g., and the display 120 of the television 360 is no longer in the field of view of the electronic device 101), the virtual window 330 is displayed at a corner (e.g., the lower right corner) of the display 370.

[0072] Additionally, in some examples, when updating the display of the virtual window 330 in the three-dimensional environment 350, the electronic device 101 may adjust one or more characteristics of the audio corresponding to the video content 315 being output by the electronic device 101. For example, as Figure 3IAs shown, the electronic device 101 can change (e.g., decrease) the volume 342 of the audio corresponding to the video content 315, as indicated by arrow 372 (e.g., or alternatively increase the volume 342 of the audio in the case where audio was not previously being output). As another example, the electronic device 101 can change the audio format of the audio corresponding to the video content 315. For example, when updating the display of the virtual window 330 in the three-dimensional environment 350, the electronic device 101 can change the format from spatial audio to stereo audio (or vice versa). It should be understood that in this case, one or more characteristics of the display and / or audio of the video content 315 output by the electronic device 101 are adjusted, without adjusting one or more characteristics of the display of the video content 315 and / or the audio corresponding to the video content 315 at the television 360. As outlined above, as a benefit, minimizing the display of the virtual window 330 and / or adjusting one or more characteristics of the audio corresponding to the video content 315 when the viewing point of the electronic device 101 changes enables the user to retain a perception of the physical environment 340, thereby maintaining user safety during the use of the electronic device 101.

[0073] In some examples, the content displayed in the virtual window 330 when updating the viewing point of the electronic device 101 as discussed above can change to be different from the video content 315. For example, instead of displaying the video content 315 as a PiP representation, the video content 315 is replaced with supplementary content associated with the video content 315, such as the information discussed above with reference to Figure 3D the first user interface element 321, the second user interface element 322, and the third user interface element 323. As an example, if the video content 315 corresponds to a sports event (e.g., a soccer game), then when the display of the virtual window 330 is updated as discussed above (e.g., displayed in a minimized state), the electronic device 101 replaces the display of the video content 315 in the virtual window 330 with an indication of the current score of the soccer game and / or an indication of the game clock.

[0074] Additionally or alternatively, in some examples, when updating the viewing point of the electronic device 101 in the manner discussed above, the electronic device 101 selectively adjusts the playback of the video content 315 in the three-dimensional environment 350. For example, as Figure 3J shown, when updating the display of the virtual window 330 in the three-dimensional environment 350, the electronic device 101 (e.g., automatically) pauses the playback of the video content 315 in the three-dimensional environment 350 (e.g., as indicated by the play affordance 339). In this case, as similarly discussed above, the playback of the video content 315 at the television 360 in the physical environment 340 will also be paused.

[0075] In some examples, the automatic pause of video content 315 in the three-dimensional environment 350 is based on the content type of the video content 315. For example, it may be determined that the playback of certain types of content is desired to be automatically paused, as opposed to the playback of other types of content. In some examples, when the viewpoint of the electronic device 101 is updated in the manner discussed above, on-demand content items (e.g., movies, television shows, video clips, music videos, short films, etc.) may be automatically paused, while live content items (e.g., content live-broadcast or streamed by their respective media providers, such as live sports events, live performance events, live political debates, live news reports, etc.) are not automatically paused. In some examples, the pause of the video content 315 may be performed in response to receiving a user input that confirms the pause of the video content 315. For example, as Figure 3J shown, when the electronic device 101 displays the video content 315 in a minimized state on the display 120 in response to detecting the movement of the viewpoint of the electronic device 315 discussed above, the electronic device 101 sends a request to the television 360 to pause the playback of the video content 315 (e.g., because the playback of the video content 101 is synchronized between the two devices). As Figure 3J shown, in response to receiving the request from the electronic device 101, the television 360 displays a message 311 on the display 370 (e.g., the message overlays the video content 315), which prompts the second user 305 to provide confirmation of whether to pause the playback of the video content 315 on the television 360 via optional options 312 and 313, which also controls whether the electronic device 101 can pause the playback of the video content 315 in the virtual window 330 of the three-dimensional environment 350. In some examples, as Figure 3J shown, in response to receiving a selection of the optional option 312 (e.g., via a remote input device communicating with the television 360), the television 360 pauses the playback of the video content 315 on the display 370, which enables the electronic device 101 to pause the playback of the video content 315, as indicated by the play gesture indicator 339 (e.g., via data sent from the television 360 to the electronic device 101).

[0076] In some examples, at Figure 3JIn [the example], if the electronic device 101 detects an input pointing to the play affordance 339 (e.g., an air pinch gesture when the gaze of user 304 points to the play affordance 339), the electronic device 101 resumes the playback of the video content 315, which also causes the television 360 to resume the playback of the video content 315 on the display 370 in the physical environment 340 in a manner similar to that discussed above. Additionally, in some examples, if the electronic device 101 detects an input pointing to the virtual window 330 in the three-dimensional environment 350, such as an air pinch gesture pointing to the virtual window 330, a gaze dwell on the virtual window 330, an oral command, etc., the electronic device 101 redisplay the virtual window 330 in the three-dimensional environment 350 at its maximized size based on the updated viewpoint of the electronic device 101, such as Figure 3H as illustrated in

[0077] Attention now turns to an example interaction that causes virtual content displayed at an electronic device to be displayed on a physical display of a second electronic device different from the electronic device in a physical environment.

[0078] Figures 4A to 4C Illustrated is an example in which an electronic device causes content to be displayed at a second electronic device in a physical environment according to some examples of the present disclosure. The electronic device 101 may correspond to or be similar to the electronic device 101 or 201 discussed above. In Figures 4A to 4C the example, the user optionally wears the electronic device 101 such that a three-dimensional environment 450 (e.g., a computer-generated environment) can be defined by an X-axis, a Y-axis, and a Z-axis viewed from the perspective of the electronic device (e.g., the viewpoint associated with the user of the electronic device 101). In some examples, the three-dimensional environment 450 has one or more characteristics of the three-dimensional environment 350 discussed above. As Figure 4A shown in Figure 4A the electronic device 101 may be positioned in a physical environment 440 that includes a plurality of real-world objects (such as a television 460 including a display 470 and a table 406). In some examples, the physical environment 440 has one or more characteristics of the physical environment 340 discussed above. Additionally, in some examples, the television 460 has one or more characteristics of the television 360 discussed above. In some examples, the electronic device 101 is configured to communicate with the television 460, as discussed above similarly. As

[0079] As Figure 4A shown in Figure 4AAs shown, the virtual window 430 is optionally displayed together with the grab bar 435, which can be selected to initiate movement of the virtual window 430 within the three-dimensional environment 450, as discussed similarly above. In some examples, as Figure 4A shown, the virtual window 430 includes a user interface 417. For example, the user interface 417 is associated with an application running on the electronic device 101, such as a media player application, a web browsing application, a photo library application, a video call application, etc. Thus, in Figure 4A , the electronic device 101 is displaying content (e.g., the user interface 417 in the virtual window 430), while the television 460 (e.g., or an auxiliary electronic device communicating with the television 460, such as a set-top box, a console, a cable box, etc., as discussed similarly above) is not displaying content.

[0080] In some examples, the electronic device 101 is configured such that the television 460 (e.g., or an auxiliary electronic device communicating with the television 460) initiates the display of the content currently being displayed by the electronic device 101. In some examples, the electronic device 101 performs this operation in response to detecting an input provided by a user of the electronic device 101 corresponding to a request to cause the television 460 to display the content currently being displayed by the electronic device 101, as discussed below.

[0081] In Figure 4B , when the electronic device 101 is displaying the user interface 417 in the virtual window 430, the electronic device 101 detects an input provided by a user of the electronic device 101 corresponding to a request to cause the television 460 to display the user interface 417 on the display 470. In some examples, as Figure 4B shown, the input includes a gesture performed with the user's hand 403. For example, in Figure 4B , the electronic device 101 detects that the user is performing a pinch and drag gesture with the hand 403 while the user's gaze 425 is directed at the user interface 417 and / or the virtual window 430 (e.g., but not at the grab bar 435). In some examples, the pinch and drag gesture includes movement of the hand 403 in space in the direction of the display 470 of the television 460, as indicated by the arrow 471. In some examples, the input includes alternative gestures, such as a throwing gesture when the hand 403 is performing a pinch (e.g., mimicking the throwing (e.g., tossing or flinging) of a physical object towards the display 470 of the television 460). In some examples, the input includes a control corresponding to a request to cause the television 460 to display the user interface 417 on the display 470 in the physical environment 440 or a selection of a language command or an affordance / option in the settings user interface.

[0082] In some examples, as Figure 4CAs shown, in response to detecting the user input discussed above, the electronic device 101 causes the television 460 to display the user interface 417 on the display 470 in the physical environment 440. For example, as Figure 4C shown, the television 460 activates (e.g., powers on and / or wakes up) the display 470 and displays the user interface 417 on the display 470. Additionally, as Figure 4C shown, the electronic device 101 optionally stops displaying the user interface 417 in the virtual window 430 in the three-dimensional environment 450. For example, as Figure 4C shown, the electronic device 101 replaces the display of the user interface 417 with a user interface 418 that optionally corresponds to the playback control user interface. As Figure 4C shown, the user interface 418 optionally includes multiple controls for controlling one or more aspects of the display of the user interface 417 on the display 470, such as the playback timeline 437 and the playback controls 455. Additionally, in some examples, as Figure 4C shown, the user interface 418 includes an indication that the content of the virtual window 430 is being displayed on the display 470 of the television 460. For example, as Figure 4C shown, the user interface 418 includes an icon, image, or other visual indication of the television.

[0083] In some examples, the television 460 (e.g., or an auxiliary electronic device communicatively coupled to the television 460) displays the user interface 417 on the display 470 based on data provided by the electronic device 101. For example, the electronic device 101 sends metadata (e.g., image data, streaming data, etc.) to the television 460 (e.g., or an auxiliary electronic device communicatively coupled to the television 460), which enables the television 460 to display the user interface 417 on the display 470. In some examples, the television 460 displays the user interface 417 on the display 470 based on one or more indications of the content displayed by the electronic device 101 that enable the television 460 to display the user interface 417. For example, the electronic device 101 sends data that includes an indication of the specific content to be displayed (e.g., a name or other identifier associated with the user interface 417), one or more sources of the content (e.g., the location (e.g., application) from which the user interface 417 can be accessed (e.g., streamed) for displaying the user interface 417), and / or an indication of how to display the content (e.g., playback position, playback speed, a specific portion of the user interface 417 to be displayed, the aspect ratio of the user interface 417, etc.).

[0084] In some examples, when the television 460 displays the user interface 417 on the display 470, the audio corresponding to the user interface 417 (if any) continues to be output by the electronic device 101 (e.g., via one or more speakers of the electronic device 101). Alternatively, in some examples, the audio corresponding to the user interface 417 is no longer output by the electronic device 101, but is output by the television 460 in the physical environment 440 (e.g., speakers integrated with the television 460 or a speaker system in communication with the television 460). In some examples, the audio corresponding to the user interface 417 is output by both the electronic device 101 and the television 460 (e.g., in a synchronized manner as previously discussed herein).

[0085] In some examples, when the television 460 is displaying the user interface 417 on the display 470, the display of the user interface 417 can also be controlled via user input received at the television 460. For example, user input detected via a remote input device (e.g., a remote controller) in communication with the television 460 can also cause the television 460 to adjust the display of the user interface 417 (e.g., playback, audio settings, etc.). Thus, when the user interface 417 is displayed on the display 470 of the television 460, the user interface 417 can be interacted with via input detected by the electronic device 101 (e.g., provided by a user of the electronic device 101) and via input detected by the television 460 (e.g., provided by a second user in the physical environment 440, similar to the second user 305 discussed above). In some examples, in response to detecting input provided on the remote input device (e.g., an input to power off the display 470 and / or the television 460) and / or in response to the electronic device 101 detecting input directed to the user interface 417 in the virtual window 430 (e.g., an input directed to an option / enablement representing to cause the television 460 to stop displaying the user interface 417 on the display 470), the television 460 can stop displaying the user interface 418 on the display 470. In some such examples, when the television 460 stops displaying the user interface 417 on the display 470, the electronic device 101 can redisplay the user interface 417 in the virtual window 430 in the three-dimensional environment 450 (e.g., as similarly shown in Figure 4A ). Thus, as outlined above, as a benefit, when the electronic device 101 detects user input corresponding to a request to display content on a second electronic device, such as the television 460, causing the second electronic device to display the content enables the second user to view and thereby interact with the content in a viewing experience shared with the user of the electronic device 101 while the content is displayed on the second electronic device.

[0086] In some examples, the display of the user interface 417 on the display 470 of the television 460 is based on determining that one or more criteria are met, such as one or more of the criteria discussed above with reference to Figures 3A to 3J one or more of the criteria discussed above. For example, the television 460 (e.g., or an auxiliary electronic device communicating with the television 460) displays the user interface 417 on the display 470 in the manner discussed above based on determining that the electronic device 101 is communicating with the television 460 (e.g., or the auxiliary electronic device), the user interface 417 can be displayed on the display 470 (e.g., based on device permissions, content accessibility, display compatibility, content type (e.g., 3D vs. 2D content), etc.), the input provided by the user is in fact an input for causing the television 460 to display the user interface 417 on the display 470, and / or the detectability of the display 470 of the television 460 (e.g., the display 470 is within the current field of view of the electronic device 101 and / or within a threshold distance (e.g., 0.25 meters, 0.5 meters, 1 meter, 2 meters, 3 meters, 5 meters, 10 meters, 15 meters, etc.) of the electronic device 101), and other requirements. In some examples, if one or more criteria are not met, the television 460 abandons displaying the user interface 417 on the display 470 in the physical environment 440. In some such examples, the electronic device 101 and / or the television 460 may provide a visual indication of the unsuccessful display of the user interface 417 on the display 470, such as by displaying a notification or other message on the display 120 and / or the display 470. Additionally, when an input provided by the user is detected, the display 470 of the television 460 does not need to be turned off as Figure 4B shown. For example, in such a case, the television 460 replaces the display of the content being shown on the display 470 with the user interface 417, as Figure 4C similarly shown in.

[0087] It should be understood that although the above example interactions are specifically described with reference to a television having a display (e.g., television 360 / 460), such interactions can be similarly and / or correspondingly applied to other electronic devices having a display (e.g., an integrated display or a non-integrated display). For example, the interactions described above regarding displaying content on the electronic device 101 and / or causing the television 460 to display content presented by the electronic device 101 can also be applied to desktop or laptop computers, tablets, smart phones, smart watches, and similar electronic devices having a display.

[0088] It should be understood that the examples shown and described herein are merely exemplary, and additional and / or alternative elements related to the synchronized display of content across multiple electronic devices may be provided within a three-dimensional environment. It should be understood that the appearance, shape, form, and size of each of the various user interface elements and objects shown and described herein are exemplary, and alternative appearances, shapes, forms, and / or sizes may be provided. For example, virtual objects representing user interfaces and / or windows (e.g., virtual window 330 and virtual window 430) may be provided in alternative shapes different from a rectangular shape (such as a circular shape, an oval shape, a triangular shape, etc.). Additionally or alternatively, in some examples, the various user interface elements described herein may be selected and / or manipulated via user input received through one or more separate input devices communicating with the electronic device. For example, where applicable, selection input (e.g., for initiating the tracking of an exercise activity) may be received via a physical input device (such as a mouse, a touchpad, a keyboard, etc.) communicating with the electronic device.

[0089] Figure 5 is a flowchart illustrating an example process for displaying a user interface including content in a computer-generated environment in response to detecting the display of the content in a physical environment, according to some examples of the present disclosure. In some examples, the process 500 begins at a first electronic device communicatively coupled to one or more displays, one or more input devices, and one or more cameras. In some examples, the electronic device is optionally a head-mounted display similar to or corresponding to Figure 2A electronic device 201 and / or Figure 1 electronic device 101 as shown. As Figure 5 shown, in some examples, at 502, the first electronic device detects, via one or more cameras, a second display different from the one or more displays communicatively coupled to a second electronic device different from the first electronic device at a first location in the (e.g., surrounding) physical environment of the first electronic device. For example, as Figure 3B shown, electronic device 101 detects (e.g., via external image sensors 114b and 114c) display 370 of television 360 in physical environment 340. In some examples, display 370 is displaying content, such as Figure 3B video content 315 as shown.

[0090] In some examples, at 504, in response to detecting the second display, at 506, based on determining that one or more criteria are met, the first electronic device displays, via one or more displays, a first object at a first location in the computer-generated environment corresponding to the first location in the physical environment, where the first object includes first content. For example, as Figure 3CAs shown, the electronic device 101 displays a virtual window 330 including video content 315 in a three-dimensional environment 350 via a display 120. In some examples, as Figure 3C shown in the top view 310 in, the electronic device 101 displays the virtual window 330 at a position relative to the display 370 of the television 360 in the three-dimensional environment 350, such as in front of and / or overlapping the television 360 from the viewpoint of the electronic device 101. The satisfaction of one or more criteria is discussed in detail above with reference to Figure 3B one or more.

[0091] In some examples, at 508, based on determining that one or more criteria are not satisfied, the first electronic device abandons displaying a first object at a first position in a computer-generated environment. For example, as Figure 3A shown, the electronic device 101 abandons displaying the virtual window 330 including the video content 315 in the three-dimensional environment 350.

[0092] It should be understood that the process 500 is an example, and more, fewer, or different operations may be performed in the same or different order. Additionally, the operations in the process 500 described above are optionally implemented by running an information processing device such as a general-purpose processor (e.g., as described with respect to Figures 2A to 2B ) or one or more functional modules in an application-specific chip and / or by Figures 2A to 2B other components of.

[0093] Accordingly, in accordance with the foregoing, some examples of the present disclosure relate to a method that includes, at a first electronic device in communication with one or more displays, one or more input devices, and one or more cameras: detecting, via the one or more cameras, a second display different from the one or more displays that is in communication with a second electronic device different from the first electronic device at a first position in a physical environment of the first electronic device; and in response to detecting the second display, displaying, via the one or more displays, a first object at a first position in a computer-generated environment corresponding to the first position in the physical environment, where the first object includes first content, and abandoning displaying the first object at the first position in the computer-generated environment based on determining that the one or more criteria are not satisfied.

[0094] Additionally or alternatively, in some examples, the one or more criteria include criteria that are met based on determining that the second display is displaying the first content. Additionally or alternatively, in some examples, the one or more criteria include criteria that are met based on determining that the first content is of a first type of content and not met based on determining that the first content is of a second type of content different from the first type. Additionally or alternatively, in some examples, the one or more criteria include criteria that are met based on determining that the user's gaze of the first electronic device is directed at the second display when the second display is detected. Additionally or alternatively, in some examples, the one or more criteria include criteria that are met based on determining that the content displayed via the second display can be visually detected via the one or more cameras based on one or more physical properties of the second display. Additionally or alternatively, in some examples, when, in response to detecting the second display, the first object is displayed at the first location in the computer-generated environment based on the determination that the one or more criteria are met, the first object visually occludes the second display from the viewpoint of the user of the first electronic device. Additionally or alternatively, in some examples, the first content corresponds to two-dimensional content. Additionally or alternatively, in some examples, the first object corresponds to a virtual application window that displays the first content.

[0095] Additionally or alternatively, in some examples, displaying the first object that includes the first content includes: identifying one or more features of the first content in one or more images of the second display captured via the one or more cameras; and obtaining the first content for display in the first object in the computer-generated environment based on the identification of the one or more features of the first content. Additionally or alternatively, in some examples, obtaining the first content is based on determining that a user of the first electronic device has authorization to access the first content via the first electronic device. Additionally or alternatively, in some examples, the first electronic device communicates with the second electronic device, and the first electronic device obtains the first content based on data provided by the second electronic device. Additionally or alternatively, in some examples, the first electronic device communicates with the second electronic device, and the first electronic device obtains and displays the first content based on data provided by the second electronic device. Additionally or alternatively, in some examples, the one or more criteria include criteria that are satisfied based on determining that the second display is displaying the first content, displaying the first content in the first object includes presenting audio corresponding to the first content, and based on the determination that the one or more criteria are satisfied, synchronizing the presentation of the audio corresponding to the first content between the first electronic device and the second electronic device. Additionally or alternatively, in some examples, the first content corresponds to first video content, the one or more criteria include criteria that are satisfied based on determining that the second display is displaying the first video content, and based on the determination that the one or more criteria are satisfied, synchronizing the playback of the first video content between the first electronic device and the second electronic device.

[0096] Additionally or alternatively, in some examples, the method further includes: when, in response to detecting the second display, the first video content is displayed in the first object in the computer-generated environment based on the determination that the one or more criteria are met, detecting an indication of a request to erase the first video content; and in response to detecting the indication, updating a current playback position within the first video content in the first object according to the request, wherein the second electronic device updates the current playback position within the first video content on the second display according to the request. Additionally or alternatively, in some examples, the method further includes: when, in response to detecting the second display, the first content is displayed in the first object in the computer-generated environment based on the determination that the one or more criteria are met, detecting a movement of the first electronic device via the one or more input devices; and in response to detecting the movement of the first electronic device, based on determining that the movement of the first electronic device causes the second display to no longer be detectable via the one or more cameras, displaying the first object at a second position different from the first position in the computer-generated environment via the one or more displays. Additionally or alternatively, in some examples, the second position in the computer-generated environment is determined based on the movement of the first electronic device and an updated viewpoint of a user of the first electronic device. Additionally or alternatively, in some examples, the method further includes: when, in response to detecting the second display, the first content is displayed in the first object in the computer-generated environment based on the determination that the one or more criteria are met, detecting a movement of the first electronic device via the one or more input devices; and in response to detecting the movement of the first electronic device, based on determining that the movement of the first electronic device causes the second display to no longer be detectable via the one or more cameras, replacing the display of the first object with a second object in the computer-generated environment via the one or more displays, wherein the second object includes second content associated with the first content. Additionally or alternatively, in some examples, the second content in the second object corresponds to a picture-in-picture representation of the first content in the first object, and the second object is displayed in a head-locked orientation in the computer-generated environment.

[0097] Additionally or alternatively, in some examples, displaying the first content in the first object includes presenting audio corresponding to the first content at a first volume, and displaying the second content in the second object includes presenting the audio corresponding to the first content at a second volume lower than the first volume. Additionally or alternatively, in some examples, displaying the first content in the first object includes presenting audio corresponding to the first content in a first audio format, and displaying the second content in the second object includes presenting the audio corresponding to the first content in a second audio format different from the first audio format. Additionally or alternatively, in some examples, the method further includes: when, in response to detecting the second display, the first content is displayed in the first object in the computer-generated environment based on the determination that the one or more criteria are met, detecting, via the one or more input devices, movement of the first electronic device; and in response to detecting the movement of the first electronic device, stopping displaying the first object in the computer-generated environment and presenting the audio corresponding to the first content based on the determination that the movement of the first electronic device causes the second display to no longer be detectable via the one or more cameras. Additionally or alternatively, in some examples, the method further includes: when, in response to detecting the second display, the first content is displayed in the first object in the computer-generated environment based on the determination that the one or more criteria are met, detecting, via the one or more input devices, movement of the first electronic device that causes the second display to no longer be detectable via the one or more cameras; and in response to detecting the movement of the first electronic device, replacing the display of the first object with a display of a second object in the computer-generated environment via the one or more displays, where the second object includes second content associated with the first content; and pausing playback of the first content in the first object in the computer-generated environment based on the determination that the first content is of a second type different from the first type. Additionally or alternatively, in some examples, the second display does not display content, and the method further includes: when a second object including second content is displayed in the computer-generated environment via the one or more displays, detecting, via the one or more input devices, a corresponding gesture performed by the hand of the user of the first electronic device that points to the second display; and in response to detecting the corresponding gesture, causing the second electronic device to display the second content via the second display. Additionally or alternatively, in some examples, causing the second electronic device to display the second content includes sending data to the second electronic device that includes instructions enabling the second electronic device to generate the second content and display the second content on the second display. Additionally or alternatively, in some examples, the first electronic device includes a head-mounted display, and the second electronic device corresponds to a computing device.

[0098] Some examples of the present disclosure relate to an electronic device, the electronic device including: one or more processors; a memory; and one or more programs, the one or more programs being stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing any of the above methods.

[0099] Some examples of the present disclosure relate to a non-transitory computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by one or more processors of an electronic device, cause the electronic device to perform any of the above methods.

[0100] Some examples of the present disclosure relate to an electronic device, the electronic device including one or more processors, a memory, and components for performing any of the above methods.

[0101] Some examples of the present disclosure relate to an information processing apparatus used in an electronic device, the information processing apparatus including components for performing any of the above methods.

[0102] For purposes of explanation, the foregoing description has been described by reference to specific examples. However, the above illustrative discussion is not intended to be exhaustive or to limit the present disclosure to the precise forms disclosed. Many modifications and variations are possible in light of the above teachings. The examples were chosen and described in order to best illustrate the principles of the present disclosure and its practical application, thereby enabling others skilled in the art to best utilize the present disclosure with various modifications suited to the particular uses contemplated as well as the various examples described.

Claims

1. A method, the method comprising: at a first electronic device in communication with one or more displays, one or more input devices, and one or more cameras: detect, via the one or more cameras, at a first location in a physical environment of the first electronic device, a second display that is different from the one or more displays and that is in communication with a second electronic device that is different from the first electronic device; and in response to detecting the second display: display, via the one or more displays, a first object at a first location in a computer-generated environment that corresponds to the first location in the physical environment, where the first object includes first content, based on determining that one or more criteria are met; and abandon displaying the first object at the first location in the computer-generated environment based on determining that the one or more criteria are not met.

2. The method according to claim 1, wherein the one or more criteria include a criterion that is met based on determining that the second display is displaying the first content.

3. The method according to claim 1, wherein the one or more criteria include a criterion that is met based on determining that a gaze of a user of the first electronic device is directed at the second display when the second display is detected.

4. The method according to claim 1, wherein the one or more criteria include a criterion that is met based on determining that content being displayed via the second display can be visually detected via the one or more cameras based on one or more physical attributes of the second display.

5. The method according to claim 1, wherein when the first object is displayed at the first location in the computer-generated environment in response to detecting the second display and based on the determining that the one or more criteria are met, the first object visually occludes the second display from a viewpoint of a user of the first electronic device.

6. The method according to claim 1, wherein the first object that includes the first content comprises: identifying one or more features of the first content in one or more images of the second display captured via the one or more cameras; and obtaining the first content for display in the first object in the computer-generated environment based on the identification of the one or more features of the first content.

7. The method according to claim 6, wherein the first content is obtained based on determining that a user of the first electronic device has authorization to access the first content via the first electronic device.

8. The method according to claim 6, wherein: the first electronic device communicates with the second electronic device; and the first electronic device obtains the first content based on data provided by the second electronic device.

9. The method according to claim 1, wherein: the one or more criteria include a criterion that is met based on determining that the second display is displaying the first content; displaying the first content in the first object includes presenting audio corresponding to the first content; and Based on determining that the one or more criteria are satisfied, synchronize the presentation of the audio corresponding to the first content between the first electronic device and the second electronic device.

10. The method according to claim 1, wherein: The first content corresponds to first video content; The one or more criteria include criteria satisfied based on determining that the second display is displaying the first video content; And Based on determining that the one or more criteria are satisfied, synchronize the playback of the first video content between the first electronic device and the second electronic device.

11. The method according to claim 10, the method further comprising: When, in response to detecting the second display, the first video content is displayed in the first object in the computer-generated environment based on determining that the one or more criteria are satisfied, detect an indication of a request to erase the first video content; And In response to detecting the indication: Update the current playback position within the first video content in the first object according to the request; Wherein the second electronic device updates the current playback position within the first video content on the second display according to the request.

12. The method according to claim 1, the method further comprising: When, in response to detecting the second display, the first content is displayed in the first object in the computer-generated environment based on determining that the one or more criteria are satisfied, detect the movement of the first electronic device via the one or more input devices; And In response to detecting the movement of the first electronic device: Based on determining that the movement of the first electronic device causes the second display to no longer be detectable via the one or more cameras, display the first object at a second position different from the first position in the computer-generated environment via the one or more displays.

13. The method according to claim 1, the method further comprising: When, in response to detecting the second display, the first content is displayed in the first object in the computer-generated environment based on determining that the one or more criteria are satisfied, detect the movement of the first electronic device via the one or more input devices; And In response to detecting the movement of the first electronic device: Based on determining that the movement of the first electronic device causes the second display to no longer be detectable via the one or more cameras, replace the display of the first object with a second object in the computer-generated environment via the one or more displays, wherein the second object includes second content associated with the first content.

14. The method according to claim 13, wherein: The second content in the second object corresponds to a picture-in-picture representation of the first content in the first object; and The second object is displayed in a head-locked orientation in the computer-generated environment.

15. The method according to claim 13, wherein: Displaying the first content in the first object includes presenting an audio corresponding to the first content at a first volume; and displaying the second content in the second object includes presenting the audio corresponding to the first content at a second volume lower than the first volume.

16. The method according to claim 13, wherein: displaying the first content in the first object includes presenting an audio corresponding to the first content in a first audio format; and displaying the second content in the second object includes presenting the audio corresponding to the first content in a second audio format different from the first audio format.

17. The method according to claim 1, the method further comprising: when displaying the first content in the first object in the computer-generated environment according to the determination that the one or more criteria are met in response to detecting the second display, detecting a movement of the first electronic device via the one or more input devices; and in response to detecting the movement of the first electronic device, according to the determination that the movement of the first electronic device causes the second display to be no longer detectable via the one or more cameras: stopping displaying the first object in the computer-generated environment; and presenting an audio corresponding to the first content.

18. The method according to claim 1, wherein the first content corresponds to a first video content, the method further comprising: when displaying the first content in the first object in the computer-generated environment according to the determination that the one or more criteria are met in response to detecting the second display, detecting a movement of the first electronic device via the one or more input devices that causes the second display to be no longer detectable via the one or more cameras; and in response to detecting the movement of the first electronic device: according to the determination that the first content is a first type of content, replacing the display of the first object in the computer-generated environment with a second object via the one or more displays, wherein the second object includes a second content associated with the first content; and according to the determination that the first content is a second type of content different from the first type, pausing the playback of the first content in the first object in the computer-generated environment.

19. An electronic device, the electronic device comprising: one or more processors; a memory; and one or more programs, the one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing the method according to any one of claims 1 to 18.

20. A non-transitory computer-readable storage medium, the non-transitory computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by one or more processors of an electronic device, cause the electronic device to perform the method according to any one of claims 1 to 18.

Images