System and method for transferring content presentation between a first electronic device and a second electronic device
The computing system optimizes content transfer between electronic devices by using user inputs to manage content presentation, enhancing user interaction and conserving battery life.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2025-09-26
- Publication Date
- 2026-04-07
AI Technical Summary
Existing systems struggle to efficiently transfer and manage content presentations between electronic devices, particularly in three-dimensional environments, without causing user confusion or unnecessary battery consumption.
A computing system that detects user inputs on a second electronic device, such as touch gestures, to transfer content presentations from a first electronic device to a second device, allowing seamless continuation of content presentation while optimizing device usage based on user intent.
Enhances user interaction and conserves battery life by ensuring content is presented only on intended devices, improving the overall efficiency and usability of the computing system.
Smart Images

Figure 2026059791000001_ABST
Abstract
Description
Technical Field
[0001] (Cross - Reference to Related Applications) This application claims the benefit of U.S. Provisional Patent Application No. 63 / 784,833, filed on April 7, 2025, U.S. Provisional Patent Application No. 63 / 699,754, filed on September 26, 2024, and U.S. Patent Application No. 19 / 298,674, filed on August 13, 2025, the contents of which are hereby incorporated by reference in their entirety for all purposes.
[0002] The present invention generally relates to systems and methods for transferring the presentation of content between electronic devices of a computing system.
Background Art
[0003] Some computer - graphical environments provide two - dimensional and / or three - dimensional environments generated by a computer, in which at least some of the objects presented for the user to view are virtual.
Summary of the Invention
[0004] Some examples of this disclosure relate to systems and methods for transferring content presentations between a first electronic device and a second electronic device of a computing system. In some examples, while the first content is presented in a three-dimensional environment via one or more first displays, the computing system detects a first input via one or more input devices of the second electronic device. For example, the first input is a touch input, such as a swipe touch gesture, detected on a touch-sensitive display of the second electronic device. In some examples, upon determination that the first input satisfies one or more first criteria, the computing system transfers the presentation of the first content from the first electronic device to the second electronic device. In some examples, transferring the presentation of the first content from the first electronic device to the second electronic device includes ceasing the presentation of the first content via one or more first displays on the first electronic device and allowing the first content to be presented via one or more second displays on the second electronic device.
[0005] A complete explanation of these examples is provided in the "Drawings" and "Detailed Description," and it should be understood that this "Summary of the Invention" does not limit the scope of this disclosure in any way.
[0006] To improve understanding of the various examples described herein, refer to the following “Modes for Carrying Out the Invention” along with the following drawings. Similar reference numbers often refer to corresponding parts throughout the drawings. [Brief explanation of the drawing]
[0007] [Figure 1] This disclosure illustrates several examples of electronic devices that present an augmented reality environment.
[0008] [Figure 2A] This disclosure provides several examples of block diagrams illustrating exemplary architectures of electronic devices. [Figure 2B]This disclosure provides several examples of block diagrams illustrating exemplary architectures of electronic devices.
[0009] [Figure 3A] The present disclosure illustrates a computing system that transfers content presentations between a first electronic device and a second electronic device in response to one or more user inputs, as illustrated by several examples of this disclosure. [Figure 3B] The present disclosure illustrates a computing system that transfers content presentations between a first electronic device and a second electronic device in response to one or more user inputs, as illustrated by several examples of this disclosure. [Figure 3C] The present disclosure illustrates a computing system that transfers content presentations between a first electronic device and a second electronic device in response to one or more user inputs, as illustrated by several examples of this disclosure. [Figure 3D] The present disclosure illustrates a computing system that transfers content presentations between a first electronic device and a second electronic device in response to one or more user inputs, as illustrated by several examples of this disclosure. [Figure 3E] The present disclosure illustrates a computing system that transfers content presentations between a first electronic device and a second electronic device in response to one or more user inputs, as illustrated by several examples of this disclosure. [Figure 3F] The present disclosure illustrates a computing system that transfers content presentations between a first electronic device and a second electronic device in response to one or more user inputs, as illustrated by several examples of this disclosure. [Figure 3G] The present disclosure illustrates a computing system that transfers content presentations between a first electronic device and a second electronic device in response to one or more user inputs, as illustrated by several examples of this disclosure. [Figure 3H] The present disclosure illustrates a computing system that transfers content presentations between a first electronic device and a second electronic device in response to one or more user inputs, as illustrated by several examples of this disclosure. [Figure 3I]The present disclosure illustrates a computing system that transfers content presentations between a first electronic device and a second electronic device in response to one or more user inputs, as illustrated by several examples of this disclosure. [Figure 3J] The present disclosure illustrates a computing system that transfers content presentations between a first electronic device and a second electronic device in response to one or more user inputs, as illustrated by several examples of this disclosure. [Figure 3K] The present disclosure illustrates a computing system that transfers content presentations between a first electronic device and a second electronic device in response to one or more user inputs, as illustrated by several examples of this disclosure.
[0010] [Figure 4A] This disclosure illustrates a computing system that modifies the display of virtual content on a first electronic device in response to one or more user inputs detected on a second electronic device, as illustrated by several examples of this disclosure. [Figure 4B] This disclosure illustrates a computing system that modifies the display of virtual content on a first electronic device in response to one or more user inputs detected on a second electronic device, as illustrated by several examples of this disclosure. [Figure 4C] This disclosure illustrates a computing system that modifies the display of virtual content on a first electronic device in response to one or more user inputs detected on a second electronic device, as illustrated by several examples of this disclosure. [Figure 4D] This disclosure illustrates a computing system that modifies the display of virtual content on a first electronic device in response to one or more user inputs detected on a second electronic device, as illustrated by several examples of this disclosure. [Figure 4E] This disclosure illustrates a computing system that modifies the display of virtual content on a first electronic device in response to one or more user inputs detected on a second electronic device, as illustrated by several examples of this disclosure. [Figure 4F]A computing system is shown that modifies the display of virtual content on a first electronic device in response to one or more user inputs detected on a second electronic device, according to some examples of the present disclosure. [Figure 4G] A computing system is shown that modifies the display of virtual content on a first electronic device in response to one or more user inputs detected on a second electronic device, according to some examples of the present disclosure. [Figure 4H] A computing system is shown that modifies the display of virtual content on a first electronic device in response to one or more user inputs detected on a second electronic device, according to some examples of the present disclosure. [Figure 4I] A computing system is shown that modifies the display of virtual content on a first electronic device in response to one or more user inputs detected on a second electronic device, according to some examples of the present disclosure.
[0011] [Figure 5A] A computing system is shown that modifies the display of virtual content in response to one or more user inputs detected for one or more touch regions, according to some examples of the present disclosure. [Figure 5B] A computing system is shown that modifies the display of virtual content in response to one or more user inputs detected for one or more touch regions, according to some examples of the present disclosure. [Figure 5C] A computing system is shown that modifies the display of virtual content in response to one or more user inputs detected for one or more touch regions, according to some examples of the present disclosure. [Figure 5D] A computing system is shown that modifies the display of virtual content in response to one or more user inputs detected for one or more touch regions, according to some examples of the present disclosure.
[0012] [Figure 6A]This disclosure illustrates several examples of computing systems for displaying video content within a three-dimensional environment. [Figure 6B] This disclosure illustrates several examples of computing systems for displaying video content within a three-dimensional environment. [Figure 6C] This disclosure illustrates several examples of computing systems for displaying video content within a three-dimensional environment. [Figure 6D] This disclosure illustrates several examples of computing systems for displaying video content within a three-dimensional environment.
[0013] [Figure 7A] This disclosure illustrates several examples of computing systems that display notifications within a three-dimensional environment. [Figure 7B] This disclosure illustrates several examples of computing systems that display notifications within a three-dimensional environment. [Figure 7C] This disclosure illustrates several examples of computing systems that display notifications within a three-dimensional environment.
[0014] [Figure 8A] The present disclosure illustrates several examples of computing systems that present content on a first electronic device and user interface elements associated with the content on a second electronic device. [Figure 8B] The present disclosure illustrates several examples of computing systems that present content on a first electronic device and user interface elements associated with the content on a second electronic device. [Figure 8C] The present disclosure illustrates several examples of computing systems that present content on a first electronic device and user interface elements associated with the content on a second electronic device. [Figure 8D]The present disclosure illustrates several examples of computing systems that present content on a first electronic device and user interface elements associated with the content on a second electronic device. [Figure 8E] The present disclosure illustrates several examples of computing systems that present content on a first electronic device and user interface elements associated with the content on a second electronic device. [Figure 8F] The present disclosure illustrates several examples of computing systems that present content on a first electronic device and user interface elements associated with the content on a second electronic device. [Figure 8G] The present disclosure illustrates several examples of computing systems that present content on a first electronic device and user interface elements associated with the content on a second electronic device.
[0015] [Figure 9] The present disclosure illustrates a flowchart of an exemplary process for transferring content presentation from a first electronic device to a second electronic device, using several examples. [Modes for carrying out the invention]
[0016] Some examples of this disclosure relate to systems and methods for transferring content presentations between a first electronic device and a second electronic device of a computing system. In some examples, while the first content is presented in a three-dimensional environment via one or more first displays, the computing system detects a first input via one or more input devices of the second electronic device. For example, the first input is a touch input, such as a swipe touch gesture, detected on a touch-sensitive display of the second electronic device. In some examples, upon determination that the first input satisfies one or more first criteria, the computing system transfers the presentation of the first content from the first electronic device to the second electronic device. In some examples, transferring the presentation of the first content from the first electronic device to the second electronic device includes ceasing the presentation of the first content via one or more first displays on the first electronic device and allowing the first content to be presented via one or more second displays on the second electronic device.
[0017] In some examples, a three-dimensional object is displayed in a computer-generated three-dimensional environment in a specific orientation that controls one or more of the object's behavior (for example, when the three-dimensional object is moved within the three-dimensional environment). In some examples, the orientation in which a three-dimensional object is displayed in the three-dimensional environment is selected by the user of the electronic device or is automatically selected by the electronic device. For example, when initiating the presentation of a three-dimensional object in the three-dimensional environment, the user may select a specific orientation for the three-dimensional object, or the electronic device may automatically select the orientation for the three-dimensional object (for example, based on the type of three-dimensional object).
[0018] In some examples, three-dimensional objects may be displayed in a three-dimensional environment with world-locked orientation, body-locked orientation, tilt-locked orientation, or head-locked orientation, as described below. As used herein, an object displayed in a body-locked orientation in a three-dimensional environment has a distance and orientation offset relative to a part of the user's body (e.g., the user's torso). Alternatively, in some examples, a body-locked object has a fixed distance from the user without the orientation of the content being relative to any part of the user's body (e.g., it may be displayed in the same basic direction relative to the user regardless of head and / or body movement). Additionally or alternatively, in some examples, a body-locked object may be configured so that changes in the head and / or body in the roll direction do not move the body-locked object in the three-dimensional environment, and that gravity or the horizontal line (e.g., perpendicular to gravity) always remains aligned. Rather, translational movement in either configuration repositions the body-locked object in the three-dimensional environment while maintaining the distance offset.
[0019] As used herein, an object displayed in a head-locked orientation in a three-dimensional environment has a distance and orientation offset relative to the user's head. In some examples, the head-locked object moves within the three-dimensional environment as the user's head moves (as the user's viewpoint changes).
[0020] When used herein, an object displayed in a world-locked orientation within a three-dimensional environment does not have a defined distance or orientation offset relative to the user, but rather has a position and orientation defined relative to the three-dimensional environment.
[0021] As used herein, an object displayed in a tilt-locked orientation in a three-dimensional environment (referred to herein as a tilt-locked object) has a distance offset relative to the user, such as a part of the user's body (e.g., the user's torso) or the user's head. In some examples, a tilt-locked object is displayed in a fixed orientation relative to the three-dimensional environment. In some examples, a tilt-locked object moves according to a polar (e.g., spherical) coordinate system centered on a pole passing through the user (e.g., the user's head). For example, a tilt-locked object moves in the three-dimensional environment based on the movement of the user's head in a spherical space surrounding the user's head (e.g., centered on it). Therefore, if the user tilts their head against gravity (e.g., upward or downward in the pitch direction), the tilt-locked object will follow the tilt of the head and move radially along the sphere, resulting in the tilt-locked object being repositioned in the three-dimensional environment to have the same distance offset relative to the user as before the tilt of the head, while optionally maintaining the same orientation relative to the three-dimensional environment. In some cases, if the user moves their head in a roll direction relative to gravity (e.g., clockwise or counterclockwise), the tilt-locked object will not be repositioned in the three-dimensional environment.
[0022] Figure 1 shows an electronic device 101 presenting an Extended Reality (XR) environment (e.g., a computer-generated environment optionally including representations of physical and / or virtual objects) according to some examples of the present disclosure. In some examples, as shown in Figure 1, the electronic device 101 is a head-mounted display or other head-mountable device configured to be worn on the head of the user of the electronic device 101. Examples of the electronic device 101 are described below with reference to the architectural block diagram of Figure 2A. As shown in Figure 1, the electronic device 101 and the table 106 are located in a physical environment. The physical environment may include physical features such as physical surfaces (e.g., floor, wall) or physical objects (e.g., table, lamp, etc.). In some examples, the electronic device 101 may be configured to detect and / or capture an image of the physical environment, including the table 106 (shown within the field of view of the electronic device 101).
[0023] In some examples, as shown in Figure 1, the electronic device 101 includes one or more internal image sensors 114a (e.g., eye-tracking cameras described below with reference to Figures 2A-2B) oriented toward the user's face. In some examples, the internal image sensors 114a are used for eye tracking (e.g., detecting the user's gaze). The internal image sensors 114a are optionally positioned in the left and right portions of the display 120 to enable eye tracking of the user's left and right eyes. In some examples, the electronic device 101 also includes external image sensors 114b and 114c facing outward from the user to detect and / or capture the movement of the physical environment of the electronic device 101 and / or the user's hands or other body parts.
[0024] In some examples, the display 120 has a field of view visible to the user (which may or may not correspond to the field of view of external image sensors 114b and 114c, for example). Since the display 120 is optionally part of a head-mounted device, the field of view of the display 120 is optionally the same as or similar to the field of view of the user's eyes. In other examples, the field of view of the display 120 may be smaller than the field of view of the user's eyes. In some examples, the electronic device 101 may be an optical see-through device in which the display 120 is a transparent or translucent display through which a portion of the physical environment can be directly viewed. In some examples, the display 120 may be contained within a transparent lens, or overlap all or part of a transparent lens. In other examples, the electronic device may be a video pass-through device in which the display 120 is an opaque display configured to display an image of the physical environment captured by external image sensors 114b and 114c. Although a single display 120 is shown, it should be understood that the display 120 may include a stereo pair of displays. In some examples, the display 120 is a passive display that outputs content (e.g., images and / or video) rendered by a second electronic device, such as the electronic device 160 described below.
[0025] In some examples, in response to a trigger, the electronic device 101 may be configured to display a virtual object 104 in the XR environment, represented by the cube shown in Figure 1, which does not exist in the physical environment but is displayed in the XR environment positioned on a real-world table 106 (or a representation thereof). Optionally, the virtual object 104 may be displayed on the surface of the table 106 in the XR environment, as displayed via the display 120 of the electronic device 101, in response to the detection of the plane of the table 106 in the physical environment 100.
[0026] Virtual object 104 is a representative virtual object, and it should be understood that one or more different virtual objects (of various numbers of dimensions, such as two-dimensional or other three-dimensional virtual objects) can be included in and rendered within a three-dimensional XR environment. For example, a virtual object can represent an application or user interface displayed within the XR environment. In some examples, a virtual object can represent content corresponding to an application and / or displayed via a user interface in the XR environment. In some examples, virtual object 104 is optionally interactive, allowing the user to virtually touch, tap, move, rotate, or otherwise interact with virtual object 104, and is configured to respond to user input (e.g., air gestures such as air pinch gestures, air tap gestures, and / or air touch gestures).
[0027] In some examples, electronic device 101 may be configured to communicate with a second electronic device, such as a companion device. For example, as shown in Figure 1, electronic device 101 can communicate with electronic device 160. In some examples, electronic device 160 corresponds to a mobile electronic device such as a smartphone, tablet computer, smartwatch, or other electronic device. Additional examples of electronic device 160 are described below with reference to the architectural block diagram in Figure 2B. In some examples, electronic devices 101 and 160 are associated with the same user. For example, in Figure 1, electronic device 101 may be positioned on the user's head (e.g., worn), and electronic device 160 may be positioned near electronic device 101, such as in the user's hand 103 (e.g., the hand 103 is holding electronic device 160), and electronic devices 101 and 160 are associated with the same user account of the user (e.g., the user is logged into the user account on electronic device 101 and electronic device 160). Additional details regarding communication between electronic device 101 and electronic device 160 are given below with reference to Figures 2A and 2B.
[0028] In some examples, displaying an object in a three-dimensional environment may involve interaction with one or more user interface objects within the three-dimensional environment. For example, initiating the display of an object in a three-dimensional environment may involve interaction with one or more virtual options / affordances displayed within the three-dimensional environment. In some examples, the user's gaze may be tracked by an electronic device as input for identifying one or more virtual options / affordances to be selected when initiating the display of an object in the three-dimensional environment. For example, gaze can be used to identify one or more virtual options / affordances to be selected using another selection input. In some examples, virtual options / affordances may be selected using hand-tracking input detected via an input device communicating with an electronic device. In some examples, objects displayed in a three-dimensional environment may be moved and / or oriented within the three-dimensional environment according to movement input detected via an input device. Virtual options / affordances presented within a three-dimensional environment that may be selected may also be referred to herein as selectable options.
[0029] The following description describes display generation components and electronic devices that communicate with one or more input devices. It should be understood that the electronic devices optionally communicate with one or more other physical user interface devices, such as touch-sensitive surfaces, physical keyboards, mice, joysticks, hand-tracking devices, eye-tracking devices, and styluses. Furthermore, as described above, it should be understood that the described electronic devices, displays, and touch-sensitive surfaces optionally distribute across two or more devices. Therefore, as used in this disclosure, information displayed on or by an electronic device may optionally be used to describe information output by a display electronic device on another display device (touch-sensitive or non-touch-sensitive). Similarly, as used in this disclosure, input received by an electronic device (e.g., touch input received on the touch-sensitive surface of an electronic device, or touch input received on the surface of a stylus) may optionally be used to describe input received by a separate input device that the electronic device receives input information from.
[0030] The device generally supports a variety of applications, including drawing applications, presentation applications, word processing applications, website creation applications, disk authoring applications, spreadsheet applications, game applications, telephone applications, video conferencing applications, email applications, instant messaging applications, training support applications, photo management applications, digital camera applications, digital video camera applications, web browsing applications, digital music playback applications, TV channel viewing applications, and / or digital video playback applications.
[0031] Figures 2A and 2B show block diagrams of exemplary architectures of electronic devices 201 and 260 according to some examples of the present disclosure. In some examples, electronic device 201 and / or electronic device 260 comprises one or more electronic devices. For example, electronic device 201 could be a portable device, an auxiliary device for communicating with another device, a head-mounted display, etc. In some examples, electronic device 201 corresponds to electronic device 101 described above with reference to Figure 1. In some examples, electronic device 260 corresponds to electronic device 160 described above with reference to Figure 1. Electronic devices 201 and 260 optionally form and / or are included in a computing system.
[0032] As shown in Figure 2A, the electronic device 201 optionally includes various sensors such as one or more hand tracking sensors 202, one or more location sensors 204A, one or more image sensors 206A (optionally corresponding to the internal image sensors 114a and / or external image sensors 114b and 114c in Figure 1), one or more touch-sensing surfaces 209A, one or more motion and / or orientation sensors 210A, one or more eye-tracking sensors 212, one or more microphones 213A or other sound sensors, one or more body tracking sensors (e.g., torso and / or head tracking sensors), one or more display generation components 214A (optionally corresponding to the display 120 in Figure 1), one or more speakers 216A, one or more processors 218A, one or more memories 220A, and / or communication circuits 222A. One or more communication buses 208A are optionally used for communication between the above-mentioned components of the electronic device 201. In addition, as shown in Figure 2B, the electronic device 260 optionally includes one or more location sensors 204B, one or more image sensors 206B, one or more touch-sensing surfaces 209B, one or more orientation sensors 210B, one or more microphones 213B, one or more display generation components 214B, one or more speakers 216B, one or more processors 218B, one or more memories 220B, and / or communication circuits 222B. One or more communication buses 208B are optionally used for communication between the above-mentioned components of the electronic device 260. The electronic devices 201 and 260 are optionally configured to communicate via a wired or wireless connection between the two electronic devices (for example, via communication circuits 222A, 222B). For example, as shown in Figure 2A, the electronic device 260 may function as a companion device to the electronic device 201.
[0033] Communication circuits 222A and 222B optionally include circuits for communicating with electronic devices, networks such as the Internet, intranets, wired networks and / or wireless networks, cellular networks, and wireless local area networks (LANs). Communication circuits 222A and 222B optionally include circuits for communicating using short-range communication such as near-field communication (NFC) and / or Bluetooth®.
[0034] The processor(s) 218A, 218B include one or more general-purpose processors, one or more graphics processors, and / or one or more digital signal processors. In some examples, memory 220A or 220B is a non-temporary computer-readable storage medium (e.g., flash memory, random-access memory, or other volatile or non-volatile memory or storage device) that stores computer-readable instructions configured to be executed by the processor(s) 218A, 218B to perform the techniques, processes, and / or methods described below. In some examples, memory 220A and / or 220B may include two or more non-temporary computer-readable storage mediums. A non-temporary computer-readable storage medium can be any (non-signal) medium that can tangibly store or store computer-executable instructions used by or in association with an instruction execution system, apparatus, or device. In some embodiments, the storage medium is a temporary computer-readable storage medium. In some embodiments, the storage medium is a non-temporary computer-readable storage medium. Non-temporary computer-readable storage media may include, but are not limited to, magnetic storage devices, optical storage devices, and / or semiconductor storage devices. Examples of such storage include magnetic disks, compact disks (CDs), digital-purpose disks (DVDs), or optical disks based on Blu-ray® technology, as well as persistent solid-state memory such as flash and solid-state drives.
[0035] In some examples, the display generation components (one or more) 214A, 214B include a single display (e.g., a liquid crystal display (LCD), an organic light-emitting diode (OLED), or another type of display). In some examples, the display generation components (one or more) 214A, 214B include multiple displays. In some examples, the display generation components (one or more) 214A, 214B may include touch-enabled displays (e.g., touchscreens), projectors, holographic projectors, retinal projectors, transparent or translucent displays, etc. In some examples, the electronic devices 201 and 260 each include touch-sensitive surfaces (one or more) 209A and 209B for receiving user input such as tap input and swipe input or other gestures. In some examples, the display generation components (one or more) 214A, 214B and the touch-sensitive surfaces (one or more) 209A, 209B form a touch-sensitive display (one or more) (for example, an external touchscreen of each of the electronic devices 201 and 260, either integrated with each of the electronic devices 201 and 260 or communicating with each of the electronic devices 201 and 260).
[0036] In some examples, the electronic device 201 may include one or more controllable tint layers, each of which may be configured to filter a tunable amount of light (e.g., light having a specific wavelength or wavelength range). One or more tint layers may be used to at least partially block the user's view of the physical environment and enhance the virtual image displayed using an optical see-through display. In some examples, the tint layers are integrated into the display generation component 214A. In some examples, the tint layers are separate layers from the display generation component 214A. In some examples, one of the controllable tint layers may include a frosted glass layer that can be controlled to scatter a tunable amount of incident light. Alternatively, in some examples, the electronic device 201 may not have separate controllable tint layers. For example, the tint function may be integrated into the display generation component 214A (e.g., integrated into other layers of the display generation component 214A).
[0037] Electronic devices 201 and 260 optionally include one or more image sensors 206A and 206B, respectively. Image sensors 206A and 206B optionally include one or more visible light image sensors, such as charge-coupled device (CCD) sensors and / or complementary metal-oxide-semiconductor (CMOS) sensors, capable of operating to acquire images of physical objects from a real-world environment. Image sensors 206A and 206B also optionally include one or more infrared (IR) sensors, such as passive or active IR sensors, for detecting infrared light from a real-world environment. For example, an active IR sensor includes an IR emitter for emitting infrared light into the real-world environment. Image sensors 206A and 206B also optionally include one or more cameras configured to capture the movement of physical objects in a real-world environment. The image sensors (one or more) 206A, 206B also optionally include one or more depth sensors configured to detect the distance of a physical object from the electronic devices 201, 260. In some examples, information from one or more depth sensors can enable the device to identify an object in a real-world environment and distinguish it from other objects in the real-world environment. In some examples, one or more depth sensors can enable the device to determine the texture and / or topography of an object in a real-world environment.
[0038] In some examples, electronic devices 201, 260 use a combination of CCD sensors, event cameras, and depth sensors to detect the physical environment surrounding the electronic devices 201, 260. In some examples, image sensors 206A, 206B include a first image sensor and a second image sensor. The first and second image sensors cooperate and are configured to optionally capture different information about physical objects in the real-world environment. In some examples, the first image sensor is a visible light image sensor and the second image sensor is a depth sensor. In some examples, electronic devices 201, 260 use image sensors 206A, 206B to detect the position and orientation of electronic devices 201, 260 and / or display generation components 214A, 214B in the real-world environment. For example, electronic devices 201 and 260 use image sensors 206A and 206B to track the position and orientation of display generation components 214A and 214B relative to one or more stationary objects in a real-world environment.
[0039] In some examples, electronic devices 201 and 260 include, respectively, microphones 213A and 213B, or other sound sensors. Electronic devices 201 and 260 optionally use microphones 213A and 213B to detect sounds from the user and / or the user's real-world environment. In some examples, microphones 213A and 213B optionally include an array of microphones (multiple microphones) working together to identify ambient noise or to locate sound sources in the space of the real-world environment.
[0040] In some examples, electronic devices 201 and 260 include location sensors 204A and 204B, respectively, for detecting the location of electronic device 201A and / or display generation component(s) 214A and the location of electronic device 260 and / or display generation component(s) 214B. For example, location sensors 204A and 204B may include Global Positioning System (GPS) receivers that receive data from one or more satellites, enabling electronic devices 201 and 260 to determine the absolute position of the devices in the physical world.
[0041] In some examples, electronic devices 201 and 260 include orientation sensors 210A and 210B, respectively, for detecting the orientation and / or movement of electronic device 260 and / or display generation component(s) 214A, and the orientation and / or movement of electronic device 201 and / or display generation component(s) 214B, respectively. For example, electronic devices 201 and 260 use orientation sensors 210A and 210B to track changes in the position and / or orientation of electronic devices 201 and 260 and / or display generation component(s) 214A and 214B relative to physical objects in a real-world environment. Orientation sensors 210A and 210B optionally include one or more gyroscopes and / or one or more accelerometers.
[0042] In some examples, the electronic device 201 includes, in some examples, a hand tracking sensor(s) 202 and / or an eye tracking sensor(s) 212 (and / or other body tracking sensors(s) such as leg, torso, and / or head tracking sensors(s)). The hand tracking sensor(s) 202 is configured to track the position / location of one or more parts of the user's hand and / or the movement of one or more parts of the user's hand relative to the augmented reality environment, the display generating component(s) 214A, and / or another defined coordinate system. The eye tracking sensor(s) 212 is configured to track the position and movement of the user's gaze(s) (more commonly, eyes, face, or head) relative to the real world or the augmented reality environment and / or the display generating component(s) 214A. In some examples, the hand tracking sensor(s) 202 and / or eye tracking sensor(s) 212 are implemented together with the display generation component(s) 214A. In some examples, the hand tracking sensor(s) 202 and / or eye tracking sensor(s) 212 are implemented separately from the display generation component(s) 214A. In some examples, the electronic device 201 does not, alternatively, include the hand tracking sensor(s) 202 and / or eye tracking sensor(s) 212. In some such examples, the display generation component(s) 214A may be used by the electronic device 260 to provide an augmented reality environment and to utilize inputs and other data collected via other sensors(s) of the electronic device 260 (e.g., one or more location sensors 204A, one or more image sensors 206A, one or more touch-sensing surfaces 209A, one or more motion and / or orientation sensors 210A, and / or one or more microphones 213A or other sound sensors) as inputs and data to be processed by the processor 218B of the electronic device 201.Additionally or alternatively, the electronic device 201 may optionally not include other components shown in Figure 2B, such as a location sensor 204B, an image sensor 206B, or a touch-sensing surface 209B. In some such examples, a display generation component(s) 214A may be utilized by the electronic device 260 to provide an augmented reality environment, and the electronic device 260 may utilize inputs and other data collected via one or more motion and / or orientation sensors 210A (and / or one or more microphones 213A) of the electronic device 201 as input.
[0043] In some examples, hand tracking sensors(s) 202 (and / or other body tracking sensors(s) such as leg, torso, and / or head tracking sensors(s)) may use image sensors(s) 206 (e.g., one or more IR cameras, 3D cameras, depth cameras, etc.) that capture three-dimensional information from the real world, including one or more body parts (e.g., the hands, legs, or torso of a human user). In some examples, the hand may be resolved with sufficient resolution to distinguish the fingers and their respective positions. In some examples, one or more image sensors(s) 206A are positioned relative to the user so as to define the field of view of the image sensors(s) 206A and the interaction space where the finger / hand positions, orientations, and / or movements captured by the image sensors are used as input (e.g., to distinguish the user's stationary hand from other hands of other people in the real-world environment). Tracking fingers / hands for input (e.g., gestures, touches, taps) can be advantageous in that it eliminates the need for users to touch, hold, or wear any kind of beacon, sensor, or other marker.
[0044] In some examples, the eye-tracking sensor(s)212 includes at least one eye-tracking camera (e.g., an infrared (IR) camera) and / or an illumination source (e.g., an IR light source, LED, etc.) that emits light toward the user's eye. The eye-tracking camera may be directed toward the user's eye so as to receive reflected IR light from the light source directly or indirectly through the eye. In some examples, both eyes are tracked separately by their respective eye-tracking cameras and illumination sources, and focus / line of sight can be determined from the tracking of both eyes. In some examples, one eye (e.g., the dominant eye) is tracked by one or more respective eye-tracking cameras / illumination sources.
[0045] Electronic devices 201 and 260 are not limited to the components and configurations shown in Figures 2A and 2B, and may include fewer, other, or additional components in multiple configurations. In some examples, electronic device 201 and / or electronic device 260 can each be implemented (e.g., as a system) among multiple electronic devices. In some such examples, each (or more) electronic device may each include one or more of the same components described above, such as various sensors, one or more display generating components, one or more speakers, one or more processors, one or more memories, and / or communication circuits. A person who uses electronic device 201 and / or electronic device 260 is optionally referred to herein as a user of the device.
[0046] Here, we consider an example of a computing system that transfers the presentation of virtual content between a first electronic device (e.g., corresponding to electronic devices 101 and / or 201) and a second electronic device (e.g., corresponding to electronic devices 160 and / or 260). For example, the computing system comprises the first electronic device and the second electronic device (for example, the first electronic device communicates with the second electronic device as described with reference to Figures 1 and / or 2A to 2B).
[0047] The methods and processes described below for transferring content presentation between a first electronic device and a second electronic device provide users of a computing system with an efficient way to control which devices of the computing system the virtual content is presented to, thereby improving user interaction and battery life of the computing system devices (for example, by avoiding presenting virtual content on one or more devices of the computing system that the user does not intend to view).
[0048] Figures 3A to 3K illustrate a computing system, according to some examples of the present disclosure, that transfers content presentations between a first electronic device and a second electronic device in response to one or more user inputs. In some examples, the computing system includes a first electronic device 301 (e.g., having one or more characteristics of electronic devices 101 and / or 201) and a second electronic device 306 (e.g., having one or more characteristics of electronic devices 160 and / or 260). In some examples, the first electronic device 301 communicates with the second electronic device 306 (e.g., the second electronic device 306 is an auxiliary and / or companion device that communicates with the first electronic device 301).
[0049] As shown in Figures 3A to 3K, the first electronic device 301 includes image sensors 114a to 114c (for example, having one or more characteristics of image sensors 314a to 314c and / or one or more characteristics of image sensors 206). In some examples, image sensors 314a to 314c are configured to detect one or more objects in a physical environment (for example, having one or more characteristics of the real-world environment and / or physical environment described above). In some examples, image sensors 314a to 314c are configured to detect movement of one or more parts of a user (e.g., hands, head, and / or eyes) and / or the user's attention (e.g., gaze). Optionally, the first electronic device 301 does not include image sensors 314a to 314c. For example, the first electronic device 301 is not configured to detect one or more objects in the physical environment, one or more parts of the user, and / or the user's attention (for example, the computing system uses one or more input devices of the second electronic device 306 to detect user input and / or one or more objects in the physical environment). Furthermore, as shown in Figures 3A to 3K, the first electronic device 301 includes a display 320 (e.g., having one or more characteristics of display 120 and / or display generating components (one or more) 214A), and the second electronic device 306 includes a display 308 (e.g., having one or more characteristics of display generating components (one or more) 214B). In some examples, the display 320 includes multiple display generating components (e.g., the first electronic device 301 is a head-mounted display including two stereo displays). The display 320 is optionally a passive display that presents content (e.g., images and / or video content) rendered by the second electronic device 306. In some examples, display 308 is a touch-sensitive display.For example, the display 308 includes a display generating component (for example, having one or more characteristics of the display generating component 214B) and a touch sensing surface (for example, having one or more characteristics of the touch sensing surface 209B) that form a touch-sensitive display (for example, a touchscreen integrated with the second electronic device 306 and communicating with the first electronic device 301 and the second electronic device 306). For example, the display 308 is configured to detect one or more touch inputs (for example, touch gestures represented by touch positions 310a to 310b in Figure 3A).
[0050] In Figures 3A to 3K, the environment 300 is visible via the display 320. In some examples, the environment 300 is a three-dimensional environment presented to the user of the first electronic device 301 via the display 320. In some examples, the environment 300 is an XR environment having one or more characteristics of the extended reality (XR) environment described above. For example, one or more virtual elements (e.g., video content 304) are presented within the environment 300 from the user's current viewpoint on the first electronic device 301, while one or more physical objects from the user's physical environment (e.g., a real-world window 302) are visible (e.g., through video passthrough or optical seethrough of the physical environment).
[0051] Figure 3A shows a first electronic device 301 that presents video content 304 within an environment 300. In some examples, the video content 304 corresponds to media presented within a virtual window and / or virtual object within the environment 300. In some examples, the video content 304 includes video and audio content (for example, the computing system performs playback of the video content 304 within the environment 300, including outputting audio associated with the video content 304 via one or more audio output devices of the first electronic device 301). For example, the video content 304 is a movie, TV show, live broadcast (e.g., associated with a streaming service), or online video (e.g., associated with social media and / or video sharing services). In some examples, it should be understood that the computing system maintains playback of the video content 304 (e.g., including outputting audio associated with the video content 304) throughout the examples illustrated and described with reference to Figures 3A–3K.
[0052] In some examples, the first electronic device 301 presents the video content 304 in a head-locked and / or tilt-locked orientation (for example, as described above). Alternatively, in some examples, the first electronic device 301 presents the video content 304 in a body-locked, world-locked, and / or tilt-locked orientation. The video content 304 is optionally rendered by a second electronic device 306 and displayed on the first electronic device 301 via a display 320 (for example, the display 320 is a passive display).
[0053] As shown in Figure 3A, while the first electronic device 301 presents video content 304 in the environment 300, the second electronic device 306 does not present video content 304. Optionally, while the first electronic device 301 presents video content 304, the second electronic device 306 operates in a power-saving state. In some examples, in the power-saving state, the second electronic device 306 causes the display 308 to operate in an inactive state. For example, operating the display 308 in an inactive state includes turning off the display 308 (e.g., not displaying content on the display 308). For example, operating the display 308 in an inactive state includes reducing the refresh rate of the display 308. For example, operating the display 308 in an inactive state includes reducing the brightness, color, and / or saturation of the content presented by the display 308. In some examples, while operating in a power-saving state, the second electronic device 306 is configured to detect touch input on the display 308 (e.g., touch gestures represented by touch positions 310a-310b). Operating the second electronic device 306 in a power-saving state while video content 304 is presented on the first electronic device 301 saves computing resources and conserves the battery life of the computing system by avoiding active operation of the display 308 when a user of the computing system intends to view the video content 304 on the first electronic device 301.
[0054] In Figure 3A, a touch gesture is detected by the second electronic device 306. In some examples, the touch gesture corresponds to a swipe gesture (e.g., a downward swipe) detected from touch position 310a to touch position 310b. For example, the touch gesture is performed by an object (e.g., the user's finger and / or stylus on the second electronic device 306). In some examples, upon determination that the touch gesture detected by the second electronic device 306 meets one or more criteria, the computing system transfers video content 304 from the first electronic device 301 to the second electronic device 306 (e.g., as shown in Figure 3B). For example, one or more criteria include evaluation criteria that are met when the touch gesture corresponds to a particular type of gesture. For example, a particular type of gesture is a swipe gesture (e.g., including a specific (e.g., defined) direction (e.g., downward), speed, and / or duration). For example, a distinct type of gesture is a tap gesture (e.g., a multi-tap gesture or tap-and-hold gesture with a specific (e.g., defined) duration (e.g., 0.1, 0.2, 0.5, 1, 2, 5, or 10 seconds)). In some examples, a distinct type of gesture is a system-defined gesture (e.g., a default gesture assigned to control the transfer of content between devices in a computing system (e.g., stored in the memory of one or more devices in the computing system)). In some examples, a distinct type of gesture is a user-defined gesture (e.g., a gesture created and / or assigned by a user to control the transfer of content between devices in a computing system (e.g., stored and / or associated with a user profile on one or more devices in the computing system)). In some examples, one or more criteria include evaluation criteria that are met when a distinct type of touch gesture is detected on a specific touch area of the display 508 of the second electronic device 306 (for example, as illustrated and described with reference to the display 308 of the second electronic device 506 in Figures 5A to 5D).In some cases, based on a determination that a touch gesture detected by the second electronic device 306 does not meet one or more criteria, the computing system refrains from transferring the presentation of video content 304 from the first electronic device 301 to the second electronic device 306 (and optionally performs a different action, for example, as illustrated and described with reference to Figures 3D to 3E). By establishing one or more criteria that must be satisfied for transferring the presentation of video content 304 from the first electronic device 301 to the second electronic device 306, the computing system ensures that the user intends to transfer the video content 304 to the second electronic device 306 before performing the transfer, which reduces errors in user interaction and saves computing resources associated with correcting unintended transfers of video content 304 (e.g., via additional user input).
[0055] Alternatively, in some examples, the second electronic device 306 presents (via the display 308) a selectable virtual element for transferring video content 304 from the first electronic device 301 to the second electronic device 306 (for example, the virtual element has one or more characteristics of the selectable options 3016 illustrated and described with reference to Figure 3B). For example, in response to detecting a touch input corresponding to the selection of a virtual element, the computing system transfers the video content 304 from the first electronic device 301 to the second electronic device 306.
[0056] Figure 3B shows a computing system that transfers the presentation of video content 304 from the first electronic device 301 to the second electronic device 306 in response to a touch gesture detected by the second electronic device 306 in Figure 3A. For example, the computing system transfers the video content 304 from a state where it is presented (e.g., displayed) on the first electronic device 301 in Figure 3B (e.g., via display 320) to a state where it is presented (e.g., displayed) on the second electronic device 306 (e.g., via display 308) in response to a touch gesture detected by the second electronic device 306 in Figure 3A that satisfies one or more of the above criteria (e.g., the computing system determines that the touch gesture corresponds to a downward swipe gesture detected by the second electronic device 306). As shown in Figure 3B, transferring the presentation of video content 304 from the first electronic device 301 to the second electronic device 306 includes ceasing the presentation of video content 304 on the first electronic device 301 (for example, within the environment 300) via the display 320, and displaying the video content 304 on the second electronic device 306 via the display 308. In some examples, presenting video content 304 on a first electronic device 301 includes rendering the video content 304 using a second electronic device 306 (for example, the second electronic device 306 transmits images and / or videos associated with the video content 304 to the first electronic device 301), and transferring the presentation of video content 304 from the first electronic device 301 to the second electronic device 306 includes ceasing to transmit images and / or videos associated with the video content 304 from the second electronic device 306 to the first electronic device 301 (for example, presenting the video content 304 on the second electronic device 306 via a display 308).
[0057] In some examples, transferring the presentation of video content 304 from a first electronic device 301 to a second electronic device 306 includes presenting a transition. In some examples, the transition includes an animation presented on the first electronic device 301 and / or the second electronic device 306. For example, presenting an animation includes gradually discontinuing the video content 304 within the environment 300 (for example, over a period of time (e.g., 0.1, 0.2, 0.5, 1, 2, 5, or 10 seconds)) (for example, by fading out the video content 304 within the environment 300 (e.g., by decreasing its opacity)). Additionally or alternatively, for example, presenting an animation includes gradually presenting the video content 304 on the second electronic device 306 (for example, by fading in the video content 304 on the display 308 (e.g., by increasing its opacity)) after discontinuing the presentation of the video content 304 on the first electronic device 301 (e.g., by fading in the video content 304 on the display 308 (e.g., by increasing its opacity)). For example, presenting an animation includes crossfading the presentation of video content 304 between the first electronic device 301 and the second electronic device 306 (for example, by fading out the presentation of video content 304 on display 320 (for example, by decreasing its opacity) while fading in the presentation of video content 304 on display 308 (for example, by increasing its opacity)). Additionally or alternatively, presenting an animation includes moving the video content 304 in environment 300 (for example, from the current viewpoint of the user of the first electronic device 301) toward a position in environment 300 corresponding to the second electronic device 306 (for example, the second electronic device 306 is located below the current viewpoint of the user of the first electronic device 301, and transferring the presentation of video content 304 includes moving the video content 304 downward toward the position of the second electronic device 306).Additionally or alternatively, for example, presenting an animation includes moving the display position of the video content 304 on display 308 (for example, in a direction corresponding to the movement of the video content 304 presented by the first electronic device 301 in the environment 300 (for example, downward toward the center of display 308)). Additionally or alternatively, for example, presenting an animation includes changing the size of the video content 304 in the environment 300 and / or on display 320 (for example, the computing system reduces the size of the video content 304 in the environment 300 (for example, until the first electronic device 301 stops presenting the video content 304 in the environment 300) and / or increases the display size of the video content 304 on display 308 (for example, until the second electronic device 306 presents the video content 304 at full size)). In some examples, the animation includes one or more characteristics of animation illustrated and described with reference to Figure 3I.
[0058] In some examples, as shown in Figure 3B, the transfer of video content 304 from a first electronic device 301 to a second electronic device 306 includes an audio output schematically represented by the sound wave 312a in Figure 3B. For example, the audio output is performed by one or more audio output devices of the first electronic device 301 (for example, having one or more characteristics of a speaker(s) 216A as described with reference to Figure 2A). For example, the audio output is performed by one or more audio output devices (e.g., headphones (e.g., wireless headphones)) communicating with the first electronic device 301. For example, the audio output provides audio feedback to the user of the computing system that content is being transferred between the first electronic device 301 and the second electronic device 306 (for example, the audio output is independent of and / or separate from the audio output associated with the playback of video content 304).
[0059] In addition to or alternative to outputting audio indicating the transfer of content from the first electronic device 301 to the second electronic device 306, the computing system modifies one or more characteristics of the audio output associated with the playback of video content 304. For example, transferring video content 304 from the first electronic device 301 to the second electronic device 306 includes changing the spatial position of the audio associated with video content 304 within the environment 300 (e.g., changing the position from which the audio associated with video content 304 is emitted within the environment 300, from the user's perspective of the first electronic device 301). For example, in Figure 3A, the audio associated with video content 304 is emitted from a position corresponding to the virtual window in which video content 304 is presented within the environment 300, and in Figure 3B, the audio associated with video content 304 is emitted from a position within the environment 300 corresponding to the second electronic device 306. In some examples, when changing the output position of the audio associated with video content 304, the first electronic device 301 transitions its output. For example, the first electronic device 301 transitions the audio output associated with the video content 304 by fading out the audio at the initial position of the video content 304 in the environment 300 (e.g., reducing the volume of the audio) and, sequentially or simultaneously, fading in the audio at a new position in the environment 300 corresponding to the second electronic device 306 (e.g., increasing the volume of the audio) (for example, the first electronic device 301 transitions the audio output until the audio reaches a final volume (e.g., a volume level at which the volume no longer increases, which is optionally the volume at which the audio was output before the transition)). In some examples, transitioning the audio output associated with the playback of the video content 304 includes spatially expanding or shrinking the audio (e.g., by changing the three-dimensional size of the audio and / or changing the soundstage of the audio).Additionally or alternatively, transferring video content 304 from the first electronic device 301 to the second electronic device 306 includes (for example, as illustrated and described with reference to Figures 3G to 3H) transitioning from audio output from the first electronic device 301 to audio output from the second electronic device 306. Additionally or alternatively, transferring video content 304 from the first electronic device 301 to the second electronic device 306 includes providing haptic feedback in the second electronic device 306.
[0060] In some examples, as used herein, the system may output spatial audio with soundstages of different sizes. Each simulated soundstage has a corresponding virtual speaker layout associated with the soundstage, and as used herein, “soundstage” refers to a separate layout of virtual speakers, including the number and / or positions of virtual speakers used to present the spatial audio. In some examples, the soundstages simulate spatial audio playback in spaces of different sizes and / or with speaker settings of different sizes. For example, a large soundstage is spatial audio that sounds as if it were being played in a movie theater with spatial audio speakers positioned at a relatively large distance from the user of the first electronic device 301. In another example, a medium soundstage is spatial audio that sounds as if it were being played in a home theater with spatial audio speakers positioned at a smaller distance from the user of the first electronic device 301 compared to the simulated speaker distance associated with the large soundstage. Additionally or alternatively, in some examples, a medium soundstage sounds as if the audio is being played with fewer simulated speakers than the number of simulated speakers in the large soundstage. As another example, a small soundstage is spatial audio that sounds like it's being played from a more localized source than a medium soundstage, such as a stereo speaker arrangement positioned at the location of visual content associated with the audio content. In some examples, a small soundstage includes fewer simulated speakers, simulated speakers positioned closer to each other, and / or simulated speakers closer to the user, compared to the simulated speakers for a medium and / or large soundstage.
[0061] In some examples, transferring the presentation of video content 304 from the first electronic device 301 to the second electronic device 306 includes maintaining the playback state of the video content 304. For example, while the second electronic device 306 detects a touch gesture represented by touch positions 310a-310b in Figure 3A, the video content 304 is played within the environment 300, and transferring the presentation of video content 304 to the second electronic device 306 includes maintaining the playback of video content 304 on the second electronic device 306 (e.g., continuing to play). Alternatively, in some examples, transferring the presentation of video content 304 from the first electronic device 301 to the second electronic device 306 includes pausing the playback of video content 304 (e.g., the second electronic device 306 resumes playback of video content 304 in response to detecting the selection of one or more selectable options included in the playback control 318 shown in Figure 3B).
[0062] In Figure 3B, the second electronic device 306 presents video content 304 simultaneously with one or more virtual elements. For example, in Figure 3B, video content 304 is presented with playback controls 318 (e.g., including multiple selectable options for controlling the playback of video content 304). In some examples, video content 304 is presented with selectable options for transferring video content 304 from the second electronic device 306 to the first electronic device 301. For example, as shown in Figure 3B, video content 304 is presented with selectable options 316. In some examples, selectable options 316 are presented by the second electronic device 306 as affordances (e.g., including text and / or icons that visually indicate that selecting selectable option 316 will transfer video content 304 from the second electronic device 306 to the first electronic device 301).
[0063] Figure 3C shows a second electronic device 306 that detects a touch input 322 corresponding to the selection of a selectable option 316. For example, the touch input 322 is a tap input detected at the location of the display 308 corresponding to the selectable option 316. In some examples, the touch input 322 corresponds to a request to transfer video content 304 from the second electronic device 306 to the first electronic device 301. Alternatively, in some examples, a request to transfer video content 304 from the second electronic device 306 to the first electronic device 301 includes one or more touch gestures that satisfy a second criterion for transferring individual content presentations from the second electronic device 306 to the first electronic device 3301 (e.g., touch gestures including individual types of gestures (e.g., an upward swipe, such as the touch gesture illustrated and described with reference to Figure 4G)). Alternatively, in some examples, a request to transfer video content 304 from a second electronic device 306 to a first electronic device 301 includes inputs detected on the first electronic device 301 that satisfy one or more second criteria for transferring individual content presentations from the second electronic device 306 to the first electronic device 301 (for example, the inputs include air gestures and / or selection of selectable options presented within the environment 300).
[0064] In some examples, in response to touch input 322, the computing system transfers video content 304 from the second electronic device 306 in Figure 3D to the first electronic device 301. For example, transferring the presentation of video content 304 from the second electronic device 306 to the first electronic device 301 includes one or more characteristics of transferring the presentation of video content 304 from the first electronic device 301 to the second electronic device 306, as described above (for example, the computing system presents transitions, animations, and / or audio outputs while transferring the presentation of video content 304 from the second electronic device 306 to the first electronic device 301). In some examples, transferring the presentation of video content 304 from a second electronic device 306 to a first electronic device 301 includes presenting the video content 304 in the environment 300 at the same location (e.g., the location of the video content 304 shown in Figure 3A) where the first electronic device 301 presented the video content 304 before transferring the presentation of video content 304 to the second electronic device 306 (e.g., the same location corresponds to the location and / or orientation (e.g., relative to the environment 300 and / or the current viewpoint of the user of the first electronic device 301)). Transferring the presentation of video content 304 from a second electronic device 306 to a first electronic device 301 optionally includes providing an audio output having one or more characteristics of the audio output illustrated and described with reference to Figure 3B (e.g., the audio output includes changing the spatial location of the audio associated with the video content 304 from the location associated with the second electronic device 306 to a different location in the three-dimensional environment 300).
[0065] Figure 3D shows a second electronic device 306 that detects touch gestures (represented by touch positions 324a to 324b). For example, the touch gesture shown in Figure 3D is a different type of touch gesture from the touch gesture shown in Figure 3A (for example, the touch gesture shown in Figure 3A that satisfies one or more criteria for transferring the presentation of video content 304 is a vertical swipe gesture (e.g., a downward swipe), while the touch gesture shown in Figure 3D is a horizontal swipe gesture (e.g., a rightward swipe)). In some examples, the touch gesture shown in Figure 3D does not satisfy one or more criteria for transferring the presentation of video content 304 from the first electronic device 301 to the second electronic device 306 (for example, because the touch gesture does not satisfy one or more criteria for transferring the presentation of video content 304, the computing system does not transfer the video content 304 in response to the touch gesture detected in Figure 3D).
[0066] In some cases, upon determining that a touch gesture detected by the second electronic device 306 satisfies one or more second criteria different from one or more criteria for transferring the presentation of the video content 304 described above (see, for example, Figure 3A), the computing system performs an action different from transferring the presentation of the video content 304 from the first electronic device 301 to the second electronic device 306 (for example, the action includes modifying the presentation of the video content 304 in the environment 300, as illustrated and described with reference to Figure 3E). For example, one or more second criteria are satisfied when the touch gesture corresponds to a second distinct type of gesture different from the distinct type of gesture illustrated and described with reference to Figure 3A. For example, the second distinct type of gesture is a swipe gesture that includes a different direction from the distinct type of gesture (for example, the second distinct type of gesture is a horizontal swipe gesture and the distinct type of gesture is a vertical swipe gesture). For example, the second distinct type of gesture is a tap gesture and the first distinct type of gesture is a swipe gesture (or the first distinct type of gesture is a tap gesture and the second distinct type of gesture is a swipe gesture). In some examples, the second distinct type of gesture is a system-defined gesture (e.g., a default gesture stored in the memory of one or more devices of the computing system that is assigned to perform an action within the environment 300). In some examples, the second distinct type of gesture is a user-defined gesture (e.g., a gesture created and / or assigned by a user to perform an action within the environment 300 (e.g., stored in and / or associated with a user profile on one or more devices of the computing system)). In some examples, in accordance with the determination that a touch gesture detected by the second electronic device 306 does not meet one or more second criteria, the computing system refrains from performing an action (e.g., and / or performs a different type of action).By assigning different types of actions (e.g., transferring the presentation of video content 304, or a different action (e.g., modifying the presentation of video content 304 as shown in Figure 3E)) to different types of gestures detected by the second electronic device 306, it is ensured that the user intends to perform the individual type of action before performing the action, thereby reducing errors in the interaction process and saving computing resources associated with error correction.
[0067] Figure 3E shows a computing system that modifies the presentation of video content 304 in the environment 300 in response to a touch gesture detected by the second electronic device 306 in Figure 3D. For example, the computing system modifies the presentation of video content 304 in the environment 300 in Figure 3E according to a determination that the touch gesture detected by the second electronic device 306 in Figure 3D satisfies one or more of the second criteria described above (for example, modifying the presentation of video content 304 corresponds to an action performed according to a determination that the touch gesture satisfies one or more of the second criteria described above). In some examples, modifying the presentation of video content 304 includes presenting the video content 304 in a picture-in-picture presentation. For example, the first electronic device 301 reduces the size of the presentation of video content 304 in the environment 300 (for example, compared to the size of video content 304 shown in Figure 3D). For example, the first electronic device 301 offsets the presentation of video content 304 and / or moves the video content 304 to a new position in the environment 300 (e.g., from the user's current viewpoint of the first electronic device 301). In some examples, presenting video content 304 in picture-in-picture presentation includes maintaining the playback state of video content 304 (e.g., continuing to play video content 304 in the environment 300). In some examples, modifying the presentation of video content 304 includes presenting an animation of video content 304 in the environment 300 that transitions to a picture-in-picture state (e.g., by gradually reducing the size of video content 304 in the environment 300 (e.g., over a period of time such as 0.1, 0.2, 0.5, 1, 2, 5, or 10 seconds) and / or moving video content 304). In some examples, presenting video content 304 in picture-in-picture presentation includes providing an audio output (having one or more characteristics of the audio output illustrated and described with reference to Figure 3B, for example).For example, the audio output includes changing the spatial position of the video content 304 from the position of the video content 304 in the environment 300 shown in Figure 3D to the position of the video content 304 in the environment 300 shown in Figure 3D.
[0068] In some examples, while the first electronic device 301 is presenting video content 304 in a modified state, the computing system detects a third distinct type of gesture on the second electronic device 306, and the first electronic device 301 ceases to present the video content 304 in a picture-in-picture state. For example, the third distinct type of gesture is different from the second distinct type of gesture (for example, the third distinct type of gesture includes a swipe gesture in the opposite direction to the second distinct type of gesture (e.g., to the left)). For example, ceasing to present video content 304 in a picture-in-picture state includes presenting the video content 304 in the state shown in Figure 3D (for example, in the size and / or position before detecting one or more touch gestures that meet the second criterion for modifying the presentation of video content 304 in the environment 300). For example, in response to detecting a third distinct type of gesture, the first electronic device 301 increases the size of the video content 304 in the environment 300 and / or moves the video content 304 (for example, to the size and / or position shown in Figure 3D).
[0069] Figure 3F shows a second electronic device 306 that detects touch gestures (represented by touch positions 326a-326b) corresponding to each of the third types of gestures (for example, as described above). For example, a touch gesture includes a horizontal swipe gesture in a different direction (e.g., the opposite direction) from the second distinct types of gestures illustrated and described with reference to Figure 3D. In some examples, the touch gesture shown in Figure 3F corresponds to a request to transition the presentation of video content 304 in the environment 300 from a picture-in-picture state (shown in Figures 3E-3F) to an enlarged presentation size (e.g., shown in Figures 3A-3D). In some examples, upon detecting the touch gesture shown in Figure 3F, the computing system causes the video content 304 to be displayed in the environment 300 via the display 320 at the enlarged presentation size, as shown in Figure 3G. Transitioning the presentation of video content 304 from the picture-in-picture state in Figure 3F to the enlarged presentation size in Figure 3G optionally includes changing one or more characteristics of the audio output associated with the playback of video content 304 (for example, changing the spatial position of the audio and / or soundstage to correspond to the change in the position and / or size of video content 304 from the picture-in-picture state to the enlarged presentation size).
[0070] Figure 3G shows that the computing system detects a touch gesture in the second electronic device 306. In some examples, the touch gesture is a swipe gesture (e.g., a downward swipe) detected from touch position 328a to touch position 328b. The touch gesture detected in the second electronic device 306 in Figure 3G optionally has one or more characteristics of the touch gesture detected in the second electronic device 306 in Figure 3A. In some examples, the touch gesture shown in Figure 3G satisfies one or more criteria for transferring video content 304 from the first electronic device 301 to the second electronic device 306, as described above. In some examples, upon determining that the touch gesture satisfies one or more criteria for transferring video content 304 from the first electronic device 301 to the second electronic device 306, the computing system displays the video content 304 on the second electronic device 306, as shown in Figure 3H.
[0071] In some examples, transferring video content 304 from a first electronic device 301 to a second electronic device 306 includes transferring the audio output associated with the playback of the video content 304 from one or more first audio output devices of the first electronic device 301 (e.g., included in and / or communicating with the first electronic device 301) to one or more second audio output devices of the second electronic device 306 (e.g., included in and / or communicating with the second electronic device 306). For example, as shown in Figure 3G, while the computing system presents video content 304 in the environment 300 on the first electronic device 301, the computing system causes audio (represented by sound waves 312b) to be output through one or more first audio output devices of the first electronic device 301 (e.g., the speaker(s) 216A described above). Furthermore, as shown in Figure 3H, for example, while the computing system is presenting the video content 304 in the second electronic device 306 (for example, after the computing system has transferred the video content 304 from the first electronic device 301 to the second electronic device 306), the computing system causes the audio (represented by sound waves 312c) to be output through one or more second audio output devices of the second electronic device 306 (for example, the speaker(s) 216B described above). In some examples, transferring the audio output associated with the playback of the video content 304 from the first electronic device 301 to the second electronic device 306 includes transitioning the audio output from one or more first audio output devices of the first electronic device 301 to one or more second audio output devices of the second electronic device 306 (for example, as illustrated and described with reference to Figure 3I). Alternatively, transferring video content 304 from the first electronic device 301 to the second electronic device 306 includes maintaining audio output associated with the playback of video content 304 via one or more first audio output devices of the first electronic device 301.For example, while the video content 304 is being transferred, the computing system causes one or more characteristics of the audio output associated with the playback of the video content 304 to be modified via one or more first audio output devices of the first electronic device 301 (for example, as described above with reference to the transfer of the video content 304 from the first electronic device 301 to the second electronic device 306 in Figures 3A to 3B).
[0072] In some examples, transitioning from an audio output using a first electronic device 301, such as in Figure 3G, to an audio output using a second electronic device 306, such as in Figure 3H, involves reproducing a transition effect using the first electronic device 301 and / or the second electronic device 306. For example, the system uses a crossfade effect to transition the audio output from the first electronic device 301 to the second electronic device 306. The crossfade effect optionally includes gradually decreasing the volume of the audio output played by the first electronic device 301 while gradually increasing the volume of the audio output played by the second electronic device 306. The system can similarly transition from audio playback on the second electronic device 306 to audio playback on the first electronic device 301 with a crossfade effect by gradually decreasing the volume of the audio output on the second electronic device 306 while gradually increasing the volume of the audio output on the first electronic device 301.
[0073] As another example, the system uses a first electronic device 301 to output spatial audio transitions that sound as if the audio is moving from one or more audio positions in Figure 3G to one or more audio positions in Figure 3H. For example, in Figure 3G, the first electronic device 301 plays spatial audio that sounds as if it is playing from the position where the first electronic device 301 is displaying the video content 304, and in Figure 3H, the second electronic device 306 plays the audio content of the video content 304 from the position of the second electronic device 306. Additionally or alternatively, in some examples, the first electronic device 301 plays spatial audio that sounds as if it is playing from the position of the second electronic device 306 while the second electronic device 306 is presenting the visual content of the video content 304 in Figure 3H. In some examples, when video content 304 is transferred from a first electronic device 301, such as in Figure 3G, to a second electronic device 306, such as in Figure 3H, the system plays spatial audio that sounds as if the audio content of the video content 304 is moving from the audio output position in Figure 3G to the audio output position in Figure 3H. In some examples, when video content 304 is transferred from a third electronic device 306, such as in Figure 3H, to a first electronic device 301, such as in Figure 3G, the system plays spatial audio that sounds as if the audio content of the video content 304 is moving from the audio output position in Figure 3H to the audio output position in Figure 3G.
[0074] In some embodiments, the system uses the first electronic device 301 to reproduce transitions that sound as if the audio is moving. In some embodiments, the first electronic device 301 estimates or infers the position of the second electronic device 306, for example, the first electronic device 301 infers that the second electronic device 306 is positioned at an angle perpendicular to the user's face and at separate angles below the user's head. In another embodiment, the system uses one or more sensors of the first electronic device 301 and / or one or more sensors of the second electronic device 306 to determine the position of the second electronic device 306. The first electronic device 301 optionally uses the estimated, inferred, and / or determined position of the second electronic device 306 to output spatial audio such as audio transitions that simulate the movement of audio presented by the second electronic device 306 in Figure 3H and / or the movement of audio in video content 304, which sounds as if it is coming from and / or moving to the position of the second electronic device 306 (or away from the position of the second electronic device 306).
[0075] In Figure 3H, the computing system detects touch gestures (represented by touch positions 332a to 332b) that satisfy one or more second criteria for transferring the presentation of video content 304 from the second electronic device 306 to the first electronic device 301 (for example, optionally different from one or more criteria for transferring the presentation of video content 304 from the first electronic device 301 to the second electronic device 306). In some examples, one or more second criteria for transferring the presentation of video content 304 from the second electronic device 306 to the first electronic device 301 have one or more characteristics of one or more second criteria for transferring a virtual keyboard 422 from the second electronic device 406 to the first electronic device 401, as described with reference to Figure 4G. In some examples, the computing system transfers the presentation of video content 304 from the second electronic device 306 to the first electronic device 301 in response to the detection of one or more touch gestures on the second electronic device 306 that satisfy a second criterion for transferring the presentation of video content 304 from the second electronic device 306 to the first electronic device 301, or in response to the detection of a touch input corresponding to the selection of a selectable option 316. In some examples, as shown in Figures 3I to 3J, the computing system transfers the presentation of video content 304 from the second electronic device 306 to the first electronic device 301 in response to the detection of one or more touch gestures that satisfy a second criterion for transferring the presentation of video content 304 from the second electronic device 306 to the first electronic device 301.
[0076] Figures 3I to 3J illustrate how, in response to detecting a touch gesture in Figure 3H, the computing system transitions the presentation of video content 304 from the second electronic device 306 to the first electronic device 301. In some examples, the transition of the presentation of video content 304 from the second electronic device 306 to the first electronic device 301, as shown in Figure 3I, includes presenting an animation. In some examples, the animation has one or more characteristics of the animation described above, with reference to the transfer of the presentation of video content 304 shown in Figures 3A to 3B. In some embodiments, the animation includes presenting the movement of video content 304. For example, while the user is performing an upward swipe gesture (e.g., the touch gesture shown in Figure 3H) on the second electronic device 306, the computing system moves the presentation position of video content 304 upward on the display 308 (e.g., until the second electronic device 306 stops presenting video content 304 via the display 308). For example, as shown in Figures 3I to 3J, at the same time as and / or after optionally moving the presentation position of the video content 304 on the display 308, the computing system presents the movement of the video content 304 (for example, the movement of the video content 304 from the bottom of the user's field of view to the center of the user's field of view) within the environment 300 via the display 320. In Figure 3I, the movement of the video content 304 within the environment 300 is schematically represented by the arrow 340.
[0077] In addition to or alternative to presenting the movement of video content 304 during animation, the computing system modifies the presentation size of video content 304. For example, while the user is performing an upward swipe gesture (e.g., the touch gesture shown in Figure 3H) on the second electronic device 306, the computing system decreases the presentation size of video content 304 on the display 308 (e.g., until the second electronic device 306 ceases presenting video content 304 via the display 308) and optionally moves the presentation position of video content 304 upward as described above. For example, as shown in Figures 3I to 3J, the computing system optionally increases the presentation size of video content 304 in the environment 300 (e.g., simultaneously with and / or after decreasing the presentation size of video content 304 on the display 308) while moving the presentation position of video content 304 upward as described above. For example, as shown in Figures 3I to 3J, the computing system presents video content 304 via the display 320, which has a larger size in the environment 300 of Figure 3J (e.g., the size at the end of the animation) compared to the size of video content 304 in Figure 3I (e.g., the size during the animation).
[0078] In Figures 3I to 3J, the computing system transitions the audio output associated with the playback of video content 304 from a state where it is output via one or more second audio output devices of the second electronic device 306 to a state where it is output via one or more first audio output devices of the first electronic device 301. In some examples, as shown in Figure 3I, the first electronic device 301 outputs audio (represented by sound waves 312d) via one or more first audio output devices, while the second electronic device 306 simultaneously outputs audio (represented by sound waves 312e) via one or more second audio output devices. For example, transitioning the audio associated with the playback of video content 304 from a state where it is output by the second electronic device 306 to a state where it is output by the first electronic device 301 involves crossfading the audio between one or more second output devices and one or more first output devices. For example, crossfading includes fading out (e.g., reducing the volume) audio output by one or more second audio output devices of the second electronic device 306 (e.g., until the second electronic device 306 stops outputting audio), while simultaneously fading in (e.g., increasing the volume) audio output by one or more first audio output devices of the first electronic device 301 (e.g., until the audio reaches a preset volume and / or the volume at which the audio was output by the first electronic device 301 before transferring the presentation of the video content 304 to the second electronic device 306). Additionally or alternatively, in some examples, transitioning the audio output associated with the playback of the video content 304 from being output by the second electronic device 306 to being output by the first electronic device 301 includes spatially extending the audio through one or more first audio output devices.For example, a computing system increases the three-dimensional size and / or soundstage of the audio to one or more first audio output devices (for example, the increase in the three-dimensional size and / or soundstage of the audio corresponds to an increase in the size of the video content 304 within the environment 300 presented during the animation).
[0079] In addition to or alternative to transitioning from audio output via one or more second audio output devices of the second electronic device 306 to audio output via one or more first audio output devices of the first electronic device 301, the computing system optionally outputs audio feedback to indicate that video content 304 is being transferred from the second electronic device 306 to the first electronic device 301. For example, the audio feedback is independent of and / or separate from the audio associated with the playback of video content 304. For example, the audio feedback is an acoustic effect output via one or more first audio output devices and / or one or more second audio output devices whenever content (e.g., video content 304) is transferred between the first electronic device 301 and the second electronic device 306 (for example, the audio feedback optionally differs depending on whether the content is being transferred from the first electronic device 301 to the second electronic device 306 or from the second electronic device 306 to the first electronic device 301). Outputting a sound effect separate from the audio associated with the video content 304 during the transition optionally helps to mask the difference in audio output between the second electronic device 306 and the first electronic device 301 during the transition. Additionally or alternatively, transferring the video content 304 from the second electronic device 306 to the first electronic device 301 includes providing haptic feedback in the second electronic device 306.
[0080] In some examples, as shown in Figure 3J, the computing system causes the audio associated with the playback of the video content 304 to be output through one or more first audio output devices of the first electronic device 301 when the transfer of the presentation of the video content 304 from the second electronic device 306 to the first electronic device 301 is complete. For example, in Figure 3J, the audio output associated with the playback of the video content 304 is schematically represented by a sound wave representing audio 312f. In some examples, playing the audio associated with the video content 304 in Figure 3J includes playing spatial audio that sounds as if it is coming from the location of the video content 304 in Figure 3J. Optionally, the first electronic device 301 plays the audio content in a small, medium, or large soundstage, as described above.
[0081] As shown in Figure 3J, the first electronic device 301 detects the movement of the first electronic device 306 and / or the user's movement while the first electronic device 301 is playing the video content 304. For example, the user rotates to the right. In response to detecting the movement of the first electronic device 301, the first electronic device 306 transitions from presenting the video content 304 in full size, as shown in Figure 3J, to presenting the video content 304 as a picture-in-picture element, as shown in Figure 3K.
[0082] Figure 3K shows a first electronic device 301 that presents video content 304 in a picture-in-picture element. In some examples, the electronic device 301 presents the video content 304 within the picture-in-picture element in response to detecting movement as described with reference to Figure 3J. In some examples, while presenting the video content 304 within the picture-in-picture element in Figure 3K, the first electronic device 301 presents spatial audio corresponding to the audio content of the video content 304. The first electronic device 306 optionally presents spatial audio having a small soundstage that sounds as if the audio is being played from a position corresponding to the visual content of the video content 304. For example, spatial audio is shown as audio 312g in Figure 3K.
[0083] In some examples, in response to detecting the movement of the first electronic device 301 and / or the user in Figure 3J, the first electronic device 301 presents an audio transition from presenting audio 312f shown in Figure 3J to presenting audio 312g shown in Figure 3K. The audio transition optionally includes a crossfade effect and / or spatial audio that moves from the position of audio 312f to the position of audio 312g, according to the examples of these transition effects described above.
[0084] In some examples, in response to detecting the movement of the first electronic device 301 and / or the user, while displaying video content 304 within the picture-in-picture element in Figure 3K, the first electronic device 301 detects movement to the position associated with displaying the video content 304, as shown in Figure 3J. For example, while the first electronic device 301 is presenting the video content 304, as shown in Figure 3J, the first electronic device 301 detects the movement of the first electronic device 301 and / or the user to the position where the first electronic device 301 and / or the user were located. In some examples, in response to detecting this movement, the first electronic device 301 displays the video content 304, presents audio 312f, and presents an audio transition effect such as a crossfade or moving spatial audio, as shown in Figure 3J. The audio transition effect causes the first electronic device 301 to transition from presenting audio 312g to presenting audio 312f, for example, in a similar manner to the above-described method of transitioning from presenting audio 312f to presenting audio 312g. In some examples, the transition from the presentation of audio 312g to the presentation of audio 312f includes presenting audio 312f in a medium or large soundstage, or presenting audio 312f in a small soundstage that sounds as if it is being played from the position of the video content 304 in Figure 3J.
[0085] It should be understood that the presentation of spatial audio 312g associated with video content 304 presented in the picture-in-picture element shown in Figure 3K is not limited to situations in which the first electronic device 301 presents the picture-in-picture element in response to the first electronic device 301 detecting movement of the first electronic device 301 and / or the user's movement, as shown in Figure 3J. For example, the first electronic device 301 presents the picture-in-picture element in response to the first electronic device 301 detecting one or more inputs and / or receiving a display of one or more inputs detected in the second electronic device 306. For example, the first electronic device 301 presents the spatial audio transition effect described with reference to Figures 3J to 3K in response to the second electronic device 306 presenting the picture-in-picture element in response to the inputs described above with respect to Figure 3D.
[0086] Figures 4A to 4I illustrate a computing system, in some examples of the present disclosure, that modifies the display of virtual content on a first electronic device in response to one or more user inputs detected on a second electronic device. In some examples, the computing system includes a first electronic device 401 (e.g., having one or more characteristics of the electronic devices 101, 201, and / or 301 described above) and a second electronic device 406 (e.g., having one or more characteristics of the electronic devices 160, 260, and / or 306 described above). In some examples, the first electronic device 401 communicates with the second electronic device 406 (e.g., the second electronic device 406 is an auxiliary and / or companion device that communicates with the first electronic device 401).
[0087] In some examples, the first electronic device 401 includes a display 420 having one or more characteristics of the display 320 illustrated and described with reference to Figures 3A to 3K. In some examples, the first electronic device 401 includes one or more image sensors 414a to 414c having one or more characteristics of the image sensors 314a to 314c illustrated and described with reference to Figures 3A to 3K. The first electronic device 401 optionally does not include the image sensors 414a to 414c. In some examples, the second electronic device 406 includes a display 408 having one or more characteristics of the display 308 illustrated and described with reference to Figures 3A to 3K (for example, the display 408 is a touch-sensitive display).
[0088] In Figures 4A to 4I, the environment 400 is visible via the display 420. In some examples, the environment 400 is a three-dimensional environment having one or more characteristics of the environment 300 illustrated and described with reference to Figures 3A to 3K.
[0089] Figure 4A shows a first electronic device 401 that presents application content 404 within an environment 400. In some examples, the application content 404 corresponds to website content presented within a virtual window and / or virtual object within the environment 400. In some examples, the application content 404 is associated with a separate application accessible via a computing system, such as an internet browsing application. Alternatively, in some examples, the separate application is another type of application, such as a video streaming application, a social media application, a messaging application, a video and / or audio phone application, or a video game application. As shown in Figure 4A, the application content 404 is presented together with an address bar 412. The address bar 412 is optionally displayed within a virtual object and / or virtual window within the same environment 400 as the application content 404.
[0090] In Figure 4A, the first electronic device 401 presents a cursor 410 (virtual cursor) in an environment 400 superimposed on application content 404. As shown in Figure 4A, the cursor 410 is presented as a circle (e.g., a shaded circle). Alternatively, in some examples, the cursor 410 may include different shapes and / or appearances (e.g., the cursor 410 may be presented as an arrow, and / or the cursor 410 may be presented without shading and / or in a different color).
[0091] In some examples, the position of the cursor 410 within the environment 400 corresponds to the position and / or orientation of the second electronic device 406. The computing system optionally uses one or more input devices of the second electronic device 406, such as a location sensor(s) 204B, an image sensor(s) 206B, and / or orientation sensor(s) 210B, as described with reference to Figure 2B, to determine the presentation position of the cursor 410 on the first electronic device 401. For example, in response to detecting movement of the second electronic device 406 (e.g., caused by movement of the user's hand holding the second electronic device 406) using one or more input devices, the computing system optionally moves the cursor 410 within the environment 400 in accordance with the movement of the second electronic device 406 (e.g., the user holding the second electronic device 406 controls the movement of the cursor 410 within the environment 400 via the movement of the second electronic device 406). For example, the computing system enables multidimensional movement of the cursor 410 within the environment 400 (for example, the computing system moves the cursor 410 vertically in accordance with the vertical movement of the second electronic device 406, and / or horizontally in accordance with the horizontal movement of the second electronic device 406). In some examples, the position of the cursor 410 within the environment 400 is limited to an area defined by the application content 404. For example, the computing system presents the cursor 410 within a virtual window and / or virtual object within the environment 400 containing the application content 404. For example, the computing system enables two-dimensional movement of the cursor 410 (for example, the computing system presents the cursor 410 at a depth within the environment 400 corresponding to the application content 404, and enables horizontal and vertical movement of the cursor 410 within the application content 404).
[0092] The computing system optionally moves the cursor 410 within the environment 400 using the position and / or orientation of the second electronic device 406, according to a determination that one or more criteria are met. In some examples, one or more criteria include evaluation criteria that are met when movement of the second electronic device 406 is detected while the second electronic device 406 is held in a separate orientation. Holding the second electronic device 406 in a separate orientation optionally includes holding the second electronic device 406 such that a separate portion of the second electronic device 406 (e.g., the top, such as the upper edge and / or top surface) is oriented toward (e.g., pointed toward) the location of the application content 404 within the environment 400. For example, the first electronic device 401 presents the cursor 410 as if it were cast to the application content 404 from the top of the second electronic device 406 (e.g., the cursor 410 is presented along a vector extending from the top surface of the second electronic device 406 to the application content 404). In some examples, one or more criteria include evaluation criteria that are met when the second electronic device 406 is operating in a separate mode. For example, the computing system presents selectable options (e.g., on the first electronic device 401 and / or the second electronic device 406) to operate the second electronic device 406 in a separate mode for controlling the movement of the cursor 410, and upon detecting a selection of the selectable option, the computing system allows the cursor 410 to be controlled by the position and / or orientation of the second electronic device 406. While the second electronic device 406 is operating in a separate mode, the computing system optionally presents selectable options (e.g., on the first electronic device 401 and / or the second electronic device 406) to discontinue operating the second electronic device 406 in a separate mode (e.g., upon detecting a selection of the selectable option, the computing system discontinues allowing the cursor 410 to be controlled by the position and / or orientation of the second electronic device 406).
[0093] In Figure 4A, the computing system detects the movement of the second electronic device 406. For example, as shown in Figure 4A, the second electronic device 406 is held by the user's hand 440 of the computing system, and the user moves the hand 440 horizontally (e.g., to the left) as indicated by the arrow 416. The movement of the second electronic device 406 optionally satisfies one or more of the above criteria (e.g., the second electronic device 406 is held in a separate orientation and / or the second electronic device 406 operates in a separate mode).
[0094] Figure 4B shows a computing system that moves a cursor 410 within the environment 400 in response to the movement of a second electronic device 406 detected in Figure 4A. As shown in Figure 4B, the first electronic device 401 presents the cursor 410 in a different location within the environment 400 (e.g., within the application content 404) compared to that shown in Figure 4A (e.g., further to the left from the user's viewpoint of the first electronic device 401, based on the detected leftward movement of the second electronic device 406). In some examples, the first electronic device 401 maintains the display of the cursor 410 while moving the cursor 410 within the environment 400 (e.g., the first electronic device 401 presents the movement of the cursor 410 within the environment 400 while the movement of the second electronic device 406 is detected).
[0095] In some examples, while presenting application content 404 within the environment 400, the computing system transfers the application content from the first electronic device 401 to the second electronic device 406 according to the determination that a touch gesture detected by the second electronic device 406 satisfies one or more criteria (for example, having one or more characteristics of one or more criteria for transferring the presentation of video content 304 from the first electronic device 301 to the second electronic device 406, as described with reference to Figures 3A to 3K). In some examples, one or more criteria for transferring the presentation of content from the first electronic device 401 to the second electronic device 406 (for example, or optionally, from the second electronic device 406 to the first electronic device 401) are defined by the individual applications to which the content is associated. For example, a touch gesture assigned to transferring the presentation of content associated with a video streaming application (e.g., video content 304 as illustrated and described with reference to Figures 3A-3K) may differ from a touch gesture assigned to transferring the presentation of content associated with a web browsing application (e.g., application content 404). Alternatively, for example, transferring the presentation of content associated with a video streaming application may require a separate touch gesture, while transferring the presentation of content associated with a web browsing application may require a tap input corresponding to the selection of a selectable option (presented on a first electronic device 401 and / or a second electronic device 406, such as selectable option 316 as illustrated and described with reference to Figures 3B-3C).By establishing one or more criteria that require satisfaction for transferring the presentation of application content 404 from the first electronic device 401 to the second electronic device 406, the computing system ensures that the user intends to transfer the application content 404 to the second electronic device 406 before performing the transfer, which reduces errors in user interaction and saves computing resources associated with correcting unintended transfers of application content 404 (e.g., via additional user input).
[0096] Additionally or alternatively, in some examples, individual applications, such as the individual application associated with application content 404, may assign individual touch gestures (or individual types of touch gestures, such as vertical swipe gestures) to different actions. For example, a web browsing application associated with application content 404 may assign a downward swipe gesture (e.g., the touch gesture illustrated and described with reference to Figure 3A) to transfer the presentation of application content 404 from the first electronic device 401 to the second electronic device 406 when application content 404 is scrolled to the top of the webpage, and assign it to scroll application content 404 upwards when application content 404 is not scrolled to the top of the webpage (for example, a computing system transfers application content 404 from the first electronic device 401 to the second electronic device 406 in response to a downward swipe gesture detected on the second electronic device 406, based on the determination that application content 404 was scrolled to the top of the webpage before the downward swipe gesture was detected). Alternatively, a downward swipe gesture may be assigned to scrolling the application content 404 downwards, and the computing system may transfer the application content 404 from the first electronic device 401 to the second electronic device 406 if the application content 404 has scrolled to the bottom of the web page before the downward swipe gesture is detected.
[0097] Alternatively, in some examples, application content 404 is not permitted to be transferred from the first electronic device 401 to the second electronic device 406. In some examples, individual applications do not need to permit their content to be transferred from the first electronic device 401 to the second electronic device 406. For example, a video streaming application (e.g., associated with video content 304) may permit its content to be transferred between the first electronic device 401 and the second electronic device 406, and a web browsing application (e.g., associated with application content 404) may permit its content to be transferred between the first electronic device 401 and the second electronic device 406. In some examples, individual applications may only permit specific content to be transferred between the first electronic device 401 and the second electronic device 406. For example, a web browsing application associated with application content 404 does not have to allow the application content 404 to be transferred from the first electronic device 401 to the second electronic device 406, but it may allow a virtual input device for interacting with the application content 404 (e.g., a virtual keyboard such as the virtual keyboard 422 illustrated and described with reference to Figures 4E to 4I) to be transferred from the first electronic device 401 to the second electronic device 406. Optionally, a virtual input device such as the virtual keyboard 422 described below may be allowed to be transferred between the first electronic device 401 and the second electronic device 406 independently of the individual applications associated with the content presented on the first electronic device 401 and / or the second electronic device 406 (e.g., the transfer of a virtual input device is a system-defined setting, as opposed to an application-defined setting).
[0098] Figure 4C shows a computing system that scrolls application content 404 downwards in response to detecting a touch gesture (represented by touch positions 416a-416b). As shown in Figure 4C, the touch gesture corresponds to an upward swipe gesture detected on the second electronic device 406. The touch gesture shown in Figure 4C optionally fails to satisfy one or more criteria for transferring the presentation of application content 404 from the first electronic device 401 to the second electronic device 406 as described above. For example, one or more criteria include evaluation criteria that are satisfied when the computing system optionally detects a downward swipe input when the application content 404 is scrolled to the top of the web page on which it is currently presented (for example, the computing system does not transfer application content 404 from the first electronic device 401 to the second electronic device 406 in Figure 4C because the touch input corresponds to an upward swipe input as opposed to a downward swipe input). For example, one or more criteria include evaluation criteria that are met when the computing system detects a vertical swipe input of a certain length and / or duration (for example, the computing system does not transfer application content 404 from the first electronic device 401 to the second electronic device 406 in Figure 4C because an upward swipe input from touch position 416a to touch position 416b does not include a length and / or duration that satisfies the evaluation criteria). Alternatively or additionally, the computing system does not transfer application content 404 from the first electronic device 401 to the second electronic device 406 because the individual application to which application content 404 is associated (e.g., a web browsing application) does not allow the application content 404 to be transferred between the first electronic device 401 and the second electronic device 406, as described above.
[0099] Figure 4D shows that the computing system detects a touch input 418 corresponding to the selection of the address bar 412. For example, between Figure 4C and Figure 4D, the computing system moves the cursor 410 from a position in the environment 400 shown in Figure 4C to a position corresponding to the address bar 412 shown in Figure 4D (based on the movement of a second electronic device 406, for example, as illustrated and described with reference to Figures 4A-4B). For example, while the cursor 410 is presented to the position in the environment 400 corresponding to the address bar 412, the computing system detects a touch input 418 on the second electronic device 406. In some examples, the touch input 418 corresponds to a tap input, a long touch input (e.g., a touch input exceeding a threshold duration (e.g., 0.1, 0.2, 0.5, 1, 2, 5, or 10 seconds)), or a multitap input (e.g., a double-tap touch input or a triple-tap touch input).
[0100] In some embodiments, the address bar 412 corresponds to a selectable virtual element for entering text. For example, after selecting the address bar 412, the user of the computing system can use a virtual keyboard to enter text (e.g., a web address) into the address bar 412 to navigate to different websites.
[0101] Figure 4E shows that, in response to detecting the touch input 418 in Figure 4D, the computing system selects the address bar 412 and presents the virtual keyboard 422 on the second electronic device 406. As shown in Figure 4E, in response to detecting the touch input 418 (for example, in response to a request to select the address bar 412), the computing system automatically presents the virtual keyboard 422 on the second electronic device 406 (for example, without additional user input and / or subsequent user input). Alternatively, in some examples, the computing system presents the virtual keyboard 422 within the environment 400 in response to detecting the touch input 418 (for example, as described with reference to Figure 4I, the virtual keyboard 422 may be forwarded to the second electronic device 406 in response to detecting a touch input that satisfies one or more criteria for forwarding the presentation of the virtual keyboard 422 from the first electronic device 401 to the second electronic device 406).
[0102] As shown in Figure 4E, the computing system modifies one or more visual properties of the application content 404 within the environment 400 in response to the selection in the address bar 412 (for example, the modification of one or more visual properties of the application content 404 is represented in Figure 4E by different shading of the application content 404 compared to those shown in Figures 4A to 4D). For example, the computing system modifies the color, saturation, brightness, sharpness, and / or opacity of the application content 404 in response to the selection in the address bar 412. When the computing system modifies one or more visual properties of the application content 404, it does not optionally modify the visual appearance of the address bar 412 (for example, the address bar 412 is presented with higher brightness than the application content 404 (for example, so that the text entered in the address bar 412 is visible to the user of the first electronic device 401)). Alternatively, in some examples, the computing system maintains the visual appearance of the application content 404 within the environment 400 depending on the selection of the address bar 412 (for example, the computing system maintains the presentation of the application content 404 within the environment 400 without changing one or more of the visual properties of the application content 404). Alternatively, in some examples, the computing system discontinues presenting the application content 404 (and optionally the address bar 412) within the environment 400 depending on the selection of the address bar 412 (for example, to conserve computing resources by limiting the presentation of content within the environment 400 when the attention of the computing system's user is likely to be directed to the virtual keyboard 422 on the second electronic device 406). Alternatively or additionally, in some examples, the computing system transfers application content 404 from the first electronic device 401 to the second electronic device 406, depending on the selection of the address bar 412 (for example, the second electronic device 406 presents the application content 404 and / or the address bar 412 in an area of the display 408 above the virtual keyboard 422).
[0103] Figure 4F shows that the computing system detects a touch input 424 on a second electronic device 406 corresponding to the selection of a key on the virtual keyboard 422 (e.g., the "W" key). In some examples, interaction with the virtual keyboard 422 on the second electronic device 406 (e.g., via user input) controls text input to the address bar 412 in the environment 400 on the first electronic device 401. For example, the touch input 424 corresponds to a request to enter the character "W" into the address bar 412 in the environment 400. In some examples, upon detecting the touch input 424 on the second electronic device 406, the computing system causes the second electronic device 406 to output audio and / or haptic feedback. For example, as shown in Figure 4F, the second electronic device 406 outputs audio output (represented by sound waves 432) corresponding to user interface sound effects (e.g., sound effects associated with typing on the virtual keyboard 422) via one or more audio output devices of the second electronic device 406. In addition or alternatively, in some examples, the computing system causes audio feedback to be output via one or more audio output devices of the first electronic device 401 in response to detecting a key selection on the virtual keyboard 422 while the virtual keyboard 422 is presented on the first electronic device 301 via the display 420.
[0104] Figure 4G shows that the computing system, in response to detecting touch input 424 in Figure 4F, enters text into the address bar 412 in the environment 400. As shown in Figure 4G, the letter "W" is presented in the address bar 412 in the environment 400 by the first electronic device 401.
[0105] In some examples, the computing system transfers the virtual keyboard 422 from the second electronic device 406 to the first electronic device 401 based on a determination that a touch input detected on the second electronic device 406 satisfies one or more second criteria (for example, optionally different from one or more criteria for transferring the presentation of application content 404 from the first electronic device 401 to the second electronic device 406). For example, one or more second criteria include evaluation criteria that are satisfied when a touch gesture corresponding to a particular type of touch gesture (e.g., an upward swipe) is detected on the second electronic device 406. For example, one or more second criteria include evaluation criteria that are satisfied when a touch gesture is detected on the second electronic device 406 in a particular area of the display 408 (e.g., an area of the display 408 shown above the virtual keyboard 422). In some examples, one or more second criteria have one or more characteristics of the one or more criteria described above (e.g., including evaluation criteria that are met when a touch gesture includes a distinct direction, duration, and / or length). Alternatively, the computing system transfers the virtual keyboard 422 from the second electronic device 406 to the first electronic device 401 according to the determination that an input detected in the first electronic device 401 satisfies one or more second criteria (e.g., the input corresponds to an air gesture and / or a selection of selectable options presented within the environment 400). By establishing one or more requirements that must be satisfied for the transfer of the virtual keyboard 422 presentation from the second electronic device 406 to the first electronic device 401, the computing system ensures that the user intends to transfer the virtual keyboard 422 to the first electronic device 401 before performing the transfer, which reduces errors in user interaction and saves computing resources associated with correcting unintended transfers of the virtual keyboard 422 (e.g., via additional user input).
[0106] As shown in Figure 4G, the computing system detects a touch gesture (represented by touch positions 426a-426b) on the second electronic device 406. For example, the touch gesture is an upward swipe gesture detected in the area of the display 408 above the virtual keyboard 422. The touch gesture shown in Figure 4G optionally satisfies one or more second criteria for transferring the presentation of the virtual keyboard 422 from the first electronic device 406 to the first electronic device 401. For example, the touch gesture shown in Figure 4G corresponds to a request to transfer the virtual keyboard 422 from the second electronic device 406 to the first electronic device 401. Alternatively, in some examples, the second electronic device 406 presents selectable options (having one or more characteristics of selectable options 316 illustrated and described with reference to Figures 3B-3C) that can be used to transfer the virtual keyboard 422 from the second electronic device 406 to the first electronic device 401. The selectable options are optionally included in the virtual keyboard 422. For example, upon detecting a selection of an selectable option (e.g., touch input directed towards an selectable option), the computing system transfers the virtual keyboard 422 from the second electronic device 406 to the first electronic device 401 (including, for example, one or more characteristics of the transfer of video content 304 as illustrated and described with reference to Figures 3C to 3D).
[0107] Figure 4H shows a first electronic device 401 that presents a virtual keyboard 422 within the environment 400 in response to the touch input detected in Figure 4G. For example, if the computing system determines that the touch input in Figure 4G (represented by touch positions 426a to 426b) satisfies one or more second criteria for transferring the presentation of the virtual keyboard 422 from the second electronic device 406 to the first electronic device 401, the computing system transfers the virtual keyboard 422 from the second electronic device 406 to the first electronic device 401.
[0108] In some examples, while the first electronic device 401 presents a virtual keyboard 422 within the environment 400, the user of the computing system may use a second electronic device 406 to perform keyboard input. For example, the position of the cursor 410 may be controlled through the movement of the second electronic device 406 (as illustrated and described with reference to, for example, Figures 4A-4B), and individual keys on the virtual keyboard 422 may be selected in response to touch input (e.g., tap input) detected on the second electronic device 406 while the position of the cursor 410 corresponds to the individual keys (for example, the computing system may input the characters corresponding to the individual keys into the address bar 412 in response to the touch input). Additionally or alternatively, in some examples, the virtual keyboard 422 may be used as a swipe keyboard using the second electronic device 406. For example, the computing system activates the swipe keyboard mode upon determining that movement of the second electronic device 406 has been detected (e.g., satisfying one or more criteria for using the position and / or orientation of the second electronic device 406 to move the cursor 410 described above) while contact is maintained on the display 408. The computing system optionally terminates the swipe keyboard mode upon determining that contact on the display 408 has ended (e.g., and the computing system has entered text (e.g., a word) corresponding to one or more positions of the cursor 410 on the virtual keyboard 422 detected during the swipe keyboard mode into the address bar 412). Additionally or alternatively, the computing system may optionally enter swipe keyboard mode upon determining that the movement of the second electronic device 406 exceeds a threshold amount (e.g., movement speed, movement distance, and / or movement duration), and optionally exit swipe keyboard mode upon determining that the movement of the second electronic device 406 does not exceed a threshold amount (e.g., within a predetermined period (e.g., 0.1, 0.2, 0.5, 1, 2, 5, or 10 seconds)).
[0109] Figure 4I illustrates that the computing system detects touch input (represented by touch positions 428a-428b) corresponding to a request to transfer the virtual keyboard 422 from the first electronic device 401 to the second electronic device 406. In some examples, the computing system transfers the virtual keyboard 422 from the first electronic device 401 to the second electronic device 406 according to the determination that the touch input detected in Figure 4I satisfies one or more criteria. For example, one or more criteria for transferring the presentation of the virtual keyboard 422 from the first electronic device 401 to the second electronic device 406 have one or more characteristics of one or more criteria for transferring the presentation of video content 304 from the first electronic device 301 to the second electronic device 306, as described with reference to Figures 3A-3B. Optionally, a separate application (e.g., a web browsing application) to which the application content 404 is associated enables the transfer of the virtual keyboard 422 between the first electronic device 401 and the second electronic device 406. Alternatively or additionally, the computing system may enable the transfer of the virtual keyboard 422 between the first electronic device 401 and the second electronic device 406, independently of the individual application to which the application content 404 is associated (for example, transferring the presentation of the virtual keyboard 422 between the first electronic device 401 and the second electronic device 406 is a system-defined setting, as opposed to an application-defined setting).
[0110] In some examples, one or more criteria for transferring the presentation of the virtual keyboard 422 from the first electronic device 401 to the second electronic device 406 include an evaluation criterion that is met when the cursor 410 is presented outside the area of the environment 400 corresponding to the virtual keyboard 422 when a touch input (e.g., a downward swipe input) is detected. For example, from Figure 4H to Figure 4I, the computing system moves the cursor 410 from a position in the environment 400 within the virtual keyboard 422 shown in Figure 4H to a position in the environment 400 outside the virtual keyboard 422 shown in Figure 4I (based on the movement of the second electronic device 406, for example, as illustrated and described with reference to Figures 4A to 4B). For example, when a touch input on the display 408 shown in Figure 4I is detected by the computing system, the cursor 410 is presented at a position in the environment 400 outside the virtual keyboard 422.
[0111] In some examples, the computing system determines that a touch input detected on the display 408 shown in Figure 4I satisfies one or more criteria for transferring the presentation of the virtual keyboard 422 from the first electronic device 401 to the second electronic device 406. In some examples, in accordance with the determination that the touch input detected on the display 408 in Figure 4I satisfies one or more criteria, the computing system transfers the virtual keyboard 422 from the first electronic device 401 to the second electronic device 406, as illustrated and described with reference to Figure 4E.
[0112] Figures 5A to 5D illustrate a computing system, according to some examples of the present disclosure, that modifies the display of virtual content in response to one or more user inputs detected in one or more touch areas. In some examples, the computing system includes a first electronic device 501 (e.g., having one or more characteristics of the electronic devices 101, 201, 301, and / or 401 described above) and a second electronic device 506 (e.g., having one or more characteristics of the electronic devices 160, 260, 306, and / or 406 described above). In some examples, the first electronic device 501 communicates with the second electronic device 506 (e.g., the second electronic device 506 is an auxiliary and / or companion device that communicates with the first electronic device 501).
[0113] In some examples, the first electronic device 501 includes a display 520 having one or more characteristics of the displays 320 and / or 420 described above. In some examples, the first electronic device 501 includes one or more image sensors 514a to 514c having one or more characteristics of the image sensors 314a to 314c and / or 414a to 414c described above. The first electronic device 501 optionally does not include the image sensors 514a to 514c. In some examples, the second electronic device 506 includes a display 508 having one or more characteristics of the displays 308 and / or 408 described above (for example, the display 508 is a touch-sensitive display).
[0114] Figure 5A shows a first electronic device 501 that presents virtual content within an environment 500. In some examples, the environment 500 has one or more characteristics of the environments 300 and / or 400 described above. As shown in Figure 5A, the first electronic device 501 presents application content 504 and a cursor 510 within the environment 500. The application content 504 and cursor 510 optionally have one or more characteristics of the application content 404 and cursor 410 illustrated and described with reference to Figures 4A to 4I. The cursor 510 is optionally movable within the environment 500 based on the movement of the second electronic device 506 (for example, as illustrated and described with reference to the cursor 410 and the second electronic device 406 in Figures 4A to 4B).
[0115] In some examples, the computing system performs one or more actions within the environment 500 in response to detecting touch input in one or more touch areas of the second electronic device 506. For example, as shown in Figure 5A, the second electronic device 506 uses a display 508 to present a first touch area 516a and a second touch area 516b. In some examples, in response to detecting a distinct touch gesture on the first touch area 516a, the computing system performs a first action within the environment 500, and in response to detecting a distinct type of touch gesture on the second touch area 516, the computing system performs a second action within the environment 500 that is different from the first action. In addition, in some examples, the computing system performs different actions based on a distinct type of touch gesture and a distinct touch area where the distinct type of touch gesture is detected. For example, the computing system performs a first action within the environment 500 in response to the detection of a first type of touch gesture (e.g., a swipe gesture) on the first touch area 516a, and performs a second action within the environment 500 that is different from the first action in response to the detection of a second type of touch gesture (e.g., a tap gesture) on the first touch area 516a. In addition, for example, the computing system performs a third action within the environment 500 in response to the detection of a third type of touch gesture on the second touch area 516b, and performs a fourth action within the environment 500 that is different from the third action in response to the detection of a fourth type of gesture on the second touch area 516b. Examples of operations performed by the computing system include, optionally, user interface operations (e.g., scrolling, selecting selectable options, moving a cursor, or moving a window), transfer of content presentation between the first electronic device 501 and the second electronic device 506, and / or system operations (e.g., volume control, display brightness control, and / or display color control).Assigning different actions to different touch areas and / or types of touch gestures ensures that the user intends to perform the individual action before actually performing it, which reduces errors in interaction processing and saves computing resources associated with correcting errors.
[0116] In Figures 5A to 5D, a boundary is shown between a first touch area 516a and a second touch area 516b on the display 508, but the first touch area 516a and the second touch area 516b can be optionally distinguished in other ways. For example, a second electronic device 506 may present a first touch area 516a having one or more first visual characteristics (e.g., color, brightness, shading, and / or pattern) and a second touch area 516b having one or more second visual characteristics different from one or more first visual characteristics. Alternatively or additionally, in some examples, the second electronic device 506 operates in a power-saving state (for example, as described above) and does not present the first touch area 516a and / or the second touch area 516b on the display 508 (for example, the computing system performs different actions based on whether a separate touch gesture is detected on the portion of the display 508 corresponding to the first touch area 516a or the portion of the display 508 corresponding to the second touch area 516b, without displaying content on the display 508).
[0117] Figures 5A to 5D show a display 508 having two touch areas (a first touch area 516a and a second touch area 516b), but it should be understood that the display 508 may have a different number of touch areas (e.g., 1, 3, 4, 5, or 10 touch areas). For example, a computing system may perform different actions within the environment 500 based on which individual touch area of the display 508 is detected to have touch input (e.g., and optionally, based on individual types of touch gestures detected).
[0118] Figure 5B shows touch gestures detected on the first touch area 516a (represented by touch positions 512a-512b). In some examples, the touch gestures shown in Figure 5B correspond to upward swipe gestures. In some examples, vertical swipe gestures (e.g., upward or downward) performed on the first touch area 516a are assigned to scrolling the application content 504 (as defined, for example, by individual applications associated with the application content 504, by the computing system (e.g., in one or more system settings), and / or by the user of the computing system (e.g., in one or more user settings (e.g., associated with user profiles)). In response to detecting a touch gesture, as shown in Figure 5B, the computing system scrolls the application content 504 downward (e.g., compared to that shown in Figure 5A). The computing system optionally performs a different type of action in response to detecting a touch gesture on the first touch area 516a that is different from the touch gestures shown in Figure 5B. For example, upon detecting a tap gesture on the first touch area 516a, the computing system performs a user interface action (for example, within the application content 504) corresponding to the selection of a selectable option (for example, according to the position of the cursor 510 corresponding to the selectable option).
[0119] Figure 5C shows touch gestures detected on the second touch area 516b (represented by touch positions 512a to 512b). In some examples, the touch gesture shown in Figure 5B corresponds to a downward swipe gesture. In some examples, a downward swipe gesture performed on the second touch area 516b is assigned to transfer the presentation of application content 504 from the first electronic device 501 to the second electronic device 506.
[0120] In some examples, the computing system transfers application content 504 from the first electronic device 501 to the second electronic device 506 according to the determination that one or more criteria are met (e.g., possessing one or more of the characteristics of the one or more criteria described above). In some examples, one or more criteria for transferring the presentation of application content 504 from the first electronic device 501 to the second electronic device 506 include evaluation criteria that are met when a particular type of touch gesture (e.g., a downward swipe as shown in Figure 5C) is detected on the second touch area 516b of the display 508. The touch input shown in Figure 5C optionally satisfies one or more criteria for transferring the presentation of application content 504 from the first electronic device 501 to the second electronic device 506.
[0121] Figure 5D shows that in response to the touch input shown in Figure 5C (represented by touch positions 512a to 512b), the computing system transfers the presentation of application content 504 from the first electronic device 501 to the second electronic device 506. As shown in Figure 5D, in response to the detection of the touch input in Figure 5C (for example, and in accordance with the determination that the touch input satisfies one or more criteria for transferring the presentation of application content 504 from the first electronic device 501 to the second electronic device 506), the computing system uses the display 508 to present the application content 504 on the second electronic device 506.
[0122] As shown in Figure 5D, the second electronic device 506 presents selectable options 522 using a display 508. The second electronic device 506 optionally includes the selectable options 522 within the application content 504 (for example, the computing system adds the selectable options 522 to the application content 504 according to the determination that the application content 504 is being transferred from the first electronic device 501 to the second electronic device 506). In some examples, the selectable options 522 are selectable for transferring the application content 504 from the second electronic device 506 to the first electronic device 501. For example, the selectable options 522 have one or more characteristics of the selectable options 316 illustrated and described with reference to Figures 3B-3C. In some examples, upon detecting the selection of a selectable option 316 (for example, a touch input having one or more characteristics of the touch input 322 illustrated and described with reference to Figure 3C), the computing system transfers the application content 504 from the second electronic device 506 to the first electronic device 501 (for example, as illustrated and described with reference to the video content 304 in Figure 3D). Alternatively or additionally, in some examples, upon detecting one or more touch gestures that satisfy a second criterion for transferring a presentation of individual content from the second electronic device 506 to the first electronic device 501 (for example, touch gestures including individual types of gestures (for example, an upward swipe such as the touch gesture illustrated and described with reference to Figure 4G)), the computing system transfers the application content 504 from the second electronic device 506 to the first electronic device 501.
[0123] Figures 6A to 6D illustrate computing systems for displaying video content in a three-dimensional environment, according to some examples of the present disclosure. In some examples, the computing system includes a first electronic device 601 (e.g., having one or more characteristics of the electronic devices 101, 201, 301, 401, and / or 501 described above) and a second electronic device 606 (e.g., having one or more characteristics of the electronic devices 160, 260, 306, 406, and / or 506 described above). In some examples, the first electronic device 601 communicates with the second electronic device 606 (e.g., the second electronic device 606 is an auxiliary and / or companion device that communicates with the first electronic device 601).
[0124] In some examples, the first electronic device 601 includes a display 620 having one or more characteristics of the displays 320, 420, and / or 520 described above. In some examples, the first electronic device 601 includes one or more image sensors 614a to 614c having one or more characteristics of the image sensors 314a to 314c, 414a to 414c, and / or 514a to 514c described above. The first electronic device 601 optionally does not include the image sensors 614a to 614c. In some examples, the second electronic device 606 includes a display 608 having one or more characteristics of the displays 308, 408, and / or 508 described above (for example, display 608 is a touch-sensitive display).
[0125] In Figures 6A to 6D, the environment 600 is visible via the display 620. In some examples, the environment 600 has one or more characteristics of the environments 300, 400, and / or 500 described above. As shown in Figures 6A to 6D, the environment 600 includes real-world objects 602a to 602e. For example, the real-world objects 602a to 602e are visible via the display 620 through video pass-through or optical see-through.
[0126] Figure 6A shows a second electronic device 606 that presents video content 604 using a display 608. The video content 604 optionally has one or more characteristics of the video content 304 illustrated and described with reference to Figures 3A to 3K. In some examples, before presenting the video content 604 on the second electronic device 606, the computing system has transferred the video content 604 from the first electronic device 601 to the second electronic device 606 (according to a determination that one or more criteria for transferring the presentation of video content from the first electronic device 601 to the second electronic device 606 are met, for example, one or more criteria described with reference to Figures 3A to 3B).
[0127] In some examples, video content 604 corresponds to an educational video (for example, one for cooking using one or more of the real-world objects 602a-602e). For example, while a user of a computing system is performing a physical (e.g., real-world) task that requires the use of one or more of the user's hands, it may be difficult for the user to control the playback of video content 604 on the second electronic device 606. Therefore, the user may want to control the playback of video content 604 via the first electronic device 601 (for example, so that the playback of video content 604 can be controlled without the use of the user's hands). Furthermore, viewing video content 604 on the second electronic device 606 may be inconvenient for the user while performing a physical task (for example, because it requires the user to physically position the second electronic device 606 within the user's field of view (e.g., on a physical stand and / or tilted relative to a physical object), and thus occupy the user's physical cooking space). Therefore, the user may want to transfer the presentation of video content 604 from the second electronic device 606 to the first electronic device 601 in order to avoid placing the second electronic device 606 within the user's field of view, which improves user interaction with the computing system.
[0128] Figure 6B shows a computing system for detecting touch input (represented by touch positions 610a-610b) on a second electronic device 606. In some examples, the touch input shown in Figure 6B satisfies one or more second criteria (e.g., having one or more characteristics of one or more second criteria described with reference to Figure 4G) for transferring the presentation of video content 604 from the second electronic device 606 to the first electronic device 601. Alternatively, in some examples, the second electronic device 606 presents selectable options (e.g., having one or more characteristics of selectable options 316 illustrated and described with reference to Figures 3B-3C) for transferring the video content 604 from the second electronic device 606 to the first electronic device 601.
[0129] Figure 6C shows that, in response to touch input detected in Figure 6B (represented by touch positions 610a-610b), the computing system transfers the presentation of video content 604 from the second electronic device 606 to the first electronic device 601. In some examples, transferring the presentation of video content 604 from the second electronic device 306 to the first electronic device 301 has one or more characteristics of transferring the presentation of video content 304 from the second electronic device 306 to the first electronic device 301 as illustrated and described with reference to Figure 3D. As shown in Figure 6C, the first electronic device 601 presents the video content 604 within the environment 600. In some examples, as shown in Figure 6C, the video content 604 is presented in a picture-in-picture presentation (as described, for example, with reference to Figure 3E). For example, before the computing system presents the video content 604 on the second electronic device 606, the first electronic device 601 presents the video content 604 in the environment 600 in a picture-in-picture presentation as shown in Figure 6C (for example, transferring the presentation of video content 604 from the second electronic device 606 to the first electronic device 601 includes presenting the video content 604 in the environment 600 at the same location where the first electronic device 601 presented the video content 604 before transferring the presentation of video content 604 to the second electronic device 606). Alternatively or additionally, in some examples, the computing system presents the video content 604 in a picture-in-picture presentation based on one or more settings associated with presenting the video content 604 in the environment 600 (for example, by the application to which the video content 604 is associated, by the user of the computing system (for example, in a user profile), and / or defined by the computing system).For example, a user-defined setting (e.g., associated with an application and / or computing system) may include a status that, by default, presents video content such as video content 604 in a picture-in-picture presentation within the environment 600 (e.g., so that the video content does not excessively obstruct the user's view (e.g., while performing a physical task)). Alternatively or additionally, in some examples, the computing system presents video content 604 in a picture-in-picture presentation upon determination that one or more touch inputs satisfying second criteria for modifying the presentation of video content 604 have been detected on a second electronic device 606 (e.g., as illustrated and described with reference to video content 304 in Figures 3D to 3E).
[0130] In some examples, as shown in Figure 6C, the first electronic device 601 detects the attention (e.g., gaze 612) of a user of the computing system via one or more input devices (e.g., one or more eye-tracking sensors 212 as illustrated and described with reference to Figure 2A). For example, the first electronic device 601 detects a gaze 612 directed to a location in the environment 600 that does not correspond to video content 604 (e.g., the user of the computing system is currently looking at a location in the environment 600 where a physical task (e.g., stirring materials in a real-world object 602e) is being performed).
[0131] In some examples, upon determination that the attention of a user of the computing system (e.g., a user wearing the first electronic device 601) corresponds to the location of video content 604 in the environment 600, the first electronic device 601 uses the display 620 to present one or more playback controls in the environment 600 for controlling the playback of video content 604 (as illustrated and described with reference to, for example, Figure 6D). In some examples, upon determination that the attention of a user of the computing system corresponds to a location other than the location of video content 604, the first electronic device 601 refrains from presenting one or more playback controls in the environment 600 for controlling the playback of video content 604 (as shown to, for example, Figure 6C). Presenting playback controls within the environment 600 in response to detecting the attention of the computing system user directed towards the location of the video content 604 limits the amount of user input required to control the playback of the video content 604 (for example, by not requiring the user to perform input on a second electronic device 606), which saves computing resources and battery life of the computing system and improves user device interaction (for example, by not requiring the user to perform manual input while performing a physical task that requires the use of their hands).
[0132] Figure 6D shows a first electronic device 601 that, in response to detecting a gaze 612 directed to a location corresponding to video content 604, uses a display 620 to present playback controls 616a-616d within the environment 600. As shown in Figure 6D, the user of the computing system moves their gaze 612 from a location within the environment 600 that does not correspond to video content 604 (shown in Figure 6C) to a location within the environment 600 that does correspond to video content 604. In response to detecting the user's attention (e.g., gaze 612) directed to a location corresponding to video content 604, the first electronic device 601 optionally presents one or more playback controls outside (e.g., adjacent to and / or adjacent to) the video content 604. For example, as shown in Figure 6D, the first electronic device 601 presents playback controls 616a and 616b adjacent to the video content 604 (for example, on both sides of the video content 604) (for example, selectable to fast forward and / or rewind (e.g., scrub) the video content 604 (for example, optionally for a predetermined time (e.g., 1, 2, 5, 10, 15, 30, or 60 seconds)) (from the current viewpoint of the user of the computing system). Additionally or alternatively, in response to detecting the user's attention (e.g., gaze 612) directed to a location corresponding to the video content 604, the first electronic device 601 optionally presents one or more playback controls within the video content 604. For example, as shown in Figure 6D, the first electronic device 601 presents a pause affordance 616c and a playback bar 616d within the video content 604. In some embodiments, while presenting playback controls 616a to 616d, the first electronic device 601 stops presenting playback controls 616a to 616d within the environment 600 in response to detecting the attention (e.g., gaze) of a user of the computing system directed to a location not corresponding to the video content 604.
[0133] In some examples, one or more of the playback controls 616a to 616d are selectable via user input that satisfies one or more criteria. For example, one or more criteria include an evaluation criterion that is satisfied when attention (e.g., gaze 612) is directed to the location of the individual playback control for at least a threshold time amount (e.g., 0.1, 0.2, 0.5, 1, 2, 5, or 10 seconds). Additionally or alternatively, for example, one or more criteria include an evaluation criterion that is satisfied when an individual air gesture (e.g., air pinch or air tap) is detected (e.g., an individual air gesture is detected via one or more hand tracking sensors 202 and / or image sensors 206A as described above with reference to Figure 2A). Additionally or alternatively, for example, one or more criteria include an evaluation criterion that is satisfied when an individual type of touch gesture (e.g., tap input, multitap input, or swipe input) is detected on the display 608. In some examples, upon detecting an input that satisfies one or more criteria for selecting an individual playback control, the first electronic device 601 (e.g., and / or a computing system) performs an action corresponding to the individual playback control (for example, upon determining that gaze 612 has been directed to pause affordance 616c for a threshold amount of time, the computing system pauses playback of video content 604 in environment 600).
[0134] Figures 7A–7C illustrate a computing system that displays a notification in a three-dimensional environment, according to some examples of the present disclosure. In some examples, the computing system includes a first electronic device 701 (e.g., having the characteristics of one or more electronic devices 101, 201, 301, 401, 501, and / or 601) and a second electronic device 706 (shown in Figure 7C) (e.g., having the characteristics of one or more electronic devices 160, 260, 306, 406, 506, and / or 606 as described above). In some examples, the first electronic device 701 communicates with the second electronic device 706 (e.g., the second electronic device 706 is an auxiliary and / or companion device that communicates with the first electronic device 701).
[0135] In some examples, the first electronic device 701 includes a display 720 having one or more characteristics of displays 320, 420, 520, and / or 620. In some examples, the first electronic device 701 includes image sensors 714a to 714c having one or more characteristics of the image sensors 314a to 314c, 414a to 414c, 514a to 514c, and / or 614a to 614c described above. The first electronic device 701 optionally does not include image sensors 714a to 714c. In some examples, the second electronic device 706 includes a display 708 having one or more characteristics of displays 308, 408, 508, and / or 608 described above (for example, display 708 is a touch-sensitive display).
[0136] In Figures 7A to 7C, the environment 700 is visible through the display 720. In some examples, the environment 700 has one or more characteristics of the environments 300, 400, 500, and / or 600 described above. As shown in Figures 7A to 7C, the environment 700 includes a representation of a virtual environment 740. For example, the representation of the virtual environment 740 includes a virtual representation of a scene (e.g., an outdoor environment and / or a geographical landmark). As shown in Figures 7A to 7C, the representation of the virtual environment 740 includes a virtual representation of a body of water (e.g., a lake), mountains, and the sky. The representation of the virtual environment 740 is optionally immersive (e.g., so that at least a portion of the user's physical environment on the first electronic device 701 is not visible through the display 720 (e.g., via video passthrough or optical seethrough)).
[0137] Figure 7A shows a first electronic device 701 that presents a fully immersive representation of the virtual environment 740. For example, as shown in Figure 7A, a real-world table 702 (e.g., a physical object in the physical environment) is not visible to the user within the display 720.
[0138] While immersive virtual content, such as a representation of the virtual environment 740, is being presented, the presentation of additional virtual content (e.g., virtual notifications) within the environment 700 simultaneously with the immersive virtual content (e.g., overlaid on top of the immersive virtual content) can be unpleasant and / or confusing for the user. Therefore, in some examples, the computing system modifies the presentation of the representation of the virtual environment 740 when presenting additional virtual content simultaneously within the environment 700 (e.g., as illustrated and described with reference to Figure 7B). The computing system optionally presents one or more virtual notifications while presenting the representation of the virtual environment 740 (e.g., while immersive virtual content is being presented), based on the determination that individual notification sources (e.g., the computing system, and / or individual applications accessible through the computing system) are permitted to present virtual notifications within the environment 700. In some examples, the user of the computing system restricts the presentation of virtual notifications in the environment 700 (e.g., through one or more user settings (e.g., associated with a user profile)). For example, a user of a computing system may allow virtual notifications to be presented only from a specific application (e.g., a messaging application) while immersive virtual content is being presented. Or, a user of a computing system may allow only certain types of notifications (e.g., messages such as text messages or social networking messages) to be presented while immersive virtual content is being presented.
[0139] Figure 7B shows a first electronic device 701 that presents a virtual notification 704 within the environment 700. For example, the virtual notification 704 is associated with a separate application that is authorized to present notifications within the environment 700 (for example, as described above). As shown in Figure 7B, the first electronic device 701 modifies the appearance of a portion 742a of the environment 700. In some examples, the first electronic device 701 applies visual effects to the portion 742a of the environment 700. For example, as shown in Figure 7B, the visual effects include increasing the transparency of the portion 742a of the environment 700 (for example, so that a part of the physical environment is visible through the representation of the virtual environment 740). In examples where the first electronic device 701 includes one or more tint layers that are activated when displaying virtual content, the visual effects may further include deactivating or reducing the tint level in the portion 742a. Alternatively or additionally, in some examples, visual effects include changing the color, saturation, sharpness, and / or clarity of virtual content presented within portion 742a of environment 700. In some examples, visual effects are presented gradually from the representation of virtual environment 740 to portion 742a (for example, the magnitude of the visual effect gradually increases from the area of environment 700 corresponding to the representation of virtual environment 740 to the area of environment 700 corresponding to virtual notification 704). Presenting visual effects within environment 700 (e.g., automatically) when virtual notification 704 is presented simultaneously with the representation of virtual environment 740 prevents user discomfort, confusion, and / or motion sickness (e.g., due to overlaying virtual content on other virtual content), which improves the interaction processing of the user device.
[0140] In some examples, portion 742a corresponds to a predetermined region of the environment 700 where the first electronic device 701 presents virtual notifications when simultaneously presenting immersive virtual content (defined, for example, by one or more system settings and / or one or more user settings). In some examples, portion 742a corresponds to a region of the environment 700 within a threshold distance of the first electronic device 701 (e.g., 0.01, 0.02, 0.05, 0.1, 0.2, 0.5, or 1 meter) (e.g., the threshold distance is measured with respect to a depth dimension from the first electronic device 701). In some examples, the visual effect is presented at a predetermined height (e.g., with respect to the user's current viewpoint on the first electronic device 701). For example, as shown in Figure 7B, portion 742a corresponds to the lower region of the environment 700 (e.g., from the user's current viewpoint on the first electronic device 701). Optionally, the visual effect occupies a larger portion of the user's field of view of the first electronic device 701 when the user is looking downwards (for example, because a portion 742a of the environment 700 occupies a larger portion of the user's field of view). Figure 7B shows a portion 742a with a curved boundary (e.g., a spherical boundary), but the visual effect may be displayed with a different geometric boundary (e.g., a rectangular, planar, or other boundary that divides the immersive virtual content (e.g., a representation of the virtual environment 740) from the portion of the environment 700 to which the visual effect is applied (e.g., portion 742a)). By presenting the visual effect and virtual notification in a predetermined area of the environment 700 when simultaneously presenting the immersive virtual content, the presentation location of the visual effect and virtual notification is made predictable to the user, thereby improving user comfort and preventing errors in the interaction process.
[0141] In some examples, the computing system transfers a virtual notification 704 from the first electronic device 701 to the second electronic device 706 according to the determination that one or more criteria are met (for example, having one or more characteristics of one or more criteria for transferring the presentation of video content 304 from the first electronic device 301 to the second electronic device 306, as described with reference to Figures 3A to 3K). In some examples, one or more criteria include evaluation criteria that are met when at least a portion of the second electronic device 706 is within the field of view of the first electronic device 701. For example, the computing system uses image sensors 714a to 714c to determine that at least a portion of the second electronic device 706 is within the field of view of the first electronic device 701 (for example, the first electronic device 701 detects the second electronic device 706 using image sensors 714a to 714c). Additionally or alternatively, for example, the computing system uses one or more image sensors 206B, illustrated and described with reference to Figure 2B, to determine that at least a portion of the second electronic device 706 is within the field of view of the first electronic device 701 (for example, the first electronic device 701 does not include image sensors 714a-714c). Additionally or alternatively, for example, the computing system uses orientation sensors (for example, one or more orientation sensors 210A and 210B) to determine that at least a portion of the second electronic device 706 is within the field of view of the first electronic device 701.
[0142] Figure 7C illustrates that, in accordance with a determination (e.g., by the computing system) that the second electronic device 706 is within the field of view of the first electronic device 701, the computing system transfers the presentation of the virtual notification 704 from the first electronic device 701 to the second electronic device 706. As shown in Figure 7C, the second electronic device 706 is visible within the environment 700 via the display 720 (e.g., the user holds the second electronic device 706 in their hand 710 within the field of view of the first electronic device 701), and the virtual notification 704 is presented on the display 708. Transferring the presentation of the virtual notification 704 to the second electronic device 706 when the second electronic device 706 is within the field of view of the first electronic device 701 saves computing resources by avoiding the presentation of the virtual notification 704 on the first electronic device 701 when the user of the computing system intends to interact with the virtual notification 704 on the second electronic device 706.
[0143] In some examples, transferring the presentation of a virtual notification 704 from a first electronic device 701 to a second electronic device 706 involves presenting a portion 742b of the environment 700 surrounding the second electronic device 706 using a visual effect. For example, the visual effect has one or more characteristics of the visual effect shown and described with reference to Figure 7C. In some examples, the computing system changes the portion of the environment 700 in which the visual effect is presented as the position of the second electronic device 706 changes within the field of view of the first electronic device 701. For example, the computing system maintains the presentation of the visual effect within a fixed area relative to the second electronic device 706 (e.g., within a threshold distance of the second electronic device 706, such as 0.01, 0.02, 0.05, 0.1, 0.2, 0.5, or 1 meter). The visual effect presented in Figure 7C is optionally presented in a different area of the environment 700 than the visual effect presented in Figure 7B. For example, the first electronic device 701 presents the visual effect of Figure 7B in a predetermined area of the environment 700 (e.g., section 742a) to present a virtual notification, while the first electronic device 701 presents the visual effect of Figure 7C in an area of the environment 700 corresponding to the location of the second electronic device 706 (e.g., section 742b) (for example, when the second electronic device 706 is within the field of view of the first electronic device 701, the computing system dynamically (e.g., automatically) updates the area of the environment 700 where the visual effect is presented to correspond to the location of the second electronic device 706).
[0144] Figures 8A to 8G illustrate a computing system, according to some examples of the present disclosure, that presents content on a first electronic device and user interface elements associated with the content on a second electronic device. In some examples, the computing system includes a first electronic device 801 (e.g., having one or more characteristics of electronic devices 101, 201, 301, 401, 501, 601, and / or 701) and a second electronic device 806 (e.g., having one or more characteristics of the aforementioned electronic devices 160, 260, 306, 406, 605, 606, and / or 706). In some examples, the first electronic device 801 communicates with the second electronic device 806 (e.g., the second electronic device 806 is an auxiliary and / or companion device that communicates with the first electronic device 801). In some examples, as shown in Figures 8A to 8G, the second electronic device 806 is a mobile device held by the user's hand 803 of the computing system (for example, the user holds the second electronic device 806 while wearing the first electronic device 801).
[0145] In some examples, the first electronic device 801 includes a display 820 having one or more characteristics of displays 320, 420, 520, 620, and / or 720. In some examples, the first electronic device 801 includes image sensors 814a to 814c having one or more characteristics of the image sensors 314a to 314c, 414a to 414c, 514a to 514c, 614a to 614c, and / or 714a to 714c described above. The first electronic device 801 optionally does not include image sensors 814a to 814c. In some examples, the second electronic device 806 includes a display 808 having one or more characteristics of the displays 308, 408, 508, 608, and / or 708 described above (for example, display 808 is a touch-sensitive display). In Figures 8A to 8G, the environment 800 is visible through the display 820. In some examples, environment 800 has one or more characteristics of the environments 300, 400, 500, 600, and / or 700 described above.
[0146] Figure 8A shows a computing system that presents video content 804 on a first electronic device 801. In some examples, the video content 804 has one or more characteristics of the video content 304 illustrated and described with reference to Figures 3A to 3K. For example, the computing system transfers the video content 804 between the first electronic device 801 and the second electronic device 806 in response to detecting a touch gesture on a second electronic device 806 that satisfies one or more criteria described with reference to Figures 3A to 3K.
[0147] Figures 8A to 8F include a playback status indicator 832. In some examples, the playback status indicator 832 provides the current playback status of video content 804 (for example, shown in Figure 8A) within the environment 800. For example, if the text indicator 832 is in the "Playing" status, the video content 804 is currently playing within the environment 800 (for example, the audio associated with the playback of video content 804 is output through one or more audio output devices of the first electronic device 801). For example, if the text indicator is in the "Paused" status, the video content 804 is not currently playing within the environment 800 (for example, the audio associated with the playback of video content 804 is not output through one or more audio output devices of the first electronic device 801).
[0148] In Figure 8A, the video content 804 is being played within the environment 800 (for example, as indicated by the playback status indicator 832). For example, as shown in Figure 8A, the computing system causes the first electronic device 801 to output audio through one or more audio output devices (e.g., one or more speakers 216A) (the audio output is schematically represented by sound waves 812). For example, the audio output is associated with the playback of the video content 804 within the environment 800. The computing system optionally presents the video content 804 within the environment 800 in a body-locked orientation (for example, including one or more characteristics of displaying a three-dimensional object in a body-locked orientation, as described above with reference to Figure 1).
[0149] In some examples, in response to detecting user interaction with a second electronic device 806, the computing system pauses playback of video content 804 within the environment 800 (e.g., automatically and / or without user input). For example, determining that a user of the computing system is interacting with a second electronic device 806 includes detecting the attention (e.g., gaze) of the computing system user directed towards the second electronic device 806 (e.g., the attention of the computing system user is detected via one or more input devices of the second electronic device 806, such as image sensors 206B). For example, determining that a user of the computing system is interacting with a second electronic device 806 includes detecting touch input on the second electronic device 806 (e.g., on a display 808, which is optionally a touch-sensitive display). For example, determining that a user of the computing system is interacting with a second electronic device 806 includes detecting the use of a specific application accessible via the second electronic device 806 (e.g., determining that the user is using a messaging app or that the user has received and / or answered a phone call). In addition or alternatively, in some examples, the computing system pauses playback of video content 804 in environment 800 (e.g., automatically and / or without user input) in response to detecting a change in the user's viewpoint in the computing system that exceeds a threshold rotation amount (e.g., 15, 20, 25, 30, 45, 70, or 90 degrees). For example, the computing system pauses playback of video content 804 upon determining that the change in the user's viewpoint exceeds a threshold rotation amount and that the user remained in the viewpoint exceeding the threshold rotation amount for a threshold time amount (e.g., 0.1, 0.2, 0.5, 1, 2, 5, or 10 seconds).
[0150] In response to detecting user interaction with the second electronic device 806, the computing system, in addition to or alternative to pausing playback of the video content 804 within the environment 800, causes the user interface elements associated with the video content 804 to be displayed on the second electronic device 806 via the display 808 (for example, the user interface element 810 as illustrated and described with reference to Figure 8B). For example, in response to detecting user interaction with the second electronic device 806, the computing system presents the user interface elements associated with the video content 804 on the second electronic device 806 without pausing playback of the video content 804 within the environment 800.
[0151] From Figure 8A to Figure 8B, a user of the computing system (for example, wearing the first electronic device 801 and holding the second electronic device 806 in hand 803) changes their viewpoint relative to the environment 800. For example, the user looks downwards towards the second electronic device 806 (for example, by the user rotating their head and the first electronic device 801) away from the position corresponding to the video content 804 (for example, because the position corresponding to the video content 804 is no longer within the user's field of view due to the change in the user's viewpoint, the first electronic device 801 ceases to present the video content 804 via the display 820). For example, as shown in Figure 8B, the second electronic device 806 is visible to the user via the display 820 (for example, via video passthrough or optical seethrough).
[0152] In some examples, as shown in Figure 8B, the computing system detects that a user of the computing system is interacting with the second electronic device 806 via one or more input devices of the second electronic device 806 (e.g., one or more image sensors 206B) (e.g., the user's attention is optionally directed to the display 808 for a threshold time amount such as 0.1, 0.2, 0.5, 1, 2, 5, or 10 seconds). In some examples, as shown in Figure 8B, in response to detecting user interaction with the second electronic device 806, the computing system pauses playback of the video content 804 within the environment 800 (e.g., automatically) (as indicated by the playback status indicator 832). For example, as shown in Figure 8B, the computing system causes the first electronic device 801 to stop outputting the audio associated with the video content 804.
[0153] As shown in Figure 8B, in response to detecting that a user of the computing system is interacting with the second electronic device 806, the computing system causes the user interface element 810 to be presented on the second electronic device 806. For example, as shown in Figure 8B, the second electronic device 806 presents the user interface element 810 superimposed on the home user interface 830 (e.g., a user interface containing one or more selectable icons for accessing one or more individual applications on the second electronic device 806). The user interface element 810 is optionally a banner displayed at the top of the display 808 to track background content (e.g., video content 804, which is not actively interacting with or playing in the environment 800). Although the user interface element 810 is shown as a banner in Figure 8B, it should be understood that the second electronic device 806 may present the user interface element 810 in different display positions on the display 808 (e.g., the side of the display 808 or the bottom of the display 808). By presenting the user interface element 810 on the second electronic device 806 when the playback of the video content 804 is paused in environment 800, the user can track the video content 804 even though it is in the background, thereby reducing errors in the interaction process.
[0154] In some examples, as shown in Figure 8B, the user interface element 810 includes one or more visual indicators. For example, the user interface element 810 includes a first visual indication 816, which is optionally a logo indicating that the user interface element 810 is associated with content (e.g., video content 804) presented within the environment 800 via a first electronic device 801. For example, the user interface element 810 also includes a second visual indication 816, which is optionally a representation associated with the video content 804 (e.g., an album cover, or a thumbnail for a television series or movie).
[0155] In some examples, the user interface element 810 includes one or more selectable options for controlling the playback of video content 804 within the environment 800. For example, as shown in Figure 8B, the user interface element 810 includes a selectable option 818a that can be selected to change the current playback state of video content 804 within the environment 800 (e.g., to resume playback of video content 804 within the environment 800). In some examples, after pausing the playback of video content 804 (e.g., automatically, as described with reference to Figure 8B), the computing system maintains the paused state of video content 804 until the computing system detects a selection of the selectable option 818a (e.g., a touch input and / or tap input directed to the selectable option 818a on the display 808). Furthermore, as shown in Figure 8B, for example, the user interface element 810 includes a selectable playback position bar 822 for changing the current playback position of video content 804 (e.g., scrubbing video content 804).
[0156] From Figure 8B to Figure 8C, the user of the computing system changes their viewpoint relative to the environment 800. For example, the user looks upward (e.g., by the user rotating their head and the first electronic device 801) toward a position corresponding to the video content 804 in the environment 800, away from the second electronic device 806 and / or hand 803 (e.g., the first electronic device 801 presents the video content 804 via the display 820 so that the change in the user's viewpoint brings the position corresponding to the video content 804 into the user's field of view). In some examples, in response to detecting a change in the user's viewpoint, the computing system maintains the current playback state of the video content 804 in the environment 800. For example, as shown in Figure 8C, the playback state of the video content 804 remains paused (e.g., as indicated by the playback state indicator 832). For example, the computing system maintains the paused playback state of the video content 804 because it has not detected the selection of any selectable option 818a. Alternatively, in some examples, in response to detecting a change in the user's viewpoint, as shown in Figures 8B to 8C, the computing system resumes playback of the video content 804 within the environment 800 (for example, automatically and / or without user input).
[0157] Figure 8D illustrates that the computing system detects the selection of selectable option 818a via one or more input devices of the second electronic device 806. For example, the computing system detects touch input (performed, for example, by the thumb of hand 803) directed to a position on the display 808 corresponding to selectable option 818a. In some examples, upon detecting the selection of selectable option 818a in Figure 8D, the computing system resumes playback of the video content 804 in the environment 800 of Figure 8E (as indicated by the playback state indication 832). For example, as shown in Figure 8E, the computing system causes the audio (circularly represented by sound waves 812) associated with the playback of the video content 804 in the environment 800 to be output via one or more audio output devices of the first electronic device 801. Furthermore, for example, as shown in Figure 8E, the second electronic device 806 updates the presentation of the user interface element 810 to replace selectable option 818a with selectable option 818b. For example, selectable option 818b is available to pause playback of video content 804 within environment 800.
[0158] In Figure 8E, the second electronic device 806 maintains the presentation of the user interface element 810 on the display 808. Alternatively, in some examples, the computing system ceases to present the user interface element 810 on the display 808 in response to detecting the selection of the selectable option 818a in Figure 8D, and / or in response to detecting that the user is no longer interacting with the second electronic device 806 (e.g., attention has not been directed to the second electronic device 806 for more than a threshold time amount such as 0.1, 0.2, 0.5, 1, 2, 5, or 10 seconds).
[0159] In some examples, from Figure 8E to Figure 8F, the computing system detects user interaction with a second electronic device 806 (as illustrated and described with reference to, for example, Figures 8A to 8B). In some examples, in response to detecting user interaction with the second electronic device 806, the computing system pauses playback of the video content 804 within the environment 800 (as shown in Figure 8F by the playback state indication 832) and presents a user interface element 310 on the second electronic device 806 via the display 808.
[0160] Figure 8F illustrates that a computing system detects a touch gesture on a second electronic device 806 while playback of video content 804 is paused in environment 800. For example, the touch gesture is performed by the thumb of hand 803. In some examples, the touch gesture is an upward swipe gesture (performed, for example, over the top of display 808 and / or the location of user interface element 810). In some examples, the touch gesture corresponds to a request to stop presenting user interface element 810 (for example, closing user interface element 810 on second electronic device 806). For example, while the touch gesture is detected, the second electronic device 806 moves the presentation position of user interface element 810 upward and simultaneously reduces the presentation size of user interface element 810.
[0161] In some examples, discontinuing the presentation of the user interface element 810 on the second electronic device 806 causes the computing system to discontinue the presentation of the video content 804 in the environment 800. For example, as shown in Figure 8G, in response to detecting a touch gesture in Figure 8F, the computing system causes the first electronic device 801 to discontinue the presentation of the video content 804 in the environment 800. Alternatively, in some examples, in response to detecting a touch gesture in Figure 8F, the computing system discontinues presenting the user interface element 810 on the second electronic device 806 while maintaining the presentation of the video content 804 in the environment 800 (e.g., in a paused playback state).
[0162] Figure 9 shows a flowchart illustrating an exemplary process for transferring content presentation from a first electronic device to a second electronic device, according to several examples of the present disclosure. In some examples, process 900 begins with a computing system comprising a first electronic device and a second electronic device, the first electronic device comprising one or more first displays, and the second electronic device comprising one or more second displays. In some examples, the first electronic device is optionally a head-mounted display similar to or corresponding to electronic device 201 in Figure 2A, and the second electronic device is optionally a mobile electronic device similar to or corresponding to electronic device 260 in Figure 2B.
[0163] As shown in Figure 9, in some examples, in 902, while the first content is presented in a three-dimensional environment via one or more first displays, the computing system detects the first input via one or more input devices of the second electronic device. For example, as shown in Figure 3A, the computing system detects touch input (represented by touch positions 310a-310b) on the display 308 of the second electronic device 306. For example, as shown in Figure 4I, the computing system detects touch input (represented by touch positions 428a-428b) on the display 408 of the second electronic device 406 (for example, as the current position of the cursor 410 outside the virtual keyboard 422). For example, as shown in Figure 5C, the computing system detects touch input (represented by touch positions 518a-518b) on the second touch area 516b of the display 508 of the second electronic device 506. For example, as shown in Figure 7C, the computing system detects that the second electronic device 706 is at least partially within the field of view of the first electronic device 701 (for example, using one or more image sensors 206B illustrated and described with reference to Figure 2B).
[0164] In some examples, in 904, according to a determination that the first input satisfies one or more first criteria, the computing system causes the presentation of the first content to be transferred from the first electronic device to the second electronic device. In some examples, transferring the presentation of the first content from the first electronic device to the second electronic device includes ceasing to display the first content through one or more first displays on the first electronic device and presenting the first content through one or more second displays on the second electronic device. For example, as shown in Figure 3B, according to a determination that the touch input detected on the second electronic device 306 in Figure 3A corresponds to a specific type of touch gesture (e.g., a downward swipe gesture), the computing system ceasing to present the video content 304 on the first electronic device 301 and presenting the video content 304 on the second electronic device 306. For example, if a touch input detected on the second electronic device 406 in Figure 4I corresponds to a specific type of touch gesture (e.g., a downward swipe), and the system determines that the touch input was detected while the cursor 410 was located in the environment 400 outside the virtual keyboard 422, the computing system will cease presenting the virtual keyboard 422 on the first electronic device 401 (for example, as shown in Figure 4E) and present the virtual keyboard 422 on the second electronic device 406. For example, as shown in Figure 5D, if the computing system determines that a touch input detected in Figure 5C corresponds to a specific type of touch gesture (e.g., a downward swipe gesture) detected on the second touch area 516b of the display 508 of the second electronic device 506, the computing system will cease presenting the application content 504 on the first electronic device 501 and present the application content 504 on the second electronic device 506.
[0165] Process 900 is an example, and it should be understood that more, fewer, or different operations may be performed in the same or different order. In addition, the operations of Process 900 described above may be optionally implemented by executing one or more functional modules of an information processing device such as a general-purpose processor (e.g., as described with respect to Figures 2A-2B) or an application-specific chip, and / or by other components of Figures 2A-2B.
[0166] Accordingly, as stated above, some examples of the present disclosure relate to methods performed in a computing system including a first electronic device that communicates with a second electronic device, wherein the first electronic device includes one or more first displays, and the second electronic device includes one or more second displays. In some examples, the method includes detecting a first input via one or more input devices of the second electronic device while the first content is presented in a three-dimensional environment via one or more first displays. In some examples, the method further includes transferring the presentation of the first content from the first electronic device to the second electronic device according to a determination that the first input satisfies one or more first criteria, wherein the transfer of the presentation of the first content from the first electronic device to the second electronic device includes ceasing the presentation of the first content via one or more first displays on the first electronic device and the presentation of the first content via one or more second displays on the second electronic device. In some embodiments, the presentation of first content in a three-dimensional environment is updated via one or more first displays according to a determination that the input satisfies one or more second criteria different from one or more first criteria. In some embodiments, updating the presentation of first content in a three-dimensional environment via one or more first displays includes changing the appearance of the content or the container of content without modifying the playback of the content. For example, updating the presentation of first content includes moving and / or resizing the container of first content (e.g., a window) in the three-dimensional environment. For example, updating the presentation of first content without modifying the playback includes updating as described herein without pausing or resuming playback (apart from continuing playback), or without skipping forward or backward within the content. In some embodiments, satisfying one or more first criteria and one or more second criteria is possible regardless of the user interface presented on the second electronic device.In some embodiments, satisfying one or more first criteria and one or more second criteria is possible while the same user interface is displayed on a second electronic device, and the one or more first criteria and one or more second criteria are associated with interaction with the same user interface or user interface elements.
[0167] In addition or alternatively, in some examples, the method further includes refraining from transferring the presentation of the first content from the first electronic device to the second electronic device based on the determination that the first input does not meet one or more first criteria.
[0168] In addition or alternatively, in some examples, one or more first criteria include evaluation criteria that are met when the first input includes a first gesture performed on a second electronic device.
[0169] Additionally or alternatively, in some examples, one or more input devices of the second electronic device are touch-sensitive surfaces, and the first gesture includes a touch gesture detected on the touch-sensitive surface.
[0170] In addition or alternatively, in some examples, the method further includes updating the presentation of first content in a three-dimensional environment via one or more first displays based on a determination that a first input satisfies one or more second criteria different from one or more first criteria.
[0171] In addition or alternatively, in some examples, one or more first criteria include a first evaluation criterion that is met when the first input includes movement in a second electronic device in a first direction, and one or more second criteria include a second evaluation criterion that is met when the first input includes movement in a second direction different from the first direction in the second electronic device.
[0172] Additionally or alternatively, in some examples, updating the presentation of the first content in a three-dimensional environment includes reducing the size of the presentation of the first content in a three-dimensional environment.
[0173] Additionally or alternatively, in some examples, updating the presentation of a first content within a three-dimensional environment involves performing user interface actions within the first content within the three-dimensional environment.
[0174] In addition or alternatively, in some examples, the method further includes presenting a virtual cursor at a first position in a three-dimensional environment via one or more first displays while detecting a first input, the first content corresponding to a virtual keyboard presented within a first region of the three-dimensional environment, and one or more first criteria including evaluation criteria that are satisfied when the first position of the virtual cursor is outside the first region of the three-dimensional environment.
[0175] In addition or alternatively, in some examples, the method further includes, upon determination that a first input satisfies one or more second criteria, where one or more second criteria include evaluation criteria that are satisfied when the first input corresponds to a selection of virtual elements presented within first content, and causing a virtual keyboard to be presented on a second electronic device via one or more second displays.
[0176] In addition or alternatively, in some examples, the method further includes operating a second electronic device in a low-power state while the first content is presented in a three-dimensional environment.
[0177] In addition or alternatively, in some examples, operating a second electronic device in a power-saving state includes operating one or more second displays of the second electronic device in an inactive state.
[0178] In addition or alternatively, in some examples, the method further includes causing a representation of multiple touch areas to be presented on a second electronic device via one or more second displays while the first content is presented in a three-dimensional environment. In some examples, the method further includes detecting a second input via one or more input devices of the second electronic device. In some examples, the method further includes performing a first action upon determination that the second input has been detected for a first touch area among the multiple touch areas. In some examples, the method further includes performing a second action different from the first action upon determination that the second input has been detected for a second touch area different from the first touch area among the multiple touch areas.
[0179] In addition or alternatively, in some examples, transferring first content from a first electronic device to a second electronic device includes outputting a first audio output indicating the transfer through one or more audio output devices of the first electronic device.
[0180] In addition or alternatively, in some examples, transferring first content from a first electronic device to a second electronic device includes transitioning the audio output associated with the first content from a state where it is output through one or more audio output devices of the first electronic device to a state where it is output through one or more audio output devices of the second electronic device.
[0181] In addition or alternatively, in some examples, the method further includes detecting a second input via one or more input devices of the second electronic device after the first content has been transferred from the first electronic device to the second electronic device. In some examples, the method further includes transferring a presentation of the first content from the second electronic device to the first electronic device according to a determination that the second input satisfies one or more second criteria, the transfer of the presentation of the first content from the second electronic device to the first electronic device includes ceasing to display the first content via one or more second displays on the second electronic device, and the first content being presented via one or more first displays on the first electronic device.
[0182] In addition or alternatively, in some examples, one or more first criteria include a first evaluation criterion that is met when a first input includes a first gesture performed on a second electronic device, and one or more second criteria include a second evaluation criterion that is met when a second input includes a second gesture, different from the first gesture, performed on a second electronic device.
[0183] In addition or alternatively, in some examples, one or more second criteria include evaluation criteria that are met when a second input corresponds to a selection of virtual elements presented to a second electronic device via one or more second displays.
[0184] In addition or alternatively, in some examples, the method further includes detecting the attention of a user of the first electronic device directed to the first content via one or more input devices of the first electronic device while the first content is being presented via one or more first displays. In some examples, the method further includes presenting the first content having one or more playback controls via one or more first displays in response to detecting the attention of a user of the first electronic device directed to the first content.
[0185] In addition or alternatively, in some examples, one or more first criteria are met when the first input includes at least a portion of the second electronic device being within the field of view of the first electronic device.
[0186] Additionally or alternatively, in some examples, the first content includes notifications for individual applications accessible on the second electronic device.
[0187] In addition or alternatively, in some examples, the method further includes detecting user interaction with one or more second electronic devices that satisfy a second criterion via one or more input devices of a second electronic device while the first content is presented in a three-dimensional environment via one or more first displays. In some examples, the method further includes causing the second electronic device to present user interface elements associated with the first content in response to the detection of user interaction.
[0188] In addition or alternatively, in some examples, the first content is video content, which is being played in a three-dimensional environment while user interaction with a second electronic device is detected. In some examples, the method further includes pausing the playback of the first content in the three-dimensional environment in response to the detection of user interaction.
[0189] In addition or alternatively, in some examples, the method further includes, while the user interface element is presented on a second electronic device, the user interface element includes selectable options that can be selected to change the playback state of first content in a three-dimensional environment, and detecting the selection of a selectable option via one or more input devices of the second electronic device. In some examples, the method further includes continuing playback of the first content in the three-dimensional environment in response to the detection of the selection of a selectable option.
[0190] Some examples of this disclosure relate to a first electronic device comprising one or more processors, memory, and one or more programs, wherein one or more programs are stored in memory and configured to be executed by one or more processors, and one or more programs include instructions that perform any of the methods described above.
[0191] Some examples of this disclosure concern a computing system comprising one or more processors, memory, and one or more programs, wherein one or more programs are stored in memory and configured to be executed by one or more processors, and one or more programs include instructions that perform any of the methods described above.
[0192] Some examples of the present disclosure relate to a non-temporary computer-readable storage medium storing one or more programs, wherein the one or more programs include instructions, and when the instructions are executed by one or more processors of an electronic device, the electronic device causes the electronic device to perform any of the methods described above.
[0193] Some examples of this disclosure relate to an electronic device comprising one or more processors, memory, and means for performing any of the methods described above.
[0194] Some examples of this disclosure relate to information processing devices for use in electronic devices, the information processing devices comprising means for performing any of the methods described above.
[0195] The above description is provided for illustrative purposes with reference to specific embodiments. However, the above exemplary description is not intended to be exhaustive or to limit the disclosure to the exact form disclosed. Many modifications and variations are possible in light of the above teachings. The examples have been selected and described in order to best illustrate the principles of the disclosure and their practical application, thereby enabling those skilled in the art to best use the disclosure and the various described examples with various modifications suitable for the specific use intended.
Claims
1. It is a method, A computing system including a first electronic device that communicates with a second electronic device, wherein the first electronic device includes one or more first displays, and the second electronic device includes one or more second displays. While the first content is presented in a three-dimensional environment via one or more first displays, the first input is detected via one or more input devices of the second electronic device. Transferring the presentation of the first content from the first electronic device to the second electronic device in accordance with the determination that the first input satisfies one or more first criteria, wherein the transfer of the presentation of the first content from the first electronic device to the second electronic device includes ceasing to present the first content via one or more first displays on the first electronic device, and presenting the first content via one or more second displays on the second electronic device. A method comprising updating the presentation of the first content in the three-dimensional environment via the one or more first displays, in accordance with the determination that the first input satisfies one or more second criteria different from the one or more first criteria.
2. In accordance with the determination that the first input does not meet one or more of the first criteria, the transfer of the presentation of the first content from the first electronic device to the second electronic device is withheld. The method according to claim 1, further comprising:
3. The method according to claim 1, wherein the one or more first criteria include evaluation criteria that are satisfied when the first input includes a first gesture performed by the second electronic device.
4. The method according to claim 3, wherein the one or more input devices of the second electronic device are touch-sensing surfaces, and the first gesture includes a touch gesture detected on the touch-sensing surface.
5. The method according to claim 1, wherein the one or more first criteria include a first evaluation criterion that is satisfied when the first input includes movement in a first direction in the second electronic device, and the one or more second criteria include a second evaluation criterion that is satisfied when the first input includes movement in a second direction different from the first direction in the second electronic device.
6. The method according to claim 1, wherein updating the presentation of the first content in the three-dimensional environment includes reducing the size of the presentation of the first content in the three-dimensional environment.
7. The further includes, while detecting the first input, presenting a virtual cursor at a first position in the three-dimensional environment via one or more first displays, The first content corresponds to a virtual keyboard presented in the first region of the three-dimensional environment, The one or more first criteria include an evaluation criterion that is satisfied when the first position of the virtual cursor is outside the first region of the three-dimensional environment. The method according to claim 1.
8. In accordance with the determination that the first input satisfies one or more third criteria, the one or more third criteria include evaluation criteria that are satisfied when the first input corresponds to the selection of a virtual element presented in the first content, causing a virtual keyboard to be presented on the second electronic device via one or more second displays. The method according to claim 1, further comprising:
9. While the first content is presented in the three-dimensional environment, the second electronic device is operated in a power-saving state. The method according to claim 1, further comprising:
10. The method according to claim 9, wherein operating the second electronic device in the power-saving state includes operating one or more of the second displays of the second electronic device in an inactive state.
11. While the first content is presented in the three-dimensional environment, a plurality of touch area representations are presented on the second electronic device via one or more second displays. The second input is detected through one or more input devices of the second electronic device, In accordance with the determination that the second input has been detected for the first touch area among the plurality of touch areas, the first operation is performed. In accordance with the determination that the second input has been detected in a second touch area among the plurality of touch areas, which is different from the first touch area, a second operation different from the first operation is performed. The method according to claim 1, further comprising:
12. The method according to claim 1, wherein transferring the first content from the first electronic device to the second electronic device includes outputting a first audio output indicating the transfer via one or more audio output devices of the first electronic device.
13. The method according to claim 1, wherein transferring the first content from the first electronic device to the second electronic device includes transitioning the audio output associated with the first content from a state in which it is output through one or more audio output devices of the first electronic device to a state in which it is output through one or more audio output devices of the second electronic device.
14. The method according to claim 1, wherein transferring the first content from the first electronic device to the second electronic device includes transitioning a spatial audio output associated with the first content from a state associated with a position corresponding to the first content presented on the first electronic device via one or more audio output devices of the first electronic device to a state associated with a position corresponding to the first content presented on the second electronic device via one or more audio output devices of the first electronic device.
15. After the first content is transferred from the first electronic device to the second electronic device, a second input is detected via one or more input devices of the second electronic device, Transferring the presentation of the first content from the second electronic device to the first electronic device in accordance with the determination that the second input satisfies one or more third criteria, wherein the transfer of the presentation of the first content from the second electronic device to the first electronic device includes ceasing the presentation of the first content via one or more second displays on the second electronic device and the presentation of the first content via one or more first displays on the first electronic device, The method according to claim 1, further comprising:
16. The method according to claim 15, wherein the one or more first criteria include a first evaluation criterion that is satisfied when the first input includes a first gesture performed by the second electronic device, and the one or more third criteria include a second evaluation criterion that is satisfied when the second input includes a second gesture different from the first gesture, performed by the second electronic device.
17. The method according to claim 15, wherein the one or more third criteria include evaluation criteria that are satisfied when the second input corresponds to a selection of virtual elements presented to the second electronic device via the one or more second displays.
18. While the first content is being presented through one or more first displays, the attention of the user of the first electronic device directed towards the first content is detected via one or more input devices of the first electronic device. In response to detecting the attention of the user of the first electronic device directed towards the first content, present the first content having one or more playback controls via one or more first displays. The method according to claim 15, further comprising:
19. The method according to claim 1, wherein the one or more first criteria include an evaluation criterion that is satisfied when the first input includes at least a portion of the second electronic device being within the field of view of the first electronic device.
20. The method according to claim 19, wherein the first content includes notifications for individual applications accessible on the second electronic device.
21. While the first content is presented in the three-dimensional environment via one or more first displays, the second electronic device detects user interaction with one or more second electronic devices that satisfy one or more third criteria via one or more input devices of the second electronic device, In response to detecting the user interaction, the user interface elements associated with the first content are displayed on the second electronic device. The method according to claim 1, further comprising:
22. The first content is video content, and the first content is played back in the three-dimensional environment while the user interaction with the second electronic device is detected, and the method is The method according to claim 21, further comprising pausing playback of the first content in the three-dimensional environment in response to the detection of the user interaction.
23. While the user interface element is presented on the second electronic device, the user interface element includes selectable options that can be selected to change the playback state of the first content in the three-dimensional environment, and the selection of the selectable option is detected via one or more input devices of the second electronic device. The method according to claim 22, further comprising continuing playback of the first content in the three-dimensional environment in response to detecting the selection of the selectable options.
24. It is an electronic device, One or more processors, Memory and An electronic device comprising: one or more programs stored in the memory and configured to be executed by one or more processors, the one or more programs including instructions for performing the method according to any one of claims 1 to 23.
25. A computing system, One or more processors, Memory and A computing system comprising: one or more programs stored in the memory and configured to be executed by one or more processors, the one or more programs including instructions for performing the method according to any one of claims 1 to 23.