System and method for transmitting presentation of content between first electronic device and second electronic device

Abstract

The present disclosure generally relates to systems and methods for transmitting a presentation of content between a first electronic device and a second electronic device. Some examples of the present disclosure relate to systems and methods for transmitting a presentation of content between a first electronic device and a second electronic device of a computing system. In some examples, when first content is presented on a first electronic device in a three-dimensional environment, a computing system detects a first input via one or more input devices of a second electronic device. In some examples, in accordance with a determination that the first input satisfies one or more first criteria, the computing system transmits a presentation of the first content from the first electronic device to the second electronic device. In some examples, transmitting presentation of the first content from the first electronic device to the second electronic device includes stopping presentation of the first content on the first electronic device and presenting the first content on the second electronic device.

Description

[0001] Cross-reference to related applications

[0002] This application claims the benefit of U.S. Provisional Application No. 63 / 784,833, filed April 7, 2025; U.S. Provisional Application No. 63 / 699,754, filed September 26, 2024; and U.S. Patent Application No. 19 / 298,674, filed August 13, 2025, the contents of which are incorporated herein by reference in their entirety for all purposes. Technical Field

[0003] This disclosure relates in its entirety to systems and methods for presenting content transmitted between electronic devices of a computing system. Background Technology

[0004] Some computer graphics environments provide two-dimensional and / or three-dimensional environments in which at least some of the objects displayed for the user to view are virtual and computer-generated. Summary of the Invention

[0005] Some examples of this disclosure relate to systems and methods for presenting content between a first electronic device and a second electronic device of a computing system. In some examples, when first content is presented in a three-dimensional environment via one or more first displays, the computing system detects a first input via one or more input devices of the second electronic device. For example, the first input is a touch input detected on a touch-sensitive display of the second electronic device, such as a swipe touch gesture. In some examples, based on determining that the first input meets one or more first criteria, the computing system causes the presentation of the first content to be transferred from the first electronic device to the second electronic device. In some examples, transferring the presentation of the first content from the first electronic device to the second electronic device includes the first content being presented on the first electronic device via one or more first displays, and the first content being presented on the second electronic device via one or more second displays.

[0006] A full description of these examples is provided in the accompanying drawings and detailed embodiments, and it should be understood that the content of this invention does not limit the scope of this disclosure in any way. Attached Figure Description

[0007] To better understand the various examples described herein, reference should be made to the following detailed embodiments and the accompanying drawings. Throughout the drawings, similar reference numerals generally refer to corresponding parts.

[0008] Figure 1 Examples of electronic devices that present extended real-world environments according to some examples of this disclosure are illustrated.

[0009] Figures 2A to 2BA block diagram illustrating an example architecture for an electronic device according to some examples of this disclosure is shown.

[0010] Figures 3A to 3K Examples of computing systems according to this disclosure illustrate the presentation of content transmitted between a first electronic device and a second electronic device in response to one or more user inputs.

[0011] Figures 4A to 4I Examples of computing systems according to this disclosure are illustrated, which modify the display of virtual content on a first electronic device in response to one or more user inputs detected at a second electronic device.

[0012] Figures 5A to 5D Examples of computing systems according to this disclosure are illustrated, which modify the display of virtual content in response to one or more user inputs detected relative to one or more touch areas.

[0013] Figures 6A to 6D Examples of computing systems according to this disclosure are shown for displaying video content in a three-dimensional environment.

[0014] Figures 7A to 7C Examples of computational systems according to this disclosure are shown displaying notifications in a three-dimensional environment.

[0015] Figures 8A to 8G Examples of computing systems according to this disclosure are shown, in which content is presented on a first electronic device and user interface elements associated with the content are presented on a second electronic device.

[0016] Figure 9 A flowchart illustrating an example process for transmitting the presentation of content from a first electronic device to a second electronic device, according to some examples of this disclosure, is provided. Detailed Implementation

[0017] Some examples of this disclosure relate to systems and methods for presenting content between a first electronic device and a second electronic device of a computing system. In some examples, when first content is presented in a three-dimensional environment via one or more first displays, the computing system detects a first input via one or more input devices of the second electronic device. For example, the first input is a touch input detected on a touch-sensitive display of the second electronic device, such as a swipe touch gesture. In some examples, based on determining that the first input meets one or more first criteria, the computing system causes the presentation of the first content to be transferred from the first electronic device to the second electronic device. In some examples, transferring the presentation of the first content from the first electronic device to the second electronic device includes the first content being presented on the first electronic device via one or more first displays, and the first content being presented on the second electronic device via one or more second displays.

[0018] In some examples, 3D objects are displayed in a computer-generated 3D environment with a specific orientation that controls one or more behaviors of the 3D object (e.g., when the 3D object moves within the 3D environment). In some examples, the orientation in which the 3D object is displayed in the 3D environment is selected by the user of the electronic device or is selected automatically by the electronic device. For example, when initiating the rendering of a 3D object in a 3D environment, the user may select a specific orientation of the 3D object, or the electronic device may automatically select the orientation of the 3D object (e.g., based on the type of the 3D object).

[0019] In some examples, 3D objects may be displayed in a 3D environment with world-locked orientation, body-locked orientation, tilt-locked orientation, or head-locked orientation, as described below. As used herein, an object displayed in a 3D environment with body-locked orientation has a distance and orientation offset relative to a portion of the user's body (e.g., the user's torso). Alternatively, in some examples, body-locked objects have a fixed distance from the user, and the orientation of the content does not reference any part of the user's body (e.g., it may be displayed in the same basic direction relative to the user, regardless of head and / or body movement). Additionally or alternatively, in some examples, body-locked objects may be configured to always maintain gravity or horizon (e.g., perpendicular to gravity) alignment, such that changes in the head and / or body's scroll direction will not cause the body-locked object to move within the 3D environment. Conversely, translational movement in either configuration will cause the body-locked object to reposition within the 3D environment to maintain the distance offset.

[0020] As used in this article, objects displayed in a head-locked orientation within a 3D environment have a distance and orientation offset relative to the user's head. In some examples, the head-locked object moves within the 3D environment as the user's head moves (when the user's viewpoint changes).

[0021] As used in this article, objects displayed in a world-locked orientation in a 3D environment do not have a distance or orientation offset relative to a user-defined distance, but rather a position and orientation defined relative to the 3D environment.

[0022] As used herein, an object displayed in a tilt-locked orientation in a three-dimensional environment (referred to herein as a tilt-locked object) has a distance offset relative to a user (such as a part of the user's body, e.g., the user's torso, or the user's head). In some examples, the tilt-locked object is displayed in a fixed orientation relative to the three-dimensional environment. In some examples, the tilt-locked object moves according to a polar (e.g., spherical) coordinate system centered on a pole passing through the user (e.g., the user's head). For example, the tilt-locked object moves in the three-dimensional environment based on the movement of the user's head within a spherical space surrounding the user's head (e.g., centered on the user's head). Thus, if the user tilts their head relative to gravity (e.g., up or down in the pitch direction), the tilt-locked object will follow the head tilt and move radially along the sphere, such that the tilt-locked object is repositioned in the three-dimensional environment with the same distance offset relative to the user as before the head tilt, while optionally maintaining the same orientation relative to the three-dimensional environment. In some examples, if the user moves their head relative to gravity in a rolling direction (e.g., clockwise or counterclockwise), the tilt-locked object is not repositioned in the three-dimensional environment.

[0023] Figure 1 An electronic device 101 is illustrated according to some examples of this disclosure, which presents an extended reality (XR) environment (e.g., a computer-generated environment that optionally includes representations of physical and / or virtual objects). In some examples, such as Figure 1 As shown, electronic device 101 is a head-mounted display or other head-mountable device configured to be worn on the head of a user of electronic device 101. See below for reference. Figure 2A An example of an architecture block diagram to describe electronic device 101. For example... Figure 1 As shown, electronic device 101 and table 106 are located in a physical environment. The physical environment may include physical features such as physical surfaces (e.g., floor, wall) or physical objects (e.g., table, lamp, etc.). In some examples, electronic device 101 may be configured to detect and / or capture images of the physical environment including table 106 (exemplified in the field of view of electronic device 101).

[0024] In some examples, such as Figure 1 As shown, the electronic device 101 includes one or more internal image sensors 114a oriented toward the user's face (e.g., referred to below). Figures 2A to 2B(The described eye-tracking camera). In some examples, an internal image sensor 114a is used for eye tracking (e.g., detecting the user's gaze). The internal image sensor 114a is optionally arranged on the left and right portions of the display 120 to enable eye tracking of the user's left and right eyes. In some examples, the electronic device 101 also includes external image sensors 114b and 114c facing outwards from the user to detect and / or capture the physical environment of the electronic device 101 and / or movement of the user's hands or other body parts.

[0025] In some examples, display 120 has a field of view visible to the user (e.g., it may or may not correspond to the fields of view of external image sensors 114b and 114c). Because display 120 is optionally part of a head-mounted device, the field of view of display 120 is optionally the same as or similar to the field of view of the user's eyes. In other examples, the field of view of display 120 may be smaller than the field of view of the user's eyes. In some examples, electronics 101 may be an optical pass-through device, through which display 120 is a transparent or translucent display through which parts of the physical environment can be directly viewed. In some examples, display 120 may be included within a transparent lens and may overlap with all or only a portion of the transparent lens. In other examples, electronics may be a video pass-through device, through which display 120 is an opaque display configured to display images of the physical environment captured by external image sensors 114b and 114c. Although a single display 120 is shown, it should be understood that display 120 may include a stereoscopic display pair. In some examples, display 120 is a passive display that outputs content (e.g., images and / or videos) rendered by a second electronic device such as electronic device 160 described below.

[0026] In some examples, in response to a trigger, electronic device 101 can be configured to display in an XR environment... Figure 1 The illustrated cube represents a virtual object 104 that does not exist in the physical environment but is displayed in an XR environment positioned on top of a real-world table 106 (or a representation thereof). Optionally, in response to detecting a flat surface of the table 106 in the physical environment 100, the virtual object 104 may be displayed on the surface of the table 106 in the XR environment displayed via a display 120 of the electronic device 101.

[0027] It should be understood that virtual object 104 is a representative virtual object and may include and render one or more different virtual objects (e.g., virtual objects with various dimensions, such as two-dimensional or other three-dimensional virtual objects) in a three-dimensional XR environment. For example, a virtual object may represent an application or user interface displayed in an XR environment. In some examples, a virtual object may represent content corresponding to an application and / or displayed via a user interface in an XR environment. In some examples, virtual object 104 is optionally configured to be interactive and responsive to user input (e.g., air gestures, such as air pinch gestures, air tap gestures, and / or air touch gestures), allowing the user to virtually touch, tap, move, rotate, or otherwise interact with virtual object 104.

[0028] In some examples, electronic device 101 may be configured to communicate with a second electronic device (such as a companion device). For example, as Figure 1 As illustrated, electronic device 101 can communicate with electronic device 160. In some examples, electronic device 160 corresponds to a mobile electronic device, such as a smartphone, tablet computer, smartwatch, or other electronic device. See below for reference. Figure 2B The following are additional examples of architectural diagrams used to describe electronic device 160. In some examples, electronic device 101 and electronic device 160 are associated with the same user. For example, in Figure 1 In this configuration, electronic device 101 may be positioned (e.g., mounted) on a user's head, and electronic device 160 may be positioned near electronic device 101, such as in the user's hand 103 (e.g., hand 103 is holding electronic device 160), and electronic devices 101 and 160 are associated with the same user account (e.g., the user is logged into a user account on both electronic devices 101 and 160). See below for further details. Figures 2A to 2B Additional details regarding the communication between electronic device 101 and electronic device 160 are provided.

[0029] In some examples, displaying an object in a 3D environment may include interaction with one or more user interface objects in the 3D environment. For example, initiating the display of an object in a 3D environment may include interaction with one or more virtual options / power representations displayed in the 3D environment. In some examples, when initiating the display of an object in a 3D environment, the electronic device may track the user's gaze as input for identifying one or more virtual options / power representations as targets for selection. For example, a gaze may be used to identify one or more virtual options / power representations as targets for selection using another selection input. In some examples, a virtual option / power representation may be selected using hand-tracking input detected via an input device communicating with the electronic device. In some examples, an object displayed in a 3D environment may move and / or reorient itself in the 3D environment based on movement input detected via an input device. Virtual options / power representations presented in the 3D environment that can serve as selection targets may also be referred to herein as selectable options.

[0030] In the following discussion, an electronic device communicating with a display generation component and one or more input devices is described. It should be understood that the electronic device optionally communicates with one or more other physical user interface devices, such as a touch-sensitive surface, physical keyboard, mouse, joystick, hand-tracking device, eye-tracking device, stylus, etc. Furthermore, as described above, it should be understood that the described electronic device, display, and touch-sensitive surface are optionally distributed among two or more devices. Therefore, as used in this disclosure, information on or displayed by the electronic device is optionally used to describe information output by the electronic device for display on a separate display device (touch-sensitive or non-touch-sensitive). Similarly, as used in this disclosure, input received on the electronic device (e.g., touch input received on a touch-sensitive surface of the electronic device, or touch input received on the surface of a stylus) is optionally used to describe input received on a separate input device from which the electronic device receives input information.

[0031] The device typically supports a variety of applications, such as one or more of the following: drawing applications, presentation applications, word processing applications, website creation applications, disk editing applications, spreadsheet applications, game applications, phone applications, video conferencing applications, email applications, instant messaging applications, fitness support applications, photo management applications, digital camera applications, digital video camera applications, web browsing applications, digital music player applications, TV channel browsing applications, and / or digital video player applications.

[0032] Figures 2A to 2BBlock diagrams illustrating example architectures for electronic devices 201 and 260 according to some examples of this disclosure are shown. In some examples, electronic device 201 and / or electronic device 260 include one or more electronic devices. For example, electronic device 201 may be a portable device, an auxiliary device for communicating with another device, a head-mounted display, etc. In some examples, electronic device 201 corresponds to the above reference. Figure 1 The described electronic device 101. In some examples, electronic device 260 corresponds to the above reference. Figure 1 The described electronic device 160. Electronic devices 201 and 260 optionally form a computing system and / or are included in a computing system.

[0033] like Figure 2A As illustrated, electronic device 201 optionally includes various sensors, such as one or more hand tracking sensors 202, one or more position sensors 204A, and one or more image sensors 206A (optionally corresponding to...). Figure 1 The internal image sensor 114a and / or external image sensors 114b and 114c, one or more touch-sensitive surfaces 209A, one or more motion and / or orientation sensors 210A, one or more eye-tracking sensors 212, one or more microphones 213A or other audio sensors, one or more body tracking sensors (e.g., torso and / or head tracking sensors), and one or more display generation components 214A (optionally corresponding to...) Figure 1 The electronic device 201 includes a display 120, one or more speakers 216A, one or more processors 218A, one or more memories 220A, and / or communication circuitry 222A. One or more communication buses 208A are optionally used for communication between the aforementioned components of the electronic device 201. Additionally, as... Figure 2B As shown, electronic device 260 optionally includes one or more position sensors 204B, one or more image sensors 206B, one or more touch-sensitive surfaces 209B, one or more orientation sensors 210B, one or more microphones 213B, one or more display generating components 214B, one or more speakers 216B, one or more processors 218B, one or more memories 220B, and / or communication circuitry 222B. One or more communication buses 208B are optionally used for communication between the aforementioned components of electronic device 260. Electronic devices 201 and 260 are optionally configured to communicate via a wired or wireless connection between the two electronic devices (e.g., via communication circuitry 222A, 222B). For example, as Figure 2A As indicated, electronic device 260 can be used as an accessory to electronic device 201.

[0034] Communication circuits 222A and 222B optionally include circuitry for communicating with electronic devices and networks such as the Internet, intranets, wired and / or wireless networks, cellular networks, and wireless local area networks (LANs). Communication circuits 222A and 222B optionally include circuitry for using near-field communication (NFC) and / or short-range communication such as... The circuit used for communication.

[0035] In some examples, processors 218A and 218B include one or more general-purpose processors, one or more graphics processors, and / or one or more digital signal processors. In some examples, memory 220A or 220B is a non-transitory computer-readable storage medium (e.g., flash memory, random access memory, or other volatile or non-volatile memory or storage device) storing computer-readable instructions configured to be executed by processor 218A or 218B to perform the techniques, processes, and / or methods described below. In some examples, memory 220A and / or 220B may include more than one non-transitory computer-readable storage medium. A non-transitory computer-readable storage medium can be any medium (e.g., excluding signals) that can tangibly contain or store computer-executable instructions for use by or in connection with an instruction execution system, apparatus, and device. In some examples, the storage medium is a transient computer-readable storage medium. In some examples, the storage medium is a non-transitory computer-readable storage medium. Non-transitory computer-readable storage media may include, but are not limited to, magnetic storage devices, optical storage devices, and / or semiconductor storage devices. Examples of such storage devices include hard disks, optical discs based on compact disc (CD), digital versatile optical disc (DVD), or Blu-ray technology, and persistent solid-state storage (such as flash memory, solid-state drives, etc.).

[0036] In some examples, display generating components 214A, 214B include a single display (e.g., a liquid crystal display (LCD), an organic light-emitting diode (OLED), or other types of display). In some examples, display generating components 214A, 214B include multiple displays. In some examples, display generating components 214A, 214B may include a touch-enabled display (e.g., a touchscreen), a projector, a holographic projector, a retinal projector, a transparent or translucent display, etc. In some examples, electronic devices 201 and 260 respectively include touch-sensitive surfaces 209A and 209B for receiving user input such as tap input and swipe input or other gestures. In some examples, display generating components 214A, 214B and touch-sensitive surfaces 209A, 209B form a touch-sensitive display (e.g., a touchscreen integrated with each of electronic devices 201 and 260 or a touchscreen external to each of electronic devices 201 and 260 that communicates with each of electronic devices 201 and 260).

[0037] In some examples, electronic device 201 includes one or more controllable shading layers, each of which can be configured to filter an adjustable amount of light (e.g., light with a specific wavelength or wavelength range). The one or more shading layers can be used to at least partially block a user's view of the physical environment and enhance a virtual image displayed using an optically perceptible display. In some examples, the shading layers are integrated into display generation component 214A. In some examples, the shading layers are separate from display generation component 214A. In some examples, one of the controllable shading layers may include a frosted glass layer that can be controlled to scatter an adjustable amount of incident light. Alternatively, in some examples, electronic device 201 may not include a separate controllable shading layer. For example, the shading functionality may be integrated into display generation component 214A (e.g., integrated into other layers of display generation component 214A).

[0038] Electronic devices 201 and 260 optionally include image sensors 206A and 206B, respectively. Image sensors 206A and 206B optionally include one or more visible light image sensors (such as charge-coupled device (CCD) sensors) and / or complementary metal-oxide-semiconductor (CMOS) sensors operable to acquire images of physical objects from a real-world environment. Image sensors 206A and 206B also optionally include one or more infrared (IR) sensors, such as passive or active IR sensors, for detecting infrared light from the real-world environment. For example, an active IR sensor includes an IR emitter for emitting infrared light into the real-world environment. Image sensors 206A and 206B also optionally include one or more cameras configured to capture movement of a physical object in the real-world environment. Image sensors 206A and 206B also optionally include one or more depth sensors configured to detect the distance between the physical object and electronic devices 201 and 260. In some examples, information from one or more depth sensors allows a device to identify objects in a real-world environment and distinguish them from other objects in the real-world environment. In some examples, one or more depth sensors allow a device to determine the texture and / or shape of objects in a real-world environment.

[0039] In some examples, electronic devices 201 and 260 combine a CCD sensor, an event camera, and a depth sensor to detect the physical environment surrounding them. In some examples, image sensors 206A and 206B include a first image sensor and a second image sensor. The first and second image sensors work cooperatively and are optionally configured to capture different information about physical objects in the real-world environment. In some examples, the first image sensor is a visible light image sensor, and the second image sensor is a depth sensor. In some examples, electronic devices 201 and 260 use image sensors 206A and 206B to detect the location and orientation of electronic devices 201 and 260 and / or display generation components 214A and 214B in the real-world environment. For example, electronic devices 201 and 260 use image sensors 206A and 206B to track the location and orientation of display generation components 214A and 214B relative to one or more stationary objects in the real-world environment.

[0040] In some examples, electronic devices 201 and 260 include microphones 213A and 213B, or other audio sensors, respectively. Electronic devices 201 and 260 optionally use microphones 213A and 213B to detect sound from a user and / or the user's real-world environment. In some examples, microphones 213A and 213B include arrays (multiple microphones) of microphones that optionally operate in cooperation, such as to identify ambient noise or locate sound sources in the space of a real-world environment.

[0041] In some examples, electronic devices 201 and 260 include position sensors 204A and 204B, respectively, for detecting the positions of electronic device 201A and / or display generation component 214A and the positions of electronic device 260 and / or display generation component 214B. For example, position sensors 204A and 204B may include Global Positioning System (GPS) receivers that receive data from one or more satellites and allow electronic devices 201 and 260 to determine the absolute location of the device in the physical world.

[0042] In some examples, electronic devices 201 and 260 include orientation sensors 210A and 210B, respectively, for detecting the orientation and / or movement of electronic device 201 and / or display generation component 214A, and the orientation and / or movement of electronic device 260 and / or display generation component 214B, respectively. For example, electronic devices 201 and 260 use orientation sensors 210A and 210B to track changes in the positioning and / or orientation of electronic devices 201 and 260 and / or display generation components 214A and 214B, such as changes relative to physical objects in a real-world environment. Orientation sensors 210A and 210B optionally include one or more gyroscopes and / or one or more accelerometers.

[0043] In some examples, electronic device 201 includes a hand tracking sensor 202 and / or an eye tracking sensor 212 (and / or other body tracking sensors, such as a leg tracking sensor, a torso tracking sensor, and / or a head tracking sensor). The hand tracking sensor 202 is configured to track the localization / position of one or more portions of a user's hand, and / or the movement of one or more portions of the user's hand relative to the extended reality environment, relative to the display generation component 214A, and / or relative to another defined coordinate system. The eye tracking sensor 212 is configured to track the localization and movement of the user's gaze (more generally, the eyes, face, or head) relative to the real world or extended reality environment and / or relative to the display generation component 214A. In some examples, the hand tracking sensor 202 and / or the eye tracking sensor 212 are implemented together with the display generation component 214A. In some examples, the hand tracking sensor 202 and / or the eye tracking sensor 212 are implemented separately from the display generation component 214A. In some examples, electronic device 201 optionally does not include the hand tracking sensor 202 and / or the eye tracking sensor 212. In some such examples, the generation component 214A can be used by the electronic device 260 to provide an extended reality environment and utilize input and other data collected via other sensors of the electronic device 201 (e.g., one or more position sensors 204A, one or more image sensors 206A, one or more touch-sensitive surfaces 209A, one or more motion and / or orientation sensors 210A and / or one or more microphones 213A or other audio sensors) as input and data processed by the processor 218B of the electronic device 260. Additionally or alternatively, the electronic device 201 optionally does not include... Figure 2B Other components shown include position sensor 204B, image sensor 206B, touch-sensitive surface 209B, etc. In some such examples, it is shown that generating component 214A can be used by electronic device 260 to provide an extended reality environment, and electronic device 260 can use input and other data collected via one or more motion and / or orientation sensors 210A (and / or one or more microphones 213A) of electronic device 201 as input.

[0044] In some examples, the hand tracking sensor 202 (and / or other body tracking sensors, such as leg tracking sensors, torso tracking sensors, and / or head tracking sensors) may use image sensors 206 (e.g., one or more IR cameras, 3D cameras, depth cameras, etc.) that capture 3D information from the real world, including one or more body parts (e.g., a human user's hand, leg, torso). In some examples, sufficient resolution is available to distinguish the hand to differentiate the fingers and their corresponding positions. In some examples, one or more image sensors 206A are positioned relative to the user to define the field of view and interaction space of the image sensors 206A, in which the finger / hand positions, orientations, and / or movements captured by the image sensors are used as input (e.g., to differentiate from the user's resting hand or other hands of other people in the real-world environment). Tracking fingers / hands to achieve input (e.g., gestures, touches, taps, etc.) may be advantageous because it does not require the user to touch, hold, or wear any type of beacon, sensor, or other marker.

[0045] In some examples, the eye-tracking sensor 212 includes at least one eye-tracking camera (e.g., an infrared (IR) camera) and / or an illumination source (e.g., an IR light source, such as an LED) that emits light toward the user's eyes. The eye-tracking camera may be pointed at the user's eyes to receive reflected IR light from the light source directly or indirectly from the eyes. In some examples, both eyes are tracked separately by the respective eye-tracking camera and illumination source, and focus / gaze can be determined by tracking both eyes. In some examples, one eye (e.g., the dominant eye) is tracked by one or more respective eye-tracking cameras / illumination sources.

[0046] Electronic devices 201 and 260 are not limited to Figures 2A to 2B The components and configurations may include, but are not limited to, a few more components, other components, or additional components in various configurations. In some examples, electronic device 201 and / or electronic device 260 may be implemented in various ways among multiple electronic devices (e.g., as a system). In some such examples, each(s) electronic device may each include one or more of the same components discussed above, such as various sensors, one or more display generation components, one or more speakers, one or more processors, one or more memories, and / or communication circuitry. One or more persons using electronic device 201 and / or electronic device 260 are optionally referred to herein as one or more users of the devices.

[0047] Now let’s turn our attention to an example of the presentation of virtual content transmitted between a computing system and a first electronic device (e.g., corresponding to electronic devices 101 and / or 201) and a second electronic device (e.g., corresponding to electronic devices 160 and / or 260). For example, the computing system includes a first electronic device and a second electronic device (e.g., the first electronic device communicates with the second electronic device, such as a reference). Figure 1 and / or Figures 2A to 2B (As described).

[0048] The methods and processes for presenting content between a first electronic device and a second electronic device, as described below, provide users of a computing system with an effective way to control which device of the computing system presents virtual content. This improves user interaction and the battery life of the computing system's devices (e.g., by avoiding the presentation of virtual content on one or more devices on which the user of the computing system does not intend to view the virtual content).

[0049] Figures 3A to 3K Examples of computing systems according to this disclosure illustrate the presentation of content transmitted between a first electronic device and a second electronic device in response to one or more user inputs. In some examples, the computing system includes a first electronic device 301 (e.g., having one or more features of electronic devices 101 and / or 201) and a second electronic device 306 (e.g., having one or more features of electronic devices 160 and / or 260). In some examples, the first electronic device 301 communicates with the second electronic device 306 (e.g., the second electronic device 306 is an auxiliary device and / or companion device communicating with the first electronic device 301).

[0050] like Figures 3A to 3K As shown, the first electronic device 301 includes image sensors 314a to 314c (e.g., having one or more characteristics of image sensors 114a to 114c and / or image sensor 206). In some examples, image sensors 314a to 314c are configured to detect one or more objects in the physical environment (e.g., having one or more characteristics of a real-world environment and / or the physical environment described above). In some examples, image sensors 314a to 314c are configured to detect movement of one or more parts of a user (e.g., hand, head, and / or eyes) and / or the user's attention (e.g., gaze). Optionally, the first electronic device 301 does not include image sensors 314a to 314c. For example, the first electronic device 301 is not configured to detect one or more objects in the physical environment, one or more parts of a user, and / or the user's attention (e.g., the computing system uses one or more input devices of the second electronic device 306 to detect user input and / or one or more objects in the physical environment). Furthermore, as... Figures 3A to 3KAs shown, the first electronic device 301 includes a display 320 (e.g., having one or more characteristics of display 120 and / or display generating component 214A), and the second electronic device 306 includes a display 308 (e.g., having one or more characteristics of display generating component 214B). In some examples, the display 320 includes multiple display generating components (e.g., the first electronic device 301 is a head-mounted display including two stereoscopic displays). The display 320 is optionally a passive display that presents content rendered by the second electronic device 306 (e.g., image and / or video content). In some examples, the display 308 is a touch-sensitive display. For example, the display 308 includes a display generating component (e.g., having one or more characteristics of display generating component 214B) forming a touch-sensitive display (e.g., a touchscreen integrated with the second electronic device 306 and communicating with the first electronic device 301 and the second electronic device 306) and a touch-sensitive surface (e.g., having one or more characteristics of touch-sensitive surface 209B). For example, the display 308 is configured to detect one or more touch inputs (e.g., by...). Figure 3A (Touch gestures represented by touch positioning 310a to 310b in the text).

[0051] exist Figures 3A to 3K In this context, environment 300 is visible via display 320. In some examples, environment 300 is a three-dimensional environment presented to the user of the first electronic device 301 via display 320. In some examples, environment 300 is an XR environment having one or more characteristics of an extended reality (XR) environment as described above. For example, one or more virtual elements (e.g., video content 304) are presented in environment 300 from the current viewpoint of the user of the first electronic device 301, while one or more physical objects from the user's physical environment (e.g., real-world window 302) are visible (e.g., through video perspective or optical perspective of the physical environment).

[0052] Figure 3A An example is illustrated of a first electronic device 301 presenting video content 304 in an environment 300. In some examples, the video content 304 corresponds to media presented within a virtual window and / or virtual object in the environment 300. In some examples, the video content 304 includes video and audio content (e.g., the computing system causes the video content 304 to be played back in the environment 300, including outputting audio associated with the video content 304 via one or more audio output devices of the first electronic device 301). For example, the video content 304 is a movie, a television program, a live broadcast (e.g., associated with a streaming service), or online video (e.g., associated with social media and / or video sharing services). It should be understood that in some examples, the computing system, in reference to... Figures 3A to 3KThe entire example shown and described maintains the playback of video content 304 (e.g., including the output of audio associated with video content 304).

[0053] In some examples, the first electronic device 301 presents the video content 304 in a head-locked and / or tilt-locked orientation (e.g., as described above). Alternatively, in some examples, the first electronic device 301 presents the video content 304 in a body-locked, world-locked, and / or tilt-locked orientation. The video content 304 is optionally rendered by the second electronic device 306 and displayed on the first electronic device 301 via a display 320 (e.g., the display 320 is a passive display).

[0054] like Figure 3A As shown, when the first electronic device 301 presents video content 304 in environment 300, the second electronic device 306 does not present video content 304. Optionally, when the first electronic device 301 presents video content 304, the second electronic device 306 operates in a power-saving state. In some examples, in the power-saving state, the second electronic device 306 operates the display 308 in an inactive state. For example, operating the display 308 in an inactive state includes turning off the display 308 (e.g., abandoning the display of content on the display 308). For example, operating the display 308 in an inactive state includes reducing the refresh rate of the display 308. For example, operating the display 308 in an inactive state includes reducing the brightness, color, and / or saturation of the content presented by the display 308. In some examples, when operating in the power-saving state, the second electronic device 306 is configured to detect touch input at the display 308 (e.g., touch gestures represented by touch locations 310a to 310b). When video content 304 is presented on the first electronic device 301, the second electronic device 306 operates in a power-saving state to save computing resources and conserve the battery life of the computing system by avoiding active operation of the display 308 when the user of the computing system intends to view the video content 304 on the first electronic device 301.

[0055] exist Figure 3A In this process, a touch gesture is detected at the second electronic device 306. In some examples, the touch gesture corresponds to a swipe gesture (e.g., a downward swipe) detected from touch location 310a to touch location 310b. For example, the touch gesture is performed by an object (e.g., the user's finger and / or stylus of the second electronic device 306). In some examples, based on the determination that the touch gesture detected at the second electronic device 306 meets one or more criteria, the computing system transmits video content 304 from the first electronic device 301 to the second electronic device 306 (e.g., as shown in the image). Figure 3B(As shown). For example, one or more criteria include criteria that are met when a touch gesture corresponds to a gesture of a corresponding type. For example, the corresponding type of gesture is a swipe gesture (e.g., including a specific (e.g., defined) direction (e.g., down), speed, and / or duration). For example, the corresponding type of gesture is a tap gesture (e.g., a multi-tap gesture or a tap and hold gesture for a specific (e.g., defined) duration (e.g., 0.1 seconds, 0.2 seconds, 0.5 seconds, 1 second, 2 seconds, 5 seconds, or 10 seconds). In some examples, the corresponding type of gesture is a system-defined gesture (e.g., a default gesture assigned to control content transfer between devices of the computing system (e.g., stored in the memory of one or more devices of the computing system)). In some examples, the corresponding type of gesture is a user-defined gesture (e.g., a gesture created and / or assigned by a user for controlling content transfer between devices of the computing system (e.g., stored in and / or associated with a user profile on one or more devices of the computing system)). In some examples, one or more criteria include criteria that are met when a touch gesture of a corresponding type is detected on a specific touch area of ​​the display 308 of the second electronic device 306 (e.g., as referenced). Figures 5A to 5D The display 508 of the second electronic device 506 is shown and described. In some examples, based on the determination that a touch gesture detected at the second electronic device 306 does not meet one or more criteria, the computing system abandons the transmission of the presentation of video content 304 from the first electronic device 301 to the second electronic device 306 (e.g., and optionally performs different operations, as referenced). Figures 3D to 3E (As shown and described). By establishing one or more criteria that need to be met to transmit the presentation of video content 304 from the first electronic device 301 to the second electronic device 306, the computing system ensures that the user intends to transmit video content 304 to the second electronic device 306 before performing the transmission. This reduces errors in user interaction and saves computing resources associated with correcting (e.g., by adding user input) unintended transmissions of video content 304.

[0056] Alternatively, in some examples, a second electronic device 306 (via display 308) presents virtual elements that can be selected to transfer video content 304 from the first electronic device 301 to the second electronic device 306 (e.g., the virtual elements have a reference...). Figure 3B (One or more features of the optional option 316 shown and described). For example, in response to detecting a touch input corresponding to a selection of a virtual element, the computing system transmits video content 304 from the first electronic device 301 to the second electronic device 306.

[0057] Figure 3B An example is given of the computing system responding to... Figure 3AThe touch gesture detected at the second electronic device 306 transmits the presentation of video content 304 from the first electronic device 301 to the second electronic device 306. For example, according to the determination by... Figure 3A If the touch gesture detected by the second electronic device 306 meets one or more of the criteria described above (e.g., the computing system determines that the touch gesture corresponds to a downward swipe gesture detected at the second electronic device 306), the computing system transmits video content 304 from the first electronic device 301 (e.g., via display 320) to the device that is presented (e.g., displayed) on the second electronic device 301. Figure 3B On the second electronic device 306 (e.g., via display 308). For example... Figure 3B As shown, transmitting video content 304 from the first electronic device 301 to the second electronic device 306 includes stopping the presentation of video content 304 on the first electronic device 301 via display 320 (e.g., in environment 300) and displaying video content 304 on the second electronic device 306 via display 308. In some examples, presenting video content 304 on the first electronic device 301 includes rendering video content 304 using the second electronic device 306 (e.g., the second electronic device 306 transmits images and / or video associated with video content 304 to the first electronic device 301), and transmitting video content 304 from the first electronic device 301 to the second electronic device 306 includes stopping the transmission of images and / or video associated with video content 304 from the second electronic device 306 to the first electronic device 301 (e.g., and displaying video content 304 on the second electronic device 306 via display 308).

[0058] In some examples, the transmission of the presentation of video content 304 from the first electronic device 301 to the second electronic device 306 includes a presentation transition. In some examples, the transition includes animation presented on the first electronic device 301 and / or the second electronic device 306. For example, the presentation animation includes gradually stopping the presentation of video content 304 in the environment 300 (e.g., over a period of time (e.g., 0.1 seconds, 0.2 seconds, 0.5 seconds, 1 second, 2 seconds, 5 seconds, or 10 seconds) by fading out video content 304 in the environment 300 (e.g., reducing the opacity of the video content)). Additionally or alternatively, for example, the presentation animation includes gradually presenting video content 304 on the second electronic device 306 (e.g., after stopping the presentation of video content 304 on the first electronic device 301 by fading in video content 304 at the display 308 (e.g., increasing the opacity of the video content))). For example, the rendering animation includes cross-fading the presentation of video content 304 between the first electronic device 301 and the second electronic device 306 (e.g., by fading out the presentation of video content 304 on display 308 (e.g., reducing its opacity) while fading in the presentation of video content 304 on display 320 (e.g., increasing its opacity)). Additionally or alternatively, for example, the rendering animation includes moving video content 304 in environment 300 (e.g., from the user's current viewpoint of the first electronic device 301) toward a position in environment 300 corresponding to the second electronic device 306 (e.g., the second electronic device 306 is positioned downwards from the user's current viewpoint of the first electronic device 301, and the rendering of the video content 304 includes moving the video content 304 downwards toward the position of the second electronic device 306). Additionally or alternatively, for example, the rendering animation includes moving the display position of video content 304 on display 308 (e.g., in a direction corresponding to the movement of video content 304 presented by the first electronic device 301 in environment 300 (e.g., downwards toward the center of display 308)). Additionally or alternatively, for example, rendering the animation includes changing the size of the video content 304 in environment 300 and / or on display 308 (e.g., the computing system reduces the size of the video content 304 in environment 300 (e.g., until the first electronic device 301 stops rendering the video content 304 in environment 300) and / or increases the display size of the video content 304 on display 320 (e.g., until the second electronic device 306 renders the video content 304 at full size)). In some examples, the animation includes references Figure 3I One or more characteristics of the animation shown and described.

[0059] In some examples, such as Figure 3B As shown, the transmission of video content 304 from the first electronic device 301 to the second electronic device 306 includes audio output, which is provided by... Figure 3BThe sound wave 312a is schematically represented. For example, in one or more audio output devices of the first electronic device 301 (e.g., having a reference...). Figure 2A Audio output is performed at one or more of the characteristics of the speaker 216A described. For example, audio output is performed at one or more audio output devices (e.g., headphones (e.g., wireless headphones)) that communicate with the first electronic device 301. For example, the audio output provides the user of the computing system with audio feedback that content is being transmitted between the first electronic device 301 and the second electronic device 306 (e.g., the audio output is independent of and / or separate from the audio output associated with the playback of the video content 304).

[0060] Additionally or alternatively, in order to enable audio output to indicate the transfer of content from the first electronic device 301 to the second electronic device 306, the computing system causes one or more characteristics of the audio output associated with the playback of video content 304 to be altered. For example, transferring video content 304 from the first electronic device 301 to the second electronic device 306 includes changing the spatial location of the audio associated with video content 304 in the environment 300 (e.g., changing the location where the audio associated with video content 304 is emitted in the environment 300 from the perspective of the user of the first electronic device 301). For example, in Figure 3A In the video content 304, audio associated with it is emitted from a position corresponding to the virtual window that renders the video content 304 within the environment 300, and... Figure 3B In this context, audio associated with video content 304 is emitted from a location in environment 300 corresponding to the second electronic device 306. In some examples, the first electronic device 301 transitions the output when the output location of the audio associated with video content 304 is changed. For example, the first electronic device 301 transitions the audio output associated with video content 304 by fading out the audio at the initial location of video content 304 in environment 300 (e.g., decreasing its volume) and continuously or simultaneously fading in the audio at a new location in environment 300 corresponding to the second electronic device 306 (e.g., increasing its volume). (For example, the first electronic device 301 transitions the audio output until the audio reaches a final volume (e.g., a volume level after which the volume no longer increases, optionally the volume of the audio output before the transition)). In some examples, transitioning the audio output associated with playback of video content 304 includes spatially expanding or reducing the audio (e.g., by changing the three-dimensional size of the audio and / or by changing the sound field of the audio). Additionally or alternatively, transmitting video content 304 from the first electronic device 301 to the second electronic device 306 includes converting audio output from the first electronic device 301 to audio output from the second electronic device 306 (e.g., as referenced). Figures 3G to 3H(As shown and described). Additionally or alternatively, transmitting video content 304 from the first electronic device 301 to the second electronic device 306 includes providing haptic feedback at the second electronic device 306.

[0061] In some examples, and as used herein, the system is capable of outputting spatial audio in sound fields of varying sizes. The corresponding simulated sound fields have associated virtual speaker layouts; as used herein, "sound field" refers to the corresponding layout of the virtual speakers, including the number and / or positioning of the virtual speakers used to represent the spatial audio. In some examples, the sound fields simulate spatial audio playback in rooms of different sizes and / or with speaker setups of different sizes. For example, a large sound field sounds like spatial audio being played in a movie theater, where the spatial audio speakers are positioned at a relatively large distance from the user of the first electronic device 301. As another example, a medium sound field sounds like spatial audio being played in a home theater, where the spatial audio speakers are positioned at a smaller distance from the user of the first electronic device 301 compared to the simulated speaker distances associated with a large sound field. Additionally or alternatively, in some examples, a medium sound field sounds like audio being played on fewer simulated speakers than a large sound field. As another example, a small sound field sounds like spatial audio being played from a source that is more localized than a medium sound field, such as a stereo speaker setup positioned at the location of visual content associated with the audio content. In some examples, a small sound field includes fewer analog speakers, analog speakers positioned closer together to each other, and / or analog speakers closer to the user, compared to analog speakers with medium and / or large sound fields.

[0062] In some examples, transmitting the presentation of video content 304 from the first electronic device 301 to the second electronic device 306 includes maintaining the playback state of the video content 304. For example, when the second electronic device 306 detects that the video content 304 has been played back, the playback state of the video content 304 is maintained. Figure 3A When a touch gesture, represented by touch positioning 310a to 310b, is received, video content 304 is played back in environment 300, and the presentation of video content 304 is transmitted to the second electronic device 306, including maintaining playback (e.g., continuing playback) of video content 304 on the second electronic device 306. Alternatively, in some examples, transmitting the presentation of video content 304 from the first electronic device 301 to the second electronic device 306 includes pausing the playback of video content 304 (e.g., the second electronic device 306 pausing playback in response to detecting a touch gesture). Figure 3B The playback control 318 shown includes one or more selectable options for resuming playback of video content 304.

[0063] exist Figure 3B In this context, the second electronic device 306 simultaneously presents video content 304 with one or more virtual elements. For example, in... Figure 3B In this configuration, video content 304 is presented along with playback controls 318 (e.g., including multiple selectable options for controlling playback of video content 304). In some examples, video content 304 is presented along with options that can be selected to transfer video content 304 from a second electronic device 306 to a first electronic device 301. For example, as... Figure 3B As shown, video content 304 is presented together with selectable option 316. In some examples, selectable option 316 is presented by the second electronic device 306 as an indication (e.g., including text and / or icons to visually indicate that selecting selectable option 316 will cause video content 304 to be transmitted from the second electronic device 306 to the first electronic device 301).

[0064] Figure 3C An example is illustrated by a second electronic device 306 that detects touch input 322 corresponding to a selection of selectable option 316. For example, touch input 322 is a tap input detected on display 308 at a location corresponding to selectable option 316. In some examples, touch input 322 corresponds to a request to transfer video content 304 from the second electronic device 306 to the first electronic device 301. Alternatively, in some examples, the request to transfer video content 304 from the second electronic device 306 to the first electronic device 301 includes satisfying one or more second-standard touch gestures (e.g., touch gestures including the corresponding type of gesture, such as swipe up, etc.) for transferring the presentation of the corresponding content from the second electronic device 306 to the first electronic device 301. Figure 4G (touch gestures shown and described). Alternatively, in some examples, a request to transfer video content 304 from a second electronic device 306 to a first electronic device 301 includes input detected on the first electronic device 301 that satisfies one or more second criteria for transferring the presentation of the corresponding content from the second electronic device 306 to the first electronic device 301 (e.g., the input includes air gestures and / or selection of selectable options presented in the environment 300).

[0065] In some examples, in response to touch input 322, the computing system transmits video content 304 from the second electronic device 306 to... Figure 3DThe first electronic device 301 in the system. For example, the presentation of video content 304 from the second electronic device 306 to the first electronic device 301 includes one or more features as described above for the presentation of video content 304 from the first electronic device 301 to the second electronic device 306 (e.g., the computing system presents transitions, animations, and / or audio outputs when the presentation of video content 304 is transmitted from the second electronic device 306 to the first electronic device 301). In some examples, the presentation of video content 304 from the second electronic device 306 to the first electronic device 301 includes the same location where the first electronic device 301 presents video content 304 before the presentation of video content 304 is transmitted to the second electronic device 306 (e.g., Figure 3A The positioning of the video content 304 shown is such that the video content 304 is presented in the environment 300 (e.g., the same positioning corresponds to a position and / or orientation (e.g., relative to the environment 300 and / or relative to the user's current viewpoint relative to the first electronic device 301)). Transmitting the presentation of the video content 304 from the second electronic device 306 to the first electronic device 301 optionally includes providing a reference... Figure 3B Audio output with one or more characteristics shown and described (e.g., audio output including changing the spatial location of audio associated with video content 304 from the location associated with the second electronic device 306 to a different location in the three-dimensional environment 300).

[0066] Figure 3D A second electronic device 306 is illustrated, which detects touch gestures (represented by touch locations 324a to 324b). For example, Figure 3D The touch gesture shown is related to Figure 3A The touch gestures shown are of different types (e.g., Figure 3A The touch gestures shown that satisfy one or more standards for the presentation of video content 304 are vertical swipe gestures (e.g., swipe down), and Figure 3D The touch gesture shown is a horizontal swipe gesture (e.g., a swipe to the right). In some examples, Figure 3D The touch gestures shown do not meet one or more criteria for transmitting the presentation of video content 304 from the first electronic device 301 to the second electronic device 306 (e.g., the computing system does not respond to...). Figure 3D The detected touch gesture is used to transmit video content 304 because the touch gesture does not meet one or more of the presentation criteria used to transmit video content 304.

[0067] In some examples, the touch gesture detected at the second electronic device 306 is determined to meet one or more second criteria, which are different from the one or more criteria described above for the presentation of video content 304 (e.g., refer to...). Figure 3A The computing system performs operations different from transmitting the presentation of video content 304 from the first electronic device 301 to the second electronic device 306 (e.g., this operation includes modifying the presentation of video content 304 in the environment 300, as referenced). Figure 3E (As shown and described). For example, when a touch gesture corresponds to a reference... Figure 3A When a second corresponding type of gesture differs from the corresponding type of gesture shown and described, one or more second criteria are met. For example, the second corresponding type of gesture is a swipe gesture that includes a direction different from the corresponding type of gesture (e.g., the second corresponding type of gesture is a horizontal swipe gesture, and the corresponding type of gesture is a vertical swipe gesture). For example, the second corresponding type of gesture is a tap gesture, and the first corresponding type of gesture is a swipe gesture (or the first corresponding type of gesture is a tap gesture, and the second corresponding type of gesture is a swipe gesture). In some examples, the second corresponding type of gesture is a system-defined gesture (e.g., a default gesture assigned to perform an operation in environment 300, which is stored in the memory of one or more devices of the computing system). In some examples, the second corresponding type of gesture is a user-defined gesture (e.g., a gesture created and / or assigned by a user to perform an operation in environment 300 (e.g., stored in and / or associated with a user profile on one or more devices of the computing system)). In some examples, based on the determination that a touch gesture detected at the second electronic device 306 does not meet one or more second criteria, the computing system abandons the execution of an operation (e.g., and / or performs an operation of a different type). Different types of operations (e.g., the presentation of video content 304) or different operations (e.g., such as...) Figure 3E The modified video content 304 shown is assigned to different types of gestures detected at the second electronic device 306 to ensure that the user intends to perform the corresponding type of operation before performing the operation. This reduces errors in the interaction and saves computing resources associated with error correction.

[0068] Figure 3E An example is given of the computing system responding to... Figure 3D The presentation of video content 304 in the environment 300 is modified based on the touch gesture detected at the second electronic device 306. For example, according to the determination in Figure 3D The touch gesture detected at the second electronic device 306 in the system meets one or more of the second criteria described above, and the computing system modifies... Figure 3EThe presentation of video content 304 in environment 300 (e.g., modifying the presentation of video content 304 corresponds to an operation performed based on determining that a touch gesture satisfies one or more second criteria as described above). In some examples, modifying the presentation of video content 304 includes presenting video content 304 in picture-in-picture format. For example, the first electronic device 301 reduces the size of the presentation of video content 304 in environment 300 (e.g., with...). Figure 3D Compared to the size of the video content 304 shown. For example, the first electronic device 301 offsets the presentation of the video content 304 and / or moves the video content 304 to a new position in the environment 300 (e.g., from the user's current viewpoint of the first electronic device 301). In some examples, presenting the video content 304 in picture-in-picture includes maintaining the playback state of the video content 304 (e.g., continuing to play back the video content 304 in the environment 300). In some examples, modifying the presentation of the video content 304 includes animing the transition of the video content 304 to a picture-in-picture state in the environment 300 (e.g., by gradually (e.g., over a period of time, such as 0.1 seconds, 0.2 seconds, 0.5 seconds, 1 second, 2 seconds, 5 seconds, or 10 seconds) reducing the size of the video content 304 in the environment 300 and / or moving the video content). In some examples, presenting the video content 304 in picture-in-picture includes providing audio output (e.g., with reference). Figure 3B (One or more characteristics of the audio output shown and described). For example, the audio output includes transferring the spatial location of the video content 304 from... Figure 3D The position of video content 304 in environment 300 shown has been changed. Figure 3D The location of video content 304 in environment 300 shown.

[0069] In some examples, in response to the computing system detecting a third corresponding type of gesture at the second electronic device 306 when the first electronic device 301 is presenting video content 304 in a modified state, the first electronic device 301 stops presenting video content 304 in picture-in-picture mode. For example, the third corresponding type of gesture differs from the second corresponding type of gesture (e.g., the third corresponding type of gesture includes a swipe gesture in the opposite direction (e.g., to the left) to the second corresponding type of gesture). For example, stopping the presentation of video content 304 in picture-in-picture mode includes... Figure 3D The state shown presents video content 304 (e.g., at its size and / or position prior to detecting a touch gesture that satisfies one or more second criteria for modifying the presentation of video content 304 in environment 300). For example, in response to detecting a third corresponding type of gesture, the first electronic device 301 increases the size of video content 304 in environment 300 and / or moves the video content (e.g., moves it to...). Figure 3D (Size and / or positioning shown).

[0070] Figure 3F An example is illustrated by a second electronic device 306 detecting a touch gesture (represented by touch positioning 326a to 326b) corresponding to a third corresponding type of gesture (e.g., as described above). For example, the touch gesture includes... Figure 3D The second corresponding type of gesture shown and described is a horizontal swipe gesture in a different direction (e.g., opposite direction). In some examples, Figure 3F The touch gesture shown corresponds to moving the presentation of video content 304 in environment 300 from picture-in-picture mode. Figures 3E to 3F (as shown) is transformed to an increased rendering size (e.g., as shown) Figures 3A to 3D (as shown in the image) request. In some examples, in response to detecting... Figure 3F The touch gesture shown causes the computing system to display video content 304 at an increased rendering size in the environment 300 via display 320, such as... Figure 3G As shown. The rendering of video content 304 will be changed from... Figure 3F The picture-in-picture state in the middle changes to Figure 3G The increased presentation size may optionally include changing one or more characteristics of the audio output associated with the playback of video content 304 (e.g., changing the spatial position of the audio and / or sound field to correspond to the change in position and / or size of video content 304 from picture-in-picture state to increased presentation size).

[0071] Figure 3G An example is illustrated where a computing system detects a touch gesture at a second electronic device 306. In some examples, the touch gesture is a swipe gesture (e.g., a downward swipe) detected from touch location 328a to touch location 328b. Figure 3G The touch gesture detected at the second electronic device 306 optionally has the capability to... Figure 3A One or more characteristics of the touch gesture detected at the second electronic device 306. In some examples, Figure 3G The touch gestures shown satisfy one or more criteria for transferring video content 304 from the first electronic device 301 to the second electronic device 306, as described above. In some examples, based on determining that the touch gestures satisfy one or more criteria for transferring video content 304 from the first electronic device 301 to the second electronic device 306, the computing system causes the video content 304 to be displayed at the second electronic device 306, such as... Figure 3H As shown.

[0072] In some examples, transmitting video content 304 from a first electronic device 301 to a second electronic device 306 includes transmitting audio output associated with the playback of video content 304 from one or more first audio output devices of the first electronic device 301 (e.g., included in and / or communicating with the first electronic device) to one or more second audio output devices of the second electronic device 306 (e.g., included in and / or communicating with the second electronic device). For example, as Figure 3G As shown, when the computing system presents video content 304 in environment 300 at the first electronic device 301, the computing system outputs audio (represented by sound wave 312b) via one or more first audio output devices of the first electronic device 301 (e.g., speaker 216A described above). Furthermore, for example, as... Figure 3H As shown, when the computing system presents video content 304 at the second electronic device 306 (e.g., after the computing system transfers video content 304 from the first electronic device 301 to the second electronic device 306), the computing system causes audio (represented by sound wave 312c) to be output via one or more second audio output devices of the second electronic device 306 (e.g., speaker 216B described above). In some examples, transferring the audio output associated with the playback of video content 304 from the first electronic device 301 to the second electronic device 306 includes converting the audio output from one or more first audio output devices of the first electronic device 301 to one or more second audio output devices of the second electronic device 306 (e.g., as referenced). Figure 3I (As shown and described). Alternatively, transmitting video content 304 from the first electronic device 301 to the second electronic device 306 includes maintaining audio output associated with playback of video content 304 via one or more first audio output devices of the first electronic device 301. For example, during the transmission of video content 304, the computing system alters one or more characteristics of the audio output associated with playback of video content 304 via one or more first audio output devices of the first electronic device 301 (e.g., as referenced above). Figures 3A to 3B The transmission of video content 304 from the first electronic device 301 to the second electronic device 306 is described in the text.

[0073] In some examples, audio will be output using the first electronic device 301 (such as in...). Figure 3G (in) is converted to output audio (such as in) using a second electronic device 306. Figure 3HThe system (in the context of the transition) includes using a first electronic device 301 and / or a second electronic device 306 to play a transition effect. For example, the system uses a crossfade effect to transition the audio output from the first electronic device 301 to the second electronic device 306. The crossfade effect optionally includes gradually decreasing the output volume of the audio played by the first electronic device 301 while gradually increasing the output volume of the audio played by the second electronic device 306. By gradually decreasing the volume of the audio output by the second electronic device 306 while gradually increasing the volume of the audio output by the first electronic device 301, the system can similarly transition from audio played by the second electronic device 306 to audio played by the first electronic device 301 with a crossfade effect.

[0074] As another example, the system uses the first electronic device 301 to output what sounds like audio is coming from... Figure 3G The audio position in the middle is moved to Figure 3H Spatial audio transformation of audio location within the audio. For example, in Figure 3G In the middle, the first electronic device 301 plays spatial audio that sounds as if it is being played from the position where the video content 304 is displayed on the first electronic device 301, and in Figure 3H In this process, the second electronic device 306 plays the audio content of the video content 304 from its position. Additionally or alternatively, in some examples, the first electronic device 301 plays spatial audio that sounds as if it is being played from the position of the second electronic device 306, while the second electronic device 306 presents... Figure 3H The visual content of video content 304 in [the context of video content]. In some examples, in response to transferring video content 304 from a first electronic device 301 (such as [the device]... Figure 3G (middle) transmits to the second electronic device 306 (such as in Figure 3H (in Chinese), the system is playing audio content that sounds like video content, but a 304 error is occurring. Figure 3G Move the audio output position to Figure 3H The spatial audio of the audio output location. In some examples, in response to transmitting video content 304 from a third electronic device 306 (such as in...) Figure 3H (middle) transmits to the first electronic device 301 (such as in Figure 3G (in Chinese), the system is playing audio content that sounds like video content, but a 304 error is occurring. Figure 3H Move the audio output position to Figure 3G Spatial audio at the audio output location.

[0075] In some examples, the system uses the first electronic device 301 to play transitions that sound like audio is moving. In some examples, the first electronic device 301 estimates or infers the position of the second electronic device 306; for example, the first electronic device 301 infers that the second electronic device 306 is located at an angle perpendicular to the user's face and at a corresponding angle below the user's head. As another example, the system uses one or more sensors of the first electronic device 301 and / or one or more sensors of the second electronic device 306 to determine the position of the second electronic device 306. The first electronic device 301 optionally uses the estimated, inferred, and / or determined position of the second electronic device 306 to output spatial audio, such as analog audio, that sounds like it is coming from or moving to the position of the second electronic device 306 or moving from that position. Figure 3H The second electronic device 306 presents the audio of the video content 304, which is a moving audio transformation.

[0076] exist Figure 3H In this context, the computing system detects touch gestures (represented by touch positioning 332a to 332b) that satisfy one or more second criteria (e.g., optionally different from one or more criteria for transmitting the presentation of video content 304 from the first electronic device 301 to the first electronic device 301) for transmitting the presentation of video content 304 from the second electronic device 306 to the first electronic device 301. In some examples, the one or more second criteria for transmitting the presentation of video content 304 from the second electronic device 306 to the first electronic device 301 have a reference... Figure 4G The description describes one or more features of one or more second standards for transmitting a virtual keyboard 422 from a second electronic device 406 to a first electronic device 401. In some examples, in response to detecting a touch gesture at the second electronic device 306 that satisfies one or more second standards for transmitting video content 304 from the second electronic device 306 to the first electronic device 301, or in response to detecting touch input corresponding to a selection of selectable option 316, the computing system causes the presentation of video content 304 to be transmitted from the second electronic device 306 to the first electronic device 301. In some examples, in response to detecting a touch gesture that satisfies one or more second standards for transmitting the presentation of video content 304 from the second electronic device 306 to the first electronic device 301, the computing system causes the presentation of video content 304 to be transmitted from the second electronic device 306 to the first electronic device 310, such as... Figures 3I to 3J As shown.

[0077] Figures 3I to 3J An example is given of a computing system responding to the detection of... Figure 3HThe presentation of video content 304 is transferred from the second electronic device 306 to the first electronic device 301 via touch gestures. In some examples, such as... Figure 3I As shown, the transition of video content 304 from the second electronic device 306 to the first electronic device 301 includes a presentation animation. In some examples, the animation has the features described above. Figures 3A to 3B The presentation of the video content 304 shown describes one or more characteristics of the animation. In some examples, the animation includes movement of the presented video content 304. For example, when a user performs an up swipe gesture on the second electronic device 306 (e.g., Figure 3H When a touch gesture is displayed (as shown), the computing system moves the presentation position of the video content 304 upwards on the display 308 (e.g., until the second electronic device 306 stops presenting the video content 304 via the display 308). For example, as... Figures 3I to 3J As shown, and optionally simultaneously with and / or after moving the presentation position of video content 304 on display 320, the computing system renders the movement of video content 304 in the environment 300 via display 308 (e.g., moving video content 304 from the lower portion of the user's field of view to the center of the user's field of view). Figure 3I In the image, the movement of video content 304 within environment 300 is schematically represented by arrow 340.

[0078] Additionally or alternatively, in order to render the movement of video content 304 during animation, the computing system causes a change in the rendering size of video content 304. For example, when a user performs an upward swipe gesture on the second electronic device 306 (e.g., Figure 3H When a touch gesture is shown, the computing system reduces the display size of the video content 304 on the display 308 (e.g., until the second electronic device 306 stops displaying the video content 304 via the display 308), optionally simultaneously shifting the display position of the video content 304 upwards, as described above. For example, as Figures 3I to 3J As shown, the computing system increases the rendering size of video content 304 in environment 300 (e.g., simultaneously and / or after decreasing the rendering size of video content 304 on display 308), optionally while simultaneously shifting the rendering position of video content 304 upwards in environment 300, as described above. For example, as Figures 3I to 3J As shown, with Figure 3I The size of the video content 304 in the computer system (e.g., during animation) is compared to the size of the video content 304 in the computer system via the display 320. Figure 3J In the environment 300 (e.g., at the end of the animation), the video content 304 is presented at a larger size.

[0079] exist Figures 3I to 3JIn this process, the computing system changes the audio output associated with the playback of video content 304 from being output via one or more second audio output devices of the second electronic device 306 to being output via one or more first audio output devices of the first electronic device 301. In some examples, such as Figure 3I As shown, the first electronic device 301 outputs audio (represented by sound wave 312d) via one or more first audio output devices, while the second electronic device 306 simultaneously outputs audio (represented by sound wave 312e) via one or more second audio output devices. For example, changing the audio associated with the playback of video content 304 from being output by the second electronic device 306 to being output by the first electronic device 301 includes crossfading the audio between one or more second output devices and one or more first output devices. For example, crossfading includes fading out the audio output by one or more second audio output devices of the second electronic device 306 (e.g., reducing its volume) (e.g., until the second electronic device 306 stops outputting audio), while fading in the audio output by one or more first audio output devices of the first electronic device 301 (e.g., increasing its volume) (e.g., until the audio reaches a preset volume and / or the volume of the audio output by the first electronic device 301 before the presentation of video content 304 is transmitted to the second electronic device 306). Additionally or alternatively, in some examples, changing the output of audio associated with the playback of video content 304 from output by a second electronic device 306 to output by a first electronic device 301 includes spatially expanding the audio via one or more first audio output devices. For example, the computing system causes one or more first audio output devices to increase the three-dimensional size and / or sound field of the audio (e.g., the increase in the three-dimensional size and / or sound field of the audio corresponds to an increase in the size of the video content 304 in the environment 300 presented during animation).

[0080] Additionally or alternatively, in order to change the output of audio from one or more second audio output devices via second electronic device 306 to one or more first audio output devices via first electronic device 301, the computing system optionally outputs audio feedback to indicate that video content 304 is being transferred from second electronic device 306 to first electronic device 301. For example, the audio feedback is independent of and / or separate from the audio associated with the playback of video content 304. For example, the audio feedback is a sound effect output via one or more first audio output devices and / or one or more second audio output devices whenever content (e.g., video content 304) is transferred between first electronic device 301 and second electronic device 306 (e.g., the audio feedback optionally varies depending on whether the content is transferred from first electronic device 301 to second electronic device 306 or from second electronic device 306 to first electronic device 301). Outputting a sound effect separate from the audio associated with video content 304 during the transition optionally helps to mask the difference in audio output between second electronic device 306 and first electronic device 301 during the transition. Additionally or alternatively, transmitting video content 304 from the second electronic device 306 to the first electronic device 301 includes providing haptic feedback at the second electronic device 306.

[0081] In some examples, such as Figure 3J As shown, when the transmission of video content 304 from the second electronic device 306 to the first electronic device 301 is completed, the computing system causes the audio associated with the playback of video content 304 to be output via one or more first audio output devices of the first electronic device 301. For example, in Figure 3J In this context, the audio output associated with the playback of video content 304 is schematically represented by sound waves representing audio 312f. In some examples, playback and Figure 3J The video content 304 in the video is associated with audio that sounds like it comes from [source name missing]. Figure 3J The spatial audio of the location of the video content 304. Optionally, the first electronic device 301 plays the audio content in a small, medium, or large sound field as described above.

[0082] like Figure 3J As shown, when the first electronic device 301 is playing video content 304, the first electronic device 301 detects movement of the first electronic device 306 and / or the user of the first electronic device 301. For example, the user rotates to the right. In response to detecting movement of the first electronic device 301, the first electronic device 306 moves away from the first electronic device 306. Figure 3J The video content shown is presented in full size, then converted to a 304 format. Figure 3K The picture-in-picture element shown presents video content 304.

[0083] Figure 3K An example is illustrated where a first electronic device 301 presents video content 304 as a picture-in-picture element. In some examples, in response to the detection of a reference... Figure 3J The described movement involves electronic device 301 presenting video content 304 as a picture-in-picture element. In some examples, when... Figure 3K When the picture-in-picture element presents video content 304, the first electronic device 301 presents spatial audio corresponding to the audio content of the video content 304. The first electronic device 306 optionally presents spatial audio in a small sound field, sounding as if the audio is playing from a position corresponding to the visual content of the video content 304. For example, the spatial audio in... Figure 3K It is described as audio 312g.

[0084] In some examples, in response to detection Figure 3J The first electronic device 301 and / or the user's movement, the first electronic device 301 presents from the presentation Figure 3J The illustrated audio 312f to Figure 3K The audio transitions of the illustrated audio 312g. Audio transitions optionally include crossfade effects and / or spatial audio, moving from the position of audio 312f to the position of audio 312g according to examples of these transition effects described above.

[0085] In some examples, when in response to detecting movement of the first electronic device 301 and / or the user... Figure 3K When the picture-in-picture element displays video content 304, the first electronic device 301 detects movement to a position associated with the displayed video content 304, such as... Figure 3J As shown. For example, the first electronic device 301 detects that the first electronic device 301 and / or the user presents the first electronic device 301 and / or the user as shown. Figure 3J The video content shown at time 304 indicates a movement in its location. In some examples, in response to detecting this movement, the first electronic device 301 displays as shown... Figure 3J The video content 304 shown presents audio 312f and employs audio transition effects such as crossfade or spatial audio shifting. For example, the audio transition effect transforms the first electronic device 301 from presenting audio 312g to presenting audio 312f in a manner similar to the transition from presenting audio 312f to presenting audio 312g described above. In some examples, the transition from presenting audio 312g to presenting audio 312f includes presenting audio 312f with a medium or large soundstage, or with a small soundstage that sounds as if it is transitioning from... Figure 3J The audio at position 312f is played in the video content at position 304.

[0086] It should be understood that, with Figure 3KThe presentation of the picture-in-picture element shown, including the video content 304 and associated spatial audio 312g, is not limited to the situation where the first electronic device 301 presents the picture-in-picture element in response to detecting movement of the first electronic device 301 and / or the user, such as in... Figure 3J In the context of [the above text], for example, a first electronic device 301 presents a picture-in-picture element in response to detecting one or more inputs at the first electronic device 301 and / or in response to receiving an instruction for one or more inputs detected at the second electronic device 306. For example, in response to the second electronic device 306 detecting the above-mentioned [input]... Figure 3D The first electronic device 301 presents a reference based on the input described. Figures 3J to 3K Describes the spatial audio transformation effect.

[0087] Figures 4A to 4I Examples of computing systems according to this disclosure illustrate how a computing system modifies the display of virtual content on a first electronic device in response to one or more user inputs detected at a second electronic device. In some examples, the computing system includes a first electronic device 401 (e.g., having one or more characteristics of electronic devices 101, 201, and / or 301 described above) and a second electronic device 406 (e.g., having one or more characteristics of electronic devices 160, 260, and / or 306 described above). In some examples, the first electronic device 401 communicates with the second electronic device 406 (e.g., the second electronic device 406 is an auxiliary device and / or companion device communicating with the first electronic device 401).

[0088] In some examples, the first electronic device 401 includes a reference Figures 3A to 3K A display 420 having one or more characteristics of the display 320 shown and described. In some examples, a first electronic device 401 includes a reference... Figures 3A to 3K Image sensors 414a-414c, which have one or more characteristics of the image sensors 314a-314c shown and described, are also included. The first electronic device 401 optionally does not include image sensors 414a-414c. In some examples, the second electronic device 406 includes a reference... Figures 3A to 3K The display 408 has one or more characteristics of the display 308 shown and described (e.g., the display 408 is a touch-sensitive display).

[0089] exist Figures 4A to 4I In this context, environment 400 is visible via display 420. In some examples, environment 400 is a reference... Figures 3A to 3K A three-dimensional environment with one or more characteristics of the environment 300 shown and described.

[0090] Figure 4AAn example is illustrated where a first electronic device 401 presents application content 404 within an environment 400. In some examples, application content 404 corresponds to website content presented within a virtual window and / or virtual object within the environment 400. In some examples, application content 404 is associated with a corresponding application (such as an internet browsing application) that can be accessed via a computing system. Alternatively, in some examples, the corresponding application is another type of application, such as a video streaming application, a social media application, a messaging application, a video and / or audio telephony application, or a video game application. Figure 4A As shown, application content 404 is presented together with address bar 412. Address bar 412 is optionally displayed within a virtual object and / or virtual window in environment 400 that is the same as application content 404.

[0091] exist Figure 4A In this context, the first electronic device 401 displays a cursor 410 (virtual cursor) overlaid on application content 404 within the environment 400. For example... Figure 4A As shown, cursor 410 is rendered as a circle (e.g., with a shadow). Alternatively, in some examples, cursor 410 includes different shapes and / or appearances (e.g., cursor 410 is rendered as an arrow, and / or cursor 410 is rendered without a shadow and / or has a different color).

[0092] In some examples, the position of cursor 410 in environment 400 corresponds to the position and / or orientation of second electronic device 406. The computing system optionally uses one or more input devices of second electronic device 406 to determine the presentation position of cursor 410 on first electronic device 401, such as reference devices. Figure 2BThe described position sensor 204B, image sensor 206B, and / or orientation sensor 210B are described. For example, in response to detecting movement of the second electronic device 406 using one or more input devices (e.g., caused by movement of a user's hand holding the second electronic device 406), the computing system optionally moves the cursor 410 in the environment 400 according to the movement of the second electronic device 406 (e.g., the user holding the second electronic device 406 controls the movement of the cursor 410 in the environment 400 by the movement of the second electronic device 406). For example, the computing system allows multidimensional movement of the cursor 410 in the environment 400 (e.g., the computing system moves the cursor 410 vertically in response to vertical movement of the second electronic device 406 and / or moves the cursor horizontally in response to horizontal movement of the second electronic device 406). In some examples, the position of the cursor 410 in the environment 400 is restricted to an area defined by the application content 404. For example, the computing system renders the cursor 410 within a virtual window and / or virtual object that includes the application content 404 in the environment 400. For example, the computing system allows the cursor 410 to move in two dimensions (e.g., the computing system renders the cursor 410 in the environment 400 at a depth corresponding to the application content 404, and allows the cursor 410 to move horizontally and vertically within the application content 404).

[0093] Based on the determination that one or more criteria are met, the computing system optionally moves the cursor 410 in the environment 400 using the position and / or orientation of the second electronic device 406. In some examples, the one or more criteria include those met when movement of the second electronic device 406 is detected while the second electronic device 406 is held in a corresponding pose. Holding the second electronic device 406 in a corresponding pose optionally includes holding the second electronic device 406 such that a corresponding portion of the second electronic device 406 (e.g., a top portion, such as a top edge and / or a top surface) is oriented in a direction toward (e.g., pointing toward) the application content 404 in the environment 400. For example, the first electronic device 401 renders the cursor 410 as if the cursor 410 were projected from the top portion of the second electronic device 406 onto the application content 404 (e.g., the cursor 410 is rendered along a vector extending from the top surface of the second electronic device 406 to the application content 404). In some examples, the one or more criteria include those met when the second electronic device 406 operates in a corresponding mode. For example, the computing system presents a selectable option (e.g., on the first electronic device 401 and / or the second electronic device 406) that can be selected to operate the second electronic device 406 in a corresponding mode for controlling the movement of the cursor 410, and in response to detecting a selection of the selectable option, the computing system allows the cursor 410 to be controlled by the position and / or orientation of the second electronic device 406. When the second electronic device 406 is operated in the corresponding mode, the computing system optionally (e.g., on the first electronic device 401 and / or the second electronic device 406) presents a selectable option to stop operating the second electronic device 406 in the corresponding mode (e.g., and the computing system stops allowing the cursor 410 to be controlled by the position and / or orientation of the second electronic device 406 in response to detecting a selection of the selectable option).

[0094] exist Figure 4A In this process, the computing system detects the movement of the second electronic device 406. For example, as Figure 4A As shown, the second electronic device 406 is held by the hand 440 of the user of the computing system, and the user moves the hand 440 horizontally (e.g., to the left), as indicated by arrow 416. The movement of the second electronic device 406 optionally satisfies one or more of the criteria described above (e.g., the second electronic device 406 remains in a corresponding pose and / or the second electronic device 406 operates in a corresponding mode).

[0095] Figure 4B An example is given of the computing system responding to... Figure 4A The movement of the second electronic device 406 detected in the environment 400 causes the cursor 410 to move. For example... Figure 4B As shown, the first electronic device 401 is in environment 400 (e.g., within application content 404) and as Figure 4A The cursor 410 is displayed at different locations as shown (e.g., further to the left from the user's viewpoint of the first electronic device 401 based on the detected leftward movement of the second electronic device 406). In some examples, the first electronic device 401 maintains the display of the cursor 410 as it moves within the environment 400 (e.g., the first electronic device 401 displays the movement of the cursor 410 within the environment 400 when the movement of the second electronic device 406 is detected).

[0096] In some examples, when application content 404 is presented in environment 400, a touch gesture detected at the second electronic device 406 is determined to satisfy one or more criteria (e.g., having one or more characteristics of one or more criteria for transmitting the presentation of video content 304 from the first electronic device 301 to the second electronic device 306, as referenced). Figures 3A to 3K As described, the computing system transfers application content from a first electronic device 401 to a second electronic device 406. In some examples, one or more criteria for transferring the presentation of content from the first electronic device 401 to the second electronic device 406 (e.g., or optionally from the second electronic device 406 to the first electronic device 401) are defined by the corresponding application associated with the content. For example, content assigned to transfer content associated with a video streaming application (e.g., reference...) Figures 3A to 3K The touch gestures for presenting the video content 304 shown and described may differ from the touch gestures assigned to presenting content associated with a web browsing application (e.g., application content 404). Alternatively, for example, the presentation of content associated with a video streaming application may require corresponding touch gestures, and the presentation of content associated with a web browsing application may correspond to selectable options (e.g., presented on the first electronic device 401 and / or the second electronic device 406, such as references). Figures 3B to 3C The tap input selects the optional option 316 shown and described. By establishing one or more criteria that need to be met to transfer the presentation of application content 404 from the first electronic device 401 to the second electronic device 406, the computing system ensures that the user intends to transfer application content 404 to the second electronic device 406 before performing the transfer. This reduces errors in user interaction and saves computing resources associated with correcting (e.g., by adding user input) unintended transfers of video content 404.

[0097] Additionally or alternatively, in some examples, the corresponding application, such as the corresponding application associated with application content 404, can assign the corresponding touch gesture (or the corresponding type of touch gesture, such as a vertical swipe gesture) to different operations. For example, the web browsing application associated with application content 404 can assign a downward swipe gesture (e.g., refer to...) Figure 3A The touch gestures shown and described are assigned to transfer the presentation of application content 404 from the first electronic device 401 to the second electronic device 406 when application content 404 scrolls to the top of the webpage, and are assigned to scroll application content 404 upwards when application content 404 has not scrolled to the top of the webpage (e.g., in response to a down swipe gesture detected on the second electronic device 406, the computing system transfers application content 404 from the first electronic device 401 to the second electronic device 406 based on determining that application content 404 scrolled to the top of the webpage before the down swipe gesture was detected). It should be understood that, alternatively, a down swipe gesture may be assigned to scroll application content 404 downwards, and the computing system may transfer application content 404 from the first electronic device 401 to the second electronic device 406 when application content 404 has scrolled to the bottom of the webpage before the down swipe gesture is detected.

[0098] Alternatively, in some examples, the transfer of application content 404 from the first electronic device 401 to the second electronic device 406 is not permitted. In some examples, the corresponding application may not allow content to be transferred from the first electronic device 401 to the second electronic device 406. For example, a video streaming application (e.g., associated with video content 304) may allow content to be transferred between the first electronic device 401 and the second electronic device 406, and a web browsing application (e.g., associated with application content 404) may not allow content to be transferred between the first electronic device 401 and the second electronic device 406. In some examples, the corresponding application may only allow specific content to be transferred between the first electronic device 401 and the second electronic device 406. For example, a web browsing application associated with application content 404 may not allow the transfer of application content 404 from the first electronic device 401 to the second electronic device 406, but may allow the transfer of virtual input devices used for interacting with application content 404 from the first electronic device 401 to the second electronic device 406 (e.g., a virtual keyboard, such as a reference keyboard). Figures 4E to 4IThe virtual keyboard 422 shown and described. Optionally, it may be possible to transfer virtual input devices, such as the virtual keyboard 422 described below, between the first electronic device 401 and the second electronic device 406 independently of the corresponding application associated with the content presented on the first electronic device 401 and / or the second electronic device 406 (e.g., the transfer of virtual input devices is a system-defined setting rather than an application-defined setting).

[0099] Figure 4C An example is shown where the computing system scrolls down application content 404 in response to a detected touch gesture (represented by touch locations 416a to 416b). Figure 4C As shown, the touch gesture corresponds to an upward swipe gesture detected on the second electronic device 406. Figure 4C The touch gesture shown optionally does not meet one or more of the criteria described above for transferring the presentation of application content 404 from the first electronic device 401 to the second electronic device 406. For example, one or more criteria include those met when the computing system detects a down swipe input (optionally when application content 404 scrolls to the top of the currently presented webpage) (e.g., the computing system does not transfer the presentation of application content 404 from the first electronic device 401 to the second electronic device 406). Figure 4C The first electronic device 401 transmits data to the second electronic device 406 because the touch input corresponds to an upward swipe input rather than a downward swipe input. For example, one or more criteria include those that are met when the computing system detects a vertical swipe input of a specific length and / or duration (e.g., the computing system does not transfer application content 404 from...). Figure 4C The first electronic device 401 transmits data to the second electronic device 406 because the upward swipe input from touch position 416a to touch position 416b does not include a length and / or duration that meets the criteria. Alternatively or additionally, the computing system does not transmit application content 404 from the first electronic device 401 to the second electronic device 406 because the corresponding application associated with application content 404 (e.g., a web browsing application) does not allow application content 404 to be transmitted between the first electronic device 401 and the second electronic device 406, as described above.

[0100] Figure 4D An example is shown where the computing system detects touch input 418 corresponding to a selection on address bar 412. For example, in Figure 4C and Figure 4D In between, the computing system moved cursor 410 from Figure 4C Move the position in environment 400 shown to Figure 4D The location shown corresponds to address bar 412 (e.g., based on reference). Figures 4A to 4B(Movement of the second electronic device 406 shown and described). For example, when cursor 410 is presented in the environment 400 at the location corresponding to address bar 412, the computing system detects touch input 418 on the second electronic device 406. In some examples, touch input 418 corresponds to tap input, long touch input (e.g., touch input exceeding a threshold duration (e.g., 0.1 seconds, 0.2 seconds, 0.5 seconds, 1 second, 2 seconds, 5 seconds, or 10 seconds)), or multi-tap input (e.g., double-tap or triple-tap touch input).

[0101] In some examples, address bar 412 corresponds to a virtual element that can be selected to enter text. For instance, after selecting address bar 412, a user of the computing system can use a virtual keyboard to enter text (e.g., a web address) into address bar 412 to navigate to different websites.

[0102] Figure 4E An example is given of a computing system responding to the detection of... Figure 4D Touch input 418 selects the address bar 412 and displays a virtual keyboard 422 on the second electronic device 406. For example... Figure 4E As shown, the computing system automatically (e.g., without additional and / or subsequent user input) presents a virtual keyboard 422 on the second electronic device 406 in response to the detection of touch input 418 (e.g., corresponding to a request to select address bar 412). Alternatively, in some examples, the computing system presents the virtual keyboard 422 in environment 400 in response to the detection of touch input 418 (e.g., and the virtual keyboard 422 may be transmitted to the second electronic device 406 in response to the detection of touch input that satisfies one or more criteria for transmitting the presentation of the virtual keyboard 422 from the first electronic device 401 to the second electronic device 406, as referenced). Figure 4I (As described).

[0103] like Figure 4E As shown, the computing system changes one or more visual characteristics of the application content 404 in the environment 400 (e.g., with) in response to the selection of the address bar 412. Figures 4A to 4D Compared to the example shown, the change in one or more visual characteristics of application content 404 is due to... Figure 4E(Different shaded representations of application content 404 in the context of the application). For example, the computing system modifies the color, saturation, brightness, sharpness, and / or opacity of application content 404 in response to a selection of address bar 412. Optionally, the computing system may modify one or more visual characteristics of application content 404 without modifying the visual appearance of address bar 412 (e.g., address bar 412 is rendered with a greater brightness than application content 404 (e.g., making text entered into address bar 412 visible to the user of first electronic device 401)). Alternatively, in some examples, the computing system maintains the visual appearance of application content 404 in environment 400 in response to a selection of address bar 412 (e.g., the computing system maintains the rendering of application content 404 in environment 400 without changing one or more visual characteristics of application content 404). Alternatively, in some examples, the computing system stops rendering application content 404 (and optionally address bar 412) in environment 400 in response to a selection of address bar 412 (e.g., to save computing resources by limiting the rendering of content in environment 400 when the user's attention might be directed to virtual keyboard 422 on second electronic device 406). Alternatively or additionally, in some examples, the computing system transfers application content 404 from first electronic device 401 to second electronic device 406 in response to a selection of address bar 412 (e.g., second electronic device 406 renders application content 404 and / or address bar 412 in an area of ​​display 408 above virtual keyboard 422).

[0104] Figure 4F An example is illustrated where the computing system detects touch input 424 on a second electronic device 406 corresponding to a selection of a key (e.g., the "W" key) on a virtual keyboard 422. In some examples, interaction with the virtual keyboard 422 on the second electronic device 406 (e.g., via user input) controls text input into the address bar 412 on the first electronic device 401 in the environment 400. For example, touch input 424 corresponds to a request to input the character "W" into the address bar 412 in the environment 400. In some examples, in response to detecting touch input 424 on the second electronic device 406, the computing system outputs audio and / or haptic feedback via the second electronic device 406. For example, as... Figure 4FAs shown, the second electronic device 406 outputs audio output (represented by sound wave 432) corresponding to user interface sound effects (e.g., sound effects associated with typing on the virtual keyboard 422) via one or more audio output devices of the second electronic device 406. Additionally or alternatively, in some examples, in response to detecting a key selection on the virtual keyboard 422 when it is presented on the first electronic device 301 via the display 420, the computing system causes audio feedback to be output via one or more audio output devices of the first electronic device 401.

[0105] Figure 4G An example is given of a computing system responding to the detection of... Figure 4F The touch input 424 inputs text into the address bar 412 in the environment 400. For example... Figure 4G As shown, the first electronic device 401 displays the character "W" in the address bar 412 of the environment 400.

[0106] In some examples, the computing system transmits the virtual keyboard 422 from the second electronic device 406 to the first electronic device 401 based on the determination that the touch input detected on the second electronic device 406 satisfies one or more second criteria (e.g., optionally different from one or more criteria used to transfer the presentation of application content 404 from the first electronic device 401 to the second electronic device 406). For example, one or more second criteria include criteria that are satisfied when a touch gesture corresponding to a corresponding type of touch gesture (e.g., an up swipe) is detected on the second electronic device 406. For example, one or more second criteria include criteria that are satisfied when a touch gesture is detected on the second electronic device 406 in a corresponding area of ​​the display 408 (e.g., in the area of ​​the display 408 shown above the virtual keyboard 422). In some examples, one or more second criteria have one or more characteristics of one or more criteria described above (e.g., criteria satisfied when the touch gesture includes a corresponding direction, duration, and / or length). Alternatively, based on the determination that the input detected at the first electronic device 401 meets one or more second criteria (e.g., the input corresponds to an air gesture and / or a selection of selectable options presented in the environment 400), the computing system transmits the virtual keyboard 422 from the second electronic device 406 to the first electronic device 401. By establishing one or more requirements that need to be met to transmit the presentation of the virtual keyboard 422 from the second electronic device 406 to the first electronic device 401, the computing system ensures that the user intends to transmit the virtual keyboard 422 to the first electronic device 401 before performing the transmission. This reduces errors in user interaction and saves computing resources associated with correcting (e.g., by attaching user input) unintended transmissions of the virtual keyboard 422.

[0107] like Figure 4GAs shown, the computing system detects touch gestures (represented by touch locations 426a to 426b) on the second electronic device 406. For example, a touch gesture is an upward swipe gesture detected in the area of ​​the display 408 above the virtual keyboard 422. Figure 4G The touch gestures shown optionally satisfy one or more second criteria for transmitting the presentation of the virtual keyboard 422 from the second electronic device 406 to the first electronic device 401. For example, Figure 4G The illustrated touch gesture corresponds to a request to transfer the virtual keyboard 422 from the second electronic device 406 to the first electronic device 401. Alternatively, in some examples, the second electronic device 406 presents a selectable option that can be selected to transfer the virtual keyboard 422 from the second electronic device 406 to the first electronic device 401 (e.g., with reference to...). Figures 3B to 3C One or more features of the selectable option 316 shown and described. The selectable option is optionally included in the virtual keyboard 422. For example, in response to detecting a selection of a selectable option (e.g., touch input pointing to a selectable option), the computing system transfers the virtual keyboard 422 from the second electronic device 406 to the first electronic device 401 (e.g., including reference). Figures 3C to 3D (One or more characteristics of the transmission of the video content 304 shown and described).

[0108] Figure 4H An example is shown of a first electronic device 401 responding to in Figure 4G The computer system detects touch input and presents a virtual keyboard 422 in environment 400. For example, the computer system transmits the virtual keyboard 422 from the second electronic device 406 to the first electronic device 401 because the computer system determines... Figure 4G The touch input (represented by touch positions 426a to 426b) satisfies one or more second standards for transmitting the presentation of the virtual keyboard 422 from the second electronic device 406 to the first electronic device 401.

[0109] In some examples, when the first electronic device 401 presents a virtual keyboard 422 in environment 400, the user of the computing system can use the second electronic device 406 to perform keyboard input. For example, the position of the cursor 410 can be controlled by moving the second electronic device 406 (e.g., as shown in the reference). Figures 4A to 4B(As shown and described), and can select a corresponding key on the virtual keyboard 422 in response to a touch input (e.g., a tap input) detected on the second electronic device 406 when the position of cursor 410 corresponds to a corresponding key (e.g., the computing system can input a character corresponding to the corresponding key in the address bar 412 in response to the touch input). Additionally or alternatively, in some examples, the virtual keyboard 422 can be used as a swipe keyboard for using the second electronic device 406. For example, the computing system activates a swipe keyboard mode based on determining that movement of the second electronic device 406 is detected while contact is maintained on the display 408 (e.g., satisfying one or more criteria described above for moving cursor 410 using the position and / or orientation of the second electronic device 406). The computing system optionally exits the swipe keyboard mode based on determining that contact on the display 408 terminates (e.g., and the computing system inputs text (e.g., a word) in the address bar 412 corresponding to one or more positions of cursor 410 on the virtual keyboard 422 detected during the swipe keyboard mode). Additionally or alternatively, the computing system may optionally enter a swipe key mode based on determining that the movement of the second electronic device 406 exceeds a threshold amount (e.g., the speed, distance, and / or duration of the movement), and may optionally exit the swipe key mode based on determining that the movement of the second electronic device 406 does not exceed a threshold amount (e.g., within a predetermined time period (e.g., 0.1 seconds, 0.2 seconds, 0.5 seconds, 1 second, 2 seconds, 5 seconds, or 10 seconds)).

[0110] Figure 4I An example is illustrated where the computing system detects touch input (represented by touch locations 428a to 428b) corresponding to a request to transfer a virtual keyboard 422 from a first electronic device 401 to a second electronic device 406. In some examples, based on the determination in Figure 4I If the detected touch input meets one or more criteria, the computing system transmits the virtual keyboard 422 from the first electronic device 401 to the second electronic device 406. For example, one or more criteria for transmitting the presentation of the virtual keyboard 422 from the first electronic device 401 to the second electronic device 406 have one or more characteristics of one or more criteria for transmitting the presentation of video content 304 from the first electronic device 301 to the second electronic device 306, as referenced. Figures 3A to 3BAs described. Optionally, the corresponding application associated with application content 404 (e.g., a web browsing application) allows virtual keyboard 422 to be transferred between the first electronic device 401 and the second electronic device 406. Alternatively or additionally, the computing system allows virtual keyboard 422 to be transferred between the first electronic device 401 and the second electronic device 406 independently of the corresponding application associated with application content 404 (e.g., the presentation of virtual keyboard 422 transferred between the first electronic device 401 and the second electronic device 406 is a system-defined setting, not an application-defined setting).

[0111] In some examples, one or more criteria for transmitting the rendering of the virtual keyboard 422 from the first electronic device 401 to the second electronic device 406 include criteria that are met when the cursor 410 is rendered outside the area of ​​the environment 400 corresponding to the virtual keyboard 422 when touch input (e.g., swipe down input) is detected. For example, from Figures 4H to 4I The computing system moves cursor 410 from Figure 4H Move to the position within the virtual keyboard 422 in the environment 400 shown. Figure 4I In the environment 400 shown, the location outside the virtual keyboard 422 (e.g., based on reference) Figures 4A to 4B (The movement of the second electronic device 406 shown and described). For example, when the computing system detects... Figure 4I When touch input is performed on the display 408 shown, the cursor 410 is positioned outside the virtual keyboard 422 in the environment 400.

[0112] In some examples, the computing system determines Figure 4I The touch input detected on display 408 shown satisfies one or more criteria for transmitting the presentation of virtual keyboard 422 from first electronic device 401 to second electronic device 406. In some examples, according to the determination Figure 4I If the touch input detected on display 408 meets one or more criteria, the computing system transmits the virtual keyboard 422 from the first electronic device 401 to the second electronic device 406, as shown in the reference. Figure 4E As shown and described.

[0113] Figures 5A to 5DExamples of computing systems according to this disclosure illustrate the modification of the display of virtual content in response to one or more user inputs detected at one or more touch areas. In some examples, the computing system includes a first electronic device 501 (e.g., having one or more characteristics of the electronic devices 101, 201, 301 and / or 401 described above) and a second electronic device 506 (e.g., having one or more characteristics of the electronic devices 160, 260, 306 and / or 406 described above). In some examples, the first electronic device 501 communicates with the second electronic device 506 (e.g., the second electronic device 506 is an auxiliary device and / or companion device communicating with the first electronic device 501).

[0114] In some examples, the first electronic device 501 includes a display 520 having one or more of the characteristics of the displays 320 and / or 420 described above. In some examples, the first electronic device 501 includes image sensors 514a-514c having one or more of the characteristics of image sensors 314a-314c and / or 414a-414c described above. Optionally, the first electronic device 501 does not include image sensors 514a-514c. In some examples, the second electronic device 506 includes a display 508 having one or more of the characteristics of the displays 308 and / or 408 described above (e.g., the display 508 is a touch-sensitive display).

[0115] Figure 5A An example is illustrated where a first electronic device 501 presents virtual content within an environment 500. In some examples, environment 500 has one or more characteristics of environments 300 and / or 400 described above. For example... Figure 5A As shown, the first electronic device 501 presents application content 504 and a cursor 510 in environment 500. The application content 504 and cursor 510 optionally have reference... Figures 4A to 4I The application content 404 and cursor 410 shown and described have one or more features. Cursor 510 is optionally capable of moving within environment 500 based on the movement of the second electronic device 506 (e.g., as shown in reference). Figures 4A to 4B (The cursor 410 and the second electronic device 406 are shown and described).

[0116] In some examples, the computing system performs one or more operations in the environment 500 in response to detecting touch input at one or more touch areas of the second electronic device 506. For example, such as Figure 5AAs shown, the second electronic device 506 uses a display 508 to present a first touch area 516a and a second touch area 516b. In some examples, in response to detecting a corresponding touch gesture on the first touch area 516a, the computing system performs a first operation in the environment 500, and in response to detecting a corresponding type of touch gesture on the second touch area 516a, the computing system performs a second operation in the environment 500 that is different from the first operation. Additionally, in some examples, the computing system performs different operations based on the corresponding type of touch gesture and the corresponding touch area on which the corresponding type of touch gesture is detected. For example, the computing system performs a first operation in the environment 500 in response to detecting a first type of touch gesture (e.g., a swipe gesture) on the first touch area 516a, and performs a second operation in the environment 500 that is different from the first operation in response to detecting a second type of touch gesture (e.g., a tap gesture) on the first touch area 516a. Additionally, for example, the computing system performs a third operation in environment 500 in response to detecting a third type of touch gesture on the second touch area 516b, and performs a fourth operation in environment 500 different from the third operation in response to detecting a fourth type of gesture on the second touch area 516b. Examples of operations performed by the computing system optionally include user interface operations (e.g., scrolling, selecting selectable options, moving the cursor, or moving a window), presentation of content transferred between the first electronic device 501 and the second electronic device 506, and / or system operations (e.g., controlling volume, display brightness, and / or display color). Assigning different operations to different touch areas and / or different types of touch gestures ensures that the user intends to perform the corresponding operation before performing the corresponding operation, which reduces errors in the interaction and saves computing resources associated with error correction.

[0117] Despite Figures 5A to 5DThe boundary between the first touch area 516a and the second touch area 516b is shown on display 508, but the first touch area 516a and the second touch area 516b may optionally be distinguished in other ways. For example, the second electronic device 506 presents the first touch area 516a with one or more first visual characteristics (e.g., color, brightness, shadow, and / or pattern) and the second touch area 516b with one or more second visual characteristics different from the one or more first visual characteristics. Alternatively or additionally, in some examples, the second electronic device 506 operates in a power-saving state (e.g., as described above) and does not present the first touch area 516a and / or the second touch area 516b on display 508 (e.g., the computing system performs different operations based on whether a corresponding touch gesture is detected on a portion of display 508 corresponding to the first touch area 516a or on a portion of display 508 corresponding to the second touch area 516b, without displaying content on display 508).

[0118] although Figures 5A to 5D A display 508 with two touch areas (first touch area 516a and second touch area 516b) is illustrated, but it should be understood that the display 508 may include a different number of touch areas (e.g., 1, 3, 4, 5, or 10 touch areas). For example, a computing system may perform different operations in environment 500 based on which corresponding touch area of ​​the display 508 is detected for touch input (e.g., and optionally based on the detected corresponding type of touch gesture).

[0119] Figure 5B An example is shown of a touch gesture detected on the first touch area 516a (represented by touch locations 512a to 512b). In some examples, Figure 5B The touch gesture shown corresponds to an upward swipe gesture. In some examples, a vertical swipe gesture (e.g., upward or downward) performed on the first touch area 516a is assigned to scroll application content 504 (e.g., as defined by the corresponding application associated with application content 504, by the computing system (e.g., in one or more system settings), and / or by the user of the computing system (e.g., in one or more user settings (e.g., associated with a user profile)). Figure 5B As shown, in response to detecting a touch gesture, the calculation system scrolls down the application content 504 (e.g., with...). Figure 5A (As shown in comparison). The computing system optionally responds to the detection of a connection on the first touch area 516a. Figure 5BDifferent touch gestures are shown to perform different types of operations. For example, in response to a tap gesture detected on the first touch area 516a, the computing system performs a user interface operation (e.g., within application content 504) corresponding to the selection of a selectable option (e.g., based on the position of the cursor 510 corresponding to the selectable option).

[0120] Figure 5C An example is shown of a touch gesture detected on the second touch area 516b (represented by touch locations 512a to 512b). In some examples, Figure 5B The touch gesture shown corresponds to a swipe-down gesture. In some examples, a swipe-down gesture performed on the second touch area 516b is assigned to transfer the presentation of application content 504 from the first electronic device 501 to the second electronic device 506.

[0121] In some examples, the computing system transfers application content 504 from the first electronic device 501 to the second electronic device 506 based on determining that one or more criteria are met (e.g., having one or more characteristics of one or more criteria described above). In some examples, one or more criteria for transferring the presentation of application content 504 from the first electronic device 501 to the second electronic device 506 include detecting a corresponding type of touch gesture (e.g., such as...) on the second touch area 516b of the display 508. Figure 5C The standard that must be met when swiping downwards as shown. Figure 5C The touch input shown optionally satisfies one or more criteria for transmitting the presentation of application content 504 from the first electronic device 501 to the second electronic device 506.

[0122] Figure 5D An example of a computing system responding to Figure 5C The touch input shown (represented by touch positions 512a to 512b) transmits the presentation of application content 504 from the first electronic device 501 to the second electronic device 506. For example... Figure 5D As shown, in response to the detection Figure 5C The computing system uses a display 508 to present the application content 504 on the second electronic device 506 based on touch input (e.g., and based on determining that the touch input meets one or more criteria for transmitting the presentation of application content 504 from the first electronic device 501 to the second electronic device 506).

[0123] like Figure 5DAs shown, the second electronic device 506 uses a display 508 to present selectable options 522. The second electronic device 506 optionally includes selectable options 522 within application content 504 (e.g., the computing system adds selectable options 522 to application content 504 based on a determination that application content 504 is being transferred from the first electronic device 501 to the second electronic device 506). In some examples, selectable option 522 can be selected to transfer application content 504 from the second electronic device 506 to the first electronic device 501. For example, selectable option 522 has a reference... Figures 3B to 3C One or more features of the selectable option 316 shown and described. In some examples, in response to detecting a selection of selectable option 316 (e.g., with reference...) Figure 3C The touch input 322 shown and described has one or more characteristics of touch input, and the computing system transfers application content 504 from the second electronic device 506 to the first electronic device 501 (e.g., as shown in the reference). Figure 3D (As shown and described in video content 304). Alternatively or additionally, in some examples, the computing system responds to detecting a touch gesture that satisfies one or more second criteria for transmitting the presentation of the corresponding content from the second electronic device 506 to the first electronic device 501 (e.g., a touch gesture including a gesture of the corresponding type (e.g., an up swipe, such as a reference)). Figure 4G The touch gestures shown and described) are used to transfer application content 504 from the second electronic device 506 to the first electronic device 501.

[0124] Figures 6A to 6D Examples of computing systems according to this disclosure are illustrated for displaying video content in a three-dimensional environment. In some examples, the computing system includes a first electronic device 601 (e.g., having one or more characteristics of electronic devices 101, 201, 301, 401 and / or 501 described above) and a second electronic device 606 (e.g., having one or more characteristics of electronic devices 160, 260, 306, 406 and / or 506 described above). In some examples, the first electronic device 601 communicates with the second electronic device 606 (e.g., the second electronic device 606 is an auxiliary device and / or companion device communicating with the first electronic device 601).

[0125] In some examples, the first electronic device 601 includes a display 620 having one or more of the characteristics of the displays 320, 420, and / or 520 described above. In some examples, the first electronic device 601 includes image sensors 614a to 614c having one or more of the characteristics of image sensors 314a to 314c, 414a to 414c, and / or 514a to 514c described above. Optionally, the first electronic device 601 does not include image sensors 614a to 614c. In some examples, the second electronic device 606 includes a display 608 having one or more of the characteristics of the displays 308, 408, and / or 508 described above (e.g., display 608 is a touch-sensitive display).

[0126] exist Figures 6A to 6D In this context, environment 600 is visible via display 620. In some examples, environment 600 has one or more characteristics of environments 300, 400, and / or 500 described above. For example... Figures 6A to 6D As shown, environment 600 includes real-world objects 602a to 602e. For example, real-world objects 602a to 602e are visible via video pass-through or optical perspective through display 620.

[0127] Figure 6A An example is illustrated where a second electronic device 606 uses a display 608 to present video content 604. The video content 604 optionally has a reference... Figures 3A to 3K One or more characteristics of the video content 304 shown and described. In some examples, before the video content 604 is presented on the second electronic device 606, the computing system transmits the video content 604 from the first electronic device 601 to the second electronic device 606 (e.g., according to determining that one or more criteria for transmitting the presentation of the video content from the first electronic device 601 to the second electronic device 606 are met, such as reference). Figures 3A to 3B (One or more standards described).

[0128] In some examples, video content 604 corresponds to an instructional video (e.g., for cooking using one or more real-world objects 602a to 602e). For example, when a user of the computing system is performing a physical (e.g., real-world) task that requires the use of one or both of their hands, the user may find it difficult to control the playback of video content 604 on the second electronic device 606. Therefore, the user may expect to control the playback of video content 604 via the first electronic device 601 (e.g., so that the playback of video content 604 can be controlled without the user's hands). Furthermore, viewing video content 604 on the second electronic device 606 while performing a physical task may be inconvenient for the user (e.g., because this would require the user to physically place the second electronic device 606 in their field of view (e.g., place it on a physical stand and / or tilt it relative to a physical object), thus occupying their physical cooking space). Therefore, the user may expect the presentation of video content 604 to be transferred from the second electronic device 606 to the first electronic device 601 to avoid placing the second electronic device 606 in their field of view, which improves user interaction with the computing system.

[0129] Figure 6B An example is illustrated where a computing system detects touch input on a second electronic device 606 (represented by touch locations 610a to 610b). In some examples, Figure 6B The touch input shown satisfies one or more second standards (e.g., having a reference) for transmitting the presentation of video content 604 from the second electronic device 606 to the first electronic device 601. Figure 4G (One or more features of one or more second standards described). Alternatively, in some examples, the second electronic device 606 presents a selectable option that can be selected to transfer video content 604 from the second electronic device 606 to the first electronic device 601 (e.g., with reference to...). Figures 3B to 3C (One or more features of the optional option 316 shown and described).

[0130] Figure 6C An example is given of the computing system responding to... Figure 6B The presentation of video content 604 is transmitted from the second electronic device 606 to the first electronic device 601 upon detection of touch input (represented by touch positioning 610a to 610b). In some examples, the transmission of video content 604 from the second electronic device 606 to the first electronic device 601 has a reference Figure 3D One or more features shown and described for transmitting video content 304 from the second electronic device 306 to the first electronic device 301. For example... Figure 6C As shown, the first electronic device 601 presents video content 604 in environment 600. In some examples, such as Figure 6C As shown, video content 604 is presented in a picture-in-picture format (e.g., as shown in the reference). Figure 3E (As described). For example, before the computing system presents video content 604 on the second electronic device 606, the first electronic device 601... Figure 6C The picture-in-picture presentation shown renders video content 604 in environment 600 (e.g., transferring the presentation of video content 604 from a second electronic device 606 to a first electronic device 601 includes presenting video content 604 in environment 600 at the same location where video content 604 is presented in first electronic device 601 before transferring the presentation of video content 604 to the second electronic device 606). Alternatively or additionally, in some examples, the computing system presents video content 604 in picture-in-picture presentation based on one or more settings associated with presenting video content 604 in environment 600 (e.g., by an application associated with video content 604, by a user of the computing system (e.g., in a user profile), and / or defined by the computing system). For example, user-defined settings (e.g., associated with an application and / or the computing system) include a default state for presenting video content (such as video content 604) in picture-in-picture presentation in environment 600 (e.g., such that the video content does not excessively obstruct the user's view (e.g., when performing a physical task)). Alternatively or additionally, in some examples, based on determining that a touch input satisfying one or more second criteria for modifying the presentation of video content 604 is detected on the second electronic device 606, the computing system presents the video content 604 in a picture-in-picture presentation (e.g., as referenced). Figures 3D to 3E (As shown and described in video content 304).

[0131] In some examples, Figure 6C In this process, the first electronic device 601 is connected via one or more input devices (e.g., reference 1). Figure 2A The eye-tracking sensor 212 shown and described detects the user's attention (e.g., gaze 612) in the computing system. For example, the first electronic device 601 detects a gaze 612 directed at a location in the environment 600 that does not correspond to a location in the video content 604 (e.g., the user of the computing system is currently looking at a location in the environment 600 where a physical task is being performed (e.g., stirring ingredients in a real-world object 602e)).

[0132] In some examples, based on determining that the attention of the user of the computing system (e.g., a user wearing the first electronic device 601) corresponds to the position of the video content 604 in the environment 600, the first electronic device 601 uses a display 620 to present one or more playback controls in the environment 600 for controlling the playback of the video content 604 (e.g., as shown in reference ). Figure 6D(As shown and described). In some examples, based on determining that the user's attention on the computing system corresponds to a position different from the position of the video content 604, the first electronic device 601 abandons presenting one or more playback controls in the environment 600 for controlling the playback of the video content 604 (e.g., such as...). Figure 6C (As shown). In response to detecting that the user's attention on the computing system is directed to the location of the video content 604, the presentation of playback controls in the environment 600 limits the amount of user input required to control the playback of the video content 604 (e.g., by not requiring the user to perform input on the second electronic device 606). This saves computing resources and battery life of the computing system and improves user device interaction (e.g., by not requiring the user to perform manual-based input when performing physical tasks that require the use of hands).

[0133] Figure 6D An example is illustrated whereby a first electronic device 601, in response to detecting a gaze 612 directed at a location corresponding to video content 604, uses a display 620 to present playback controls 616a to 616d in an environment 600. For example... Figure 6D As shown, the user of the computing system has removed their gaze 612 from environment 600 that does not correspond to video content 604 (e.g., Figure 6C The position (shown) is moved to the position in environment 600 corresponding to video content 604. In response to detecting that the user's attention (e.g., gaze 612) is directed to the position corresponding to video content 604, the first electronic device 601 optionally presents one or more playback controls outside (e.g., and / or adjacent to) video content 604. For example, as shown Figure 6D As shown, the first electronic device 601 presents playback controls 616a and 616b adjacent to (e.g., on either side of) the video content 604 (e.g., from the user's current viewpoint of the computing system) (e.g., capable of selecting to fast forward and / or rewind (e.g., erase) the video content 604 (e.g., optionally, for a predetermined amount of time (e.g., 1 second, 2 seconds, 5 seconds, 10 seconds, 15 seconds, 30 seconds, or 60 seconds)). Additionally or alternatively, in response to detecting user attention (e.g., gaze 612) pointing to a location corresponding to the video content 604, the first electronic device 601 optionally presents one or more playback controls within the video content 604. For example, as... Figure 6D As shown, the first electronic device 601 presents a pause indicator 616c and a playback bar 616d within the video content 604. In some examples, when the playback controls 616a to 616d are presented, in response to detecting that the user's attention (e.g., gaze) is directed to a location not corresponding to the video content 604, the first electronic device 601 stops presenting the playback controls 616a to 616d in the environment 600.

[0134] In some examples, one or more of the playback controls 616a to 616d can be selected by user input that meets one or more criteria. For example, one or more criteria include those that are met when attention (e.g., gaze 612) is directed at the location of the corresponding playback control for at least a threshold amount of time (e.g., 0.1 seconds, 0.2 seconds, 0.5 seconds, 1 second, 2 seconds, 5 seconds, or 10 seconds). Additionally or alternatively, for example, one or more criteria include those that are met when a corresponding air gesture (e.g., an air pinch or air tap) is detected (e.g., via the reference above). Figure 2A The described criteria are satisfied when the hand tracking sensor 202 and / or image sensor 206A detects a corresponding air gesture. Additionally or alternatively, for example, one or more criteria include those satisfied when a corresponding type of touch gesture (e.g., tap input, multiple tap input, or swipe input) is detected on the display 608. In some examples, in response to detecting input that satisfies one or more criteria for selecting a corresponding playback control, the first electronic device 601 (e.g., and / or computing system) performs an operation corresponding to the corresponding playback control (e.g., the computing system pauses playback of video content 604 in environment 600 based on determining that gaze 612 has pointed to pause indication 616c for an amount of time exceeding a threshold).

[0135] Figures 7A to 7C Examples of computing systems according to this disclosure are illustrated for displaying notifications in a three-dimensional environment. In some examples, the computing system includes a first electronic device 701 (e.g., having one or more characteristics of electronic devices 101, 201, 301, 401, 501, and / or 601) and a second electronic device 706 (e.g., ...). Figure 7C (As shown) (e.g., having one or more of the characteristics of the electronic devices 160, 260, 306, 406, 506 and / or 606 described above). In some examples, the first electronic device 701 communicates with the second electronic device 706 (e.g., the second electronic device 706 is an auxiliary device and / or companion device that communicates with the first electronic device 701).

[0136] In some examples, the first electronic device 701 includes a display 720 having one or more characteristics of displays 320, 420, 520, and / or 620. In some examples, the first electronic device 701 includes image sensors 714a to 714c having one or more characteristics of image sensors 314a to 314c, 414a to 414c, 514a to 514c, and / or 614a to 614c as described above. Optionally, the first electronic device 701 does not include image sensors 714a to 714c. In some examples, the second electronic device 706 includes a display 708 having one or more characteristics of displays 308, 408, 508, and / or 608 as described above (e.g., display 708 is a touch-sensitive display).

[0137] exist Figures 7A to 7C In this context, environment 700 is visible via display 720. In some examples, environment 700 has one or more characteristics of environments 300, 400, 500, and / or 600 described above. For example... Figures 7A to 7C As shown, environment 700 includes a representation of virtual environment 740. For example, the representation of virtual environment 740 includes a virtual representation of a scene (e.g., a representation of an outdoor environment and / or geographical landmarks). Figures 7A to 7C As shown, the representation of the virtual environment 740 includes virtual representations of water bodies (e.g., lakes), mountains, and the sky. The representation of the virtual environment 740 is optionally immersive (e.g., such that at least a portion of the physical environment of the user of the first electronic device 701 is not visible through the display 720 (e.g., in video passthrough or optical passthrough)).

[0138] Figure 7A An example is shown where the first electronic device 701 presents the representation of the virtual environment 740 as fully immersive. For example, as... Figure 7A As shown, the real-world table 702 (e.g., a physical object in a physical environment) is not visible to the user within the display 720.

[0139] When presenting immersive virtual content (such as a representation of virtual environment 740), additional virtual content (e.g., virtual notifications) that is presented simultaneously (e.g., overlaid) on top of the immersive virtual content in environment 700 may cause discomfort and / or disorientation to the user. Therefore, in some examples, when additional virtual content is presented simultaneously in environment 700, the computing system modifies the presentation of the representation of virtual environment 740 (e.g., as referenced). Figure 7B(As shown and described). Depending on whether a corresponding notification source (e.g., a computing system and / or a corresponding application accessible via the computing system) is allowed to present virtual notifications in environment 740 (e.g., when presenting immersive virtual content), the computing system optionally presents one or more virtual notifications when presenting a representation of the virtual environment 700. In some examples, the user of the computing system (e.g., through one or more user settings (e.g., associated with a user profile)) restricts the presentation of virtual notifications in environment 700. For example, the user of the computing system may only allow virtual notifications to be presented from certain applications (e.g., messaging applications) when presenting immersive virtual content. Alternatively, the user of the computing system may only allow certain types of notifications (e.g., messages, such as text messages or social network messages) to be presented when presenting immersive virtual content.

[0140] Figure 7B An example is illustrated where a first electronic device 701 presents a virtual notification 704 in an environment 700. For example, the virtual notification 704 is associated with a corresponding application that is permitted to present notifications in the environment 700 (e.g., as described above). Figure 7B As shown, the first electronic device 701 modifies the appearance of a portion 742a of the environment 700. In some examples, the first electronic device 701 applies visual effects to the portion 742a of the environment 700. For example, as... Figure 7B As shown, the visual effect includes increasing the transparency of a portion 742a of environment 700 (e.g., making a portion of the physical environment visible through the representation of virtual environment 740). In examples where the first electronic device 701 includes one or more shading layers activated when displaying virtual content, the visual effect may also include deactivating or reducing the shading level at portion 742a. ​​Alternatively or additionally, in some examples, the visual effect includes changing the color, saturation, sharpness, and / or clarity of the virtual content rendered within portion 742a of environment 700. In some examples, the visual effect is gradually rendered between the representation of virtual environment 740 and portion 742a (e.g., the magnitude of the visual effect gradually increases from the area of ​​environment 700 corresponding to the representation of virtual environment 740 to the area of ​​environment 700 corresponding to virtual notification 704). The rendering of the visual effect in environment 740 (e.g., automatically) when virtual notification 704 is rendered simultaneously with the representation of virtual environment 700 prevents user discomfort, disorientation, and / or motion sickness (e.g., preventing virtual content from being overlaid on other virtual content), which improves user device interaction.

[0141] In some examples, portion 742a corresponds to a predetermined area of ​​environment 700, within which the first electronic device 701 presents virtual notifications when immersive virtual content (e.g., defined by one or more system settings and / or one or more user settings) is simultaneously rendered. In some examples, portion 742a corresponds to an area of ​​environment 700 within a threshold distance (e.g., 0.01 m, 0.02 m, 0.05 m, 0.1 m, 0.2 m, 0.5 m, or 1 m) from the first electronic device 701 (e.g., the threshold distance is measured relative to the depth dimension from the first electronic device 701). In some examples, the visual effects are presented at a predetermined height (e.g., relative to the user's current viewpoint of the first electronic device 701). For example, as... Figure 7B As shown, portion 742a corresponds to the lower region of environment 700 (e.g., from the user's current viewpoint of the first electronic device 701). Optionally, when the user looks down, the visual effect occupies a larger portion of the user's field of view of the first electronic device 701 (e.g., because portion 742a of environment 700 occupies a larger portion of the user's field of view). Although Figure 7B A portion 742a with curved boundaries (e.g., spherical boundaries) is illustrated, but visual effects can be displayed with different geometric boundaries (e.g., rectangular, planar, or other boundaries that separate the immersive virtual content (e.g., a representation of virtual environment 740) from the portion of environment 700 to which the visual effects are applied (e.g., portion 742a)). Presenting visual effects and virtual notifications within a predetermined area of ​​environment 700 while simultaneously presenting immersive virtual content makes the presentation location of the visual effects and virtual notifications predictable for the user, improving user comfort and preventing errors in interaction.

[0142] In some examples, based on the determination that one or more criteria are met (e.g., having one or more characteristics of one or more criteria for transmitting the presentation of video content 304 from the first electronic device 301 to the second electronic device 306, as referenced...), Figures 3A to 3K As described, the computing system transmits virtual notification 704 from a first electronic device 701 to a second electronic device 706. In some examples, one or more criteria include those satisfied when at least a portion of the second electronic device 706 is within the field of view of the first electronic device 701. For example, the computing system uses image sensors 714a to 714c to determine that at least a portion of the second electronic device 706 is within the field of view of the first electronic device 701 (e.g., the first electronic device 701 detects the second electronic device 706 using image sensors 714a to 714c). Additionally or alternatively, for example, the computing system uses a reference... Figure 2BThe image sensor 206B shown and described determines that at least a portion of the second electronic device 706 is within the field of view of the first electronic device 701 (e.g., the first electronic device 701 does not include image sensors 714a to 714c). Additionally or alternatively, for example, the computing system uses orientation sensors (e.g., orientation sensors 210A and 210B) to determine that at least a portion of the second electronic device 706 is within the field of view of the first electronic device 701.

[0143] Figure 7C An example is illustrated where a computing system transmits the presentation of a virtual notification 704 from the first electronic device 701 to the second electronic device 706 based on a determination (e.g., by the computing system) that the second electronic device 706 is within the field of view of the first electronic device 701. For example... Figure 7C As shown, the second electronic device 706 is visible in environment 700 via display 708 (e.g., the user holds the second electronic device 706 within the field of view of the first electronic device 701 with their hand 710), and a virtual notification 704 is displayed on display 720. Transmitting the presentation of the virtual notification 704 to the second electronic device 706 when it is within the field of view of the first electronic device 701 saves computing resources by avoiding the presentation of the virtual notification 704 on the first electronic device 701 when the user of the computing system intends to interact with the virtual notification 704 on the second electronic device 706.

[0144] In some examples, transmitting the presentation of the virtual notification 704 from the first electronic device 701 to the second electronic device 706 includes presenting a portion 742b of the environment 700 surrounding the second electronic device 706 with visual effects. For example, the visual effects have a reference Figure 7C One or more characteristics of the visual effect shown and described. In some examples, when the position of the second electronic device 706 changes within the field of view of the first electronic device 701, the computing system alters the portion of the environment 700 that is presented along with the visual effect. For example, the computing system maintains the presentation of the visual effect within a fixed area relative to the second electronic device 706 (e.g., within a threshold distance of the second electronic device 706 such as 0.01 m, 0.02 m, 0.05 m, 0.1 m, 0.2 m, 0.5 m, or 1 m). Figure 7C The visual effects presented can be selected in an environment of 700 degrees. Figure 7B The visual effects are presented in different areas within the environment. For example, the first electronic device 701 presents the virtual notification in a predetermined area (e.g., portion 742a) of the environment 700. Figure 7B The visual effect in the environment 700 is such that the first electronic device 701 is presented in the area (e.g., portion 742b) of the environment 700 corresponding to the location of the second electronic device 706. Figure 7CThe visual effects (e.g., when the second electronic device 706 is within the field of view of the first electronic device 701, the computing system dynamically (e.g., automatically) updates the area of ​​the environment 700 that presents the visual effects to correspond to the position of the second electronic device 706).

[0145] Figures 8A to 8G Examples of computing systems according to this disclosure are illustrated, showing content presented on a first electronic device and user interface elements associated with the content presented on a second electronic device. In some examples, the computing system includes a first electronic device 801 (e.g., having one or more characteristics of electronic devices 101, 201, 301, 401, 501, 601, and / or 701) and a second electronic device 806 (e.g., having one or more characteristics of electronic devices 160, 260, 306, 406, 605, 606, and / or 706 described above). In some examples, the first electronic device 801 communicates with the second electronic device 806 (e.g., the second electronic device 806 is an auxiliary device and / or companion device communicating with the first electronic device 801). In some examples, such as... Figures 8A to 8G As shown, the second electronic device 806 is a mobile device held by the hand 803 of the user of the computing system (e.g., the user holds the second electronic device 806 while wearing the first electronic device 801).

[0146] In some examples, the first electronic device 801 includes a display 820 having one or more characteristics of displays 320, 420, 520, 620, and / or 720. In some examples, the first electronic device 801 includes image sensors 814a to 814c having one or more characteristics of image sensors 314a to 314c, 414a to 414c, 514a to 514c, 614a to 614c, and / or 714a to 714c as described above. The first electronic device 801 optionally does not include image sensors 814a to 814c. In some examples, the second electronic device 806 includes a display 808 having one or more characteristics of displays 308, 408, 508, 608, and / or 708 as described above (e.g., display 808 is a touch-sensitive display). Figures 8A to 8G In this context, environment 800 is visible via display 820. In some examples, environment 800 has one or more of the characteristics of environments 300, 400, 500, 600 and / or 700 described above.

[0147] Figure 8A An example is illustrated where a computing system presents video content 804 on a first electronic device 801. In some examples, the video content 804 has a reference... Figures 3A to 3KOne or more characteristics of the video content 304 shown and described. For example, the computing system responds to detecting on the second electronic device 806 that a reference is satisfied. Figures 3A to 3K The video content 804 is transmitted between the first electronic device 801 and the second electronic device 806 using one or more standard touch gestures as described.

[0148] Figures 8A to 8F This includes a playback status indicator 832. In some examples, the playback status indicator 832 provides the current playback status of the video content 804 in the environment 800 (e.g., Figure 8A (As shown). For example, when text indication 832 is in the "Play" state, video content 804 is currently being played back in environment 800 (e.g., audio associated with the playback of video content 804 is output via one or more audio output devices of the first electronic device 801). For example, when text indication is in the "Pause" state, video content 804 is not currently being played back in environment 800 (e.g., audio associated with the playback of video content 804 is not output via one or more audio output devices of the first electronic device 801).

[0149] exist Figure 8A In the video, content 804 is being played back in environment 800 (e.g., as indicated by playback status indicator 832). For example, as... Figure 8A As shown, the computing system outputs audio via one or more audio output devices (e.g., speaker 216A) of the first electronic device 801 (audio output is schematically represented by sound wave 812). For example, the audio output is associated with the playback of video content 804 in environment 800. The computing system optionally presents video content 804 in body-locked orientation in environment 800 (e.g., including the above references). Figure 1 The described body-locking orientation displays one or more properties of a 3D object.

[0150] In some examples, in response to the computing system detecting user interaction with the second electronic device 806, the computing system pauses playback of video content 804 in the environment 800 (e.g., automatically and / or in the absence of user input). For example, determining that a user of the computing system is interacting with the second electronic device 806 includes detecting that the user's attention (e.g., gaze) is directed at the second electronic device 806 (e.g., detected via one or more input devices of the second electronic device 806, such as image sensor 206B). For example, determining that a user of the computing system is interacting with the second electronic device 806 includes detecting touch input on the second electronic device 806 (e.g., on display 808, which is optionally a touch-sensitive display). For example, determining that a user of the computing system is interacting with the second electronic device 806 includes detecting use of a corresponding application accessible via the second electronic device 806 (e.g., determining that the user is using a messaging application, or that the user has received and / or answered a phone call). Additionally or alternatively, in some examples, in response to detecting that a change in the user's viewpoint exceeds a threshold rotation amount (e.g., 15 degrees, 20 degrees, 25 degrees, 30 degrees, 45 degrees, 70 degrees, or 90 degrees), the computing system pauses the playback of video content 804 in environment 800 (e.g., automatically and / or in the absence of user input). For example, based on determining that the user's viewpoint change has exceeded a threshold rotation amount, and that the user has remained at a viewpoint exceeding the threshold rotation amount for more than a threshold time amount (e.g., 0.1 seconds, 0.2 seconds, 0.5 seconds, 1 second, 2 seconds, 5 seconds, or 10 seconds), the computing system pauses the playback of video content 804.

[0151] Additionally or alternatively, in response to detecting user interaction with the second electronic device 806 and pausing playback of video content 804 in the environment 800, the computing system causes user interface elements associated with video content 804 to be displayed on the second electronic device 806 via display 808 (e.g., see reference 1). Figure 8B User interface element 810 shown and described. For example, in response to detecting user interaction with the second electronic device 806, the computing system presents user interface elements associated with the video content 804 on the second electronic device 806 without pausing the playback of the video content 804 in the environment 800.

[0152] from Figures 8A to 8BThe user of the computing system (e.g., wearing the first electronic device 801 and holding the second electronic device 806 with their hand 803) changes their viewpoint relative to the environment 800. For example, the user looks down (e.g., by rotating their head and the first electronic device 801) away from the position corresponding to the video content 804 and towards the second electronic device 806 (e.g., the first electronic device 801 stops displaying the video content 804 via the display 820 because the change in the user's viewpoint makes the position corresponding to the video content 804 no longer within the user's field of view). For example, as... Figure 8B As shown, the second electronic device 806 is visible to the user via the display 820 (e.g., via video pass-through or optical pass-through).

[0153] In some examples, Figure 8B In this context, the computing system detects, via one or more input devices (e.g., image sensor 206B) of the second electronic device 806, that a user of the computing system is interacting with the second electronic device 806 (e.g., the user's attention is optionally directed at the display 808 for a threshold amount of time, such as 0.1 seconds, 0.2 seconds, 0.5 seconds, 1 second, 2 seconds, 5 seconds, or 10 seconds). In some examples, in Figure 8B In response to detecting user interaction with the second electronic device 806, the computing system pauses playback of video content 804 in environment 800 (e.g., automatically) (e.g., as indicated by playback status indicator 832). Figure 8B As shown, the computing system causes the first electronic device 801 to stop outputting audio associated with the video content 804.

[0154] like Figure 8B As shown, in response to detecting that a user of the computing system is interacting with the second electronic device 806, the computing system renders user interface elements 810 on the second electronic device 806. For example, as Figure 8B As shown, the second electronic device 806 presents a user interface element 810 over the main user interface 830 (e.g., a user interface including one or more optional icons for accessing one or more corresponding applications on the second electronic device 806). The user interface element 810 is optionally a banner displayed on the top portion of the display 808 to track background content (e.g., content not actively interacting with or playing back in the environment 800, such as video content 804). Although the user interface element 810 is... Figure 8BWhile shown as a banner, it should be understood that the second electronic device 806 may present the user interface element 810 in different display locations on the display 808 (e.g., on one side of the display 808 or at the bottom portion of the display 808). Presenting the user interface element 810 on the second electronic device 806 when playback of the video content 804 is paused in the environment 800 allows the user to follow the video content 804, even though the video content 804 is in the background, which reduces errors in the interaction.

[0155] In some examples, such as Figure 8B As shown, user interface element 810 includes one or more visual indicators. For example, user interface element 810 includes a first visual indicator 816, which is optionally an identifier indicating that user interface element 810 is associated with content (e.g., video content 804) presented in environment 800 via first electronic device 801. For example, user interface element 810 includes a second visual indicator 816, which is optionally a representation associated with video content 804 (e.g., album cover or thumbnail of a TV series or movie).

[0156] In some examples, user interface element 810 includes one or more selectable options for controlling the playback of video content 804 within environment 800. For example, as Figure 8B As shown, user interface element 810 includes a selectable option 818a that can be selected to change the current playback state of video content 804 in environment 800 (e.g., to resume playback of video content 804 in environment 800). In some examples, this option pauses playback of video content 804 (e.g., automatically, as shown in reference). Figure 8B Following the description, the computing system maintains the paused state of the video content 804 until the computing system detects a selection of the selectable option 818a (e.g., a touch and / or tap input pointing to the selectable option 818a on the display 808). Furthermore, for example, as... Figure 8B As shown, the user interface element 810 includes a playback position bar 822, which can be selected to change the current playback position of the video content 804 (e.g., to erase the video content 804).

[0157] from Figures 8B to 8CThe user of the computing system changes their viewpoint relative to environment 800. For example, the user (e.g., by rotating their head and the first electronic device 801) looks upwards towards the location in environment 800 corresponding to video content 804, away from the second electronic device 806 and / or hand 803 (e.g., the first electronic device 801 displays video content 804 via display 820, because the change in the user's viewpoint brings the location corresponding to video content 804 into the user's field of view). In some examples, in response to detecting a change in the user's viewpoint, the computing system maintains the current playback state of video content 804 in environment 800. For example, as... Figure 8C As shown, the playback state of video content 804 remains paused (e.g., as indicated by playback state indication 832). For example, the computing system maintains the paused playback state of video content 804 because the computing system has not yet detected a selection of selectable option 818a. Alternatively, in some examples, in response to detecting a selection from... Figures 8B to 8C As shown by the change in the user's viewpoint, the computing system restores the playback of video content 804 in environment 800 (e.g., automatically and / or without user input).

[0158] Figure 8D An example is illustrated where a computing system detects a selection of selectable option 818a via one or more input devices of a second electronic device 806. For example, the computing system detects touch input (e.g., performed by the thumb of hand 803) pointing to a location on display 808 corresponding to selectable option 818a. In some examples, in response to the detection of a selection... Figure 8D The selection of option 818a in the calculation system restores the system. Figure 8E The video content 804 is played back in environment 800 (as indicated by playback status indicator 832). For example, as... Figure 8E As shown, the computing system causes the audio (schematically represented by sound wave 812) associated with the playback of video content 804 in environment 800 to be output via one or more audio output devices of the first electronic device 801. Furthermore, for example, as... Figure 8E As shown, the second electronic device 806 updates the presentation of the user interface element 810 to replace the selectable option 818a with a selectable option 818b. For example, selectable option 818b can be selected to pause the playback of video content 804 in the environment 800.

[0159] exist Figure 8E In this process, the second electronic device 806 maintains the rendering of the user interface element 810 on the display 808. Alternatively, in some examples, in response to detecting an access... Figure 8DWhen the optional option 818a is selected and / or in response to the detection that the user is no longer interacting with the second electronic device 806 (e.g., attention has not been directed at the second electronic device 806 for more than a threshold amount of time, such as 0.1 seconds, 0.2 seconds, 0.5 seconds, 1 second, 2 seconds, 5 seconds, or 10 seconds), the computing system stops presenting the user interface element 810 on the display 808.

[0160] In some examples, from Figures 8E to 8F The computing system detects user interactions with the second electronic device 806 (e.g., as referenced). Figures 8A to 8B (As shown and described). In some examples, in response to detecting user interaction with the second electronic device 806, the computing system pauses playback of video content 804 in the environment 800 (e.g. Figure 8F (As shown by playback status indicator 832), and the user interface element 310 is presented on the second electronic device 806 via display 808.

[0161] Figure 8F An example is illustrated where the computing system detects a touch gesture on a second electronic device 806 when playback of video content 804 is paused in environment 800. For example, the touch gesture is performed by the thumb of hand 803. In some examples, the touch gesture is an up swipe gesture (e.g., performed on the top portion of display 808 and / or above the position of user interface element 810). In some examples, the touch gesture corresponds to a request to stop rendering user interface element 810 (e.g., to remove user interface element 810 from the second electronic device 806). For example, when a touch gesture is detected, the second electronic device 806 moves the rendering position of user interface element 810 upwards while simultaneously reducing the rendering size of user interface element 810.

[0162] In some examples, stopping the rendering of user interface elements 810 on the second electronic device 806 causes the computing system to stop rendering video content 804 in the environment 800. For example, as Figure 8G As shown, in response to the detection Figure 8F In response to a touch gesture, the computing system causes the first electronic device 801 to stop displaying video content 804 in the environment 800. Alternatively, in some examples, in response to a detected touch gesture, the computing system causes the first electronic device 801 to stop displaying video content 804 in the environment 800. Figure 8F During a touch gesture, the computing system stops displaying the user interface element 810 on the second electronic device 806 while maintaining the display of the video content 804 in the environment 800 (e.g., in a paused playback state).

[0163] Figure 9Flowcharts illustrating example processes for transferring the presentation of content from a first electronic device to a second electronic device, according to some examples of this disclosure, are provided. In some examples, process 900 begins at a computing system including a first electronic device and a second electronic device, wherein the first electronic device includes one or more first displays, and the second electronic device includes one or more second displays. In some examples, the first electronic device is optionally similar to or corresponding to... Figure 2A The head-mounted display of the electronic device 201, and the second electronic device optionally being similar to or corresponding to... Figure 2B 260 mobile electronic devices.

[0164] like Figure 9 As shown, in some examples, at 902, when the first content is rendered in a three-dimensional environment via one or more first displays, the computing system detects the first input via one or more input devices of a second electronic device. For example, as Figure 3A As shown, the computing system detects touch input (represented by touch positions 310a to 310b) on the display 308 of the second electronic device 306. For example, as Figure 4I As shown, the computing system detects touch input (represented by touch positioning 428a to 428b) on the display 408 of the second electronic device 406 (e.g., the cursor 410 moves from its current position to a position outside the virtual keyboard 422). For example, as... Figure 5C As shown, the computing system detects touch input (represented by touch locations 518a to 518b) on the second touch area 516b of the display 508 of the second electronic device 506. For example, as... Figure 7C As shown, the computing system detects that the second electronic device 706 is at least partially within the field of view of the first electronic device 701 (e.g., using a reference). Figure 2B Image sensor 206B shown and described.

[0165] In some examples, at 904, based on determining that the first input meets one or more first criteria, the computing system causes the presentation of the first content to be transferred from the first electronic device to the second electronic device. In some examples, transferring the presentation of the first content from the first electronic device to the second electronic device includes: the first content being stopped from being displayed on the first electronic device via one or more first displays, and the first content being presented on the second electronic device via one or more second displays. For example, as... Figure 3B As shown, based on the determination in Figure 3A The touch input detected on the second electronic device 306 corresponds to a corresponding type of touch gesture (e.g., a swipe-down gesture), and the computing system stops displaying video content 304 on the first electronic device 301 and displays video content 304 on the second electronic device 306. For example, based on the determination in Figure 4I The touch input detected on the second electronic device 406 corresponds to a corresponding type of touch gesture (e.g., a swipe down), and when the cursor 410 is located outside the virtual keyboard 422 in the environment 400, the computing system stops displaying the virtual keyboard 422 on the first electronic device 401 and displays the virtual keyboard 422 on the second electronic device 406 (e.g., as shown in the image). Figure 4E (As shown). For example, as Figure 5D As shown, based on the determination in Figure 5C If the detected touch input corresponds to a corresponding type of touch gesture (e.g., a swipe-down gesture) detected on the second touch area 516b of the display 508 of the second electronic device 506, the computing system stops displaying application content 504 on the first electronic device 501 and displays application content 504 on the second electronic device 506.

[0166] It should be understood that process 900 is an example, and more, fewer, or different operations may be performed in the same or different order. Additionally, the operations in process 900 described above may optionally be performed by running an information processing device such as a general-purpose processor (e.g., as per [reference to...]). Figures 2A to 2B (as described) or one or more functional modules in a dedicated chip and / or through Figures 2A to 2B It is implemented using other components.

[0167] Therefore, based on the foregoing, some examples of this disclosure relate to a method performed at a computing system including a first electronic device communicating with a second electronic device, wherein the first electronic device includes one or more first displays, and the second electronic device includes one or more second displays. In some examples, the method includes: detecting a first input via one or more input devices of the second electronic device when first content is rendered in a three-dimensional environment via one or more first displays. In some examples, the method further includes: transferring the rendering of the first content from the first electronic device to the second electronic device based on determining that the first input meets one or more first criteria, wherein transferring the rendering of the first content from the first electronic device to the second electronic device includes: the first content ceasing to be rendered on the first electronic device via one or more first displays, and the first content being rendered on the second electronic device via one or more second displays. In some embodiments, updating the rendering of the first content in the three-dimensional environment via one or more first displays based on determining that the input meets one or more second criteria different from one or more first criteria. In some embodiments, updating the rendering of the first content in the three-dimensional environment via one or more first displays includes changing the appearance of the content or the container of the content without modifying the playback of the content. For example, updating the rendering of the first content includes moving and / or resizing the container (e.g., a window) of the first content in the three-dimensional environment. For example, updating the presentation of the first content without modifying the playback includes updates as described herein, without pausing or resuming playback or skipping content forward or backward (other than continuing playback). In some embodiments, it is possible to satisfy one or more first criteria and one or more second criteria regardless of the user interface presented on the second electronic device. In some embodiments, it is possible to satisfy one or more first criteria and one or more second criteria when the same user interface is displayed on the second electronic device: one or more first criteria and one or more second criteria are associated with interactions with the same user interface or user interface elements.

[0168] Additionally or alternatively, in some examples, the method further includes: abandoning the transmission of the presentation of the first content from the first electronic device to the second electronic device based on determining that the first input does not meet one or more first criteria.

[0169] Additionally or alternatively, in some examples, one or more first criteria include criteria that are met when the first input includes a first gesture performed at a second electronic device.

[0170] Additionally or alternatively, in some examples, one or more input devices of the second electronic device are touch-sensitive surfaces, and the first gesture includes a touch gesture detected at the touch-sensitive surface.

[0171] Additionally or alternatively, in some examples, the method further includes: updating the rendering of the first content in a three-dimensional environment via one or more first displays based on determining that the first input satisfies one or more second criteria that differ from one or more first criteria.

[0172] Additionally or alternatively, in some examples, one or more first criteria include a first criterion satisfied when the first input includes movement at the second electronic device in a first direction, and one or more second criteria include a second criterion satisfied when the first input includes movement at the second electronic device in a second direction different from the first direction.

[0173] Additionally or alternatively, in some examples, updating the rendering of the first content in the three-dimensional environment includes reducing the size of the rendering of the first content in the three-dimensional environment.

[0174] Additionally or alternatively, in some examples, updating the rendering of the first content in the three-dimensional environment includes performing user interface operations within the first content in the three-dimensional environment.

[0175] Additionally or alternatively, in some examples, the method further includes: upon detecting the first input, rendering a virtual cursor at a first location in a three-dimensional environment via one or more first displays, wherein the first content corresponds to a virtual keyboard rendered in a first region of the three-dimensional environment, and one or more first criteria include criteria that are satisfied when the first location of the virtual cursor is outside the first region of the three-dimensional environment.

[0176] Additionally or alternatively, in some examples, the method further includes: displaying a virtual keyboard on a second electronic device via one or more second displays based on determining that the first input satisfies one or more second criteria, the one or more second criteria including criteria satisfied when the first input corresponds to a selection of a virtual element presented within the first content.

[0177] Additionally or alternatively, in some examples, the method further includes operating a second electronic device in a power-saving state while the first content is presented in a three-dimensional environment.

[0178] Additionally or alternatively, in some examples, operating the second electronic device in a power-saving state includes one or more second displays that operate the second electronic device in an inactive state.

[0179] Additionally or alternatively, in some examples, the method further includes: when the first content is presented in a three-dimensional environment, causing representations of the plurality of touch areas to be displayed on a second electronic device via one or more second displays. In some examples, the method further includes: detecting a second input via one or more input devices of the second electronic device. In some examples, the method further includes: performing a first operation based on determining that the second input is detected relative to a first touch area among the plurality of touch areas. In some examples, the method further includes: performing a second operation different from the first operation based on determining that the second input is detected relative to a second touch area among the plurality of touch areas that is different from the first touch area.

[0180] Additionally or alternatively, in some examples, transferring the first content from the first electronic device to the second electronic device includes causing a first audio output indicating the transfer to be output via one or more audio output devices of the first electronic device.

[0181] Additionally or alternatively, in some examples, transferring the first content from the first electronic device to the second electronic device includes changing the output of audio associated with the first content from being output via one or more audio output devices of the first electronic device to being output via one or more audio output devices of the second electronic device.

[0182] Additionally or alternatively, in some examples, the method further includes: detecting a second input via one or more input devices of the second electronic device after the first content has been transferred from the first electronic device to the second electronic device. In some examples, the method further includes: causing the presentation of the first content to be transferred from the second electronic device to the first electronic device based on determining that the second input meets one or more second criteria, wherein transferring the presentation of the first content from the second electronic device to the first electronic device includes: the first content ceasing to be displayed on the second electronic device via one or more second displays, and the first content being presented on the first electronic device via one or more first displays.

[0183] Additionally or alternatively, in some examples, one or more first criteria include a first criterion that is satisfied when the first input includes a first gesture performed at the second electronic device, and one or more second criteria include a second criterion that is satisfied when the second input includes a second gesture performed at the second electronic device that is different from the first gesture.

[0184] Additionally or alternatively, in some examples, one or more second criteria include criteria that are satisfied when the second input corresponds to the selection of a virtual element presented at a second electronic device via one or more second displays.

[0185] Additionally or alternatively, in some examples, the method further includes: detecting, via one or more input devices of the first electronic device, attention of a user of the first electronic device pointing at the first content while the first content is presented via one or more first displays. In some examples, the method further includes: in response to detecting attention of a user of the first electronic device pointing at the first content, presenting the first content via one or more first displays together with one or more playback controls.

[0186] Additionally or alternatively, in some examples, one or more first criteria include criteria that are satisfied when the first input includes at least a portion of the second electronic device within the field of view of the first electronic device.

[0187] Additionally or alternatively, in some examples, the first content includes notifications from a corresponding application accessible on the second electronic device.

[0188] Additionally or alternatively, in some examples, the method further includes: detecting user interaction with the second electronic device via one or more input devices of the second electronic device that satisfies one or more second criteria while the first content is presented in a three-dimensional environment via one or more first displays. In some examples, the method further includes: in response to detecting user interaction, causing user interface elements associated with the first content to be presented on the second electronic device.

[0189] Additionally or alternatively, in some examples, the first content is video content, and upon detection of user interaction with a second electronic device, the first content is played back in a three-dimensional environment. In some examples, the method further includes pausing the playback of the first content in the three-dimensional environment in response to the detection of user interaction.

[0190] Additionally or alternatively, in some examples, the method further includes: detecting a selection of the selectable option via one or more input devices of the second electronic device when a user interface element is presented on a second electronic device, wherein the user interface element includes selectable options that can be selected to change the playback state of the first content in a three-dimensional environment. In some examples, the method further includes: in response to detecting a selection of the selectable option, causing playback of the first content to continue in the three-dimensional environment.

[0191] Some examples of this disclosure relate to an electronic device comprising: one or more processors; a memory; and one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing any of the methods described above.

[0192] Some examples of this disclosure relate to a computing system comprising: one or more processors; memory; and one or more programs stored in memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing any of the methods described above.

[0193] Some examples of this disclosure relate to a non-transitory computer-readable storage medium that stores one or more programs, the one or more programs including instructions that, when executed by one or more processors of an electronic device, cause the electronic device to perform any of the methods described above.

[0194] Some examples of this disclosure relate to an electronic device that includes one or more processors, a memory, and components for performing any of the methods described above.

[0195] Some examples of this disclosure relate to an information processing apparatus used in an electronic device, the information processing apparatus including components for performing any of the methods described above.

[0196] For purposes of explanation, the foregoing description has been given by way of specific examples. However, the illustrative discussion above is not intended to be exhaustive or to limit this disclosure to the precise form disclosed. Many modifications and variations are possible in accordance with the teachings above. The examples were chosen and described in order to best elucidate the principles of this disclosure and its practical application, thereby enabling others skilled in the art to make optimal use of this disclosure with various modifications suitable for the particular intended purpose, as well as the various described examples.

Claims

1. A method comprising: at a computing system comprising a first electronic device in communication with a second electronic device, wherein the first electronic device comprises one or more first displays and the second electronic device comprises one or more second displays: while first content is presented in a three-dimensional environment via the one or more first displays, detecting, via one or more input devices of the second electronic device, a first input; and in accordance with a determination that the first input satisfies one or more first criteria, causing presentation of the first content to be transferred from the first electronic device to the second electronic device, wherein causing presentation of the first content to be transferred from the first electronic device to the second electronic device includes the first content ceasing to be presented via the one or more first displays on the first electronic device and the first content being presented via the one or more second displays on the second electronic device; and in accordance with a determination that the input satisfies one or more second criteria that are different from the one or more first criteria, causing the presentation of the first content in the three-dimensional environment to be updated via the one or more first displays.

2. The method of claim 1, further comprising: in accordance with a determination that the first input does not satisfy the one or more first criteria, forgoing causing the presentation of the first content to be transferred from the first electronic device to the second electronic device.

3. The method of claim 1, wherein the one or more first criteria include a criterion that is satisfied when the first input includes a first gesture performed at the second electronic device.

4. The method of claim 3, wherein the one or more input devices of the second electronic device are a touch-sensitive surface and the first gesture includes a touch gesture detected at the touch-sensitive surface.

5. The method of claim 1, wherein the one or more first criteria include a first criterion that is satisfied when the first input includes movement in a first direction at the second electronic device, and the one or more second criteria include a second criterion that is satisfied when the first input includes movement in a second direction at the second electronic device that is different from the first direction.

6. The method of claim 1, wherein causing the presentation of the first content in the three-dimensional environment to be updated includes causing a size of the presentation of the first content in the three-dimensional environment to be reduced.

7. The method of claim 1, further comprising: while the first input is detected, causing a virtual cursor to be presented at a first location in the three-dimensional environment via the one or more first displays, wherein: the first content corresponds to a virtual keyboard that is presented in a first region of the three-dimensional environment; and the one or more first criteria include a criterion that is satisfied when the first location of the virtual cursor is outside of the first region of the three-dimensional environment.

8. The method of claim 1, further comprising: in accordance with a determination that the first input satisfies one or more third criteria, the one or more third criteria including a criterion that is satisfied when the first input corresponds to a selection of a virtual element presented within the first content, causing a virtual keyboard to be presented on the second electronic device via the one or more second displays.

9. The method of claim 1, the method further comprising: operating the second electronic device in a power saving state while the first content is presented in the three-dimensional environment.

10. The method of claim 9, wherein operating the second electronic device in the power saving state includes operating the one or more second displays of the second electronic device in an inactive state.

11. The method of claim 1, the method further comprising: while the first content is presented in the three-dimensional environment, causing a representation of a plurality of touch regions to be presented on the second electronic device via the one or more second displays; detecting, via the one or more input devices of the second electronic device, a second input; in accordance with a determination that the second input is detected with respect to a first touch region of the plurality of touch regions, performing a first operation; and in accordance with a determination that the second input is detected with respect to a second touch region of the plurality of touch regions that is different from the first touch region, performing a second operation that is different from the first operation.

12. The method of claim 1, wherein transmitting the first content from the first electronic device to the second electronic device includes causing a first audio output indicative of the transmission to be output via one or more audio output devices of the first electronic device.

13. The method of claim 1, wherein transmitting the first content from the first electronic device to the second electronic device includes transitioning audio output associated with the first content from being output via one or more audio output devices of the first electronic device to being output via one or more audio output devices of the second electronic device.

14. The method of claim 1, wherein transmitting the first content from the first electronic device to the second electronic device includes transitioning spatial audio output associated with the first content from being associated with a position corresponding to the first content as presented with the first electronic device via one or more audio output devices of the first electronic device to being associated with a position corresponding to the first content as presented with the second electronic device via one or more audio output devices of the first electronic device.

15. The method of claim 1, the method further comprising: after the first content is transmitted from the first electronic device to the second electronic device, detecting, via the one or more input devices of the second electronic device, a second input; and in response to determining that the second input meets one or more third criteria, causing presentation of the first content to be transferred from the second electronic device to the first electronic device, wherein causing presentation of the first content to be transferred from the second electronic device to the first electronic device includes the first content ceasing to be presented on the second electronic device via the one or more second displays and the first content being presented on the first electronic device via the one or more first displays.

16. The method of claim 15, wherein the one or more first criteria includes a first criterion that is met when the first input includes a first gesture performed at the second electronic device, and the one or more third criteria includes a second criterion that is met when the second input includes a second gesture performed at the second electronic device that is different from the first gesture.

17. The method of claim 15, wherein the one or more third criteria includes a criterion that is met when the second input corresponds to a selection of a virtual element presented at the second electronic device via the one or more second displays.

18. The method of claim 15, further comprising: while presenting the first content via the one or more first displays, detecting, via one or more input devices of the first electronic device, that a user of the first electronic device is directing attention to the first content; and in response to detecting that the user of the first electronic device is directing the attention to the first content, presenting the first content with one or more playback controls via the one or more first displays.

19. The method of claim 1, wherein the one or more first criteria includes a criterion that is met when the first input includes at least a portion of the second electronic device being within a field of view of the first electronic device.

20. The method of claim 19, wherein the first content includes a notification of a respective application that is accessible on the second electronic device.

21. The method of claim 1, further comprising: while the first content is presented in the three-dimensional environment via the one or more first displays, detecting, via the one or more input devices of the second electronic device, a user interaction with the second electronic device that meets one or more third criteria; and in response to detecting the user interaction, causing a user interface element associated with the first content to be presented on the second electronic device.

22. The method of claim 21, wherein the first content is video content, and upon detecting the user interaction with the second electronic device, the first content is played back in the three-dimensional environment, the method further comprising: in response to detecting the user interaction, causing playback of the first content to be paused in the three-dimensional environment.

23. The method of claim 22, further comprising: while the user interface element is presented on the second electronic device, wherein the user interface element includes a selectable option that is selectable to change a playback state of the first content in the three-dimensional environment, detecting, via the one or more input devices of the second electronic device, selection of the selectable option; and in response to detecting the selection of the selectable option, causing playback of the first content to continue in the three-dimensional environment.

24. An electronic device, the electronic device comprising: one or more processors; memory; and one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing the method of any of claims 1-23.

25. A computing system, the computing system comprising: one or more processors; memory; and one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing the method of any of claims 1-23.

Images