System and method for creating workflow for scene creation

Abstract

A system and method of making workflow for scene creation. Some examples of the present disclosure relate to systems and methods for presenting a virtual three-dimensional environment at an electronic device. Some examples of the present disclosure relate to presenting a virtual three-dimensional environment according to an environment template. Some examples of the present disclosure relate to virtual platforms, virtual previews into virtual three-dimensional environments, virtual view frames, virtual models, and immersive presentation of virtual three-dimensional environments.

Description

Cross-references to related applications

[0001] This application claims the benefit of U.S. Provisional Application No. 63 / 700,402, filed September 27, 2024; U.S. Patent Application No. 19 / 311,465, filed August 27, 2025; and U.S. Patent Application No. 19 / 330,648, filed September 16, 2025, the contents of which are incorporated herein by reference in their entirety for all purposes. Technical Field

[0002] This disclosure relates generally to systems and methods for presenting virtual three-dimensional environments, and more specifically to presenting virtual scenes based on templates. Background Technology

[0003] Some computer graphics environments provide two-dimensional and / or three-dimensional environments, where at least some of the objects presented for the user to view are virtual and computer-generated. In some examples, the virtual three-dimensional environment may be based on one or more images of the computer's physical environment. In some examples, the virtual three-dimensional environment does not include images of the computer's physical environment. Summary of the Invention

[0004] This disclosure relates generally to systems and methods for presenting virtual 3D environments, and more specifically to presenting virtual 3D environments based on environment templates. In some examples, the template includes one or more of a virtual platform, virtual model, virtual preview and / or viewing portal, virtual viewframe, and / or immersive view of the virtual 3D environment. In some examples, data and information for displaying the virtual 3D environment on an electronic device, such as a head-mounted device, are received and / or streamed from a computer system. In some examples, the electronic device exports virtual content from the virtual 3D environment. In some examples, the electronic device changes the active environment template. In some examples, the electronic device facilitates viewing and interacting with a virtual 3D environment used in media production workflows.

[0005] A full description of these examples is provided in the accompanying drawings and detailed embodiments, and it should be understood that the content of this invention does not limit the scope of this disclosure in any way. Attached Figure Description

[0006] To better understand the various examples described herein, reference should be made to the following detailed embodiments and accompanying drawings. Throughout the drawings, similar reference numerals generally refer to corresponding parts.

[0007] Figure 1 Examples of electronic devices that present a three-dimensional environment according to some examples of this disclosure are illustrated.

[0008] Figures 2A to 2BA block diagram illustrating an example architecture for an electronic device according to some examples of this disclosure is shown.

[0009] Figure 3 Examples of electronic devices that present virtual 3D environment templates of virtual platforms according to some examples of this disclosure are illustrated.

[0010] Figure 4 Examples of displaying an environment template including a virtual model are shown according to some examples of this disclosure.

[0011] Figure 5 Examples of displaying a virtual environment at an immersion level greater than a threshold immersion level are illustrated according to some examples of this disclosure.

[0012] Figure 6 Examples of the review of the animation are shown.

[0013] Figure 7 Examples of electronic devices that present virtual 3D environment templates, including virtual models and environment previews, according to some examples of this disclosure are illustrated.

[0014] Figure 8 Examples of electronic devices that present virtual 3D environment templates including viewframes, according to some examples of this disclosure, are illustrated.

[0015] Figure 9 This is a flowchart illustrating a method for presenting a virtual 3D environment based on a template, according to some examples of this disclosure.

[0016] Figure 10 This is a flowchart illustrating, according to some examples of the present disclosure, a method for streaming information from a computer system to an electronic device so that the electronic device renders a virtual three-dimensional environment based on a template. Detailed Implementation

[0017] This disclosure relates generally to systems and methods for presenting virtual 3D environments, and more specifically to presenting virtual 3D environments based on environment templates. In some examples, the template includes one or more of a virtual platform, virtual model, virtual preview and / or viewing portal, virtual viewframe, and / or immersive view of the virtual 3D environment. In some examples, data and information for displaying the virtual 3D environment on an electronic device, such as a head-mounted device, are received and / or streamed from a computer system. In some examples, the electronic device exports virtual content from the virtual 3D environment. In some examples, the electronic device changes the active environment template. In some examples, the electronic device facilitates viewing and interacting with a virtual 3D environment used in media production workflows.

[0018] In some examples, a 3D object is displayed in a computer-generated 3D environment with a specific orientation that controls one or more behaviors of the 3D object (e.g., when the 3D object moves within the 3D environment). In some examples, the orientation of the 3D object displayed in the 3D environment is selected by the user of the electronic device or automatically by the electronic device. For example, when initiating the rendering of a 3D object in a 3D environment, the user may select a specific orientation of the 3D object, or the electronic device may automatically select the orientation of the 3D object (e.g., based on the type of the 3D object).

[0019] In some examples, 3D objects may be displayed in a 3D environment with world-locked orientation, body-locked orientation, tilt-locked orientation, or head-locked orientation, as described below. As used herein, an object displayed in a 3D environment with body-locked orientation has a distance and orientation offset relative to a portion of the user's body (e.g., the user's torso). Alternatively, in some examples, body-locked objects have a fixed distance from the user, and the orientation of the content does not reference any part of the user's body (e.g., it may be displayed in the same basic direction relative to the user, regardless of head and / or body movement). Additionally or alternatively, in some examples, body-locked objects may be configured to always maintain gravity or horizon (e.g., perpendicular to gravity) alignment, such that changes in the head and / or body's scrolling direction will not cause the body-locked object to move within the 3D environment. Conversely, translational movement in either configuration will cause the body-locked object to reposition within the 3D environment to maintain the distance offset.

[0020] As used in this article, objects displayed in a head-locked orientation within a 3D environment have a distance and orientation offset relative to the user's head. In some examples, the head-locked object moves within the 3D environment as the user's head moves (when the user's viewpoint changes).

[0021] As used in this article, objects displayed in a world-locked orientation in a 3D environment do not have a distance or orientation offset relative to the user.

[0022] As used herein, an object displayed in a tilt-locked orientation in a 3D environment (referred to herein as a tilt-locked object) has a distance offset relative to a user (such as a part of the user's body, e.g., the user's torso, or the user's head). In some examples, the tilt-locked object is displayed in a fixed orientation relative to the 3D environment. In some examples, the tilt-locked object moves according to a polar (e.g., spherical) coordinate system centered on a pole passing through the user (e.g., the user's head). For example, the tilt-locked object moves in the 3D environment based on the movement of the user's head within a spherical space surrounding the user's head (e.g., centered on the user's head). Therefore, if the user tilts their head relative to gravity (e.g., up or down in the pitch direction), the tilt-locked object will follow the head tilt and move radially along the sphere, such that the tilt-locked object is repositioned in the 3D environment with the same distance offset relative to the user as before the head tilt, while optionally maintaining the same orientation relative to the 3D environment. In some examples, if the user moves their head relative to gravity in a rolling direction (e.g., clockwise or counterclockwise), the tilt-locked object is not repositioned in the 3D environment.

[0023] Figure 1 An electronic device 101 is illustrated according to some examples of this disclosure, which presents a three-dimensional environment (e.g., an extended reality (XR) environment or a computer-generated reality (CGR) environment that optionally includes representations of physical and / or virtual objects). In some examples, such as Figure 1 As shown, electronic device 101 is a head-mounted display or other head-mountable device configured to be worn on the head of a user of electronic device 101. See below for reference. Figure 2A An example of an architecture block diagram to describe electronic device 101. For example... Figure 1 As shown, electronic device 101 and table 106 are located in a physical environment. The physical environment may include physical features such as physical surfaces (e.g., floor, wall) or physical objects (e.g., table, lamp, etc.). In some examples, electronic device 101 may be configured to detect and / or capture images of the physical environment including table 106 (exemplified in the field of view of electronic device 101).

[0024] In some examples, such as Figure 1 As shown, electronic device 101 includes one or more internal image sensors 114a oriented toward the user's face (e.g., referred to below). Figures 2A to 2B(The described eye-tracking camera). In some examples, an internal image sensor 114a is used for eye tracking (e.g., detecting the user's gaze). The internal image sensor 114a is optionally arranged on the left and right portions of the display 120 to enable eye tracking of the user's left and right eyes. In some examples, the electronic device 101 also includes external image sensors 114b and 114c facing outwards from the user to detect and / or capture the physical environment of the electronic device 101 and / or movement of the user's hands or other body parts.

[0025] In some examples, display 120 has a field of view visible to the user. In some examples, the user-visible field of view is the same as the field of view of external image sensors 114b and 114c. For example, when display 120 is optionally part of a head-mounted device, the field of view of display 120 may be the same as or similar to the field of view of the user's eyes. In some examples, the user-visible field of view is different from the field of view of external image sensors 114b and 114c (e.g., narrower than the field of view of external image sensors 114b and 114c). In other examples, the field of view of display 120 may be smaller than the field of view of the user's eyes. The user's viewpoint determines what is visible in the field of view, and the viewpoint typically specifies the position and orientation relative to the three-dimensional environment. As the user's viewpoint shifts, the field of view of the three-dimensional environment also shifts accordingly. In some examples, electronic device 101 may be an optically transparent device, through which display 120 is a transparent or translucent display through which parts of the physical environment can be directly viewed. In some examples, display 120 may be included within a transparent lens and may overlap entirely or only partially with the transparent lens. In other examples, the electronics may be a video pass-through device, wherein display 120 is an opaque display configured to display images of the physical environment captured by external image sensors 114b and 114c. Although Figure 1 A single display is shown, but it should be understood that display 120 may optionally include more than one display. For example, display 120 may optionally include displays that are merged (e.g., merged by the user's brain) to create Figure 1 The view of the content shown is displayed in a stereoscopic pair on the monitor (e.g., a left display panel and a right display panel for the user's left and right eyes, respectively). In some examples, see the following references. Figures 2A to 2B In more detail, the display 120 includes or corresponds to a transparent or translucent surface (e.g., a lens) that is not equipped with display capabilities (e.g., and therefore cannot generate and display the virtual object 104), and alternatively presents a direct view of the physical environment in the user's field of view (e.g., the user's eye's field of view).

[0026] In some examples, electronic device 101 is configured to display (e.g., in response to a trigger) virtual object 104 in a three-dimensional environment. Virtual object 104 is... Figure 1 The cube illustrated represents a cube that does not exist in the physical environment but is displayed in a three-dimensional environment positioned on top of table 106 (e.g., a real-world table or a representation thereof). Optionally, in response to detecting a flat surface of table 106 in the physical environment 100, virtual object 104 is displayed on the surface of table 106 in the three-dimensional environment displayed via display 120 of electronic device 101.

[0027] It should be understood that virtual object 104 is a representative virtual object and may include and render one or more different virtual objects (e.g., virtual objects with various dimensions, such as two-dimensional or other three-dimensional virtual objects) in a three-dimensional environment. For example, a virtual object may represent an application or user interface displayed in a three-dimensional environment. In some examples, a virtual object may represent content corresponding to an application and / or displayed via a user interface in a three-dimensional environment. In some examples, virtual object 104 may optionally be configured to be interactive and responsive to user input (e.g., air gestures, such as air pinch gestures, air tap gestures, and / or air touch gestures), allowing the user to virtually touch, tap, move, rotate, or otherwise interact with virtual object 104.

[0028] As discussed in this article, by the user (e.g., using Figure 1 One or more air pinch gestures performed by the hand (103) are detected by one or more input devices of the electronic device 101 and interpreted as one or more user inputs pointing to content displayed by the electronic device 101. Additionally or alternatively, in some examples, one or more user inputs interpreted by the electronic device 101 as pointing to content displayed by the electronic device 101 (e.g., virtual object 104) are detected via one or more hardware input devices (e.g., controllers, touchpads, proximity sensors, buttons, sliders, knobs, etc.) rather than via one or more input devices configured to detect air gestures (such as one or more air pinch gestures) performed by the user. This description is intended to be exemplary and not restrictive; the user may optionally use different air gestures and / or other forms of input to provide user input.

[0029] In some examples, electronic device 101 may be configured to communicate with a second electronic device, such as a companion device. For example, as Figure 1As illustrated, electronic device 101 may optionally communicate with electronic device 160. In some examples, electronic device 160 corresponds to a mobile electronic device, such as a smartphone, tablet computer, smartwatch, laptop computer, or other electronic device. In some examples, electronic device 160 corresponds to a non-mobile electronic device, which is typically stationary and not easily moved within a physical environment (e.g., a desktop computer, server, etc.). See below for reference. Figure 2B The following are additional examples of architectural diagrams used to describe electronic device 160. In some examples, electronic device 101 and electronic device 160 are associated with the same user. For example, in Figure 1 In this configuration, electronic device 101 may be positioned (e.g., mounted on) a user's head, and electronic device 160 may be positioned near electronic device 101, such as in the user's hand 103 (e.g., hand 103 is holding electronic device 160), in the user's pocket or bag, or on a surface near the user. Electronic devices 101 and 160 may optionally be associated with the same user account (e.g., the user's account logged into both electronic devices 101 and 160). See below for further details. Figures 2A to 2B Additional details regarding the communication between electronic device 101 and electronic device 160 are provided.

[0030] In some examples, the display of an object in a 3D environment is triggered by, or enables, interaction with one or more user interface objects in the 3D environment. For example, initiating the display of an object in a 3D environment may include interaction with one or more virtual option / function representations displayed in the 3D environment. In some examples, when initiating the display of an object in a 3D environment, the electronic device may track the user's gaze as input for identifying one or more virtual option / function representations targeted for selection. For example, a gaze may be used to identify one or more virtual option / function representations targeted for selection using another selection input. In some examples, a virtual option / function representation may be selected using hand-tracking input detected via an input device communicating with the electronic device. In some examples, an object displayed in a 3D environment may be moved and / or reoriented in the 3D environment based on movement input detected via an input device.

[0031] In the following description, an electronic device that communicates with one or more displays and one or more input devices is described. It should be understood that the electronic device may optionally communicate with one or more other physical user interface devices, such as touch-sensitive surfaces, physical keyboards, mice, joysticks, hand-tracking devices, eye-tracking devices, styluses, etc. Furthermore, as described above, it should be understood that the described electronic device, display, and touch-sensitive surface may optionally be distributed among two or more devices. Therefore, as used in this disclosure, information on or displayed by the electronic device may optionally be used to describe information output by the electronic device for display on a separate display device (touch-sensitive or non-touch-sensitive). Similarly, as used in this disclosure, input received on the electronic device (e.g., touch input received on a touch-sensitive surface of the electronic device, or touch input received on the surface of a stylus) may optionally be used to describe input received on a separate input device from which the electronic device receives input information.

[0032] The device typically supports a variety of applications, such as one or more of the following: drawing applications, presentation applications, word processing applications, website creation applications, disk editing applications, spreadsheet applications, game applications, telephone applications, video conferencing applications, email applications, instant messaging applications, fitness support applications, photo management applications, digital camera applications, digital video camera applications, web browsing applications, digital music player applications, TV channel browsing applications, and / or digital video player applications.

[0033] Figures 2A to 2B Block diagrams illustrating example architectures for electronic devices according to some examples of this disclosure are shown. In some examples, electronic device 201 and / or electronic device 260 include one or more electronic devices. For example, electronic device 201 may be a portable device, an auxiliary device for communicating with another device, a head-mounted display, a head-mounted speaker, etc. In some examples, electronic device 201 corresponds to the above reference. Figure 1 The described electronic device 101. In some examples, electronic device 260 corresponds to the above reference. Figure 1 The described electronic device 160.

[0034] like Figure 2A As illustrated, electronic device 201 may optionally include one or more sensors, such as one or more hand tracking sensors 202, one or more position sensors 204A, and one or more image sensors 206A (optionally corresponding to...). Figure 1The electronic device 201 may include an internal image sensor 114a and / or external image sensors 114b and 114c, one or more touch-sensitive surfaces 209A, one or more motion and / or orientation sensors 210A, one or more eye-tracking sensors 212, one or more microphones 213A or other audio sensors, one or more body tracking sensors (e.g., torso tracking sensors and / or head tracking sensors), etc. The electronic device 201 may optionally include one or more output devices, such as one or more display generation components 214A (optionally corresponding to...). Figure 1 The electronic device 201 may include a display 120, one or more speakers 216A, one or more tactile output devices (not shown), etc. The electronic device 201 may optionally include one or more processors 218A, one or more memories 220A, and / or communication circuitry 222A. One or more communication buses 208A may optionally be used for communication between the components of the electronic device 201 mentioned above.

[0035] Additionally, electronic device 260 may optionally include components that are the same as or similar to those of electronic device 201. For example, such as Figure 2B As shown, the electronic device 260 optionally includes one or more position sensors 204B, one or more image sensors 206B, one or more touch-sensitive surfaces 209B, one or more orientation sensors 210B, one or more microphones 213B, one or more display generating components 214B, one or more speakers 216B, one or more processors 218B, one or more memories 220B, and / or communication circuitry 222B. One or more communication buses 208B are optionally used for communication between the components of the electronic device 260 mentioned above.

[0036] Electronic devices 201 and 260 are optionally configured to communicate via a wired or wireless connection between the two electronic devices (e.g., via communication circuits 222A, 222B). For example, as Figure 2A As indicated, electronic device 260 can be used as an accessory device to electronic device 201. For example, in some examples, electronic device 260 processes sensor inputs from electronic devices 201 and 260, and / or uses the display generation component 214A of electronic device 201 to generate content for display.

[0037] Communication circuits 222A and 222B optionally include circuitry for communicating with electronic devices and networks such as the Internet, intranets, wired and / or wireless networks, cellular networks, and wireless local area networks (LANs). Communication circuits 222A and 222B optionally include circuitry for using near-field communication (NFC) and / or short-range communication (such as Bluetooth). ®The communication circuits 222A and 222B communicate with each other. In some examples, the communication circuits 222A and 222B include or support Wi-Fi (e.g., the 802.11 protocol), Ethernet, Ultra Wideband (“UWB”), high-frequency systems (e.g., 900MHz, 2.4GHz, and 5.6GHz communication systems) or any other communication protocol or any combination thereof.

[0038] One or more processors 218A, 218B include one or more general-purpose processors, one or more graphics processors, and / or one or more digital signal processors. In some examples, one or more processors 218A, 218B include one or more microprocessors, one or more central processing units, one or more application-specific integrated circuits, one or more field-programmable gate arrays, one or more programmable logic devices, or combinations of such devices. In some examples, memories 220A and / or 220B are non-transitory computer-readable storage media (e.g., flash memory, random access memory, or other volatile or non-volatile memory or storage device) that store computer-readable instructions configured to be executed by one or more processors 218A, 218B to perform the techniques, processes, and / or methods described herein. In some examples, memories 220A and / or 220B may include more than one non-transitory computer-readable storage medium. A non-transitory computer-readable storage medium can be any medium (e.g., excluding signals) that can tangibly contain or store computer-executable instructions for use by or in connection with an instruction execution system, apparatus, and device. In some examples, the storage medium is a transient computer-readable storage medium. In some examples, the storage medium is a non-transitory computer-readable storage medium. Non-transitory computer-readable storage media may include, but are not limited to, magnetic storage devices, optical storage devices, and / or semiconductor storage devices. Examples of such storage devices include magnetic disks, optical discs based on compact disc (CD), digital versatile optical disc (DVD), or Blu-ray technology, and persistent solid-state storage devices such as flash memory, solid-state drives, etc.

[0039] In some examples, one or more display generating components 214A, 214B include a single display (e.g., a liquid crystal display (LCD), an organic light-emitting diode (OLED), or other type of display). In some examples, one or more display generating components 214A, 214B include multiple displays. In some examples, one or more display generating components 214A, 214B may include a touch-enabled display (e.g., a touchscreen), a projector, a holographic projector, a retinal projector, a transparent or translucent display, etc. In some examples, the electronic device does not include one or more display generating components 214A or 214B. For example, instead of one or more display generating components 214A or 214B, some electronic devices include transparent or translucent lenses or other surfaces that are not configured to display or present virtual content. However, it should be understood that in such instances, electronic device 201 and / or electronic device 260 may optionally be equipped with Figure 2A and Figure 2B One or more of the other components illustrated and described herein, such as one or more hand-tracking sensors 202, one or more eye-tracking sensors 212, one or more image sensors 206A, and / or one or more motion and / or orientation sensors 210A. Alternatively, in some examples, one or more display generation components 214A or 214B are provided separately from electronic devices 201 and / or 260. For example, one or more display generation components 214A, 214B communicate with electronic device 201 (and / or electronic device 260) but are not integrated with electronic device 201 and / or electronic device 260 (e.g., within the housing of electronic devices 201, 260). In some examples, electronic devices 201 and 260 respectively include one or more touch-sensitive surfaces 209A and 209B for receiving user input, such as tap input and swipe input or other gestures (e.g., hand-based gestures or finger-based gestures)). In some examples, one or more display generating components 214A, 214B and one or more touch-sensitive surfaces 209A, 209B form one or more touch-sensitive displays (e.g., touchscreens integrated with each of the electronic devices 201 and 260 or touchscreens external to each of the electronic devices 201 and 260 that communicate with each of the electronic devices 201 and 260).

[0040] Electronic devices 201 and 260 optionally include one or more image sensors 206A and 206B, respectively. The one or more image sensors 206A and 206B optionally include one or more visible light image sensors (such as charge-coupled device (CCD) sensors) and / or complementary metal-oxide-semiconductor (CMOS) sensors operable to obtain images of physical objects from a real-world environment. The one or more image sensors 206A and 206B also optionally include one or more infrared (IR) sensors, such as passive or active IR sensors, for detecting infrared light from the real-world environment. For example, an active IR sensor includes an IR emitter for emitting infrared light into the real-world environment. The one or more image sensors 206A and 206B also optionally include one or more cameras configured to capture movement of physical objects in the real-world environment. The one or more image sensors 206A and 206B also optionally include one or more depth sensors configured to detect the distance of the physical object from the electronic devices 201 and 260. In some examples, information from one or more depth sensors can allow a device to identify objects in a real-world environment and distinguish them from other objects in the real-world environment. In some examples, one or more depth sensors can allow a device to determine the texture and / or shape of objects in a real-world environment. In some examples, one or more image sensors 206A or 206B are included in an electronic device different from electronic devices 201 and / or 260. For example, one or more image sensors 206A, 206B communicate with electronic devices 201, 260 but are not integrated with electronic devices 201, 260 (e.g., within the housing of electronic devices 201, 260). Specifically, in some examples, one or more cameras of one or more image sensors 206A, 206B are integrated with and / or coupled to one or more devices separate from electronic devices 201 and / or 260 (e.g., but communicating with electronic devices 201 and / or 260), such as one or more input and / or output devices (e.g., one or more speakers and / or one or more microphones, such as earpieces or headphones) that include one or more image sensors 206A, 206B. In some examples, electronic device 201 or electronic device 260 corresponds to a headphone speaker (e.g., headphones or earbuds). In such instances, electronic device 201 or electronic device 260 is equipped with Figure 2A and Figure 2B A subset of other components illustrated and described herein. In some such examples, electronic device 201 or electronic device 260 is equipped with one or more image sensors 206A, 206B, one or more motion and / or orientation sensors 210A, 210B, and / or speakers 216A, 216B.

[0041] In some examples, electronic devices 201 and 260 combine a CCD sensor, an event camera, and a depth sensor to detect the physical environment surrounding them. In some examples, one or more image sensors 206A and 206B include a first image sensor and a second image sensor. The first and second image sensors work cooperatively and are optionally configured to capture different information about physical objects in the real-world environment. In some examples, the first image sensor is a visible light image sensor, and the second image sensor is a depth sensor. In some examples, electronic devices 201 and 260 use one or more image sensors 206A and 206B to detect the location and orientation of electronic devices 201 and 260 and / or one or more display generation components 214A and 214B in the real-world environment. For example, electronic devices 201 and 260 use one or more image sensors 206A and 206B to track the location and orientation of one or more display generation components 214A and 214B relative to one or more stationary objects in the real-world environment.

[0042] In some examples, electronic devices 201 and 260 include one or more microphones 213A and 213B or other audio sensors, respectively. Electronic devices 201 and 260 may optionally use one or more microphones 213A and 213B to detect sound from a user and / or the user's real-world environment. In some examples, the one or more microphones 213A and 213B include microphone arrays (e.g., multiple microphones) that optionally operate in cooperation to identify ambient noise or locate sound sources in the space of a real-world environment.

[0043] Electronic devices 201 and 260 each include one or more position sensors 204A and 204B, which are used to detect the positions of electronic device 201 and / or one or more display generating components 214A and the positions of electronic device 260 and / or one or more display generating components 214B, respectively. For example, the one or more position sensors 204A, 204B may include a Global Positioning System (GPS) receiver that receives data from one or more satellites and allows electronic devices 201, 260 to determine the absolute position of the electronic devices in the physical world.

[0044] Electronic devices 201 and 260 each include one or more orientation sensors 210A and 210B, which are used to detect the orientation and / or movement of electronic device 201 and / or one or more display generation components 214A and the orientation and / or movement of electronic device 260 and / or one or more display generation components 214B, respectively. For example, electronic devices 201 and 260 use one or more orientation sensors 210A and 210B to track changes in the positioning and / or orientation of electronic devices 201 and 260 and / or one or more display generation components 214A and 214B, such as relative to physical objects in a real-world environment. The one or more orientation sensors 210A and 210B may optionally include one or more gyroscopes and / or one or more accelerometers.

[0045] In some examples, electronic device 201 includes one or more hand tracking sensors 202 and / or one or more eye tracking sensors 212. It should be understood that although referred to as hand tracking sensors or eye tracking sensors, electronic device 201 additionally or optionally includes one or more other body tracking sensors, such as one or more leg tracking sensors, one or more torso tracking sensors, and / or one or more head tracking sensors. One or more hand tracking sensors 202 are configured to track the localization and / or position of one or more portions of a user's hand, and / or the movement of one or more portions of the user's hand relative to a three-dimensional environment, relative to one or more display generation components 214A, and / or relative to another defined coordinate system. One or more eye tracking sensors 212 are configured to track the localization and movement of a user's gaze (e.g., the user's attention, more generally including the eyes, face, or head) relative to the real-world environment or a three-dimensional environment and / or relative to one or more display generation components 214A. In some examples, one or more hand tracking sensors 202 and / or one or more eye tracking sensors 212 are implemented together with one or more display generation components 214A. In some examples, one or more hand-tracking sensors 202 and / or one or more eye-tracking sensors 212 are implemented separately from one or more display generation components 214A. In some examples, the electronic device 201 alternatively does not include one or more hand-tracking sensors 202 and / or one or more eye-tracking sensors 212. In some such examples, the electronic device 260 may utilize one or more display generation components 214A to provide a three-dimensional environment, and the electronic device 260 may use input and other data collected via other one or more sensors of the electronic device 201 (e.g., one or more position sensors 204A, one or more image sensors 206A, one or more touch-sensitive surfaces 209A, one or more motion and / or orientation sensors 210A and / or one or more microphones 213A or other audio sensors) as input and data processed by one or more processors 218B of the electronic device 260. Additionally or alternatively, the electronic device 260 may optionally not include... Figure 2B Other components shown include one or more position sensors 204B, one or more image sensors 206B, one or more touch-sensitive surfaces 209B, etc. In some such examples, the electronic device 260 may utilize one or more display generation components 214A to provide a three-dimensional environment, and the electronic device 260 may use input and other data collected via one or more motion and / or orientation sensors 210A (and / or one or more microphones 213A) of the electronic device 201 as input.

[0046] In some examples, one or more hand-tracking sensors 202 (and / or other body-tracking sensors, such as leg-tracking sensors, torso-tracking sensors, and / or head-tracking sensors) may use one or more image sensors 206 (e.g., one or more IR cameras, 3D cameras, depth cameras, etc.) that capture 3D information from the real world, including one or more body parts (e.g., a human user's hand, leg, or torso). In some examples, the hand may be distinguishable with sufficient resolution to differentiate the fingers and their corresponding positions. In some examples, one or more image sensors 206A are positioned relative to the user to define a field of view and interaction space for one or more image sensors 206A, in which the finger / hand positions, orientations, and / or movements captured by the image sensors are used as input (e.g., to differentiate from the user's resting hand or other hands of other people in the real-world environment). Tracking the fingers / hands used for input (e.g., gestures, touches, taps, etc.) may be advantageous because it does not require the user to touch, hold, or wear any type of beacon, sensor, or other marker.

[0047] In some examples, one or more eye-tracking sensors 212 include at least one eye-tracking camera (e.g., an IR camera) and / or an illumination source (e.g., an IR light source, such as an LED) that emits light toward the user's eyes. The eye-tracking camera may be pointed at the user's eyes to receive reflected IR light from the light source directly or indirectly from the eyes. In some examples, both eyes are tracked separately by the respective eye-tracking camera and illumination source, and focus / gaze can be determined by tracking both eyes. In some examples, one eye (e.g., the dominant eye) is tracked by one or more respective eye-tracking cameras / illumination sources.

[0048] Electronic devices 201 and 260 are not limited to Figures 2A to 2B The components and configurations may include, but are not limited to, a few components, other components, or additional components in various configurations. In some examples, electronic device 201 and / or electronic device 260 may be implemented in various ways among multiple electronic devices (e.g., as a system). In some such examples, each electronic device (or more electronic devices) in the electronic device may include one or more of the same components discussed above, such as various sensors, one or more display generation components, one or more speakers, one or more processors, one or more memories, and / or communication circuitry. One or more persons using electronic device 201 and / or electronic device 260 may optionally be referred to herein as one or more users of the device.

[0049] Some examples of this disclosure relate to electronic devices and / or computer systems configured to convey information for viewing and / or interacting with virtual scenes. Virtual scenes may include virtual content and / or other information rendered on a specific device for viewing and / or interaction, such as virtual campsites, virtual offices, virtual meadows, virtual towns, etc. In some examples, virtual scenes may include user- and / or computer-generated assets, such as virtual floors, skies, object groupings, and / or metadata associated with such assets.

[0050] In some examples, the virtual scene can be displayed on the device. When the virtual scene is displayed, the device's users can view, edit, and / or share comments about the content of the virtual scene. In some examples, the display device presents the virtual scene in an extended reality (XR), virtual reality (VR), and / or mixed reality (XR) environment that includes a portion of the virtual scene. In some examples, an environment template, as further described herein, is used to display the virtual scene. In some examples, the environment template is included in a user interface for creating content. For example, the user interface can be used to facilitate the editing of a Universal Scene Description (USD) file and the virtual assets included in the USD file. The virtual elements included in the user interface and / or environment template can provide the device's users with the ability to inspect the virtual scene, comment on the virtual scene, and / or quickly collaborate with other users on other devices during the inspection of the virtual scene.

[0051] In some examples, the display device may display virtual content within elements included in an environment template used to display the virtual environment, and / or may itself be included in the environment template used to display the virtual environment. The virtual content may be displayed at a first level of detail, including the resolution, appearance, simulated lighting, and / or some combination thereof of the virtual assets displayed within the platform. The examples in this document illustrate several operations related to how virtual scenes are presented using environment templates and how a user of the device can interact with the virtual scene when a user interface is created based on the content displayed in the environment template.

[0052] The emergence of digital display technology has allowed professionals and hobbyists to create and share virtual content for consumers worldwide. For example, directors, cinematographers, visual effects artists, architects, designers, and software engineers can use digital tools to create, share, and interact with virtual content such as virtual backdrops, virtual scenes, virtual objects, and / or virtual user interfaces. Some devices are configured to present virtual content within virtual reality (VR), extended reality (XR), and / or mixed reality (MR) environments. By displaying virtual content in such environments, devices can achieve more intuitive, efficient, and novel ways to view and interact with virtual content. However, it is understandable that current platforms used to present virtual content implement limited or completely inflexible methods for presenting virtual content. Therefore, systems and methods for presenting virtual content in various spatial and interactive formats may be desired, especially in the context of creating different types of content during the media production workflow.

[0053] Some examples of this disclosure relate to different ways in which virtual content can be presented within a content creation user interface. The content creation user interface may include options for selecting the type of content creation project, such as a live experience, immersive video, spatial video, 3D cinema, and / or a regular cinema project. In some examples, the device may present virtual content and / or scenes based on an environment template. In some examples, the environment template may specify how the virtual content is displayed and / or what interactions are available to the user of the device when initiating the presentation of the virtual content and / or scenes. In some examples, one or more devices within the device may communicate using a multi-user communication session to interact concurrently and / or collaboratively with the virtual content. In some examples, a host device (such as a desktop computer and / or server) may stream data and metadata to one or more devices, thereby offloading at least some of the processing required for rendering and / or displaying the virtual content. In this way, the examples of this disclosure envisioned herein provide novel methods for rapidly creating, inspecting, and reviewing content, such as when creating 3D computer graphics data.

[0054] In some examples, devices (such as head-mounted devices) can display virtual scenes according to a template environment format. In some examples, displaying a virtual scene using an environment format includes displaying a virtual platform and / or a virtual background. In some examples, displaying a virtual scene using an environment format includes displaying a model of the virtual scene. In some examples, displaying a virtual scene using an environment format includes displaying a preview of virtual objects, such as viewing a portal. In some examples, displaying a virtual scene using an environment format includes displaying the virtual scene as an environment with an immersion level greater than a threshold immersion level. In some examples, displaying a virtual scene using an environment format includes displaying viewframes corresponding to areas within the virtual scene.

[0055] By rendering the same virtual scene based on various environment templates, the rendering device can ensure that virtual content is presented in a way that facilitates inspection, editing, and / or export of assets, such as presenting the virtual scene at an appropriate scale and / or view. For example, a virtual model displaying a virtual 3D environment can visually emphasize the spatial arrangement of multiple virtual objects, while when displaying a virtual platform, this spatial arrangement can be emphasized relatively less, within which one or more virtual objects, such as virtual roads and / or virtual objects, can be displayed. Additionally or alternatively, in some examples, the display viewing portal can present a 2D shape suitable for previewing how the virtual 3D environment will appear when used as a backdrop to generate 2D and / or video.

[0056] Understandable, regarding Figures 3 to 8 The specific order of input, determination, information presentation and other operations described are merely exemplary, and without departing from the scope of this disclosure, it is also contemplated that the order of such operations may differ from the explicitly described example.

[0057] Figure 3 Examples of electronic devices that present virtual 3D environment templates of virtual platforms, according to some examples of this disclosure, are illustrated. In some examples, electronic device 101 has features similar to those described above. Figure 1 The described electronic device 101 and / or the electronic device 201 described above with reference to Figure 2 have the same architecture. In some examples, in response to receiving an instruction on the format of the virtual platform environment, the following is displayed: Figure 3 The virtual scene shown is illustrated. In some examples, the virtual platform defines an area within which created virtual content can be displayed and / or interacted with. (Reference) Figure 3 Some of the examples described in this disclosure are applicable to additional or alternative examples, such as references Figures 4 to 8 The described examples (e.g., descriptions of attention, virtual environments in general, avatars, annotations, etc.). References Figure 3 Some examples of this disclosure described herein (such as those examples further referenced herein to platform 306) may involve displaying a virtual scene according to a virtual platform template when an instruction for a virtual platform environment format and / or environment template is received (such as a request received from computer system 312 at electronic device 101).

[0058] In some examples, electronic device 101 may be a first electronic device used by a first user 308 to display a user interface for viewing and interacting with virtual content and / or accessing and participating in a communication session. For example, electronic device 101 may be a mobile device (e.g., a tablet, smartphone, media player, or wearable device) or a computer or other electronic device. In some examples, the display generating component is a display integrated with the electronic device (optionally a touchscreen display), an external display such as a monitor, projector, television, and / or a hardware component (optionally integrated or external) for projecting the user interface or making the user interface visible to one or more users. In some examples, one or more input devices include electronic devices or components capable of receiving user input (e.g., capturing user input, detecting user input) and sending information associated with the user input to the electronic device. Examples of input devices include touchscreens, mice (e.g., external), trackpads (optionally integrated or external), touchpads (optionally integrated or external), remote control devices (e.g., external), another mobile device (e.g., separate from the electronic device), handheld devices (e.g., external), controllers (e.g., external), cameras, depth sensors, eye-tracking devices, and / or motion sensors (e.g., hand-tracking devices, hand motion sensors). In some examples, the electronic device communicates with a hand-tracking device (e.g., one or more cameras, depth sensors, proximity sensors, touch sensors (e.g., touchscreens or trackpads)). In some examples, the hand-tracking device is a wearable device, such as a smart glove. In some examples, the hand-tracking device is a handheld input device, such as a remote control or stylus.

[0059] In some examples, computer system 312 sends and / or receives (e.g., streaming) information, such as data. In some examples, computer system 312 includes some or all of the circuitry of electronic device 101 and / or electronic device 201 (e.g., referenced). Figure 1 and Figures 2A to 2B (As described). In some examples, electronic device 101 and computer system 312 are different types of devices. For example, computer system 312 may be a desktop or laptop computer, and electronic device 101 may be a wearable device, such as a head-mounted device. In some examples, computer system 312 uses one or more data formats, such as JavaScript Object Notation (JSON), Extensible Markup Language (XML), and / or Graphics Library Send Format (GLTF), to stream data. In some examples, computer system and / or electronic device 101 use the streamed data to render and / or otherwise represent scene graphs, object models, animation data, and other graphics-related information.

[0060] In some examples, electronic device 101 communicates with computer system 312 using one or more protocols, such as UDP (User Datagram Protocol) and / or TCP / IP (Transmission Control Protocol / Internet Protocol), to send data packets to and / or receive data packets from computer system 312. In some examples, computer system 312 may host and / or manage XR applications used by electronic device 101 to render the displayed virtual content. For example, the computer system may implement a client-server architecture, where a central computing unit (e.g., computer system 312) manages the state of the virtual environment and delivers updates to connected clients (e.g., electronic device 101 and additional or alternative devices).

[0061] In some examples, the three-dimensional environment is generated, displayed, or otherwise made viewable through a device (e.g., a computer-generated reality (CGR) environment, such as a virtual reality (VR) environment, a mixed reality (MR) environment, and / or an augmented reality (AR) environment). For example, the three-dimensional environment 302 may include the physical and / or virtual environment of the user 308 and the electronic device 101.

[0062] exist Figure 3 In this context, the 3D environment 302 includes a virtual 3D environment (e.g., sometimes referred to herein as a virtual scene), which includes multiple virtual objects and / or textures, and is displayed via a display 120 of the electronic device 101. In some examples, the electronic device 101 displays the virtual scene in a way that completely replaces the view of the physical environment, as if the user were physically present within a physical equivalent of the virtual scene. In some examples, displaying a virtual scene that replaces the user's view of the physical environment may correspond to displaying the virtual scene at an immersion level greater than a threshold immersion level, which is further described herein. In some examples, in response to detecting a change in the user's viewpoint in the physical environment (e.g., a change in user positioning and / or orientation), the electronic device may change the perspective of the virtual scene as if the user were changing their position within the virtual scene. Figure 3 The three-dimensional environment 302 is illustrated from the perspective of the electronic device 101 and additionally from the top view in the glyph 310 below the perspective of the electronic device 101.

[0063] In some examples, the virtual scene is an immersive 3D environment. For instance, the user of electronic device 101 can be immersed in its entire physical environment (including...). Figure 3The user moves physically within a region of the physical environment (exemplified as the area beyond the end of the housing of electronic device 101), and device 101 optionally updates the simulated viewpoints of the virtual sky, virtual floor, and objects in response to detecting a change in the user's viewpoint (e.g., the user's positioning and / or orientation relative to their physical environment). These simulated viewpoints are analogous to the physical viewpoints of the physical sky, physical floor, and / or one or more physical objects when the user moves relative to their physical environment. In some examples, the virtual scene included in the three-dimensional environment 302 may optionally include a simulated texture of a physically represented floor overlaid on the user's physical environment and / or a virtual floor having a simulated spatial contour (e.g., topography) different from the user's physical environment. Furthermore, the virtual scene may include a simulated atmosphere, such as a virtual sky (e.g., a simulated lower atmosphere at dawn, daytime, dusk, night, etc.). It should be understood that, without departing from the scope of this disclosure, the virtual scene can be any suitable computer-generated environment.

[0064] exist Figure 3 In this context, the user's physical environment is illustrated as the end extending beyond the casing of the electronic device 101. It should be understood that, for reference... Figure 3 The descriptions of the three-dimensional environment, virtual environment, and / or physical environment described herein may be applied at least in part to the references herein, such as those in the references provided. Figures 4 to 8 Additional or alternative example operations and techniques described in the three-dimensional environment, virtual environment and / or physical environment.

[0065] In some examples, the virtual scene is displayed as if it occupies one or more areas of the user's physical environment. Figure 3The physical environment outside the housing of electronic device 101, as illustrated herein, may include the physical room occupied by user 308. In some examples, a virtual scene may be displayed by display 120, at least partially replacing the view of the user's physical environment, thereby "consuming" the view of the physical environment. For example, electronic device 101 may include one or more outward-facing cameras (e.g., image sensors 114a to 114b) that acquire images of the user's physical environment, and these images may be displayed via display 120 as if the user could directly view the physical environment without the assistance of electronic device 101. At least a portion or all of such a view of the physical environment may be displayed at corresponding locations on display 120, with an opacity level less than a threshold level (e.g., 0%, 1%, 5%, 10%, 15%, 20%, 25%, 30%, 35%, 40%, 45%, or 50% opacity), and the virtual scene may be displayed at these corresponding locations with an opacity level greater than the opacity threshold level (e.g., 0%, 1%, 5%, 15%, 25%, 40%, 50%, 60%, 65%, 75%, 90%, or 100% opacity). Additionally or alternatively, in some examples, portions of the physical environment may be visible through transparent portions of the display without the display actively displaying those portions of the physical environment.

[0066] In some examples, the physical environment of user 308 may include one or more physical objects in the user environment, physical individuals in the user environment, physical walls, physical floors, etc. In some examples, electronic device 101 may present a representation of the user's physical environment. For example, Figure 3 The virtual scene included in the 3D environment 302 can be displayed with at least partial translucency, overlaying a representation and / or view of the user's physical environment presented via display 120 (e.g., images collected by sensors 114a to 114c of the user's physical environment). In some examples, presenting the 3D environment 302 includes displaying virtual content and / or presenting a view of the user's physical environment (e.g., via passive optical transmission including lenses and / or partially or fully transparent sheets of material such as glass). In some examples, the representation of the user's physical environment includes one or more images of the user's physical environment. In some examples, the electronic device 101 displays a real-time or near-real-time image stream (e.g., video) of one or more portions of the physical environment corresponding to the "representation" of the user's physical environment.

[0067] As previously described, in some examples of this disclosure, a virtual scene may include one or more virtual objects. These virtual objects may include digital assets modeled from physical objects, virtual placeholder objects (e.g., polygons, prisms, and / or simulated two- or three-dimensional shapes), virtual objects that include the user interface of an application (e.g., stored in memory by electronic device 101), and / or other virtual objects that may be displayed within a VR, XR, and / or MR environment. For example, a three-dimensional environment 302 may include a virtual road 328, a foreground 326 within a platform 306, and a virtual background corresponding to a background 304 including virtual trees, which may optionally be virtual assets displayed within the virtual scene at simulated locations similar to the physical location and orientation of physical objects relative to the viewpoint of user 308. It should be understood that more, fewer, and / or alternative objects may be displayed without departing from the scope of this disclosure.

[0068] In some examples, electronic device 101 concurrently displays virtual boundaries and / or borders in parallel with the virtual scene. For example, in Figure 3 The virtual platform 306 is displayed with a boundary that includes curves exemplifying circular boundaries. In some examples, the boundary is displayed with visual attributes such as color, brightness, saturation, opacity, hue, luminous effects that simulate lighting and / or mimic the visual appearance of light sources illuminating the virtual scene, and / or width, to distinguish the boundary from the three-dimensional environment 302. In some examples, the virtual boundary (and therefore the platform 306) may optionally be a triangle, pentagon, circle, ellipse, and / or any other suitable polygonal shape and / or a group of curves. In some examples, the virtual boundary is three-dimensional, occupying one or more portions of the virtual floor and / or one or more portions of the virtual scene above the virtual floor. For example, the boundary may optionally be a sphere, cube, rectangular prism, and / or another suitable volumetric shape, optionally including one or more visually distinguishable edges. Displaying virtual boundaries reduces the likelihood that a user will erroneously move relative to the three-dimensional environment in a manner that would cause the electronic device 101 to stop displaying virtual content within and / or corresponding to the virtual boundary, thereby reducing the processing required to perform operations based on such erroneous movements.

[0069] In some examples, electronic device 101 uses a first rendering technique to display virtual content within platform 306. For example, electronic device 101 may use the first technique to display first content in foreground 326 at one or more first levels of detail. It should be understood that the specific rendering technique is not limited, but may include one or more of the following: multi-rendering of the target virtual content, deferred rendering and forward rendering, screen-space effects (such as ambient occlusion, subsurface scattering and / or distortion and refraction), stereo rendering, foveated rendering, asynchronous time warp, reprojection, late latching, deferred shading, ray tracing, ray casting, radiosity analysis, path tracing, neural rendering, and / or some combination thereof. It should also be understood that, in general, virtual content may be rendered as a relatively high-resolution portion of an image, video, and / or animation presented by electronic device 101 for user interaction with electronic device 101. By using a first rendering technology to display virtual content, the user of electronic device 101 can inspect the high-fidelity portion of the virtual scene, which can reduce the time and effort required to closely examine virtual assets when creating virtual content using virtual scenes (e.g., images, videos, animations, immersive virtual experiences, and / or using virtual scenes as a backdrop for traditional media such as television and / or movies).

[0070] In some examples, electronic device 101 displays virtual content outside of platform 306 using a second rendering technique different from the first rendering technique. For example, electronic device 101 may use a second rendering technique to display background 304, which may include displaying a lower resolution, a lower amount of shading and / or texture detail, and / or some combination thereof. In some examples, using a second rendering technique to display virtual content includes displaying the virtual content outside of platform 306 at a second level of detail different from the first level of detail. It should be understood that the second rendering technique may include one or more characteristics similar to or the same as those described with reference to the first rendering technique. In some examples, the second rendering technique may differ from the first technique by omitting one or more techniques, setting different thresholds for the algorithm used to determine how the virtual content is displayed, or by including one or more techniques and / or some combination thereof not included in the first rendering technique. Furthermore, the hybrid rendering method reduces the computational requirements of electronic device 101 and / or the computer system communicating with electronic device 101 by potentially using more computationally intensive techniques for virtual content closer to the user's viewpoint and / or less computationally intensive techniques for virtual content farther from the user's viewpoint.

[0071] Generally speaking, it should be understood that by utilizing a second technology to display virtual content, electronic device 101 can reduce the computation required to display the virtual content compared to displaying the same virtual content using a first rendering technology. For example, electronic device 101 can display a virtual cloud at a lower resolution than if the virtual cloud were displayed in platform 306. Additionally or alternatively, the cloud can move in response to the detection of movement of the viewpoint of electronic device 101 to simulate a parallax effect. In some examples, virtual content outside platform 306 corresponds to the midground and / or background of the virtual scene. In some examples, electronic device 101 can render other parts of the virtual scene concurrently with platform 306 and / or background 304, such as by using a third rendering technology different from the first and / or second technologies. By utilizing multiple rendering technologies to simplify the computational complexity that may be involved in displaying virtual content, electronic device 101 and / or the computer system streaming data used to display virtual content at electronic device 101 reduce the amount of data that can be transmitted and / or reduce the processing required at electronic device 101 and / or at the computer system.

[0072] In some examples, electronic device 101 can detect input toward virtual content included in the three-dimensional environment 302 (e.g., gaze, voice commands, air gestures (e.g., air pinching, air pointing, and air gripping involving one or more of the user's fingers), contact with a trackpad, and / or selection using a stylus). In response to receiving input pointing to a virtual object, electronic device 101 can initiate scaling and / or movement of the virtual object in a first dimension, and the scaling and / or movement corresponding to a first magnitude corresponding to the direction and / or magnitude of the user input. Additionally or alternatively, electronic device 101 can initiate scaling of the virtual object in a second, different direction in response to input pointing to the virtual object.

[0073] In some examples, the electronic device 101 displays the virtual scene with a first visual appearance when the user 308's positioning and / or orientation corresponds to a region of the three-dimensional environment 302 corresponding to the virtual scene. Thus, for example, the electronic device 101 displays the virtual scene at a first level of immersion (e.g., full immersion, where the virtual scene replaces any representation of the user's physical environment). In some examples, the immersion level includes or corresponds to the degree to which the virtual content consumes the viewport of the electronic device 101. In some examples, the immersion level additionally or alternatively includes visual characteristics of the virtual scene, such as opacity, brightness, saturation, resolution level, and / or some combination thereof. For example, a threshold immersion level may define a percentage value and / or location within the three-dimensional environment 302 consumed by the virtual three-dimensional environment, such as 5%, 15%, 25%, 35%, 50%, 75%, or 90% immersion levels. For example, the electronic device 101 may display presented virtual content that replaces a representation of the physical environment, and the percentage of the viewport consumed by the virtual three-dimensional environment may increase as the immersion level increases. Therefore, when a virtual 3D environment is displayed at 100% immersion level, the user 308 may optionally (temporarily) not see physical objects that may be in their physical environment. Thus, increasing the immersion level may optionally result in more of the virtual environment being displayed, replacing and / or occluding more of the physical environment, and decreasing the immersion level may optionally result in less of the virtual environment being displayed, thereby revealing previously undisplayed and / or previously occluded portions of the physical environment.

[0074] In some examples, before initiating the display of a virtual scene, electronic device 101 displays the boundaries of a virtual platform 306 that overlays a representation of the user's physical environment (e.g., images and / or videos), prompting the user 308 to remove physical objects from the area of ​​the three-dimensional environment 302 defined by the boundaries. Figure 3 In this context, the electronic device 101 displays the previously described virtual sky, virtual floor, and virtual objects at a relatively high level of opacity (e.g., 100% opacity).

[0075] In some examples, electronic device 101 displays one or more representations of individuals other than user 308 via display 120. For example, electronic device 101 may display virtual avatars and / or supplementary or alternative media, such as a virtual window including an image of the user corresponding to the avatar. Thus, electronic device 101 may display representations of other individuals virtually or physically included in the user's three-dimensional environment 302. For example, the representation may be an expressive avatar, such as an anthropomorphic avatar, having one or more body parts that can move relative to each other. These body parts may optionally include a head, hands, arms, shoulders, neck, legs, fingers, toes, facial features, etc. In some examples, the representation may correspond to an individual sharing the user's physical environment, such as an individual in the user's physical room. In some examples, the representation is presented via passive optical transmission (e.g., lenses, transparent materials, and / or direct visibility to the user's eyes) and corresponds to their respective views of the corresponding physical user. As an example of a fully expressive avatar or a representation of a physical individual sharing the user 308's physical environment, the representation may include multiple body parts. In some examples, the representation includes a partially expressive avatar or electronic device that does not physically share the physical environment of user 308. It should be understood that such representations are merely exemplary, and additional or alternative representations of the user corresponding to the electronic device may be included in the three-dimensional environment 302.

[0076] In some examples, a user's representation may correspond to an individual not present in the user's physical environment but represented using spatial information. In some examples, electronic device 101 uses spatial information to map portions of the user 308's physical environment to portions of a virtual scene, and / or to map portions of the physical environment of an individual corresponding to the user's representation to portions of a virtual scene. For example, a communication session between electronic device 101, a first electronic device used by a first user represented by a first representation, and a second electronic device used by a second user represented by a second representation can be ongoing to facilitate mapping between the physical environments of the respective users of the respective electronic devices. In some examples, the communication session includes communication of information corresponding to real-time or near-real-time communication of sound detected by the electronic device (e.g., speech, user-generated sounds, and / or ambient sounds). In some examples, the communication session includes communication of information corresponding to real-time or near-real-time movement and / or requests to move a representation (e.g., an avatar) corresponding to a user participating in the communication session.

[0077] For example, a first electronic device can detect movement of a first user corresponding to a first representation in the user's physical environment (e.g., a physical environment different from that of user 308), and can communicate information indicating that movement to electronic devices (including electronic device 101) participating in the communication session. Before movement is detected, the first electronic device can display a virtual scene relative to the viewpoint of the first electronic device (e.g., positioning and / or orientation relative to the virtual scene, similar to the physical positioning and / or orientation of the user relative to a physical equivalent of the virtual scene). In response to the detection of movement (e.g., obtaining information indicating movement from another electronic device), the first electronic device can update the viewpoint of the user of the first electronic device to a newer viewpoint based on physical movement (e.g., in a certain direction, and / or moving by a certain amount of movement), as if the user of the first electronic device were physically moving through a physical equivalent of the virtual scene. It is understood that, in addition to detecting the user's physical movement or as an alternative to detecting the user's physical movement, such a request for movement may be directed to an input device (e.g., a virtual joystick, trackpad, physical joystick, virtual button, physical button, and / or another suitable control). Electronic device 101 can receive such information and, in response, can cause the representation to move relative to the virtual scene, the magnitude and / or direction of which mimics the physical movement of the user of the first electronic device relative to the user's physical environment. It should be understood that other electronic devices (such as the electronic device corresponding to the second representation and / or electronic device 101) can also detect similar inputs described with reference to the first electronic device and cause their corresponding representations to move within the virtual scene.

[0078] It should also be understood that the movement and / or placement of a user's representation participating in a communication session can be defined relative to a shared coordinate system, rather than strictly relative to the virtual dimensions of the virtual scene. For example, electronic device 101 can present a view of the physical environment of user 308 that does not include the virtual scene, and can display the user's representation at a location within the view of the physical environment, and / or display the movement of the user's representation within the view of the physical environment. It should be understood that regarding Figures 3 to 8 The described examples can occur during a communication session (described herein) and convey information about the physical user's location, orientation, audio, and / or other aspects, and / or information provided by the physical user, which can be exchanged via the communication session to the devices participating in the communication session. It should be understood that, depending on the context, the actions described with reference to virtual content displayed relative to the virtual scene can be displayed relative to a representation of the user's physical environment (such as visual indications of the user 308's attention as described below).

[0079] In some examples, electronic device 101 displays one or more visual cues indicating the user's attention within a three-dimensional environment 302. For example, electronic device 101 detects the virtual location of the target of the user's attention (e.g., gaze) and displays a visual cue at that virtual location, thereby presenting a visual cue of the portion of the three-dimensional environment 302 to which the user's attention is directed. In some examples, one or more parts of the user's body other than the eyes are used to indicate the target of the user's attention. For example, although... Figure 3 Not shown, but electronic device 101 can detect the spatial relationship between the contact points between one or more fingers of user 308's hand (e.g., forming an air pinch gesture or an air pointing gesture) and electronic device 101. This spatial relationship can be based on light rays projected from a part of electronic device 101 (such as the center of electronic device 101), passing through various parts of the user's body (e.g., through the air pinch gesture, through the fingertips arranged in the air pointing gesture), and extending toward a location within the virtual scene.

[0080] In some examples, electronic device 101 detects attention and / or obtains information indicating the target of attention, and electronic device 101 responds to the detection and / or obtaining to display a visual indication of attention. Based on determining that the user's attention is directed to an invisible part of the virtual scene (e.g., as if a physical user is gazing at a part of a physical object in the user's physical environment that corresponds to a representation not visible to user 308 from their perspective), electronic device 101 abandons the display of a representation of attention to that representation. Additionally or alternatively, electronic device 101 may utilize modified appearances (e.g., different spatial contours, such as simulated illumination around a portion of virtual trees included in the foreground 326, arrows with simulated depth curving behind virtual trees, and / or visual characteristics (e.g., opacity, blur, saturation, and / or simulated lighting effects)) to display a visual indication of attention to convey that the target of the user's attention corresponding to the representation is currently invisible to user 308. It should be understood that visual indications of attention may be displayed, and are sometimes omitted from the figures for convenience.

[0081] In some examples, the virtual scene has simulated depth, and visual cues are displayed at locations based on the user's attention and / or the spatial relationship between the electronic device 101 and the air gesture. For example, due to the user's gaze and / or light projected from the electronic device 101 through the air pinch gesture intersecting with the location on the virtual floor, Figure 3 The electronic device 101 in the virtual scene can display a visual indication at the location on the surface of the virtual floor included in the virtual scene.

[0082] In some examples, as described herein, electronic device 101 may display indications of other users' attention. For example, in Figure 3 In this context, a user's attention (e.g., gaze) corresponding to another user's representation on another electronic device is directed towards a virtual floor. That user's electronic device can detect that the floor is the target of the user's attention and can communicate information indicating that target to electronic device 101. In response to receiving this information, electronic device 101 can display a visual indication of the attention. It should be understood that, in some examples, in response to detecting information that the corresponding user's attention has changed relative to the 3D environment 302 and / or the virtual scene, the corresponding electronic device can communicate information indicating the movement of attention towards an updated target. In response to receiving such updated information, electronic device 101 can move the visual indication of attention to an updated position and / or orientation relative to content included in the virtual scene based on the updated information. In some examples, the visual indication of attention is displayed as a representation covering the physical environment of user 308 (e.g., excluding a portion of the virtual scene).

[0083] In some examples, electronic device 101 selectively displays visual indicators of attention. For example, electronic device 101 may display visual indicators of attention when an interaction mode relative to the virtual scene (e.g., edit mode) is enabled. In some examples, electronic device 101 refrains from displaying visual indicators of attention when the interaction mode is disabled. Similarly, electronic device 101 may display other visual indicators of other users' attention when the interaction mode is enabled, and may refrain from displaying visual indicators of other users' attention when the interaction mode is disabled. In some examples, electronic device 101 displays visual indicators of attention based on user preferences. For example, user settings specified by electronic device 101 may allow or disable the sharing of visual indicators of user 308's attention with other users participating in a communication session with electronic device 101. In some examples, visual cues of attention may be displayed in response to the detection of a visual cue within the three-dimensional environment 302 (e.g., a predefined air gesture performed by the user's body, a posture of one or more parts of the user's body, a verbal request to display a visual cue and / or a selection of virtual and / or physical controls (e.g., buttons, sliders, and / or menu options)) and / or an explicit request to share the visual cue with other devices participating in a communication session with electronic device 101.

[0084] Figure 4Examples of displaying an environment template including a virtual model according to some examples of this disclosure are illustrated. In some examples, electronic device 101a displays model 404. In some examples, electronic device 101a displays visual indication 406 corresponding to a portal view. A portal (such as portal 410) can provide a preview of at least a portion of the virtual environment, similar to how a user can peer a physical equivalent of the virtual environment through a physical window. The scale of the virtual content in model 404 may differ from the scale of the virtual content when electronic device 101a immerses itself in the virtual environment (e.g., the scale of building 412 in model 404 may be greater or smaller than the scale of building 414 in portal 410). In some examples, when displaying model 404 and / or portal 410, electronic device 101a concurrently presents a view of the physical environment (e.g., with reference to...). Figure 3 (Similar or identical to the described). In some examples, when the environment format corresponds to the virtual model and / or viewing portal format, electronic device 101a is based on at least the reference Figure 4 One or more examples are described to represent the virtual environment.

[0085] Displaying virtual models and / or viewing portals can provide users of electronic devices with a quick preview and / or inspection of virtual content included in a virtual 3D environment and / or ways to modify that content. By displaying virtual models, users can quickly view the overall composition of the virtual 3D environment, such as how a collection of buildings from an Old Western set can be arranged within the virtual scene. By displaying viewing portals, users can quickly view a detailed collection of virtual objects, textures, etc., included in the virtual 3D environment, and / or verify how the virtual content is presented according to user preferences when implemented at scale. Furthermore, displaying scaled models of the virtual 3D environment can reduce the computational and power consumption originally required to display the virtual 3D environment at a user-scale.

[0086] In the context of media production workflows, viewing the portal allows users of electronic devices to quickly preview and edit the effects of virtual content included in a virtual 3D environment. Additionally or alternatively, when an electronic device receives data streaming from a computer system (as referenced...), Figure 5(Further described) Systems including electronic devices and computer systems can facilitate real-time editing and / or inspection of virtual 3D environments without the excessive time required for rendering, then sharing, and then inspecting the generated or edited virtual 3D environment. Furthermore, by initiating the display of the virtual environment based on a virtual model and / or viewing portal environment templates, electronic devices reduce user input for visually configuring and / or emphasizing portions of the virtual environment that may be used at specific stages of the media production workflow and / or for corresponding types of media content. By concurrently displaying model 404 and portal 410, a single device (e.g., electronic device 101) can display different views of the virtual content, thereby quickly identifying the appearance of the same virtual content displayed in different environment formats.

[0087] In some examples, the display environment template includes one or both of display model 404 and portal 410, such as displaying model 404 and portal 410 concurrently. In some examples, electronic device 101a displays model 404 at a first size and / or portal 410 at a second size relative to the 3D environment 402. Model 404 may represent a miniaturized version of the virtual environment, similar to a stereoscopic model of the 3D environment. In some examples, model 404 is displayed with a visual appearance according to settings specified in the template. For example, settings may be configured to display model 404 without texture. Displaying model 404 without texture can save processing required to examine aspects of model 404, such as the size of virtual objects, the spatial arrangement of virtual objects, the number of virtual objects, and / or the appearance of the simulated skyline.

[0088] In some examples, portal 410 is a two-dimensional rendering of a virtual environment. In some examples, the content displayed in portal 410 corresponds to the projection of visual indicator 406 relative to model 404. For example... Figure 4 As shown, for example, portal 410 includes building 414, which corresponds to building 412 in model 404, because the projection of the content included in model 404 and the zoom visual indication 406 include the front of building 412.

[0089] In some examples, portal 410 and model 404 are rendered using different rendering techniques. In other examples, portal 410 and model 404 are rendered with different visual characteristics (e.g., due to differences in rendering techniques). For example, model 404 can be displayed as a wireframe excluding lighting effects, shading layers, textures, etc. In contrast, portal 410 can be displayed using some or all of the aforementioned visual effects, making the content displayed in portal 410 look closer to the final rendered appearance and / or appear more realistic.

[0090] In some examples, the environment template defines the positioning of model 404 and portal 410 relative to each other and / or the viewpoint of electronic device 101a. For example, model 404 can be displayed at a first positioning, and portal 410 can be displayed at a second, different positioning. In some examples, when using Figure 4 Before the template shown initiates the display of the virtual environment, a first location and / or a second location are predetermined. In some examples, electronic device 101a detects one or more inputs requesting the movement of virtual model 404 and / or portal 410, and in response, moves virtual model 404 and / or portal 410 according to the one or more inputs.

[0091] In some examples, electronic device 101a communicates with one or more other electronic devices, as shown in the reference. Figure 5 As described. In some examples, each electronic device may display a preview of the virtual 3D environment at the same location relative to the physical environment as the location where electronic device 101a displays the preview of the virtual 3D environment. For example, the preview of the virtual 3D environment, which may include one or both of virtual model 404 and portal 410, may be world-locked. In some examples, if the preview of the virtual 3D environment is world-locked, the positioning of the preview of the virtual 3D environment will not change in response to the detection of movement of electronic device 101a (or one of the other electronic devices capable of accessing the virtual 3D environment). Therefore, the 3D environment may not move relative to a spatial reference other than the viewpoint of electronic device 101.

[0092] In some examples, model 404 is body-locked to the user. For example, model 404 may be body-locked to the user regardless of whether electronic device 101a displays model 404 without displaying a viewing portal previewing the virtual 3D environment. In some examples, model 404 is world-locked. For example, model 404 is world-locked regardless of whether electronic device displays the model without displaying portal 410 and / or while portal 410 is displayed concurrently.

[0093] In some examples, model 404 includes indications for a virtual camera, such as images, graphics, icons, and / or lighting effects displayed in a 3D environment, indicating a viewpoint relative to the 3D environment from which a 2D image of the virtual 3D environment can be generated. For example, model 404 includes indications for a virtual camera facing building 412, from which electronic device 101a and / or a computer system communicating with electronic device 101a can generate a 2D image of building 412, similar to the appearance of a physical camera pointing at a physical building. Additionally or alternatively, background virtual content existing in the virtual 3D environment behind building 412 may be included in the image. In some examples, the virtual camera is not associated with and / or is different from the viewpoint of user 408 relative to the 3D environment. For example, the view of the virtual 3D environment presented by the virtual camera may differ from the viewpoint of user 408 presented by electronic device 101a. In some examples, in response to detecting input for updating the positioning and / or orientation of the virtual camera, electronic device 101a updates the virtual camera in model 404 and changes the displayed image to correspond to the viewpoint indicated by the virtual camera relative to the virtual 3D environment. In some examples, electronic device 101 is capable of storing one or more virtual images and / or viewpoints of virtual cameras in a virtual 3D environment. In some examples, electronic device 101a derives some or all of a virtual environment, which may include the positioning and / or orientation of virtual model 404, portal 410, visual indicators 406 relative to virtual model 404, the positioning and / or orientation of one or more virtual cameras, and / or some combination thereof. Additionally or alternatively, electronic device 101a may generate media such as images reflecting the positioning of virtual cameras, two-dimensional and / or three-dimensional videos corresponding to virtual cameras, and / or immersive videos corresponding to the placement of virtual cameras within model 404.

[0094] Figure 5 Examples of displaying a virtual environment at an immersion level greater than a threshold immersion level, according to some examples of this disclosure (e.g., as referenced in...) Figure 3 (As described). In Figure 5 In this context, when communicating with electronic device 101b and / or computer system 516, electronic device 101a displays immersive virtual content included in a virtual environment 502 (e.g., a virtual 3D environment) within an immersive area 512. Electronic device 101a can display the virtual environment 502 according to an immersive environment template, which, when implemented at electronic device 101a, allows electronic device 101a to display the virtual environment 502 at an immersion level greater than a threshold immersion level, as further described herein.

[0095] Computer system 516 can stream scene data to electronic devices 101a and / or 101b, and can concurrently display the virtual environment 502 via a monitor while electronic device 101a displays an immersive view of the virtual environment 502 (e.g., a 3D environment). Additionally or alternatively, electronic device 101b can concurrently display virtual objects 514, which may include perspective views corresponding to the viewpoint of electronic device 101a. When any of electronic devices 101a, 101b, and / or computer system 516 provides input to change the virtual content in the virtual environment 502, such change can be displayed by another electronic device and / or computer system. Therefore, electronic devices 101a and 101b and computer system 516 can communicate to collaboratively develop the virtual content included in the virtual environment 502.

[0096] In some examples, electronic devices 101a and / or 101b have one or more characteristics, such as circuitry and architecture, and / or performance references. Figure 1 The electronic device 101 and / or shown Figures 2A to 2B The electronic device 201 and / or shown Figure 3 The operational capability described in the electronic device 101a. Figure 5 Electronic device 101a is being used by user 518a to participate in a multi-user communication session, and electronic device 101 is being used by user 518b to participate in a multi-user communication session. In some examples, the multi-user communication session has the same characteristics as the reference. Figure 3 One or more properties that are similar to or the same as those described.

[0097] In some examples, the immersive area 512 corresponds to which parts of the physical environment 500 are replaced by the display of the virtual environment 502. For example, electronic device 101a may display the virtual environment 502, which replaces the visibility of walls, ceilings, floors, and / or physical objects. In some examples, electronic device 101a detects input to join a multi-user communication session and, in response, initiates a call to, for example... Figure 5 The virtual environment 502 shown is displayed. Because the environment format corresponds to an immersive type format, the electronic device 101a abandons the display of the virtual model and / or two-dimensional portal to facilitate the display of a three-dimensional version of the virtual environment 502, thereby consuming at least a portion of the display of the electronic device 101a. In some examples, the immersive area 512 is a percentage of the viewport of the electronic device 101a (e.g., 50%, 60%, 70%, 80%, 90%, or 100%).

[0098] In some examples, the degree to which the virtual content replaces the visibility of various aspects of the physical environment 500 corresponds to the immersion level. The immersion level may include a percentage of the display 120 that includes the virtual environment 502 (and excludes the view of the physical environment 500 reproduced via a camera that transmits transparency and / or the physical environment 500). The immersion level may, for example, include the width and / or height of the display 120 that includes continuous virtual content. The immersion level may additionally or alternatively include the positioning of the virtual content covering the physical environment 500 within the three-dimensional environment, such as defining the boundary between the start of the virtual environment 502 and the physical environment 500. In some examples, in response to detecting a movement of the viewpoint of the electronic device 101a relative to the virtual environment 502 and / or the physical environment 500 that changes its positioning and / or orientation, the electronic device 101a updates the portion of the virtual environment 502 displayed according to that movement. Therefore, the electronic device 101a may maintain the display of the virtual environment 502 (e.g., consuming the center or entirety of the display of the electronic device 101a). In contrast, electronic device 101a can stop displaying the portal rendering of virtual environment 502 in response to detecting a movement of the viewpoint away from the portal rendering.

[0099] In some examples, electronic devices 101a and / or 101b communicate to cause electronic device 101b to display a view of electronic device 101a from the perspective of virtual environment 502. For example, electronic device 101a may transmit information to electronic device 101b, and in response to receiving such information, electronic device 101b may display virtual object 514 and / or populate virtual object 514 using immersion area 512, display portion of virtual environment 502, and / or visible portion of physical environment 500. In some examples, this information may additionally or alternatively be communicated to computer system 516, and computer system 516 may display the perspective of electronic device 101a.

[0100] In some examples, computer system 516 displays a model of the virtual environment. In some examples, computer system 516 renders the virtual environment with a higher level of visual fidelity than other renderings of the virtual environment on devices with lower computing power (e.g., head-mounted devices or mobile phones). For example, computer system 516 may utilize shaders and textures to display a full rendering, while electronic device 101a displays a simplified or schematic version of the same set of virtual content. Additionally or alternatively, electronic device 101a may utilize some of the shaders and / or textures displayed on computer system 516 but with a lower polygon count, texture resolution, shading accuracy, global illumination, and / or some combination thereof to display a preview of virtual environment 502.

[0101] In some examples, computer system 516 can host a collaborative review session where electronic devices participating in the communication session exchange information about the placement of annotations regarding their observations and comments about the virtual environment 502. In some examples, each device and / or computer system participating in the communication can detect input (e.g., text, virtual pins, spatial records of a user moving throughout the virtual environment 502, voice input, instructions for gazing, the user's attention and / or the pointing of a finger or cursor and / or some combination thereof) that inserts annotations into the virtual environment 502 and / or into a record of the user's review of the virtual environment 502 during their session. In response to the detection of input, the detecting device can share the annotations with other devices in a multi-user communication session. In response to receiving an instruction for an annotation from another device, the receiving device can display the annotation overlaying the virtual environment 502. At both the transmitting and receiving devices, the annotations can share their positions within the virtual environment 502, thereby synchronizing the placement of annotations between the devices.

[0102] In some examples, one or more of electronic devices 101a, 101b, and / or computer system 516 define the characteristics of the environment template. For example, computer system 516 may display a user interface for content creation and may display a menu of different project types available. Project types may correspond to possible expected outputs of virtual content generated when using a project, such as spatial video (e.g., linear 3D video presented via virtual frames including parallax simulation), immersive video (e.g., video presented immersively around the user's viewpoint, consuming 180 or 360 degrees), 3D environment projects, and / or regular 2D video. When a project is created based on the selected project type, computer system 516 may automatically adopt a specific environment format, such as those described herein. Additionally or alternatively, computer system 516 may prompt the user of computer system 516 with additional characteristics of the format, such as the size of the portal, the positioning of the portal, the size and / or positioning of the virtual model, the level of immersion, whether a virtual model and / or portal is included, the size of the view frame, the dimensions of the virtual platform, the spatial outline of the virtual platform, and / or the background used for projecting background content and / or some combination thereof.

[0103] In some examples, computer system 516 may transmit data and / or metadata to other devices during a communication session, based on any user-specified settings and / or settings left as default. In some examples, the receiving device may approve (or reject) an invitation to receive data and / or metadata and may display a view of the environment based on an environment template and / or settings indicated by computer system 516. In some examples, other devices (such as electronic devices 101a and / or 101b) may define some or all of the aforementioned characteristics of the environment format and may display virtual environment 502 (or other virtual environments) based on specified characteristics and / or settings. Displaying a 3D representation concurrently with a 2D view or simulated 2D view of the environment in an immersive view allows a single device to potentially render concurrent representations of the same virtual scene in different ways. This can reduce the processing required to display different views of the same view on different devices and can reduce the number of devices used to preview how different views can be rendered on different types of displays (e.g., immersive and conventional 2D displays, such as televisions). Additionally, scenes can be presented in a way that simulates the experience of being placed within a scene while simultaneously providing the user with visibility of their physical surroundings. This improves the user's perception of their physical environment when presenting an immersive view of the scene that another electronic device might present, such as previewing how the scene might look when presented by an XR-capable electronic device.

[0104] Figure 6 Examples of the review of the animation are shown. In some examples, electronic device 101 uses reference... Figure 4 The described similar or identical technology is used to display the portal. Figure 6 In this context, computer system 616, in response to detecting input from user 618d initiating animation replay, initiates the display of animation of virtual assets moving relative to the virtual scene. In some examples, portal 610 may display a view of the virtual 3D environment. For example... Figure 6 As shown, the environment format can correspond to the template in which portal 610 is displayed without concurrently displaying virtual models of virtual 3D environments.

[0105] Users 618a to 618c who participate in a multi-user communication session with computer system 616 via electronic devices 101a to 101c can concurrently present portal 610 via electronic devices 101a to 101c. For example, computer system 616 can stream virtual scenes and / or animation data to electronic devices 101a to 101c for displaying animations. Electronic devices 101a to 101c can display portal 610 in a corresponding orientation based on the corresponding viewpoint of electronic devices 101a to 101c relative to their position within the physical environment specified by computer system 616.

[0106] In some examples, animated virtual content can move beyond the size of portal 610, such as into areas where the physical environment is rendered and / or displayed. For example, virtual object 620 corresponding to a virtual representation of a dinosaur... Figure 6 The center is shown as protruding from the surface of portal 610. (See reference...) Figure 4 As described, a portal (such as Portal 610) can be a two-dimensional virtual object. For example... Figure 6 As shown, the virtual object 620 is displayed as a portion of the physical environment corresponding to the three-dimensional environment of the electronic devices 101a to 101c (e.g., extending beyond and outside the surface of portal 610). In some examples, the computer system 616 may share information that introduces new animations into the virtual three-dimensional environment while a communication session is in progress. In response to receiving information from the computer system 616 during a communication session, the electronic devices 101a to 101c may initiate animations as described above (e.g., move beyond portal 610). Thus, the computer system 616 can cause the display of animated virtual content extending beyond portal 610, which was initially created during a collaborative communication session between the computer system 616 and the electronic devices 101a to 101c.

[0107] In some examples, when portal 610 is displayed, electronic devices 101a to 101c and / or computer system 616 can detect the target of attention and share the target of attention with other participants in a multi-user communication session. By displaying the target of attention, the device can effectively point to and / or understand the target of discussion. In some examples, displaying the target of attention is used when indicating the expected animation of an object moving within a virtual 3D environment.

[0108] For example, electronic device 101a can detect a user's gaze toward locations within portal 610, can detect the user pointing at these locations with their fingers and / or using a pointing device (such as a stylus), and / or can detect movement of a joystick controlling the cursor. Electronic device 101a can display visual cues of the target of attention, such as a glowing cursor at the target location, and can track paths across the virtual environment based on detected movement of attention throughout portal 610. Electronic device 101a can share information indicating attention with other electronic devices 101b and 101c and / or computer system 616. In response to receiving this information, the device can display visual cues of the attention being aimed at and / or moved throughout the virtual environment, thereby reflecting the movement of attention.

[0109] In some examples, the electronic device can detect input requesting the placement of annotations into a virtual 3D environment. In response to the detection of this input, the electronic device can prompt the user for information corresponding to the annotation and / or description of the virtual object. For example, electronic device 101a can display a user interface prompting the user to provide voice, air gestures, text input (e.g., via a virtual or physical keyboard), movement, attention, and / or other suitable information modalities. Such a user interface may include one or more virtual buttons to initiate recording of text input, voice recording, movement recording, and / or the user's attention, and / or to stop such text input and / or recording. In some examples, the information provided by the user includes a description associated with the virtual object, the name of the virtual object, metadata associated with the virtual object (such as the category of the virtual object), and / or other suitable information that a future inspector of the virtual object might be of interest. After the text input and / or recording provided by the user is completed, the electronic device can stop displaying the user interface and / or associate the provided information with the corresponding virtual object. In some examples, the electronic device starts recording and / or initiates text input in response to the insertion of a virtual object and / or in response to the detection of input pointing to an animated virtual object, without displaying a dedicated user interface. Using portal 610 to present virtual scenes allows several devices to synchronize views of the same set of virtual content and / or eliminates the need for a dedicated external monitor that occupies the physical environment, thereby increasing the likelihood that users can collaboratively inspect, edit, and / or export media while and / or after collaborating with workstations or other computer systems (such as computer system 616).

[0110] Figure 7 Examples of electronic devices that present virtual 3D environment templates, including virtual models and environment previews, according to some examples of this disclosure are illustrated. (See reference...) Figure 4 and Figure 6 As described, electronic devices (such as electronic devices 101a to 101c) can communicate with each other and / or with computer systems that stream data to electronic devices 101a to 101c. In some examples, the data can be used to render a virtual 3D environment based on an environment template. For example, Figure 7 Electronic devices 101a to 101c can receive requests from the computer system to display instructions for a virtual 3D environment based on an environment format that includes a preview of the virtual 3D environment (such as portal 710 and virtual model 704). It should be understood that, with reference to... Figure 4 and Figure 6 Some or all of the techniques and / or operations described in the template shown may be applied to the reference. Figure 7 The example described.

[0111] In some examples, the environment format and / or data from the computer system additionally or alternatively indicate the spatial arrangement of portal 710 and / or virtual model 704, and / or which part of the virtual environment is presented within portal 710 and / or virtual model 704. For example, portal 710 may present a two-dimensional view of a portion of a virtual three-dimensional environment represented in three dimensions within virtual model 704. Additionally or alternatively, portal 710 and / or virtual model 704 may include different parts of the virtual three-dimensional environment. For example, in Figure 7 In this context, virtual model 704 includes rectangular virtual objects 720 that are not displayed and / or rendered in portal 710. For example... Figure 7 As shown, it is assumed that portal 710 corresponds to a part of the virtual 3D environment that is different from the part displayed in virtual model 704, and virtual model 704 does not include visual indications corresponding to portal 710.

[0112] like Figure 7 As shown, portal 710 and virtual model 704 are displayed at locations within a representation of the same physical environment for each of the electronic devices 101a to 101c. Therefore, portal 710 and virtual model 704 can be world-locked virtual content. In some examples, users 718a to 718c can move the portal and virtual model 704 relative to their three-dimensional environment. For example, electronic devices 101a to 101c can detect input pointing to selectable options (such as buttons and / or icons) and, in response, can move portal 710 and / or virtual model 704 individually or concurrently based on that input. In some examples, when the first electronic device moves portal 710 and / or virtual model 704, other electronic devices participating in the communication session move portal 710 and / or virtual model 704 to an updated location specified by the input detected by the first electronic device. By concurrently displaying the virtual model 704 and portal 710, electronic devices 101a to 101c can synchronize spatial data that specifies the position of virtual assets within portal 710 and visualize this spatial data as occupying three dimensions of a three-dimensional environment, thereby presenting the virtual scene in a more intuitive way and / or in a way that might be impossible with conventional two-dimensional displays. Furthermore, as referenced... Figure 7 The described communication session between electronic devices 101a and 101c for editing and / or previewing spatial media allows for concurrent examination of the spatial relationships of assets in the spatial media using virtual model 704, while also previewing how the view from the simulated camera can capture the assets, as presented in portal 710.

[0113] In some examples, the computer system streaming environmental data to electronic devices 101a to 101c and / or the electronic devices 101a to 101c can change between environmental templates. For example, electronic devices 101a to 101c can detect input that changes the environmental template used to render the virtual 3D environment. For example, this input could be a voice command, or a command displayed on a first environmental template (e.g., ...). Figure 7 When a template is shown, the electronic device 101a to 101c can select a representation of one or more buttons, icons, display options, text, and / or environment templates. In response to receiving this input, the electronic devices 101a to 101c can render a virtual 3D environment based on the input. For example, the electronic device 101a can display only a virtual model (e.g., Figure 4 When model 404 is initially displayed, a virtual 3D environment is presented, and the selection of buttons requesting the display of a portal and virtual mode from the menu can be detected. In response to the detection of input from the selection button, electronic device 101a can stop displaying model 404 and / or move model 404 to... Figure 7 The location shown (e.g., corresponding to virtual model 704) and / or portal 710 can be displayed concurrently.

[0114] Additionally or alternatively, electronic device 101a can detect input requesting the display of only a portal environment template, and can select the environment template from, for example... Figure 7 The change shown is as follows Figure 6 As shown. In some examples, when changing between templates, the electronic device 101a maintains the display of virtual content common to the templates of the selected type. For example, if the environment template of the newly selected type has a portal (e.g., as... Figure 6 As shown), electronic device 101a can initiate access to an environment template that includes a virtual model and a portal (e.g., as shown). Figure 7 (As shown) When displaying, maintain the display of the portal corresponding to the same part of the virtual 3D environment.

[0115] In some examples, electronic devices 101a to 101c can change the environment template used to render the virtual 3D environment in response to detecting input directed at it. For example, electronic devices 101a to 101c can detect movement of users 718a to 718c (e.g., a single electronic device can detect movement of a user wearing and / or using the device), such as movement within a threshold distance of the virtual model 704 and / or portal 710. The threshold distance can be 0.05m, 0.1m, 0.25m, 0.5m, 0.75m, 1m, 1.5m, 3m, 4m, or 5m, and can be used to trigger the display of an immersive and / or partially immersive display of the virtual 3D environment. For example, electronic device 101a can detect that user 718a has moved within the threshold distance and / or moved through portal 710. In response to detecting this movement, electronic device 101a can stop the display of the virtual model 704 and / or portal 710, and / or display the virtual 3D environment according to the immersive environment template. For example, electronic device 101a can animate the virtual environment at a specific scale and / or initiate the display of the virtual environment, such as... Figure 5 As shown. Additionally or alternatively, portions of the physical environment presented via the display of electronic device 101a may be replaced by portions of a virtual environment. For example, electronic device 101a may display a virtual three-dimensional environment as if the user were standing on a physical equivalent of the virtual three-dimensional environment.

[0116] In some examples, the immersion level is 5%, 10%, 25%, 50%, 75%, 90%, or 100%. For example, in response to detecting movement of user 718a through portal 710, electronic device 101a may display a virtual 3D environment consuming all viewports of electronic device 101a. In some examples, portions of the 3D environment consumed by the virtual 3D environment are mapped to the physical environment. For example, the area where the virtual 3D environment is immersively displayed may be fixed and mapped to a portion of the physical 3D environment. Thus, in response to detecting movement of the viewpoint of electronic device 101a away from the area where the virtual 3D environment is displayed, electronic device 101a may render a portion of the physical 3D environment, similar to a situation where the virtual 3D environment at least temporarily occupies a portion of the physical 3D environment but not the entirety of it. In examples where the 3D environment is displayed at full immersion (e.g., 100%), electronic device 101a may abandon rendering the physical environment because all of the physical environment is virtually occupied by the virtual 3D environment.

[0117] It should be understood that, based on various inputs, electronic devices 101a to 101c can be referenced Figures 3 to 8 The described environment templates change. For example, the descriptions of various operations below may optionally apply to the reference. Figures 3 to 8The described examples may be one, some, or all of them. For example, when immersively displaying a virtual 3D environment, electronic device 101a can detect input requesting incorporation into the virtual platform, as shown in the reference. Figure 3 As described. In response to detecting the input, the electronic device 101a may display a virtual platform 306, and / or may change the immersion level to display the physical components of the three-dimensional environment 334 and / or 336.

[0118] Additionally or alternatively, the computer system may detect the loading of new workflows and / or projects to share one or more inputs with electronic devices 101a to 101c. For example, a new project may be associated with a specific environment format and / or the type of data to be exported, such as spatial video, immersive video, environment, and / or 2D content creation projects. The computer system may transmit instructions to electronic devices 101a to 101c that a new project should be loaded and / or a new virtual 3D environment should be displayed. In some examples, the computer system additionally or alternatively transmits instructions that a specific environment format corresponds to the new project and / or the new virtual 3D environment. In response to receiving such instructions from the computer system, electronic devices 101a to 101c may stop displaying the currently displayed virtual 3D environment and initiate the display of a new virtual 3D environment using an environment template that matches the requested environment format and / or template.

[0119] In some examples, displaying a virtual scene using an environment format involves displaying viewframes corresponding to areas within the virtual scene. By rendering the same virtual scene according to various environment templates, the rendering device can ensure that virtual content is presented in a way that facilitates inspection, editing, and / or export of assets, such as presenting the virtual scene at an appropriate scale and / or view.

[0120] Figure 8 Examples of electronic devices that present virtual 3D environment templates including viewframes according to some examples of this disclosure are illustrated. As mentioned herein, viewframe 824 can be a virtual volume that can limit which parts(s) of the virtual 3D environment are presented to the user, thereby directing the user's attention to aspects of the virtual 3D environment. In the context of a media production workflow, viewframes can limit the amount of visual stimulation presented to the user, thereby increasing the likelihood that the user can focus on a subset of the virtual 3D environment (such as a set of virtual objects and / or less than the entire virtual 3D environment). Therefore, viewframe environment templates can be useful when the user is interested in deriving virtual objects, virtual textures, virtual lighting effects, and / or portions of the virtual 3D environment, especially when iterating through the design of such virtual content from rough ideas to / or refining them.

[0121] In some examples, viewframe 824 includes multiple markers 826 indicating the scale of the virtual 3D environment. Markers 826 can assist the user 808 when inspecting virtual content, such as virtual objects 822. Virtual objects 822 include virtual boxes and virtual buckets, which can be included in the virtual 3D environment at locations defined by viewframe 824.

[0122] In some examples, viewframe 824 occupies a virtual space corresponding to a physical region (e.g., in a manner similar to the virtual platform described above). In some examples, viewframe 824 corresponds to a volume within a virtual 3D environment, and virtual assets defined within that volume are at least partially displayed within viewframe 824. In some examples, displaying a virtual environment using viewframe 824 involves omitting some or all of the display of the virtual 3D environment. For example, one or more of the walls, ceiling, and / or floor of viewframe 824 may not include virtual content from the virtual 3D environment. In some examples, some or all of the walls, ceiling, and / or floor of viewframe 824 comprise a 2D image of the virtual 3D environment. In some examples, some or all of the walls, ceiling, and / or floor of viewframe 824 are rendered using techniques similar to or the same as those described with reference to the virtual platform above.

[0123] In some examples, electronic device 101a can detect input that changes the scale of viewframe 824 and can scale virtual content (such as virtual objects 822 and / or markers 826) according to that input. In this way, electronic device 101a can make virtual content from a virtual 3D environment larger or smaller according to the user's preferences. In some examples, viewframe 824 may have different scales, sizes, shapes, and / or some combination thereof. For example, the length, width, and / or height of viewframe 824 may be defined and / or modified by a computer system that streams data to electronic device 101a to display viewframe 824. Additionally or alternatively, the environment template may include viewframes of spherical, circular, other linear, and / or mixed shapes, which include different lines, curves, and / or surfaces with different spatial contours and / or sizes.

[0124] In one or more of the examples described herein, electronic device 101a may change or maintain its viewpoint relative to the virtual 3D environment based on the currently implemented environment template. For example, in response to detecting movement of the viewpoint of electronic device 101a relative to the virtual environment displayed in the immersive environment template, electronic device 101a may update the displayed virtual content based on the movement of the viewpoint, similar to how a user may physically perceive changes in their physical surroundings based on movement relative to the physical environment. Therefore, in response to detecting a change in the viewpoint relative to at least a portion of the immersive virtual 3D environment, electronic device 101a may stop displaying virtual content and / or initiate the display of virtual content included in the virtual 3D environment.

[0125] In some examples, in response to detecting a change in the viewpoint of electronic device 101a, electronic device 101a can maintain the display of its perspective relative to the virtual 3D environment. For example, when displaying a portal, electronic device 101a can, in response to detecting a change in its viewpoint, abandon changing which parts of the 3D environment are presented in the portal. In this way, the user of electronic device 101a can be consistently presented with a fixed perspective for entering the virtual 3D environment, depending on how the portal is positioned and / or oriented relative to the virtual 3D environment.

[0126] Figure 9 This is a flowchart illustrating a method for presenting a virtual 3D environment based on a template, according to some examples of this disclosure.

[0127] In some examples, the instructions for performing method 900 are stored using (e.g., non-transitory) computer-readable storage media, and executing the instructions causes an electronic device (e.g., electronic device 101 or electronic device 201) to perform method 900.

[0128] At 902, in some examples, method 900 includes, when the user of the electronic device has access to a 3D environment, detecting input including a request to display a content-creating user interface, which includes a view of a portion of the virtual environment, such as a user interface including some or all of the virtual content shown in 3D environment 302. At 904, in some examples, method 900 includes, in response to the detection of input, displaying a view of the virtual environment in the 3D environment at 906 via one or more displays, such as... Figure 4 The virtual model 404 and / or portal 410 shown are displayed as follows: Figure 5 The display of the immersive area 512 shown and / or as shown Figure 8 The display of view frame 824 is shown. At 908, in some examples, when a computer system communicating with an electronic device instructs that a view be displayed according to a first type of environment template, with a first spatial outline (such as...) Figure 3 The virtual environment is displayed using the spatial outlines of the virtual platform 306 and / or background 304. At 910, in some examples, when the computer system instructs that a view be displayed according to a second type of environment template different from the first type, a view of the virtual environment is displayed with a second spatial outline different from the first spatial outline, wherein the first and second spatial outlines differ from the orientation of the view of the virtual environment, such as... Figure 7 The portal 710 and / or virtual model 704 are shown.

[0129] Additionally or alternatively, in some examples, the first spatial profile includes a first shape of the view relative to the three-dimensional environment, and the second spatial profile includes a second shape of the view relative to the three-dimensional environment that is different from the first shape. Additionally or alternatively, in some examples, the first shape corresponds to a two-dimensional shape, and the second shape corresponds to a three-dimensional shape. Additionally or alternatively, in some examples, when the view is displayed with the first spatial profile, it occupies a first portion of the viewport of one or more displays, and when the view is displayed with the second spatial profile, it occupies a second portion of the viewport that is different from the first portion. Additionally or alternatively, in some examples, the first portion of the viewport includes a field of view smaller than the viewport itself. Additionally or alternatively, in some examples, the first portion of the viewport completely consumes the field of view of the viewport. Additionally or alternatively, in some examples, when input is detected and when a view of the virtual environment is displayed, the user has a viewpoint relative to the three-dimensional environment, which is a first viewpoint. Method 900 further includes: when the viewpoint is the first viewpoint, detecting via one or more input devices a request to change the viewpoint to a second viewpoint different from the first viewpoint; and in response to detecting the request, updating the view of the virtual environment according to the change in viewpoint. Additionally or alternatively, in some examples, when the user's viewpoint is the first viewpoint, a portion of the viewport of the electronic device is occupied by the virtual environment, and when the user's viewpoint is the second viewpoint, that portion of the viewport of the electronic device remains occupied by the virtual environment. Additionally or alternatively, in some examples, when the user's viewpoint is the first viewpoint, a first portion of the viewport of the electronic device is occupied by the virtual environment, and when the user's viewpoint is the second viewpoint, a second portion of the viewport different from the first portion is occupied by the virtual environment. Additionally or alternatively, in some examples, the first spatial contour corresponds to a world-locked viewing volume. Additionally or alternatively, in some examples, the input includes the selection of selectable options, and method 900 further includes: receiving from a computer system an indication that three-dimensional graphics data representing the virtual environment is available to an electronic device when the three-dimensional environment is presented; and, in response to receiving the indication, displaying one or more selectable options, each of which can be selected to choose a view of the virtual environment. Additionally or alternatively, in some examples, the three-dimensional graphics data includes one or more images or data corresponding to virtual objects. Additionally or alternatively, in some examples, method 900 further includes: receiving from a computer system an indication of a change to the three-dimensional graphics data when the three-dimensional environment is presented and a view of the virtual environment is displayed; and, in response to detecting the indication, updating the view of the virtual environment according to the change to the three-dimensional graphics data.Additionally or alternatively, in some examples, method 900 further includes: in response to detecting input, and when the view corresponds to an environment template of the first type, displaying via a display a virtual object corresponding to a representation of at least a portion of the virtual environment, wherein the virtual object is different from the view of the virtual environment and is displayed concurrently with the view of the virtual environment. Additionally or alternatively, in some examples, method 900 further includes: when displaying the view of the virtual environment, receiving one or more inputs requesting the export of content corresponding to the virtual environment; in response to receiving the one or more inputs: exporting one or more types of first-type virtual content based on determining that the view corresponds to an environment template of the first type; and exporting one or more types of second-type virtual content based on determining that the view corresponds to an environment template of the second type. Additionally or alternatively, in some examples, the one or more types of first-type virtual content include one or more of the following: virtual objects, images, videos, scene data, animation data, and virtual cameras. Additionally or alternatively, in some examples, method 900 further includes: in response to detecting input, joining a multi-user communication session between a computer system providing three-dimensional graphics data for displaying a view of a virtual environment and a corresponding computer system different from the computer system, wherein: one or more characteristics of the electronic device are the same as one or more characteristics of the corresponding computer system, and while the real-time communication session is in progress, the corresponding computer system displays a corresponding view of that portion of the virtual environment based on the viewpoint of the user of the corresponding computer system relative to the three-dimensional environment. Additionally or alternatively, in some examples, method 900 further includes: when the three-dimensional environment is visible and when the view of the virtual environment is displayed in a first spatial contour, receiving a corresponding input including a request to change the view of that portion of the virtual environment; and in response to receiving the corresponding input, changing the view of the virtual environment from being displayed in the first spatial contour to being displayed in a second spatial contour. Additionally or alternatively, in some examples, when the virtual environment is displayed in a first spatial contour including a first shape relative to the three-dimensional environment, first virtual content associated with the virtual environment is displayed as extending beyond the dimensions of the first shape. Additionally or alternatively, in some examples, the first type of environment template corresponds to one or more of the following: view portal template, virtual platform template, view frame template, virtual model template, and immersive template.

[0130] Some examples of this disclosure relate to an electronic device including a memory and one or more processors coupled to the memory and configured to perform method 900. Some examples of this disclosure relate to a non-transitory computer-readable storage medium storing instructions that, when executed by an electronic device including the memory and one or more processors coupled to the memory, cause the electronic device to perform method 900.

[0131] Figure 10 This is a flowchart illustrating, according to some examples of the present disclosure, a method for streaming information from a computer system to an electronic device so that the electronic device renders a virtual three-dimensional environment based on a template.

[0132] In some examples, the instructions for performing method 1000 are stored using (e.g., non-transitory) computer-readable storage media, and executing the instructions causes an electronic device (e.g., electronic device 101 or electronic device 201) to perform method 1000.

[0133] At 1002, in some examples, method 1000 includes, at a computer system communicating with an electronic device, one or more input devices, and one or more displays: detecting a request from the electronic device to display a virtual environment. At 1004, in some examples, in response to the detection of input: at 1006, the computer system streams information corresponding to a view of the virtual environment to the electronic device. In some examples, at 1008, when an editing application for the virtual environment at the computer system specifies that the virtual environment is displayed with a first type of environment template, the computer system causes the electronic device to display the virtual environment with a first spatial outline corresponding to the first type of environment template. In some examples, at 1010, when an editing application for the virtual environment at the computer system specifies that the virtual environment is displayed with a second type of environment template, the computer system causes the electronic device to display the virtual environment with a second spatial outline corresponding to the second type of environment template. Some examples of this disclosure relate to a computer system including a memory and one or more processors coupled to the memory and configured to perform method 1000. Some examples of this disclosure relate to a non-transitory computer-readable storage medium that stores instructions that, when executed by a computer system including memory and one or more processors coupled to the memory, cause the computer system to perform method 1000.

[0134] Some examples of this disclosure relate to an electronic device that includes one or more processors, a memory, and components for performing any of the methods described above.

[0135] Some examples of this disclosure relate to an information processing apparatus used in an electronic device, the information processing apparatus including components for performing any of the methods described above.

[0136] Additionally or alternatively, in some examples, the first spatial profile includes a first shape of the view relative to the three-dimensional environment, and the second spatial profile includes a second shape of the view relative to the three-dimensional environment, different from the first shape. Additionally or alternatively, in some examples, the first spatial profile corresponds to a world-locked view volume. Additionally or alternatively, in some examples, when presenting a three-dimensional environment, the method may further include sending an indication from a computer system that three-dimensional graphical data representing the virtual environment is available to the electronic device, and causing the electronic device to display one or more selectable options, each selectable to choose a view of the virtual environment. Additionally or alternatively, in some examples, when the electronic device is displaying a view of the virtual environment, the method may further include receiving one or more virtual contents of a first type exported from the electronic device based on determining that the view corresponds to a first type of environment template; and receiving one or more virtual contents of a second type exported from the electronic device based on determining that the view corresponds to a second type of environment template. Additionally or alternatively, in some examples, the method may further include joining a multi-user communication session between a computer system providing three-dimensional graphics data for displaying a view of a virtual environment and a corresponding computer system different from that computer system, wherein one or more characteristics of an electronic device are identical to one or more characteristics of the corresponding computer system, and while the multi-user communication session is in progress, the corresponding computer system displays a corresponding view of that portion of the virtual environment based on the viewpoint of the user of the corresponding computer system relative to the three-dimensional environment. In some examples, the method may further include receiving a corresponding input, including a request to change the view of that portion of the virtual environment, when the three-dimensional environment is visible and when the view of the virtual environment is displayed in a first spatial contour; and in response to receiving the corresponding input, changing the view of the virtual environment from being displayed in a first spatial contour to being displayed in a second spatial contour. Additionally or alternatively, in some examples, the first type of environment template corresponds to one or more of the following: a viewing portal template, a virtual platform template, a view frame template, a virtual model template, and an immersive template.

[0137] Some examples of this disclosure relate to a computer system including one or more processors, memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for: detecting a request from an electronic device communicating with the computer system to display a virtual environment; and, in response to detecting the request, streaming information corresponding to a view of the virtual environment to the electronic device, wherein when an editing application of the virtual environment at the computer system specifies that the virtual environment is displayed with a first type of environment template, causing the electronic device to display the virtual environment with a first spatial outline corresponding to the first type of environment template, and when the editing application of the virtual environment at the computer system specifies that the virtual environment is displayed with a second type of environment template, causing the electronic device to display the virtual environment with a second spatial outline corresponding to the second type of environment template. It should be understood that one or more programs including instructions for one or more operations may include examples where one or more programs include instructions that, when executed by one or more processors of the computer system, may cause the computer system to perform the corresponding one or more operations.

[0138] Additionally or alternatively, in some examples, the first spatial profile includes a first shape of the view relative to the three-dimensional environment, and the second spatial profile includes a second shape of the view relative to the three-dimensional environment, different from the first shape. Additionally or alternatively, in some examples, one or more instructions are further configured to: when presenting a three-dimensional environment, send an indication from a computer system that three-dimensional graphical data representing the virtual environment is available to the electronic device; and cause the electronic device to display one or more selectable options, each selectable to choose a view of the virtual environment. Additionally or alternatively, in some examples, one or more instructions are further configured to: when the electronic device is displaying a view of the virtual environment, receive one or more virtual contents of a first type exported from the electronic device, based on determining that the view corresponds to a first type of environment template; and receive one or more virtual contents of a second type exported from the electronic device, based on determining that the view corresponds to a second type of environment template. Additionally or alternatively, in some examples, one or more instructions are further configured to: join a multi-user communication session between a computer system providing 3D graphics data for displaying a view of a virtual environment and a corresponding computer system different from that computer system, wherein one or more characteristics of an electronic device are identical to one or more characteristics of the corresponding computer system, and while the multi-user communication session is in progress, the corresponding computer system displays a corresponding view of that portion of the virtual environment based on the viewpoint of the user of the corresponding computer system relative to the 3D environment. Additionally or alternatively, in some examples, one or more instructions are further configured to: receive a corresponding input including a request to change the view of that portion of the virtual environment when the 3D environment is visible and when the view of the virtual environment is displayed in a first spatial contour; and in response to receiving the corresponding input, change the view of the virtual environment from being displayed in a first spatial contour to being displayed in a second spatial contour. Additionally or alternatively, in some examples, the first type of environment template corresponds to one or more of the following: a viewing portal template, a virtual platform template, a view frame template, a virtual model template, and an immersive template.

[0139] Some examples of this disclosure relate to a non-transitory computer-readable storage medium storing instructions that, when executed by one or more processors of a computer system communicating with a display generation component and one or more input devices, cause the computer system to: detect a request for displaying a virtual environment from an electronic device communicating with the computer system; and, in response to detecting the request, stream information corresponding to a view of the virtual environment to the electronic device, wherein, when an editing application of the virtual environment at the computer system specifies that the virtual environment be displayed with a first type of environment template, the electronic device displays the virtual environment with a first spatial outline corresponding to the first type of environment template, and when the editing application of the virtual environment at the computer system specifies that the virtual environment be displayed with a second type of environment template, the electronic device displays the virtual environment with a second spatial outline corresponding to the second type of environment template.

[0140] Additionally or alternatively, in some examples, the first spatial profile includes a first shape of the view relative to the three-dimensional environment, and the second spatial profile includes a second shape of the view relative to the three-dimensional environment, different from the first shape. Additionally or alternatively, in some examples, the instructions, when executed, further cause the computer system to: send an indication from the computer system that three-dimensional graphical data representing the virtual environment is available to the electronic device when the three-dimensional environment is being presented; and cause the electronic device to display one or more selectable options, each of which can be selected to choose a view of the virtual environment. Additionally or alternatively, in some examples, the instructions, when executed, further cause the computer system to: receive one or more virtual contents of a first type exported from the electronic device, based on determining that the view corresponds to a first type of environment template, while the electronic device is displaying a view of the virtual environment; and receive one or more virtual contents of a second type exported from the electronic device, based on determining that the view corresponds to a second type of environment template. Additionally or alternatively, in some examples, the instructions, when executed, further cause the computer system to: join a multi-user communication session between the computer system providing three-dimensional graphics data for displaying a view of the virtual environment and a corresponding computer system different from the computer system, wherein one or more characteristics of the electronic device are the same as one or more characteristics of the corresponding computer system, and while the multi-user communication session is in progress, the corresponding computer system displays a corresponding view of that portion of the virtual environment based on the viewpoint of the user of the corresponding computer system relative to the three-dimensional environment.

[0141] This disclosure envisions that, in some examples, the data utilized may include personal information that uniquely identifies or can be used to contact or locate a specific person. Such personal information may include demographic data, content consumption activity, location-based data, telephone numbers, email addresses, Twitter IDs, home addresses, data or records relating to a user's health or fitness level (e.g., vital sign measurements, medication information, exercise information), date of birth, or any other identifying or personal information. Specifically, as described herein, one aspect of this disclosure is the tracking of users' biometric data.

[0142] This disclosure recognizes that the use of such personal information data in the present invention can benefit users. For example, personal information data can be used to display suggested text that changes based on changes in a user's biometric data. For example, suggested text can be updated based on changes in a user's age, height, weight, and / or medical history.

[0143] This disclosure anticipates that entities responsible for the collection, analysis, disclosure, transmission, storage, or other use of such personal information data will comply with robust privacy policies and / or privacy measures. Specifically, such entities should implement and adhere to privacy policies and measures that are recognized as meeting or exceeding industry or governmental requirements for maintaining the privacy and security of personal information data. Such policies should be easily accessible to users and should be updated as the collection and / or use of data changes. Personal information from users should be collected for legitimate and reasonable entity purposes and should not be shared or sold outside of these legitimate purposes. Furthermore, such collection / sharing should be conducted only after receiving informed consent from users. Additionally, such entities should consider taking any necessary steps to protect and safeguard the right to access such personal information data and ensure that other entities with access to such personal information data comply with the privacy policies and procedures of those other entities. Furthermore, such entities may subject themselves to third-party assessments to demonstrate their compliance with widely accepted privacy policies and privacy measures. Moreover, policies and measures should be adapted to the specific types of personal information data collected and / or accessed, and to applicable laws and standards, including considerations of specific jurisdictions. For example, in the United States, the collection or acquisition of certain health data may be governed by federal and / or state laws, such as the Health Insurance Portability and Accountability Act (HIPAA); while health data in other countries may be subject to other regulations and policies and should be handled accordingly. Therefore, different privacy measures should be advocated for different types of personal data in each country.

[0144] Regardless of the foregoing, this disclosure also envisions examples of users selectively blocking the use or access to personal information data. That is, this disclosure anticipates providing hardware and / or software components to prevent or block access to such personal information data. For example, the inventive technology can be configured to allow a user to opt-in or opt-out during or at any time after registering for the service. In another example, a user may choose not to enable the recording of personal information data in a specific application (e.g., a first application and / or a second application). In addition to providing "opt-in" and "opt-out" options, this disclosure also anticipates providing notifications related to access to or use of personal information. For example, a user may be notified that their personal information data will be accessed after collection has been initiated, and then reminded again just before one or more devices access the personal information data.

[0145] Furthermore, the intent of this disclosure is that personal information data should be managed and processed in a manner that minimizes the risk of unintentional or unauthorized access or use. Once data is no longer needed, this risk can be minimized by restricting data collection and deleting data. Additionally, and where applicable, including in certain health-related applications, data deidentification can be used to protect user privacy. Deidentification can be facilitated, where appropriate, by removing specific identifiers (e.g., date of birth, etc.), controlling the amount or specificity of stored data (e.g., collecting location data at the city level rather than the address level), controlling how data is stored (e.g., aggregating data among users), and / or other methods.

[0146] For purposes of explanation, the foregoing description has been described by reference to specific examples. However, the illustrative description above is not intended to be exhaustive or to limit the present disclosure to the precise form disclosed. Many modifications and variations are possible in accordance with the foregoing teachings. The examples were chosen and described in order to best elucidate the principles of the present disclosure and its practical application, thereby enabling others skilled in the art to make optimal use of the present disclosure with various modifications suitable for the particular intended purpose, as well as the various described examples.

Claims

1. A method, the method comprising: At a computer system that communicates with electronic devices, one or more input devices, and one or more displays: Detect requests from the electronic device to display a virtual environment; as well as In response to the detection of the request: Information corresponding to the view of the virtual environment is streamed to the electronic device, wherein: When the editing application of the virtual environment at the computer system specifies that the virtual environment is displayed with a first type of environment template, the electronic device displays a portion of the view of the virtual environment with a first spatial outline corresponding to the first type of environment template; and When the editing application of the virtual environment at the computer system specifies that the virtual environment be displayed with a second type of environment template, the electronic device displays a portion of the view of the virtual environment with a second spatial outline corresponding to the second type of environment template.

2. The method of claim 1, wherein the first spatial profile includes a first shape of the view relative to a three-dimensional environment, and the second spatial profile includes a second shape of the view relative to the three-dimensional environment that is different from the first shape.

3. The method of claim 1, wherein the first spatial contour corresponds to a world-locked viewing volume.

4. The method according to claim 1, further comprising: When a three-dimensional environment is presented, sending three-dimensional graphical data representing the virtual environment from the computer system can be used as an instruction for the electronic device; as well as The electronic device displays one or more selectable options, each of which can be selected to choose the view of the virtual environment.

5. The method of claim 4, wherein the three-dimensional graphics data includes one or more of the following: one or more images or data corresponding to a virtual object.

6. The method according to claim 5, further comprising: When the three-dimensional environment is presented and the view of the virtual environment is displayed, an instruction for change of the three-dimensional graphics data is received from the computer system; as well as In response to the detection of the indication, the view of the virtual environment is updated according to the change in the three-dimensional graphics data.

7. The method according to claim 5, further comprising: When the electronic device is displaying the view of the virtual environment: Based on determining that the view corresponds to the first type of environment template, one or more virtual contents of the first type exported from the electronic device are received; as well as Based on determining that the view corresponds to the second type of environment template, one or more second type of virtual content exported from the electronic device are received.

8. The method according to claim 1, further comprising: Join a multi-user communication session between the computer system providing the three-dimensional graphics data for displaying the view of the virtual environment and a corresponding computer system different from the computer system, wherein: One or more characteristics of the electronic device are the same as one or more characteristics of the corresponding computer system, and When the multi-user communication session is in progress, the corresponding computer system displays a corresponding view of the portion of the virtual environment based on the viewpoint of the user of the corresponding computer system relative to the three-dimensional environment.

9. The method according to claim 1, further comprising: When the three-dimensional environment is visible and when the view of the virtual environment is displayed with the first spatial outline, receive corresponding input including a request to change the view of the portion of the virtual environment; as well as In response to receiving the corresponding input, the view of the virtual environment is changed from being displayed with the first spatial outline to being displayed with the second spatial outline.

10. The method of claim 1, wherein the first type of environment template corresponds to one or more of the following: a portal template, a virtual platform template, a view frame template, a virtual model template, and an immersive template.

11. The method of claim 1, wherein the first shape corresponds to a two-dimensional shape and the second shape corresponds to a three-dimensional shape.

12. The method of claim 1, wherein the view of the virtual environment displayed at the electronic device changes according to a change in the viewpoint of the electronic device relative to the three-dimensional environment.

13. The method of claim 1, wherein when the view corresponds to an environment template of the first type, the electronic device displays a virtual object corresponding to a representation of at least a portion of the view of the virtual environment, wherein the virtual object is different from the portion of the view of the virtual environment and is displayed concurrently with the portion of the view of the virtual environment.

14. The method according to claim 1, further comprising: When the electronic device receives one or more inputs requesting the export of one or more types of virtual content, it receives the one or more types of virtual content from the electronic device, wherein: When the view corresponds to the first type of environment template, the received virtual content of one or more types includes one or more types of virtual content of the first type; and When the view corresponds to the second type of environment template, the received one or more types of virtual content include one or more types of second type virtual content that are different from the one or more types of first type virtual content.

15. The method of claim 14, wherein the one or more of the first type of virtual content includes one or more of the following: virtual objects, images, videos, scene data, animation data, and virtual cameras.

16. The method of claim 1, wherein the computer system participates in a multi-user communication session between the electronic device and the corresponding computer system, wherein: One or more characteristics of the electronic device are the same as one or more characteristics of the corresponding computer system, and When the multi-user communication session is in progress, the corresponding computer system displays a corresponding view of a portion of the virtual environment based on the viewpoint of the user of the corresponding computer system relative to the three-dimensional environment.

17. The method of claim 1, wherein the electronic device is configured to change the portion of the view of the virtual environment from the first spatial contour to the second spatial contour in response to a corresponding input that detects a request including a request to change the portion of the view of the virtual environment.

18. The method of claim 1, wherein displaying the virtual environment at the electronic device in the first spatial outline includes displaying it in a first shape relative to the three-dimensional environment, and displaying first virtual content associated with the virtual environment that extends beyond the first shape.

19. An electronic device comprising a memory and one or more processors, the one or more processors being coupled to the memory and configured to perform the method according to any one of claims 1 to 20.

20. A non-transitory computer-readable storage medium storing instructions that, when executed by an electronic device including a memory and one or more processors coupled to the memory, cause the electronic device to perform the method according to any one of claims 1 to 20.

Images