Spatial presentation of network content

Abstract

Some examples of the present disclosure relate to systems and methods for displaying a virtual environment associated with a developer of a web page. Some examples of the present disclosure relate to displaying a selectable option for displaying a virtual environment based on information from a developer of a web page. Some examples of the present disclosure relate to displaying a virtual environment at an immersion level that is greater than a threshold immersion level.

Description

Cross-reference to related applications

[0001] This application claims the benefit of U.S. Provisional Application No. 63 / 794,221, filed April 24, 2025, and U.S. Patent Application No. 19 / 639,995, filed April 6, 2026, the contents of which are incorporated herein by reference in their entirety for all purposes. Technical Field

[0002] This disclosure relates in general to systems and methods for presenting virtual environments. Background Technology

[0003] Some computer graphics environments provide two-dimensional (2D) and / or three-dimensional (3D) environments, in which at least some of the objects presented to the user are virtual and computer-generated. Summary of the Invention

[0004] Examples of this disclosure relate to systems and methods for displaying virtual environments associated with virtual content items, such as web pages, video content, and / or other types of content items. Examples of this disclosure relate to displaying selectable options for displaying a virtual environment based on information associated with the virtual content. Examples of this disclosure relate to displaying a virtual environment at an immersion level greater than a threshold immersion level. Examples of this disclosure relate to displaying virtual content, stopping the display of virtual content, animate virtual content, visually emphasizing virtual content, and / or initiating the display of a replacement virtual environment. Examples of this disclosure relate to displaying a virtual environment based on changes to the currently displayed web page or other types of virtual content. Examples of this disclosure relate to displaying virtual lighting. Examples of this disclosure relate to displaying virtual objects according to patterns such as reading modes. Examples of this disclosure relate to displaying a virtual environment based on a mapping between a shape and one or more images provided by the web page developer.

[0005] Some examples of this disclosure involve displaying visual cues based on determining that virtual content, such as a webpage, is associated with an immersive virtual environment. Some examples of this disclosure involve detecting the selection of a visual cue and, in response, initiating operations to display the virtual environment at an immersion level greater than a threshold immersion level.

[0006] A full description of these examples is provided in the accompanying drawings and detailed embodiments, and it should be understood that the content of this invention does not limit the scope of this disclosure in any way. Attached Figure Description

[0007] To better understand the various examples described herein, reference should be made to the following detailed embodiments and the accompanying drawings. Throughout the drawings, the same reference numerals generally refer to corresponding parts.

[0008] Figure 1 Examples of electronic devices that present a three-dimensional environment according to some examples of this disclosure are illustrated.

[0009] Figures 2A to 2B A block diagram illustrating an example architecture for an electronic device according to some examples of this disclosure is shown.

[0010] Figure 3 Examples of electronic devices that present a three-dimensional environment including virtual objects are illustrated according to some examples of this disclosure.

[0011] Figure 4 An electronic device displaying a menu associated with a virtual environment is illustrated according to some examples of this disclosure.

[0012] Figure 5 Electronic devices for displaying virtual environments are illustrated according to some examples of this disclosure.

[0013] Figure 6 Examples of electronic devices for displaying, modifying, and stopping the display of content based on interaction with a user interface of a webpage, according to some examples of this disclosure, are illustrated.

[0014] Figure 7 Examples of electronic devices displaying new web browsing tabs according to some examples of this disclosure are shown.

[0015] Figure 8 Examples of electronic devices for maintaining the display of a virtual environment according to some examples of this disclosure are illustrated.

[0016] Figure 9 Examples of electronic devices displaying new web browsing tabs according to some examples of this disclosure are shown.

[0017] Figures 10A to 10B An electronic device for stopping the display of a virtual environment is illustrated according to some examples of this disclosure.

[0018] Figure 11 Examples of electronic devices that display virtual environments different from previously shown virtual environments are illustrated according to some examples of this disclosure.

[0019] Figure 12 Examples of electronic devices that display virtual environments different from previously shown virtual environments are illustrated according to some examples of this disclosure.

[0020] Figure 13 A flowchart illustrating an example process for displaying a developer-provided virtual environment in a three-dimensional environment at an immersion level greater than a threshold immersion level, according to some examples of this disclosure. Detailed Implementation

[0021] Examples of this disclosure relate to systems and methods for displaying a virtual environment associated with a webpage developer. Examples of this disclosure relate to displaying selectable options for displaying the virtual environment based on information from the webpage developer. Examples of this disclosure relate to displaying a virtual environment at an immersion level greater than a threshold immersion level. Examples of this disclosure relate to displaying virtual content, stopping the display of virtual content, animate virtual content, visually emphasizing virtual content, and initiating the display of a replacement virtual environment. Examples of this disclosure relate to displaying a virtual environment based on a change in the currently displayed webpage. Examples of this disclosure relate to displaying virtual lighting. Examples of this disclosure relate to displaying virtual objects according to a pattern such as a reading mode. Examples of this disclosure relate to displaying a virtual environment based on a mapping between a shape and one or more images provided by the webpage developer.

[0022] Some examples of this disclosure involve displaying visual cues based on determining that virtual content, such as a webpage, is associated with an immersive virtual environment. Some examples of this disclosure involve detecting the selection of a visual cue and, in response, initiating operations to display the virtual environment at an immersion level greater than a threshold immersion level.

[0023] Figure 1 An electronic device 101 is illustrated according to some examples of this disclosure, which presents a three-dimensional environment (e.g., an extended reality (XR) environment or a computer-generated reality (CGR) environment, optionally including representations of physical and / or virtual objects). In some examples, such as Figure 1 As shown, electronic device 101 is a head-mounted display or other head-mountable device configured to be worn on the head of a user of electronic device 101. See below for reference. Figure 2A An example of an architecture block diagram to describe electronic device 101. For example... Figure 1 As shown, electronic device 101 and table 106 are located in a physical environment. The physical environment may include physical features such as physical surfaces (e.g., floor, wall) or physical objects (e.g., table, lamp, etc.). In some examples, electronic device 101 may be configured to detect and / or capture images of the physical environment including table 106 (exemplified in the field of view of electronic device 101).

[0024] In some examples, such as Figure 1 As shown, the electronic device 101 includes one or more internal image sensors 114a oriented toward the user's face (e.g., referred to below). Figures 2A to 2B(The described eye-tracking camera). In some examples, an internal image sensor 114a is used for eye tracking (e.g., detecting the user's gaze). The internal image sensor 114a is optionally arranged on the left and right portions of the display 120 to enable eye tracking of the user's left and right eyes. In some examples, the electronic device 101 also includes external image sensors 114b and 114c facing outwards from the user to detect and / or capture the physical environment of the electronic device 101 and / or movement of the user's hands or other body parts.

[0025] In some examples, display 120 has a field of view visible to the user. In some examples, the user-visible field of view is the same as the field of view of external image sensors 114b and 114c. For example, when display 120 is optionally part of a head-mounted device, the field of view of display 120 is optionally the same as or similar to the field of view of the user's eyes. In some examples, the user-visible field of view is different from the field of view of external image sensors 114b and 114c (e.g., narrower than the field of view of external image sensors 114b and 114c). In other examples, the field of view of display 120 may be smaller than the field of view of the user's eyes. The user's viewpoint determines what is visible in the field of view, and the viewpoint typically specifies the position and orientation relative to the three-dimensional environment. As the user's viewpoint changes, the field of view of the three-dimensional environment may also change accordingly. In some examples, electronic device 101 may be an optically transparent device, through which display 120 is a transparent or translucent display through which parts of the physical environment can be directly viewed. In some examples, display 120 may be included within a transparent lens and may overlap entirely or only partially with the transparent lens. In other examples, the electronics may be a video pass-through device, wherein display 120 is an opaque display configured to display an image of the physical environment using images captured by external image sensors 114b and 114c. Although Figure 1 A single display is shown, but it should be understood that display 120 optionally includes more than one display. For example, display 120 optionally includes a pair of stereoscopic displays (e.g., a left display panel and a right display panel for the user's left and right eyes, respectively), the display outputs of which are (e.g., by the user's brain) combined to create Figure 1 The view showing the content. In some examples, see the references below. Figures 2A to 2B In more detail, the display 120 includes or corresponds to a transparent or translucent surface (e.g., a lens) that is not equipped with display capabilities (e.g., and therefore cannot generate and display virtual objects 104), and alternatively presents a direct view of the physical environment in the user's field of view (e.g., the user's eye's field of view).

[0026] In some examples, electronic device 101 is configured to display (e.g., in response to a trigger) virtual object 104 in a three-dimensional environment. Virtual object 104 is... Figure 1 The illustrated cube represents a cube that does not exist in the physical environment but is displayed as positioned on top of table 106 (e.g., a real-world table or a representation thereof) in a three-dimensional environment. Optionally, in response to detecting a flat surface of table 106 in the physical environment 100, virtual object 104 is displayed on the surface of table 106 in the three-dimensional environment displayed via display 120 of electronic device 101.

[0027] It should be understood that virtual object 104 is a representative virtual object and may include and render one or more different virtual objects (e.g., virtual objects with various dimensions, such as two-dimensional or other three-dimensional virtual objects) in a three-dimensional environment. For example, a virtual object may represent an application or user interface displayed in a three-dimensional environment. In some examples, a virtual object may represent content corresponding to an application and / or displayed via a user interface in a three-dimensional environment. In some examples, virtual object 104 is optionally configured to be interactive and responsive to user input (e.g., air gestures, such as air pinch gestures, air tap gestures, and / or air touch gestures), allowing the user to virtually touch, tap, move, rotate, or otherwise interact with virtual object 104.

[0028] As discussed in this article, by the user (e.g., through...) Figure 1 One or more air pinch gestures performed by the hand (103) are detected by one or more input devices of electronic device 101 and interpreted as one or more user inputs pointing to content displayed by electronic device 101. Additionally or alternatively, in some examples, one or more user inputs interpreted by electronic device 101 as pointing to content displayed by electronic device 101 (e.g., virtual object 104) are detected via one or more hardware input devices (e.g., controllers, touchpads, proximity sensors, buttons, sliders, knobs, etc.) rather than via one or more input devices configured to detect air gestures (such as one or more air pinch gestures) performed by the user. This description is intended to be exemplary and not restrictive; the user may optionally use different air gestures and / or other forms of input to provide user input.

[0029] In some examples, electronic device 101 may be configured to communicate with a second electronic device (such as a companion device). For example, as Figure 1As illustrated, electronic device 101 optionally communicates with electronic device 160. In some examples, electronic device 160 corresponds to a mobile electronic device, such as a smartphone, tablet computer, smartwatch, laptop computer, or other electronic device. In some examples, electronic device 160 corresponds to a non-mobile electronic device, which is typically stationary and not easily moved within a physical environment (e.g., a desktop computer, server, etc.). See below for reference. Figure 2B The following are additional examples of architectural diagrams used to describe electronic device 160. In some examples, electronic device 101 and electronic device 160 are associated with the same user. For example, in Figure 1 In this configuration, electronic device 101 may be positioned (e.g., mounted on) a user's head, and electronic device 160 may be positioned near electronic device 101, such as in the user's hand 103 (e.g., hand 103 is holding electronic device 160), in the user's pocket or bag, or on a surface near the user. Electronic devices 101 and 160 may optionally be associated with the same user account (e.g., the user logs into a user account on both electronic devices 101 and 160). See below for further details. Figures 2A to 2B Additional details regarding the communication between electronic device 101 and electronic device 160 are provided.

[0030] In some examples, displaying an object in a 3D environment is triggered or enabled by interaction with one or more user interface objects in the 3D environment. For example, initiating the display of an object in a 3D environment may include interaction with one or more virtual option / power representations displayed in the 3D environment. In some examples, when initiating the display of an object in a 3D environment, the electronic device may track the user's gaze as input for identifying one or more virtual option / power representations as a target for selection. For example, a gaze may be used to identify one or more virtual option / power representations as a target for selection using another selection input. In some examples, a virtual option / power representation may be selected using hand-tracking input detected via an input device communicating with the electronic device. In some examples, an object displayed in a 3D environment may move and / or reorient itself in the 3D environment based on movement input detected via an input device.

[0031] In the following description, electronic devices that communicate with one or more displays and one or more input devices are described, such as head-mounted devices including one or more displays and one or more input devices. It should be understood that the electronic devices optionally communicate with one or more other physical user interface devices, such as touch-sensitive surfaces, physical keyboards, mice, joysticks, hand-tracking devices, eye-tracking devices, styluses, etc. Furthermore, as described above, it should be understood that the described electronic devices, displays, and touch-sensitive surfaces are optionally distributed among two or more devices. Therefore, as used in this disclosure, information on or displayed by an electronic device is optionally used to describe information output by the electronic device for display on a separate display device (touch-sensitive or non-touch-sensitive). Similarly, as used in this disclosure, input received on an electronic device (e.g., touch input received on a touch-sensitive surface of the electronic device, or touch input received on the surface of a stylus) is optionally used to describe input received on a separate input device from which the electronic device receives input information.

[0032] The device typically supports a variety of applications, such as one or more of the following: drawing applications, presentation applications, word processing applications, website creation applications, disk editing applications, spreadsheet applications, game applications, telephone applications, video conferencing applications, email applications, instant messaging applications, fitness support applications, photo management applications, digital camera applications, digital video camera applications, web browsing applications, digital music player applications, TV channel browsing applications, and / or digital video player applications.

[0033] Figures 2A to 2B Block diagrams illustrating example architectures for electronic devices according to some examples of this disclosure are shown. In some examples, electronic device 201 and / or device 260 include one or more electronic devices. For example, electronic device 201 may be a portable device, an auxiliary device for communicating with another device, a head-mounted display, a head-mounted speaker, etc. In some examples, electronic device 201 corresponds to the above reference. Figure 1 The described electronic device 101. In some examples, electronic device 260 corresponds to the above reference. Figure 1 The described electronic device 160.

[0034] like Figure 2A As illustrated, electronic device 201 optionally includes one or more sensors, such as one or more hand tracking sensors 202, one or more position sensors 204A, and one or more image sensors 206A (optionally corresponding to...). Figure 1The electronic device 201 may include an internal image sensor 114a and / or external image sensors 114b and 114c, one or more touch-sensitive surfaces 209A, one or more motion and / or orientation sensors 210A, one or more eye-tracking sensors 212, one or more microphones 213A or other audio sensors, one or more body tracking sensors (e.g., torso and / or head tracking sensors), etc. The electronic device 201 may optionally include one or more output devices, such as one or more display generation components 214A (optionally corresponding to...). Figure 1 The electronic device 201 may include a display 120, one or more speakers 216A, one or more tactile output devices (not shown), etc. The electronic device 201 optionally includes one or more processors 218A, one or more memories 220A, and / or communication circuitry 222A. One or more communication buses 208A are optionally used for communication between the components of the electronic device 201 mentioned above.

[0035] Additionally, electronic device 260 optionally includes components that are the same as or similar to those of electronic device 201. For example, such as Figure 2B As shown, electronic device 260 optionally includes one or more position sensors 204B, one or more image sensors 206B, one or more touch-sensitive surfaces 209B, one or more orientation sensors 210B, one or more microphones 213B, one or more display generating components 214B, one or more speakers 216B, one or more processors 218B, one or more memories 220B, and / or communication circuitry 222B. One or more communication buses 208B are optionally used for communication between the components of electronic device 260 mentioned above.

[0036] Electronic devices 201 and 260 are optionally configured to communicate via a wired or wireless connection between the two electronic devices (e.g., via communication circuits 222A, 222B). For example, as Figure 2A As indicated, electronic device 260 can be used as an accessory to electronic device 201. For example, in some examples, electronic device 260 processes sensor inputs from electronic devices 201 and 260, and / or uses the display generation component 214A of electronic device 201 to generate content for display.

[0037] Communication circuits 222A and 222B optionally include circuitry for communicating with electronic devices and networks such as the Internet, intranets, wired and / or wireless networks, cellular networks, and wireless local area networks (LANs). Communication circuits 222A and 222B optionally include circuitry for using near-field communication (NFC) and / or short-range communication such as Bluetooth. ®The communication circuits 222A and 222B include or support Wi-Fi (e.g., the 802.11 protocol), Ethernet, Ultra Wideband (“UWB”), high-frequency systems (e.g., 900MHz, 2.4GHz, and 5.6GHz communication systems), or any other communication protocol or any combination thereof.

[0038] One or more processors 218A, 218B include one or more general-purpose processors, one or more graphics processors, and / or one or more digital signal processors. In some examples, one or more processors 218A, 218B include one or more microprocessors, one or more central processing units, one or more application-specific integrated circuits, one or more field-programmable gate arrays, one or more programmable logic devices, or combinations of such devices. In some examples, memories 220A and / or 220B are non-transitory computer-readable storage media (e.g., flash memory, random access memory, or other volatile or non-volatile memory or storage device) that store computer-readable instructions configured to be executed by one or more processors 218A, 218B to perform the techniques, processes, and / or methods described herein. In some examples, memories 220A and / or 220B may include more than one non-transitory computer-readable storage medium. A non-transitory computer-readable storage medium can be any medium (e.g., excluding signals) that can tangibly contain or store computer-executable instructions for use by or in connection with an instruction execution system, apparatus, and device. In some examples, the storage medium is a transient computer-readable storage medium. In some examples, the storage medium is a non-transitory computer-readable storage medium. Non-transitory computer-readable storage media may include, but are not limited to, magnetic storage devices, optical storage devices, and / or semiconductor storage devices. Examples of such storage devices include magnetic disks, optical discs based on compact disc (CD), digital versatile optical disc (DVD), or Blu-ray technology, and persistent solid-state storage devices such as flash memory, solid-state drives, etc.

[0039] In some examples, one or more display generating components 214A, 214B include a single display (e.g., a liquid crystal display (LCD), an organic light-emitting diode (OLED), or other type of display). In some examples, one or more display generating components 214A, 214B include multiple displays. In some examples, one or more display generating components 214A, 214B may include a touch-enabled display (e.g., a touchscreen), a projector, a holographic projector, a retinal projector, a transparent or translucent display, etc. In some examples, the electronic device does not include one or more display generating components 214A or 214B. For example, instead of one or more display generating components 214A or 214B, some electronic devices include transparent or translucent lenses or other surfaces not configured to display or present virtual content. However, it should be understood that in such instances, electronic device 201 and / or electronic device 260 are optionally equipped with Figure 2A and Figure 2B One or more of the other components illustrated and described herein, such as one or more hand-tracking sensors 202, one or more eye-tracking sensors 212, one or more image sensors 206A, and / or one or more motion and / or orientation sensors 210A. Alternatively, in some examples, one or more display generation components 214A or 214B are provided separately from electronic devices 201 and / or 260. For example, one or more display generation components 214A, 214B communicate with electronic device 201 (and / or electronic device 260) but are not integrated with electronic device 201 and / or electronic device 260 (e.g., within the housing of electronic devices 201, 260). In some examples, electronic devices 201 and 260 respectively include one or more touch-sensitive surfaces 209A and 209B for receiving user input, such as tap input and swipe input or other gestures (e.g., hand-based gestures or finger-based gestures). In some examples, one or more display generating components 214A, 214B and one or more touch-sensitive surfaces 209A, 209B form one or more touch-sensitive displays (e.g., touchscreens integrated with each of the electronic devices 201 and 260 or touchscreens external to each of the electronic devices 201 and 260 that communicate with each of the electronic devices 201 and 260).

[0040] Electronic devices 201 and 260 optionally include one or more image sensors 206A and 206B, respectively. The one or more image sensors 206A / 206B optionally include one or more visible light image sensors (such as charge-coupled device (CCD) sensors) and / or complementary metal-oxide-semiconductor (CMOS) sensors operable to acquire images of physical objects from a real-world environment. The one or more image sensors 206A, 206B also optionally include one or more infrared (IR) sensors, such as passive or active IR sensors, for detecting infrared light from the real-world environment. For example, an active IR sensor includes an IR emitter for emitting infrared light into the real-world environment. The one or more image sensors 206A, 206B also optionally include one or more cameras configured to capture movement of physical objects in the real-world environment. The one or more image sensors 206A, 206B also optionally include one or more depth sensors configured to detect the distance between the physical object and the electronic devices 201, 260. In some examples, information from one or more depth sensors allows a device to identify objects in a real-world environment and distinguish them from other objects in the real-world environment. In some examples, one or more depth sensors allow a device to determine the texture and / or shape of objects in a real-world environment. In some examples, one or more image sensors 206A or 206B are included in an electronic device different from electronic devices 201 and / or 260. For example, one or more image sensors 206A, 206B communicate with electronic devices 201, 260 but are not integrated with electronic devices 201, 260 (e.g., within the housing of electronic devices 201, 260). Specifically, in some examples, one or more cameras of one or more image sensors 206A, 206B are integrated with and / or coupled to electronic devices 201 and / or 260 and to one or more devices separate from that electronic device (e.g., but communicating with electronic devices 201 and / or 260), such as one or more input and / or output devices (e.g., one or more speakers and / or one or more microphones, such as headphones or headsets) that include one or more image sensors 206A, 206B. In some examples, electronic device 201 or electronic device 260 corresponds to a headphone speaker (e.g., headphones or earbuds). In such instances, electronic device 201 or electronic device 260 is equipped with Figure 2A and Figure 2B A subset of the other components illustrated and described herein. In some such examples, electronic device 201 or electronic device 260 is equipped with one or more image sensors 206A, 206B, one or more motion and / or orientation sensors 210A, 210B, and / or speakers 216A, 216B.

[0041] In some examples, electronic devices 201 and 260 combine a CCD sensor, an event camera, and a depth sensor to detect the physical environment surrounding them. In some examples, one or more image sensors 206A and 206B include a first image sensor and a second image sensor. The first and second image sensors work cooperatively and are optionally configured to capture different information about physical objects in the real-world environment. In some examples, the first image sensor is a visible light image sensor, and the second image sensor is a depth sensor. In some examples, electronic devices 201 and 260 use one or more image sensors 206A and 206B to detect the location and orientation of electronic devices 201 and 260 and / or one or more display generating components 214A and 214B in the real-world environment. For example, electronic devices 201 and 260 use one or more image sensors 206A and 206B to track the location and orientation of one or more display generating components 214A and 214B relative to one or more stationary objects in the real-world environment.

[0042] In some examples, electronic devices 201 and 260 include one or more microphones 213A and 213B or other audio sensors, respectively. Electronic devices 201 and 260 optionally use one or more microphones 213A and 213B to detect sound from a user and / or the user's real-world environment. In some examples, the one or more microphones 213A and 213B include microphone arrays (e.g., multiple microphones) that optionally operate in cooperation, such as to identify ambient noise or locate sound sources in the space of a real-world environment.

[0043] Electronic devices 201 and 260 each include one or more position sensors 204A and 204B for detecting the positions of electronic device 201 and / or one or more display generating components 214A and electronic device 260 and / or one or more display generating components 214B, respectively. For example, the one or more position sensors 204A, 204B may include a Global Positioning System (GPS) receiver that receives data from one or more satellites and allows electronic devices 201, 260 to determine the absolute position of the electronic devices in the physical world.

[0044] Electronic devices 201 and 260 respectively include one or more orientation sensors 210A and 210B for detecting the orientation and / or movement of electronic device 201 and / or one or more display generation components 214A and the orientation and / or movement of electronic device 260 and / or one or more display generation components 214B. For example, electronic devices 201 and 260 use one or more orientation sensors 210A and 210B to track changes in the positioning and / or orientation of electronic devices 201 and 260 and / or one or more display generation components 214A and 214B, such as changes relative to physical objects in a real-world environment. The one or more orientation sensors 210A and 210B optionally include one or more gyroscopes and / or one or more accelerometers.

[0045] In some examples, electronic device 201 includes one or more hand tracking sensors 202 and / or one or more eye tracking sensors 212. It should be understood that although referred to as hand tracking or eye tracking sensors, electronic device 201 may additionally or alternatively include one or more other body tracking sensors, such as one or more leg, one or more torso, and / or one or more head tracking sensors. One or more hand tracking sensors 202 are configured to track the localization and / or position of one or more portions of a user's hand, and / or the movement of one or more portions of the user's hand relative to a three-dimensional environment, relative to one or more display generation components 214A, and / or relative to another defined coordinate system. One or more eye tracking sensors 212 are configured to track the localization and movement of a user's gaze (e.g., the user's attention, more generally including the eyes, face, or head) relative to the real world or three-dimensional environment and / or relative to one or more display generation components 214A. In some examples, one or more hand tracking sensors 202 and / or one or more eye tracking sensors 212 are implemented together with one or more display generation components 214A. In some examples, one or more hand-tracking sensors 202 and / or one or more eye-tracking sensors 212 are implemented separately from one or more display generation components 214A. In some examples, the electronic device 201 alternatively does not include one or more hand-tracking sensors 202 and / or one or more eye-tracking sensors 212. In some such examples, one or more display generation components 214A may be used by the electronic device 260 to provide a three-dimensional environment, and the electronic device 260 may utilize input and other data collected via one or more other sensors of the electronic device 201 (e.g., one or more position sensors 204A, one or more image sensors 206A, one or more touch-sensitive surfaces 209A, one or more motion and / or orientation sensors 210A, and / or one or more microphones 213A or other audio sensors) as input and data processed by one or more processors 218B of the electronic device 260. Additionally or alternatively, the electronic device 260 optionally does not include Figure 2B Other components shown include one or more position sensors 204B, one or more image sensors 206B, one or more touch-sensitive surfaces 209B, etc. In some such examples, one or more display generation components 214A may be used by electronic device 260 to provide a three-dimensional environment, and electronic device 260 may use input and other data collected via one or more motion and / or orientation sensors 210A (and / or one or more microphones 213A) of electronic device 201 as input.

[0046] In some examples, one or more hand-tracking sensors 202 (and / or other body-tracking sensors, such as leg, torso, and / or head-tracking sensors) may use one or more image sensors 206 (e.g., one or more IR cameras, 3D cameras, depth cameras, etc.) that capture 3D information from the real world, including one or more body parts (e.g., a human user's hand, leg, torso). In some examples, sufficient resolution is available to distinguish the hand to differentiate the fingers and their corresponding positions. In some examples, one or more image sensors 206A are positioned relative to the user to define a field of view and interaction space for one or more image sensors 206A, in which the finger / hand positions, orientations, and / or movements captured by the image sensors are used as input (e.g., to differentiate from the user's resting hand or other hands of other people in the real-world environment). Tracking the fingers / hands used for input (e.g., gestures, touches, taps, etc.) may be advantageous because it does not require the user to touch, hold, or wear any type of beacon, sensor, or other marker.

[0047] In some examples, one or more eye-tracking sensors 212 include at least one eye-tracking camera (e.g., an IR camera) and / or an illumination source (e.g., an IR light source, such as an LED) that emits light toward the user's eyes. The eye-tracking camera may be pointed at the user's eyes to receive reflected IR light from the light source directly or indirectly from the eyes. In some examples, both eyes are tracked separately by the respective eye-tracking camera and illumination source, and focus / gaze can be determined by tracking both eyes. In some examples, one eye (e.g., the dominant eye) is tracked by one or more respective eye-tracking cameras / illumination sources.

[0048] Electronic devices 201 and 260 are not limited to Figures 2A to 2B The components and configurations may include, but are not limited to, a few more components, additional components, or supplementary components in various configurations. In some examples, electronic device 201 and / or electronic device 260 may be implemented in various ways among multiple electronic devices (e.g., as a system). In some such examples, each (or more) of the electronic devices may include one or more of the same components discussed above, such as various sensors, one or more display generation components, one or more speakers, one or more processors, one or more memories, and / or communication circuitry. One or more persons using electronic device 201 and / or electronic device 260 are optionally referred to herein as one or more users of the devices.

[0049] Attention now turns to interaction with one or more virtual objects displayed in a three-dimensional environment presented at an electronic device (e.g., corresponding to electronic device 201). Some examples of this disclosure involve presenting virtual content based on specifications and / or information received from the developer of web content using the electronic device. The electronic device's ability to detect the availability of such information, display options for selecting buttons or icons corresponding to the information, and / or automatically present information in response to selection input allows the computer system to selectively present virtual content of web content displayed in virtual objects, thereby reducing reliance on downloading separate applications to receive and / or download such content in an extended reality environment and freeing up storage for other content on storage devices. Furthermore, by changing and / or updating the virtual content displayed in the three-dimensional environment based on interaction with web pages of virtual content, the electronic device reduces the amount of input required to influence changes and / or updates to the virtual content and thus reduces input processing.

[0050] Figure 3 Examples of electronic devices that present a three-dimensional environment including virtual objects according to some examples of this disclosure are illustrated. In some examples, electronic device 101 presents a three-dimensional environment 302 via one or more displays including display 120. In some examples, electronic device 101 includes or communicates with one or more input devices, such as an internal image sensor, an external image sensor 114b, and / or an external image sensor 114c. In some examples, external image sensors 114b and 114c correspond to one or more outward-facing devices, such as image sensors, cameras, infrared sensors, light detection and ranging (LiDAR) sensors, and / or some combination thereof. In some examples, internal image sensor 114a corresponds to one or more user-facing sensors, such as one or more of the sensors described with reference to external image sensors 114b-114c.

[0051] exist Figures 3 to 13 In this context, the 3D environment 302 includes both physical and virtual objects. For example, the 3D environment 302 includes a table 322. The table 322 is optionally visible via a partially or fully transparent sheet of material, such as a lens. Thus, the electronic device 101 facilitates presentation by allowing visibility via transparent material. In some examples, the table 322 is visible through digital reproduction, such as when the electronic device 101 captures images via one or more cameras corresponding to image sensors 114b-c and displays such images via a display 120.

[0052] exist Figures 3 to 13 In this context, the three-dimensional environment 302 includes virtual objects. For example, virtual object 340 is accessed via... Figure 3The display 120 shows the virtual object. In some examples, the virtual object 340 is associated with an application. For example, in... Figure 3 In this context, virtual object 340 corresponds to a web browsing application and may include a user interface for interacting with the web browsing application.

[0053] exist Figures 3 to 13 In the example, the three-dimensional environment 302 is illustrated from two perspectives. For example, in... Figures 3 to 13 The image illustrates a view of a three-dimensional environment 302 presented via electronic device 101. Additionally, Figures 3 to 13 A top view of the three-dimensional environment 302 is shown, illustrating the positioning of the viewpoint of the electronic device 101, the positioning of virtual content, and / or the positioning of physical objects.

[0054] In some examples, the virtual object 340 includes virtual controls and / or is displayed simultaneously with virtual controls. For example, Figure 3 Control 304 includes one or more selectable options, each corresponding to one or more actions associated with the web browsing application. For example, control 304 may include a selectable option to display a sidebar that may include browsing history, bookmarks, browsing tab groups, and / or additional or alternative representations of information and / or actions related to the web browsing application. Additionally or alternatively, control 304 may include selectable options for navigating between different web pages. For example, control 304 may include selectable options for navigating backward through web browsing history and / or may include selectable options for navigating forward through web browsing history. In some examples, control 304 includes selectable options for initiating sharing of the currently displayed web page via text message, via near-field communication protocols, via email, and / or via additional or alternative representations using additional or alternative protocols. Control 304 may include selectable option 344 for adding a new tab managed by the web browsing application and / or allow the user to display a set of currently managed browsing web page tabs. Control 304 may include address bar 324, which may include text indicating the currently displayed webpage, such as a Uniform Resource Locator (URL) (e.g., the currently displayed webpage included in the web browsing user interface within virtual object 340). In some examples, controls such as selectable option 306 are included in and / or overlay the address bar.

[0055] In some examples, electronic device 101 can detect selection input pointing to selectable options and / or virtual elements. In response to detecting selection input, electronic device 101 can perform one or more operations associated with the selected selectable option and / or selected virtual element. Some examples described herein relate to selectable options that can be selected to perform one or more operations. It should be understood that selectable can refer to an example in which electronic device 101 can detect input and, in response, perform one or more corresponding operations.

[0056] In one or more examples, control 304 may include one or more controls for managing the positioning and / or display of virtual object 340. For example, such as Figure 3 As illustrated in the examples, electronic device 101 displays a grasper 316. In some examples, grasper 316 can be selected to initiate movement of virtual object 340 within a three-dimensional environment 302. For example, electronic device 101 can detect attention 314 directed at grasper 316 (e.g., based on user gaze) when hand 310 forms an air gesture (such as a pinch between two fingers included in hand 310 (e.g., an air pinch)). In some examples, control 304 includes a selectable option 318. Selectable option 318 can be selected to stop the display of virtual object 340, and additional or alternative controls associated with virtual object 340 can be displayed based on a time period determined to be maintained for a period greater than a threshold time period.

[0057] In some examples, in response to detecting the attention 314 of a user pointing at the grasper 316 and simultaneously detecting an air gesture (e.g., an air pinch) performed by the hand 310, the electronic device 101 initiates movement of the virtual object 340. In some examples, the electronic device 101 moves the virtual object 340 in one or more directions and / or moves the virtual object by one or more amounts corresponding to one or more directions and / or one or more amounts of movement of the hand 310 and / or the air shape while maintaining an air shape. For example, the electronic device 101 detects movement of the hand 310 in a first direction and optionally moves the virtual object 340 in a second direction based on the first direction (e.g., similar to, opposite to, or the same as the first direction). Additionally or alternatively, in response to detecting movement of the hand 310 in a third direction other than the first direction, the electronic device 101 may move the virtual object 340 in a fourth direction other than the second direction and / or based on a third direction (e.g., similar to, opposite to, or the same as the third direction). Additionally or alternatively, the electronic device 101 may detect a first amount of movement of the hand 310, and in response, may move the virtual object 340 by a second amount based on the first amount of movement (e.g., the same as or a multiple of the first amount). In some examples, in response to detecting a third amount of movement of the hand 310 (different from the first amount), the electronic device 101 may move the virtual object 340 by a fourth amount different from the second amount and / or based on the third amount (e.g., the same as or a multiple of the third amount).

[0058] In some examples, control 304 includes one or more controls for initiating operations related to the manner in which electronic device 101 displays virtual content. For example, as further described herein, selectable option 306 optionally corresponds to a selectable option that can be selected to initiate the display of a menu including the aforementioned operations. (See at least the references provided.) Figures 4 to 13 As described, the electronic device can display selectable options for displaying a virtual environment and / or images (e.g., virtual content) corresponding to the virtual environment to be displayed simultaneously with a web browser. In some examples, the virtual environment is associated with a webpage displayed in the user interface of virtual object 340. For example, in Figure 3 In this context, virtual object 340 includes text associated with a webpage (e.g., "Webpage1"), which includes a title and / or sample content 312, which may include text and / or images associated with the webpage.

[0059] In some examples, entities associated with a webpage provide electronic device 101 with indications about the availability of a virtual environment for display by electronic device 101. For example, the webpage developer may embed metadata associated with the webpage, such as meta tags pointing to one or more images, media, virtual objects, Universal Scene Descriptor (USD) files, and / or additional or alternative resources that electronic device 101 can receive and access to display the virtual environment. In some examples, the metadata is indicated by the developer, and the resources used to display the relevant virtual environment are stored on a different device than electronic device 101. For example, the resources may be stored partially or entirely on one or more servers that can communicate directly or indirectly with electronic device 101. In some examples, the developer may embed metadata about the scale of the virtual environment into the webpage's Hypertext Markup Language (HTML). For example, the developer may embed attributes, tags, fields, and / or other web-based information that, when parsed and / or read by electronic device 101, enables electronic device 101 to display visual indications to the user of electronic device 101 indicating that the developer has provided a virtual environment. In some examples, the developer may embed metadata about compatibility with extended reality (XR) devices. In some examples, developers may specify spatial resources and / or additional or alternative information to display the virtual environment, such as links to one or more devices, one or more links, and / or one or more files for retrieving resources and / or information.

[0060] In some examples, developers may use metadata to indicate the availability of a 3D model. For example, a 3D model may include one or more of the following: a handcrafted scene comprising multiple polygons, a digital scan and / or reproduction of a physical environment, geometry with photographic or generated textures covering the geometry, and / or some combination thereof. In some examples, metadata may correspond to, be identical to, and / or otherwise correspond to a “model” HTML element. For example, a developer may use an HTML indicator for a webpage to point to a model element or a similar but different element that points to a 3D model and / or environment. In such examples, electronic device 101 may display the 3D model and / or environment indicated by the HTML model element or similar HTML elements within the user's 3D environment, such as overlaying the visibility of the user's physical environment. In some examples, the 3D model includes 2D content such as images, pre-recorded video, and / or live video streams. In some examples, some or all of the model may be used to render virtual lighting within a 3D virtual environment displayed by electronic device 101, as further described below.

[0061] exist Figure 3 In one example, electronic device 101 detects a selection of selectable option 306. In some examples, based on the determination that the developer has embedded information indicating that the virtual environment can be used for display at electronic device 101, electronic device 101 displays information such as... Figure 3 Selectable options 306 are shown in terms of appearance (e.g., having a first color, size, brightness, including a first media, etc.). In some examples, selection includes selection input. In some examples, selection input includes one or more of the following: attention directed at selectable option 306, air shapes and / or air gestures, voice commands, pressing physical buttons included in and / or included in input devices communicating with electronic device 101, contact between an object and a surface (e.g., hand 310 contacting a touchpad or non-touch-sensitive surface monitored by electronic device 101 and / or input devices communicating with electronic device 101), and / or some combination thereof. In response to detecting selection input, electronic device 101 may perform one or more operations to change the way virtual content is presented to the user. For example, operations may include displaying a menu for displaying a virtual environment associated with a webpage displayed in virtual object 340, such as Figure 4 exemplified.

[0062] Figure 4 Examples of menu displays associated with a virtual environment according to some examples of this disclosure are illustrated. For example, electronic device 101 may respond to detection such as Figure 3 The selection input shown will be displayed as follows. Figure 4 Menu 320 is shown. (For example...) Figure 4 As illustrated, electronic device 101 may display menu 320, which may include selectable options 342. In some examples, menu 320 covers some or all of virtual object 340.

[0063] In some examples, based on the determination that a webpage corresponding to the URL depicted in address bar 324 is associated with the virtual environment, electronic device 101 displays selectable option 342 (e.g., as described above with reference to information embedded by the developer indicating the availability of the virtual environment). In some examples, based on the determination that a webpage is not associated with the virtual environment, electronic device 101 either forgoes the display of selectable option 342 or displays it in a manner consistent with when the virtual environment is available (e.g., as described above with reference to information embedded by the developer indicating the availability of the virtual environment). Figure 4 The visual appearance of the optional option 342 (as shown) is different.

[0064] exist Figure 4In this context, selectable option 342 includes text indicating that selectable option 342 can be selected to display an environment associated with the webpage. For example, selectable option 342 indicates that a "display environment" option is available to the user of electronic device 101. In some examples, selectable option 342 can be selected to choose an environment from multiple different environments. For example, the webpage developer may optionally indicate to electronic device 101 that multiple environments are available for display. In response to receiving such an indication and / or based on reading metadata received from the developer (e.g., embedded in the webpage), electronic device 101 may optionally display multiple representations of multiple environments in response to detecting a selection of selectable option 342.

[0065] exist Figure 4 In the middle, option 306 can be selected to match... Figure 3 The appearance of the selected option 306 can be displayed differently as depicted in the diagram. Specifically, the electronic device 101 can change the displayed appearance of the selectable option 306 to indicate that the menu 320 is displayed, such as from... Figure 3 The description of the destination Figure 4 As depicted. In some examples, electronic device 101 may change opacity, size, brightness, saturation, color, and / or content such as images and / or icons included in selectable option 306. In some examples, such changes are made by electronic device 101 in response to detecting selection input pointing to selectable option 306 (e.g., as...). Figure 3 As shown in the figure, it is executed.

[0066] In some examples, electronic device 101 displays additional or alternative selectable options included in menu 320. For example, electronic device 101 may display one or more selectable options for changing the font size of text included in virtual object 340. For example, electronic device 101 may display a first selectable option to increase the font size. Additionally or alternatively, electronic device 101 may display a second selectable option to decrease the font size. In some examples, electronic device 101 may display an indication of font size, such as a percentage of the nominal font size (e.g., 20%, 50%, 80%, 100%, 120%, 150%, or 200%).

[0067] In some examples, electronic device 101 displays selectable options for displaying content included in a webpage in reader mode. In some examples, electronic device 101 displays content in reader mode by stopping the display of some content included in the webpage (such as advertisements and / or content navigation elements, such as thumbnails that are not particularly relevant to the focus of the webpage). In some examples, electronic device 101 displays content in reader mode with a different color, size, scale, alignment, line width, and / or some combination thereof than when the content is displayed without reader mode. For example, electronic device 101 may display text centered on the page, overlaid with a background color different from the original webpage color. Additionally or alternatively, electronic device 101 may display text with a fixed line width different from the line width displayed when reader mode is not configured. As further described herein, selectable options corresponding to reader mode, when selected, may cause electronic device 101 to display a virtual environment and / or virtual overlay, which may replace the virtual environment displayed when the selectable option corresponding to reader mode is selected. As an example, electronic device 101 may display one or more colors that cover the display and / or visibility of virtual and / or physical objects in a three-dimensional environment 302. The colors may be based on colors included in images, media, graphics, and / or other content included in a webpage displayed in the virtual object 340. In some examples, colors are displayed at an immersion level greater than a threshold immersion level, as further described herein with at least reference to the display of the virtual environment associated with optional option 342. In this manner, electronic device 101 may stop the display of the virtual environment and / or may display the virtual object 340 and / or replace the virtual environment according to a mode of presentation of the web content (e.g., a first mode).

[0068] In some examples, menu 320 includes additional or alternative selectable options. For example, menu 320 may include a selectable option to display translations of content included in the webpage. Additionally or alternatively, menu 320 may include selectable options to request different configurations of the webpage, such as configurations suitable for handheld mobile devices when electronic device 101 is a different type of device (e.g., tablet, desktop computer, headset, etc.). In some examples, menu 320 may include selectable options to display settings associated with the webpage. In some examples, menu 320 may include selectable options to display a set of privacy metrics associated with the webpage.

[0069] In some examples, in response to detecting a selection input to selectable option 306, electronic device 101 performs one or more of the operations described above for the menu without displaying the menu.

[0070] exist Figure 4In the example, when hand 310 forms an air gesture corresponding to a pinch gesture (e.g., an air pinch), electronic device 101 detects attention 314 directed at selectable option 342. The aforementioned input combination may correspond to a selection input directed to a selectable display of a virtual environment configured to initiate a display associated with a webpage corresponding to a URL in address bar 324.

[0071] In some examples, in response to the detection of a selection of selectable option 342, electronic device 101 displays a virtual environment associated with the webpage (e.g., as described above). Figure 5 Electronic devices displaying virtual environments according to some examples of this disclosure are illustrated. Figure 5 In the example, electronic device 101 displays a virtual environment at an immersion level greater than a threshold immersion level, as further described below. For example, electronic device 101 may respond to detecting such... Figure 4 The example shows the selection input and displays as shown. Figure 5 The virtual environment 301 is shown. In some examples, the virtual environment 301 is created by the developer of the webpage included in the virtual object 340 and incorporated into the metadata associated with the webpage, such as at least referencing Figures 3 to 4 Further description. In some examples, the three-dimensional environment 302 includes a virtual environment 301, such as Figure 5 As shown in the example. Figure 5 In the examples, the top view of the three-dimensional environment 302 illustrates a virtual environment that can surround the user of the electronic device 101, such that the virtual environment will still be displayed to the user by the electronic device 101 even if the user changes their viewpoint (e.g., the positioning and / or orientation of the electronic device 101 relative to the three-dimensional environment 302). In some examples, the virtual environment 301 occludes a virtual environment representing the user's physical environment (e.g., as further described herein).

[0072] In some examples, the virtual environment 301 is displayed relative to the viewpoint of the electronic device 101 and / or relative to the three-dimensional environment 302. For example, the electronic device 101 may optionally display the virtual environment 301 based on a plurality of coordinate axes established relative to the physical portion of the three-dimensional environment 302. As an example, the vertical axis of the virtual environment 301 may optionally be parallel to a vector extending perpendicular to the floor on which the electronic device 101 is located. Additionally or alternatively, the depth axis of the virtual environment 301 (e.g., perpendicular to the vertical axis and / or perpendicular to a surface of the electronic device 101, such as the front surface of the electronic device 101) may optionally be parallel to a vector extending perpendicular to the front surface of the electronic device 101 and / or parallel to the vector extending perpendicular to the floor of the electronic device 101. In some examples, the depth axis is not parallel to the floor and / or parallel to a vector extending perpendicular to the front surface of the electronic device 101 (e.g., tilted or slanted relative to the floor). In this way, in response to the detection of an input initiating the display of the virtual environment 301, the electronic device 101 displays the virtual environment 301 in an orientation that matches the relative positioning and / or orientation of the electronic device 101 in the three-dimensional environment 302. In some examples, displaying the virtual environment 301 includes cropping some or all of the virtual content 301 that might otherwise overlap and / or conflict with any virtual windows corresponding to the operating system of the electronic device 101. For example, in response to detecting input initiating the display of the virtual environment 301, the electronic device 101 may optionally relinquish the display of the virtual content within a radius of 0.1, 0.25, 0.5, 1, 1.5, or 3 m on the electronic device 101 and / or optionally maintain the visibility of the physical floor of the three-dimensional environment 302. Additionally or alternatively, the electronic device 101 may relinquish the display of portions of the virtual environment 301 that may overlap with system user interfaces (e.g., keyboard, settings user interface, notifications).

[0073] In some examples, the virtual environment 301 includes virtual objects, textures, images, and / or additional or optional virtual content. For example, Figure 5 An example is illustrated of a virtual environment 301 including virtual stars and / or a virtual moon. Additionally or alternatively, the virtual environment 301 may include night sky colors. In some examples, the virtual content included in the virtual environment 301 is displayed as covering and / or visually obscuring aspects of the physical environment. For example, Figure 5 In the example, electronic device 101 abandons, as Figure 4 The visibility of table 322 is presented as shown in the example. Furthermore, electronic device 101 may at least temporarily relinquish the representation of the size of the physical environment. For example, Figure 5 In the example, electronic device 101 stops the visibility of walls and / or ceiling in the three-dimensional environment 302 and displays a virtual environment 301 that covers the ceiling and / or walls.

[0074] In some examples, displaying the virtual environment 301 includes displaying one or more animation effects. For example, the developer of a webpage that instructs the electronic device 101 on the virtual environment 301 may specify one or more animations of the virtual content in the virtual environment 301. In response to receiving such instructions, the electronic device 101 may animate changes to the virtual environment 301 according to a configuration obtained based on the instructions from the developer. For example, the electronic device 101 may animate the movement of virtual content, stop the display of virtual content, initiate the display of virtual content, display media (e.g., images, previously recorded video, live streaming video), initiate the display of virtual lighting as further described herein, and / or change the visual characteristics of the virtual content, such as color, saturation, hue, brightness, and / or contrast.

[0075] In some examples, the electronic device 101 maintains the display of the virtual object 340 in the three-dimensional environment 302 while displaying the virtual environment 301. For example, in response to detecting... Figure 4 The example illustrates the selection input, in which electronic device 101... Figure 5 In the example with Figure 4 The positioning and / or orientation illustrated in the example maintains the display of the virtual object 340. Therefore, the electronic device 101 can abandon changes to the positioning of the virtual object 340 in the three-dimensional environment 302 in response to detecting a selection input that initiates the display of the virtual environment 301. Additionally or alternatively, the electronic device 101 can maintain a position having... Figure 4 The example shows the display of the optional visual appearance option 306 to indicate that a virtual environment provided by the developer of the webpage shown in the virtual object 340 is being displayed.

[0076] In some examples, electronic device 101 additionally or alternatively displays visual indications of the virtual environment 301 being displayed, which differ from the selectable option 306, such as an additional icon displayed adjacent to or covering the address bar 324. In some examples, electronic device 101 changes the content of selectable option 306 (e.g., icon, text, color, and / or shape) to indicate that a virtual environment is being displayed. For example, electronic device 101 may respond to a detection Figure 4 The input shown in the example changes the shape, color, and / or one or more icons included in the selectable option 306.

[0077] As shown in the top view of the 3D environment 302, the electronic device 101 can display the virtual environment 301 at an immersion level greater than a threshold immersion level. For example, some or all of the visibility and / or display of the physical parts of the 3D environment can be replaced by virtual content included in the virtual environment 301. In this way, developers of web pages or other content associated with the virtual object 340 can indicate the availability of the virtual environment 301 and facilitate the configuration of the virtual environment 301 for display on the electronic device 101, thereby immersing the user of the electronic device 101 within the virtual environment 301.

[0078] In some examples, immersion includes the degree to which virtual content displayed in a 3D environment occludes background content (e.g., a representation of the user's physical environment, and / or certain virtual content, such as the virtual environment, displayed before the virtual content is displayed at an immersion level greater than a threshold immersion level). As further described herein, the immersion level optionally relates to the visual properties of the virtual content included in the virtual environment. For example, the immersion level optionally includes a threshold percentage (e.g., 10%, 30%, 50%, 70%, 80%, 90%, 95%, or 100% of the viewport of the electronic device 101 that contains the virtual environment and / or is consumed by the virtual environment). Additionally or alternatively, the immersion level optionally defines a radius around the electronic device 101 that is not consumed by the virtual content (e.g., a portion of the 3D environment 302 beyond the radius that is consumed by the virtual environment 301, such as a radius of 0m, 0.5m, 0.1m, 0.15m, 0.3m, 0.5m, 1m, 1.5m, 3m, or 5m). Additionally or alternatively, the immersion level may optionally include the opacity level of the virtual content (e.g., 0%, 5%, 10%, 20%, 30%, 50%, 75%, or 100% opacity). In some examples, the combination of multiple levels of visual attributes changes according to the immersion level, as described below with reference to the first immersion level and / or the second immersion level.

[0079] In some examples, the level of immersion includes the degree to which the content displayed by the electronic device occludes background content around / behind the first virtual object (e.g., content other than the virtual content), optionally including the number of items of the displayed background content and the visual characteristics of the background content (e.g., color, contrast, opacity), and / or the angular range of the content displayed via the display generation component (e.g., 60 degrees for content displayed at low immersion, 120 degrees for content displayed at medium immersion, and 180 degrees for content displayed at high immersion), and / or the proportion of the viewport displayed via the display generation component consumed by the content displayed by the electronic device (e.g., 33% of the field of view consumed by the content displayed by the electronic device at low immersion, 66% of the field of view consumed by the content displayed by the electronic device at medium immersion, and 100% of the field of view consumed by the content displayed by the electronic device at high immersion).

[0080] In some examples, at a first (e.g., low) immersion level, the background, virtual, and / or real objects are displayed in an unobstructed manner. For example, a user interface displayed at a low immersion level may be displayed simultaneously with background content, optionally displayed at full brightness, color, and / or semi-transparency. In some examples, in a corresponding user interface displayed with no (or very low) immersion, no (or very few) virtual user interface elements are displayed, and only (or almost only) background content may be displayed via a display generation component. In some examples, at a second (e.g., higher) immersion level, the background, virtual, and / or real objects are displayed in an obstructed manner (e.g., dimmed, blurred, removed from the display, etc.). For example, a corresponding user interface with a high immersion level may be displayed without simultaneously displaying background content (e.g., in full-screen or fully immersive mode). As another example, a user interface displayed at a medium immersion level may be displayed simultaneously with darkened, blurred, or otherwise de-emphasized background content. In some examples, the visual characteristics of the background objects differ between background objects. For example, at a certain level of immersion, one or more first background objects may be visually de-emphasized more than one or more second background objects (e.g., dimmed, blurred, or displayed with increased transparency), and one or more third background objects may be stopped from being displayed.

[0081] In some examples, electronic device 101 changes the immersion level based on user input. For example, electronic device 101 may detect input, such as the twisting of an electromechanical crown button (or other mechanical input device or button) on a wearable device. In response to detecting input, electronic device 101 may decrease or increase the immersion level by a amount based on the direction and / or amount of the twist.

[0082] In some examples, electronic device 101 increases the immersion level of virtual environment 301 by a first amount in response to detecting a first amount of rotation of the electromechanical crown button in a first direction. In some examples, electronic device 101 increases the immersion level of virtual environment 301 by a second amount different from the first amount in response to detecting a second amount of rotation in the first direction.

[0083] In some examples, the electronic device 101 reduces the immersion level of the virtual environment 301 by a third amount in response to detecting a third amount of rotation in a second direction different from the first direction. In some examples, the electronic device 101 reduces the immersion level of the virtual environment 301 by a fourth amount different from the third amount in response to detecting a fourth amount of rotation in the second direction.

[0084] In some examples, the change in immersion level based on button rotation is symmetrical. For example, electronic device 101 may change the immersion level by a first amount (e.g., increase or decrease the immersion level) in response to detecting a first amount of button rotation (e.g., in a first or second direction). In some examples, the immersion level is fixed based on metadata associated with the webpage. In such examples, electronic device 101 may or may not display virtual environment 301. Furthermore, electronic device 101 may abandon the change of immersion level of virtual environment 301 in response to detecting input requesting a change in immersion level (e.g., rotation of the electromechanical crown button).

[0085] In some examples, the developer of the webpage associated with the virtual object 340 may point to a file such as a script (e.g., JavaScript or other scripting modalities). For example, electronic device 101 may run one or more scripts in response to detecting a selection of optional option 306, including but not limited to one or more calls for initiating an XR session and / or initiating the display of a virtual environment. Electronic device 101 may detect a request from a server to initiate an XR session and / or display a virtual environment, and in response, may initiate the display of a virtual environment based on the requested XR session. Electronic device 101 may transmit a request to one or more servers for assets and / or resources for displaying the virtual environment. In response to receiving a request, one or more servers may convey the requested assets and / or resources to electronic device 101. In response to receiving the requested assets and / or resources, electronic device 101 may render virtual content including virtual objects, visual cues, images, media, and / or additional or optional virtual content, and display an image corresponding to the virtual environment via display 120.

[0086] In some examples, electronic device 101 communicates with one or more devices using a first communication protocol and / or a second communication protocol to request, render images for display, and / or display a virtual environment. For example, electronic device 101 may use the first communication protocol to transmit a request for an asset to one or more servers. In response to receiving a request, one or more servers may transmit the asset to electronic device 101 and / or one or more devices designated for offloading computation. For example, electronic device 101 may offload rendering to a desktop computer, laptop computer, and / or head-mounted device. In some examples, in response to receiving an asset, the offloading device may render one or more images based on the requested asset and / or additional or alternative information from electronic device 101, such as the positioning and / or orientation of electronic device 101 relative to the 3D environment 302. In some examples, electronic device 101 may use the second communication protocol to request and / or receive rendered images from devices used for offloading some or all of the rendering.

[0087] exist Figure 5 In some examples, electronic device 101 detects selection input including attention 314 pointing to scroll bar 308 when hand 310 forms a pinch shape in the air. In some examples, electronic device 101 scrolls a webpage based on input pointing to scroll bar 308. In some examples, scroll bar 308 may be associated with navigation, initiating the display of content in virtual object 340, and / or stopping the display of content in virtual object 340. For example, in response to detecting that hand 310 maintains a pinch shape in the air after detecting selection input, electronic device 101 may scroll a webpage included in virtual object 340 based on the movement of hand 310.

[0088] Figure 6 Examples of electronic devices, based on interactions with a webpage's user interface, are illustrated to display, modify, and stop the display of content, according to some examples of this disclosure. For example, in... Figure 6 In the example, electronic device 101 has made some virtual stars and / or virtual moons relative to each other. Figure 5 The corresponding position movement shown in the example (e.g., in response to hand 310 from such) Figure 5 The example shown moves to, as Figure 6 (as shown in the example to detect scroll input).

[0089] In some examples, electronic device 101 animates changes in virtual environment 301 based on changes to web pages included in virtual object 340. For example, electronic device 101 detects hand 310 moving from... Figures 5 to 6 The virtual star moves upwards, and in response, the position and / or orientation change of the virtual star is animated. In some examples, the amount of change in the virtual environment 301 is based on the amount of change in the webpage. For example, based on determining from... Figures 5 to 6 The scrolling corresponds to a first scrolling amount, and the electronic device 101 can move some or all of the virtual environment 301 by the first translation amount. Based on the determination from... Figures 5 to 6 The scrolling corresponds to a second scrolling amount different from the first scrolling amount, and the electronic device 101 can translate some or all of the movement in the virtual environment 301 by the second translation amount. In some examples, the movement of the virtual environment 301 differs from the parallax effect of content displayed in a webpage based on webpage scrolling. For example, movement simulated by the parallax effect of a background image in virtual object 340 may include translating the content in the webpage by one or more of the first amounts. In some examples, changes and / or movements of the content included in the virtual environment 301 may optionally include movements and / or changes in the positioning and / or orientation of the content in the virtual environment 301, such as movements in several directions different from the translation direction used to display the parallax effect.

[0090] In some examples, electronic device 101 adjusts the size of virtual content included in virtual environment 301 based on changes to a webpage. For example, Figure 6 In the example, electronic device 101 displays star 330 at a larger size than it was before input to the scrolling webpage was detected (e.g., as shown in the image). Figure 5 (As shown in the examples). In some examples, electronic device 101 reduces the size of some or all of the virtual content included in virtual environment 301.

[0091] In some examples, electronic device 101 displays virtual lighting effects. In some examples, the virtual lighting effects are based on changes made to the webpage by electronic device 101 in response to input that initiates the display of the virtual environment 301 and / or changes to the webpage input. For example, in Figure 6 In one example, the electronic device displays an analog light source corresponding to star 328, which is projected onto region 331 of the virtual object 340. In some examples, the analog light source corresponds to virtual content displayed in the virtual environment 301. For example, in response to detecting that a scroll position on a webpage corresponds to a specific scroll position (e.g., corresponding to text), star 328 may be virtually illuminated by the text describing star 328 included in the virtual object 340 and / or by the area surrounding the text describing star 328. Simultaneously, the electronic device 101 may refrain from displaying virtual lighting on other parts of the virtual object 340 that do not correspond to star 328.

[0092] In some examples, virtual lighting is based on an ambient lighting map. In some examples, the ambient lighting map instructs the electronic device 101 on how to display reflected and / or ambient virtual lighting. For example, the ambient lighting map may include one or more images. In some examples, one or more images include color, simulated light intensity, texture and / or object positioning, contrast, saturation, and / or additional or alternative information that the electronic device 101 can use to display ambient and / or directional virtual lighting within a virtual environment. In some examples, the ambient lighting map includes the positioning and / or orientation of one or more virtual light sources. In some examples, virtual light sources are used to determine the positioning and / or appearance of the virtual environment and / or other objects separated from the virtual environment. For example, the electronic device 101 may use the ambient lighting map to extract and / or determine the intensity, color, attenuation, and / or point and / or directional light sources in the virtual environment.

[0093] In some examples, electronic device 101 uses an ambient lighting map to virtually illuminate content (e.g., textures, objects, media, and / or some combination thereof) in a virtual environment that the developer has indicated should be illuminated by a lighting source. In some examples, electronic device 101 additionally or alternatively uses an ambient lighting map to virtually illuminate content not indicated by the developer, such as virtual objects not included in the virtual environment but displayed concurrently with it, including virtual windows, volumetric objects, system user interfaces such as notifications and / or keyboards. In some examples, when the virtual environment indicated by the developer is not displayed, electronic device 101 displays virtual objects not included in the virtual environment with a first virtual lighting effect, and when the virtual environment is displayed, the electronic device displays virtual objects with a second lighting effect different from the first lighting effect. For example, electronic device 101 optionally displays virtual lighting of virtual objects based on one or more light sources in the three-dimensional environment of electronic device 101 as indicated by the ambient lighting map, and / or optionally changes the positioning, intensity, shadow, color, and / or other aspects of the lighting of virtual objects in response to detecting input that changes the currently displayed virtual environment and / or stops the display of the virtual environment.

[0094] In some examples, virtual lighting may include one or more colors, brightness levels, contrast levels, and / or opacities of the area displaying the virtual object as the subject of the virtual lighting. In some examples, no simulated light source is displayed. In some examples, the simulated light source has positioning, orientation, light type, intensity, attenuation range, and / or shape. In some examples, the aforementioned characteristics of the simulated light source are similar to those of a physical light source.

[0095] exist Figure 6 In the example, electronic device 101 detects selection input including attention 314 and a hand 310 forming an air shape pointing at selectable option 344. In response to detecting such... Figure 6As shown in the example of the selection input, electronic device 101 can add a new browsing tab.

[0096] from Figures 6 to 7 Electronic device 101 stops displaying the first webpage and initiates a statement indicating that the first webpage (e.g., Figure 6 The display of tab 326a of the webpage (as illustrated in the example). Figure 7 Examples of electronic devices displaying new web browsing tabs according to this disclosure are shown. Figure 7 In some examples, electronic device 101 displays a second tab 326b, different from tab 326a, corresponding to a URL listed in address bar 324. In some examples, electronic device 101 detects input, such as input pointing to virtual keyboard 326. In response to the detection of input, electronic device 101 may display text pointing to a field selected based on the selection input (e.g., selection input pointing to address bar 324). In some examples, electronic device 101 stops displaying the currently displayed virtual environment in response to the detection of input selecting and / or adding a tab not associated with the currently displayed virtual environment. For example, electronic device 101 may optionally stop displaying the virtual environment in response to the detection of selection input adding a new tab, such as... Figure 6 exemplified.

[0097] exist Figure 7 In the example, electronic device 101 has detected text input and displays the corresponding text indicating the URL. The URL (e.g., "Webpage1.com / example") has... Figure 6 The domain is the same as the URLs illustrated in the examples (e.g., "Webpage1.com"). Therefore, it is the same as... Figure 6 and Figure 7 The websites corresponding to the URLs depicted in the examples may be developed by the same developer. As further described herein, electronic device 101 may maintain the display of virtual environment 301 in response to detecting input that navigates to a webpage that has been designated as the same virtual environment as the currently displayed virtual environment (e.g., from the same developer). In other words, if a new webpage is associated with the same virtual environment, electronic device 101 may maintain the display of the virtual environment when navigating to the new webpage.

[0098] exist Figure 7 In one example, electronic device 101 detects selection input within a threshold distance (e.g., 0m, 0.001m, 0.005m, 0.01m, 0.05m, 0.075m, 0.1m, or 0.25m) including hand 310 moving to a virtual back key included in virtual keyboard 326. In some examples, electronic device 101 navigates to a second webpage different from the first webpage in response to detecting selection input, the second webpage corresponding to... Figure 7The URL is shown in the example. From Figures 7 to 8 Electronic device 101 initiates the display of a second webpage (e.g., "Webpage1.com / example") in virtual object 340 and address bar 324.

[0099] Figure 8 Examples of electronic devices for maintaining the display of a virtual environment according to some examples of this disclosure are illustrated. Figure 8 In the example, electronic device 101 responds to detecting Figure 7 The example illustrates the selection input and abandoning the change in the display of selectable option 306. In some examples, electronic device 101 abandons the change in selectable option 306 because the developer of the second webpage has indicated that the virtual environment 301 displayed by electronic device 101 is the same virtual environment indicated by the second webpage.

[0100] In some examples, in response to, such as Figure 8 When a selection input pointing to selectable option 306 is detected, as shown in the example, electronic device 101 either abandons the display of the selectable option used to initiate the display of the virtual environment or displays a selectable option with an appearance indicating that a virtual environment has been displayed. For example, electronic device 101 may display a menu (e.g., as shown in the reference). Figure 4 The menu 320 described is similar or identical. In some examples, the menu may include selectable options for displaying the virtual environment, but the selectable options may be used to indicate that the virtual environment is already displayed with a visual appearance different from the selectable options when the virtual environment is not displayed. In response to detecting a selection input pointing to a selectable option displayed with a visual appearance, the electronic device 101 may stop the display of the virtual environment 301.

[0101] exist Figure 8 In the example, electronic device 101 detects selection input pointing to selectable option 344, including attention 314 and a hand 310 forming an air pinch. In response to detecting such... Figure 8 As shown in the example of the selection input, electronic device 101 can add a new browsing tab.

[0102] from Figures 8 to 9 Electronic device 101 stops displaying the second webpage (e.g., "Webpage1.com / example") and initiates a statement indicating that the second webpage (e.g., Figure 8 The display of tab 326b of the webpage (as illustrated in the example). Figure 9 Examples of electronic devices displaying new web browsing tabs according to this disclosure are shown. Figure 9In one example, electronic device 101 displays a third tab 326c, different from tabs 326a and 326b, corresponding to a URL (e.g., “Webpage2.com”) listed in address bar 324. In some examples, electronic device 101 detects input, such as input pointing to virtual keyboard 326. In response to the detection of input, electronic device 101 may display text pointing to a field previously selected based on selection input (e.g., selection input pointing to address bar 324).

[0103] exist Figure 9 In the example, electronic device 101 has detected text input and displays the corresponding text indicating a URL. The URL (e.g., "Webpage2.com") has... Figure 8 The domain is different from the URLs illustrated in the examples (e.g., "Webpage1.com / example"). Therefore, compared to... Figure 8 and Figure 9 The website corresponding to the URL depicted in the examples may be developed by different developers. As further described herein, electronic device 101 may present indications of a virtual environment different from the currently displayed virtual environment that can be shown. In some examples, electronic device 101 maintains the display of virtual environment 301 at least temporarily in response to detecting input navigating to a webpage associated with a different developer. In some examples, electronic device 101 presents selectable option 306 and / or additional or alternative visual indications and / or selectable options to facilitate a change in which virtual environment is displayed by electronic device 101. As described above, electronic device 101 may stop the display of virtual environment 301 in response to detecting input navigating to a webpage associated with a different developer.

[0104] exist Figure 9 In one example, electronic device 101 detects selection input including hand 310 moving within a threshold distance (e.g., 0m, 0.001m, 0.005m, 0.01m, 0.5m, 0.075m, 0.1m, or 0.25m) of a virtual back key included in the virtual keyboard 326. In some examples, electronic device 101 responds to detection Figure 9 The example shows how selecting an input navigates to a third webpage, which is different from the first and second webpages.

[0105] Figure 10A Examples of electronic devices for stopping the display of a virtual environment according to some examples of this disclosure are illustrated. Figure 10A In the example, electronic device 101 responds to detecting Figure 9 The example illustrates how selecting input stops the virtual environment 301, which includes virtual stars and a virtual moon (e.g., corresponding to the example shown in the reference). Figures 4 to 8The display of the described first webpage and / or second webpage. In this way, in Figure 10A In some examples, electronic device 101 may abandon the display of a virtual environment corresponding to a developer-specified webpage that is different from the webpages included in virtual object 340. In some examples, electronic device 101 maintains the display of virtual environment 301 independently of whether the currently displayed tabs included in virtual object 340 correspond to virtual environment 301. For example, electronic device 101 may respond to detecting such... Figure 9 The example illustrates how selecting input maintains the display of the virtual environment.

[0106] exist Figure 10A In the example, virtual object 340 includes content corresponding to a third webpage (e.g., "Webpage2"). Figure 10A In the example, relative to such Figure 9 The example shows updating tab 326c to indicate the name of the third webpage.

[0107] exist Figure 10A In the example, electronic device 101 responds to detecting Figure 9 The example illustrates how selecting input changes the display of selectable option 306. In some examples, electronic device 101 alters the visual appearance of selectable option 306 to indicate that the virtual environment specified by the developer of a third webpage differs from the currently displayed virtual environment 301. For example, Figure 10A The visual appearance of optional option 306 in the example can be compared with Figure 3 Similar to or the same as those illustrated in the examples.

[0108] In some examples, electronic device 101 responds to detecting Figure 9 The example illustrates a selection input that forgoes changing the visual appearance of selectable option 306. For example, electronic device 101 may respond to such selection input by... Figure 9 The example maintains the display of selectable option 306 as shown. In these and other examples, selectable option 306 can be used to indicate that an immersive virtual environment is currently being displayed, optionally regardless of the specific virtual environment being displayed.

[0109] In some examples, electronic device 101 displays additional visual indicators and / or selectable options (e.g., buttons, icons, text, media, and / or some combination thereof) to indicate that a virtual environment different from virtual environment 301 is available, as specified by the developer associated with the third webpage. For example, electronic device 101 may simultaneously display an additional icon covering address bar 324 and Figure 10A Other visual elements are shown in the example. Additionally or alternatively, electronic device 101 may respond to, as in... Figure 10AThe example shows that such visual indications and / or selectable options are displayed when a selection of selectable option 306 is detected.

[0110] exist Figure 10A In one example, electronic device 101 detects input pointing to selectable option 306. In some examples, electronic device 101 displays a reference... Figure 4 The described menu 320 is similar to, includes some or all of its elements, and / or is identical to, a menu. In some examples, menu 320 includes selectable options that can be chosen to initiate the display of a virtual environment embedded in metadata by the developer of a third-party webpage. In some examples, the selectable options are similar to those in the reference... Figure 4 The described selectable option 306 is similar or identical. In some examples, in response to detecting a selection of selectable option 306, and / or when the 3D environment includes... Figure 10A When the virtual content shown in the example is displayed, the electronic device 101 displays a virtual environment picker user interface (e.g., including...). Figure 4 (Some or all of the selectable options illustrated in menu 320 in the example). In some examples, the virtual environment picker user interface includes a representation of virtual environment 301, and additionally or alternatively includes a representation of the virtual environment associated with a third webpage. In some examples, the selectable options differ from those in the reference. Figure 4 The optional options described. For example, optional options may include text for “changing” the virtual environment.

[0111] For example, the pickup user interface may include selectable options to switch between virtual environment 301 and a virtual environment associated with a third webpage. Although Figure 10A The example depicts attention 314 directed at the grasper 316 and selection inputs forming an air hand shape in the air pinch, which may cause the electronic device 101 to display a menu. However, it should be understood that selection inputs may represent multiple inputs for displaying a representation of a virtual environment different from the virtual environment 301 and / or selection of that representation.

[0112] Figure 10B Electronic devices for stopping the display of virtual environments according to some examples of this disclosure are illustrated, and descriptions are made in conjunction with reference to... Figure 10A The described example is similar to other examples. In some examples, electronic device 101 facilitates the display of a virtual environment based on input from content provided by the developer. For example, as... Figure 10BAs shown, electronic device 101 displays selectable options 350, which may be buttons or other virtual content created by the developer of a website included in virtual object 340. In this way, the developer can create web pages containing content that, when selected by the user, causes electronic device 101 to display a virtual environment indicated by the developer.

[0113] In some examples, in response to detecting input that optionally includes the user's attention 314 and an air pinch performed by the hand 310, the electronic device 101 performs the following further reference. Figure 11 One or more of the operations described include the rendering of a virtual environment. In some examples, in response to detecting input pointing to content on a webpage, electronic device 101 displays a confirmation prompt before displaying the virtual environment. In some embodiments, the content includes buttons, media, and / or scrollable content displayed by electronic device 101. In response to detecting input approving the launch of the virtual environment, electronic device 101 may display the virtual environment according to specifications provided by the developer. In response to detecting input rejecting the launch of the virtual environment, electronic device 101 may abandon the launch of the virtual environment.

[0114] In some examples, such as Figure 10B As shown, electronic device 101 performs reference Figure 10A Some or all of the operations described, and abandoning such Figure 10A The optional option 306 is shown.

[0115] Figure 11 and Figure 12 The examples illustrate how the virtual environment presented to the user can be based on specifications provided by the developer. In some examples, the developer can control the content presented and / or displayed to the user, including the inclusion, positioning, and / or orientation of virtual content within the virtual environment and / or the placement of the user within the virtual environment.

[0116] Figure 11 Examples of electronic devices displaying virtual environments different from those previously shown are illustrated according to some examples of this disclosure. Figure 11 In the example, electronic device 101 displays a developer-specified virtual environment that differs from the previously displayed virtual environment. For example, as... Figure 11 The virtual environment 303 shown in the example is associated with a third webpage (e.g., "Webpage2.com"). In some examples, the electronic device 101 displays the virtual environment 303 in response to detecting one or more inputs indicating that a virtual environment has been selected for display by a user (e.g., as shown in the reference). Figure 10A and / or Figure 10B(As described herein). In some examples, virtual environment 303 has one or more characteristics similar to, identical to, and / or corresponding to one or more characteristics described herein with reference to virtual environment 301. For example, virtual environment 303 may include virtual objects, textures, images, media (e.g., pre-recorded and / or live media) and / or some combination thereof. As an example, virtual environment 303 includes representation 332, which includes a virtual dog and a colored user interface disk below the virtual dog.

[0117] Figure 12 Examples of electronic devices illustrating virtual environments that differ from previously shown virtual environments, according to some examples of this disclosure, are provided. For example, such as... Figure 11 and Figure 12 As shown, the developers of the web pages included in virtual object 340 optionally specify how the virtual content included in the virtual environment is presented to the user. Figure 11 In the first specification, based on instructions received from the developer, it indicates that 332 will be displayed in the first position, signifying that 332 is displayed in the first position. Figure 12 In response to reference Figure 10A and Figure 10B One or more of the described inputs indicate that 332 is displayed in a second location different from the first location. Furthermore, a second specification (optionally different from the first specification) indicating that 332 will be displayed in the second location, based on instructions received from the developer, indicates that 332 is displayed in the second location. In some examples, it indicates that 332 is displayed in a corresponding location specified by the developer.

[0118] In some examples, electronic device 101 arranges the positions of media included in the virtual environment based on specifications provided by the developer. For example, in response to detecting network content indicating that video will be displayed in a virtual window at a corresponding distance from the user's viewpoint of electronic device 101, electronic device 101 may display a virtual window at the corresponding distance. Based on determining that the corresponding distance is a first distance, electronic device 101 may display a virtual window including video at the first distance. Based on determining that the corresponding distance is a second distance, electronic device 101 may display a virtual window including video at the second distance.

[0119] In some examples, electronic device 101 positions the user relative to the virtual environment based on developer specifications. For example, in response to detecting network content instructing the user of electronic device 101 to display the virtual environment with a first positioning and / or orientation, electronic device 101 may display the virtual environment such that the user is located at the first positioning and / or has the first orientation, such as in the middle of a virtual lake. Additionally or alternatively, in response to detecting network content instructing the user of electronic device 101 to display the virtual environment with a second positioning and / or orientation, electronic device 101 may display the virtual environment such that the user is located at the second positioning and / or has the first orientation, such as on the shore of a lake, facing the middle of the lake.

[0120] In some examples, electronic device 101 transitions between virtual environments based on input scrolling, such as transitioning between virtual environment 301 and virtual environment 303 (e.g., when a webpage developer instructs electronic device 101 to use metadata to use virtual environments 301 and 303 and / or transition between them). For example, electronic device 101 may stop displaying virtual environment 301 and initiate the display of virtual environment 303 based on determining that the scroll positioning in the webpage exceeds a threshold scroll positioning.

[0121] In some examples, electronic device 101 stops displaying virtual environment 301 based on a determination that a webpage corresponding to virtual environment 301 should not be displayed. For example, in response to detecting input that changes the web browsing tab to a webpage that does not correspond to virtual environment 301, in response to detecting input that hides or turns off virtual object 340 (e.g., unlike input that moves virtual object 340 outside the viewport of electronic device 101 and / or unlike input that changes the positioning and / or orientation of electronic device 101 such that the viewpoint of electronic device 101 does not include virtual object 340), and / or in response to receiving an indication that virtual object 340 should be hidden for applications running on electronic device 101, electronic device 101 may stop displaying virtual environment 301.

[0122] In some examples, electronic device 101 displays visual emphasis on some or all of the content included in the virtual environment. For example, based on determining that certain criteria are met regarding the user's scrolling positioning and interaction with the webpage (e.g., content selection, content highlighting, content consumption), electronic device 101 may display virtual lighting effects projected onto one or more portions of the virtual environment and / or assets within the virtual environment. In some examples, webpage developers may use scripts and / or metadata to instruct electronic device 101 on the criteria and / or manner in which it displays visual emphasis.

[0123] Generally, specifications from developers can be used to drive the presentation of content included in a virtual environment. For example, electronic device 101 can detect input scrolling, content selection, content highlighting, and / or changes between pages of web content (e.g., included in a webpage within virtual object 340). In response to detecting such input, electronic device 101 can, based on determining that the web content has been configured according to specifications from developers to perform such changes on the virtual content based on user input, alter visual characteristics of the virtual content such as opacity and / or brightness, move the virtual content, display new virtual content, stop the display of virtual content, park the virtual content to occupy a predetermined position within the virtual 3D environment, animate the virtual 3D environment, change the displayed virtual environment, change the user's viewpoint relative to the 3D environment, and / or any combination of changes to the virtual content.

[0124] In some examples, the webpage developer specifies properties for mapping developer-provided images—skyboxes, sky spheres, and / or additional or alternative 3D shapes—that are projected onto shapes that form the dimensions of the immersive virtual environment. For example, the developer may specify metadata and / or values ​​for: skybox height, width, and / or depth; floor height relative to the skybox; the shape of the sky shape (e.g., skybox, sky sphere, or additional or alternative shapes); the depth at which the developer-provided images will be displayed relative to the positioning and / or orientation of the electronic device relative to the virtual environment; the availability and / or use of a 3D USD file for generating the virtual environment; and / or some combination thereof. In some examples, the electronic device projects one or more images received from one or more servers specified by the developer. In some examples, the electronic device projects images onto one or more shapes specified by the developer, such as asymmetric shapes and / or custom shapes that include various curves and / or surfaces defined by information from the developer (e.g., included in the developer-provided metadata).

[0125] It should be understood that the examples shown and described herein are merely exemplary, and additional and / or alternative elements may be provided within a three-dimensional environment for presenting selectable options that can be selected to display the virtual environment at an immersion level greater than a threshold immersion level relative to the three-dimensional environment. It should be understood that the appearance, shape, form, and size of each of the various user interface elements and objects shown and described herein are exemplary, and alternative appearances, shapes, forms, and / or sizes may be provided. For example, a virtual object representing an application window (e.g., virtual window 340) may be displayed in an alternative shape (such as a rectangular shape, a circular shape, a triangular shape, a volumetric shape, etc.) different from the shape shown. In some examples, various selectable options described herein (e.g., selectable option 306, address bar 324, selectable option 342, and / or selectable option 344) may be verbally selected in response to the electronic device detecting a verbal command (e.g., a verbal command to “select an option” or “select a virtual object”). Additionally or alternatively, in some examples, the various selectable options, user interface elements, control elements, etc., described herein may be selected and / or manipulated via user input received through one or more input devices communicating with the electronic device (or multiple electronic devices). For example, selection input may be received via a physical input device (such as a mouse, touchpad, keyboard, etc.) communicating with the electronic device (or multiple electronic devices) or a physical button integrated with the electronic device (or multiple electronic devices).

[0126] Figure 13 Flowcharts illustrating example processes for displaying a developer-provided virtual environment in a three-dimensional environment at an immersion level greater than a threshold immersion level, according to some examples of this disclosure, are provided. In some examples, process 1300 is executed at a first electronic device communicating with a display and one or more input devices. In some examples, the electronic device is optionally similar to or corresponding to... Figure 2A The electronic device 201 is a head-mounted display or similar to or corresponding to Figure 2B 260 mobile electronic devices. For example... Figure 13 As shown in the examples, in some examples, at 1302, the electronic device displays a virtual content object via one or more displays. For example, the electronic device (e.g., Figure 4 In the example, electronic device 101) presents a virtual environment, such as virtual environment 301 that consumes the visibility of a portion of the physical environment.

[0127] In some examples, at 1304, when displaying a virtual content object via one or more displays, based on the determination that the virtual content object is associated with a virtual environment, the electronic device displays, via one or more displays, selectable options indicating that the virtual environment is available for display. For example, the electronic device displays... Figure 3The example illustrates selectable option 306. In some examples, at 1306, when displaying a virtual content object via one or more displays, the electronic device detects one or more inputs via one or more input devices requesting the display of a virtual environment associated with the virtual content object, pointing to the selectable option, while displaying the selectable option. For example, the electronic device detects selection inputs including attention 314 and / or an air shape formed by a hand 310, such as... Figure 3 and / or Figure 4 As shown in the examples. In some examples, in response to detecting one or more inputs pointing to selectable options, the electronic device displays a virtual environment with respect to the three-dimensional environment of the electronic device at an immersion level greater than a threshold immersion level via one or more displays. For example, electronic device 101 displays virtual environment 301 with an immersion level greater than the threshold immersion level, as... Figure 5 As shown in the example.

[0128] It should be understood that process 1300 is an example, and more, fewer, or different operations may be performed in the same or different order. Additionally, the operations in process 1300 described above may optionally be performed by running an information processing device such as a general-purpose processor (e.g., as per [reference to...]). Figures 2A to 2B (as described) or one or more functional modules in a dedicated chip and / or through Figures 2A to 2B It is implemented using other components.

[0129] Therefore, based on the foregoing, some examples of this disclosure relate to a method comprising, at an electronic device communicating with one or more input devices and one or more displays, displaying a virtual content object via the one or more displays. In some examples, the method may further include: when displaying the virtual content object via the one or more displays: based on determining that the virtual content object is associated with a virtual environment, displaying selectable options for displaying the virtual environment via the one or more displays; and when displaying the selectable options, detecting one or more inputs via the one or more input devices requesting display of the virtual environment associated with the virtual content object and pointing to the selectable options; and in response to detecting the one or more inputs pointing to the selectable options, displaying the virtual environment via the one or more displays relative to the three-dimensional environment of the electronic device at an immersion level greater than a threshold immersion level.

[0130] In some examples, the changes to the virtual environment include stopping the display of virtual content when the input that causes one or more modifications to the virtual content object is detected.

[0131] In some examples, the changes to the virtual environment include visual emphasis on at least a portion of the virtual environment displayed via the one or more monitors.

[0132] In some examples, the change to the virtual environment includes: stopping the display of a first virtual environment and initiating the display of a second virtual environment different from the first virtual environment. In some examples, the input causing one or more modifications to the virtual content object includes input changing the currently selected webpage within the web browsing user interface associated with the virtual content object. In some examples, the input causing one or more modifications to the virtual content object includes input scrolling the virtual content.

[0133] In some examples, the virtual content object includes multiple browsing tabs, including a first browsing tab and a second browsing tab. In some examples, the method further includes: when displaying the virtual environment and virtual browser content associated with the first browsing tab, detecting via the one or more input devices a second input that causes one or more modifications to the virtual content object, the second input including a selection of a second browsing tab different from the first browsing tab; and in response to detecting the second input, abandoning modifications to the virtual environment based on determining that the second browsing tab is associated with the virtual environment.

[0134] In some examples, displaying the virtual environment includes one or more animations that display one or more portions of the virtual environment.

[0135] In some examples, displaying the virtual environment also includes displaying virtual lighting effects within the virtual environment. In some examples, displaying the virtual lighting effects includes applying the virtual lighting effects projected onto the virtual content object.

[0136] In some examples, the method further includes: detecting, while displaying the virtual content object and the virtual environment, an input requesting to display network content according to a first mode via the one or more input devices; and, in response to detecting the input requesting to display the network content in the first mode, stopping the display of the virtual environment and displaying the network content according to the first mode via the one or more displays.

[0137] In some examples, the virtual environment is displayed based on a mapping of an image corresponding to the virtual environment projected onto a three-dimensional shape.

[0138] In some examples, the availability of the virtual environment to the electronic device is indicated based on metadata associated with the provider of the network content included in the virtual content object, which is associated with the virtual environment.

[0139] Some examples of this disclosure relate to an electronic device comprising: one or more processors; a memory; and one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing any of the methods described above.

[0140] Some examples of this disclosure relate to a non-transitory computer-readable storage medium that stores one or more programs, the one or more programs including instructions that, when executed by one or more processors of an electronic device, cause the electronic device to perform any of the methods described above.

[0141] Some examples of this disclosure relate to an electronic device that includes one or more processors, a memory, and components for performing any of the methods described above.

[0142] Some examples of this disclosure relate to an information processing apparatus used in an electronic device, the information processing apparatus including components for performing any of the methods described above.

[0143] This disclosure anticipates that, in some examples, the data utilized may include personal information that uniquely identifies or can be used to contact or locate specific individuals. Such personal information may include demographic data, content consumption activity, location-based data, telephone numbers, email addresses, social media IDs, home addresses, data or records related to a user's health or fitness level (e.g., vital sign measurements, medication information, exercise information), date of birth, or any other identifying or personal information. Specifically, as described herein, one aspect of this disclosure is the tracking of users' biometric data.

[0144] This disclosure recognizes that the use of such personal information data in the techniques of this invention can be used to benefit users. For example, personal information data can be used to display suggested text that changes based on changes in a user's biometric data. For example, suggested text can be updated based on changes in a user's age, height, weight, and / or medical history.

[0145] This disclosure anticipates that entities responsible for the collection, analysis, disclosure, transmission, storage, or other use of such personal information data will comply with robust privacy policies and / or privacy measures. Specifically, such entities should implement and adhere to privacy policies and measures that are recognized as meeting or exceeding industry or governmental requirements for maintaining the privacy and security of personal information data. Such policies should be easily accessible to users and should be updated as the collection and / or use of data changes. Personal information from users should be collected for legitimate and reasonable entity purposes and should not be shared or sold outside of these legitimate purposes. Furthermore, such collection / sharing should be conducted only after receiving informed consent from the user. Additionally, such entities should consider taking any necessary steps to protect and safeguard the right to access such personal information data and ensure that other entities with access to personal information data comply with the privacy policies and procedures of those other entities. Furthermore, such entities may be subject to third-party assessments to demonstrate their compliance with widely accepted privacy policies and privacy measures. Moreover, policies and measures should be adapted to the specific types of personal information data collected and / or accessed, and to applicable laws and standards, including considerations of specific jurisdictions. For example, in the United States, the collection or acquisition of certain health data may be governed by federal and / or state laws, such as the Health Insurance Portability and Accountability Act (HIPAA); while health data in other countries may be subject to other regulations and policies and should be handled accordingly. Therefore, different privacy measures should be advocated for different types of personal data in each country.

[0146] Regardless of the foregoing, this disclosure also anticipates examples of users selectively blocking the use or access to personal information data. That is, this disclosure anticipates providing hardware and / or software components to prevent or block access to such personal information data. For example, the inventive technology can be configured to allow a user to opt-in or opt-out during or at any time after registering for the service. In another example, a user can choose not to enable the recording of personal information data in a specific application (e.g., a first application and / or a second application). In addition to providing "opt-in" and "opt-out" options, this disclosure also anticipates providing notifications related to access to or use of personal information. For example, a user may be notified that their personal information data will be accessed after collection is initiated, and then reminded again just before access to the personal information data on one or more devices.

[0147] Furthermore, the intent of this disclosure is that personal information data should be managed and processed in a manner that minimizes the risk of unintentional or unauthorized access or use. Once data is no longer needed, this risk can be minimized by restricting data collection and deleting data. Additionally, and where applicable, including in certain health-related applications, data deidentification can be used to protect user privacy. Deidentification can be facilitated, where appropriate, by removing specific identifiers (e.g., date of birth, etc.), controlling the amount or specificity of stored data (e.g., collecting location data at the city level rather than the address level), controlling how data is stored (e.g., aggregating data among users), and / or other methods.

[0148] For purposes of explanation, the foregoing description has been described by reference to specific examples. However, the illustrative description above is not intended to be exhaustive or to limit this disclosure to the precise form disclosed. Many modifications and variations are possible based on the teachings above. The examples were chosen and described in order to best elucidate the principles of this disclosure and its practical application, thereby enabling others skilled in the art to best use this disclosure with various modifications suitable for the particular intended use, as well as the various described examples.

Claims

1. A method, the method comprising: At an electronic device that communicates with one or more input devices and one or more displays: Virtual content objects are displayed via the one or more displays; When displaying the virtual content object via the one or more displays: Based on the determination that the virtual content object is associated with a virtual environment, selectable options for displaying the virtual environment are displayed via the one or more displays; and When the selectable option is displayed, one or more inputs pointing to the selectable option in the virtual environment associated with the virtual content object are detected via the one or more input devices. as well as In response to detecting one or more inputs pointing to the selectable option, the virtual environment is displayed via the one or more displays relative to the three-dimensional environment of the electronic device at an immersion level greater than a threshold immersion level.

2. The method according to claim 1, further comprising: When displaying the virtual environment, inputs that cause one or more modifications to the virtual content object are detected via the one or more input devices; as well as In response to detecting input that modifies the virtual content object, the virtual environment is changed via the one or more displays based on the one or more modifications to the virtual content object.

3. The method of claim 2, wherein changing the virtual environment includes displaying animation in the virtual environment.

4. The method of claim 2, wherein the change of the virtual environment includes initiating the display of virtual content that was not displayed before the detection of the input that causes the one or more modifications to the virtual content object.

5. The method of claim 2, wherein the change of the virtual environment includes stopping the display of virtual content when the input causing the one or more modifications to the virtual content object is detected.

6. The method of claim 2, wherein the alteration of the virtual environment includes displaying visual emphasis on at least a portion of the virtual environment via the one or more displays.

7. The method of claim 2, wherein the modification of the virtual environment includes: Stop displaying the first virtual environment, and Initiate the display of a second virtual environment that is different from the first virtual environment.

8. The method of claim 7, wherein the input causing one or more modifications to the virtual content object includes input that changes the currently selected webpage within the web browsing user interface associated with the virtual content object.

9. The method of claim 2, wherein the input causing one or more modifications to the virtual content object includes input for scrolling the virtual content.

10. The method according to claim 1, wherein the virtual content object includes a plurality of browsing tabs, the plurality of browsing tabs including a first browsing tab and a second browsing tab, the method further comprising: When displaying the virtual environment and the virtual browser content associated with the first browsing tab, a second input causing one or more modifications to the virtual content object is detected via the one or more input devices, the second input including a selection of a second browsing tab different from the first browsing tab; as well as In response to the detection of the second input: Based on the determination that the second browsing tab is associated with the virtual environment, modifications to the virtual environment are abandoned.

11. The method of claim 1, wherein displaying the virtual environment includes displaying one or more animations of one or more portions of the virtual environment.

12. The method of claim 1, wherein displaying the virtual environment further includes displaying virtual lighting effects within the virtual environment.

13. The method of claim 12, wherein displaying the virtual lighting effect includes applying the virtual lighting effect projected onto the virtual content object.

14. The method according to claim 1, further comprising: When displaying the virtual content object and the virtual environment, an input request to display network content according to a first mode is detected via the one or more input devices; as well as In response to the input that detects a request to display the network content in the first mode: Stop the display of the virtual environment; and The network content is displayed via the one or more displays according to the first mode.

15. The method of claim 1, wherein the virtual environment is displayed based on a mapping of an image corresponding to the virtual environment projected onto a three-dimensional shape.

16. The method of claim 1, wherein the availability of the virtual environment to the electronic device is indicated based on metadata associated with a provider of network content included in the virtual content object, the virtual content object being associated with the virtual environment.

17. An electronic device, the electronic device comprising: One or more processors; Memory; and One or more programs, the programs being stored in the memory and configured to be executed by the one or more processors, the programs including instructions for performing the method according to any one of claims 1 to 16.

18. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by one or more processors of an electronic device, cause the electronic device to perform the method according to any one of claims 1 to 16.

19. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system, the one or more programs comprising instructions for performing the method according to any one of claims 1 to 16.

Images