Metadata-based content lock behavior and overlay thereof

Abstract

The invention relates to metadata-based content locking behaviors and overlay thereof. Some examples of the present disclosure relate to systems and methods for presenting virtual content according to metadata associated with the virtual content and indicating (or defining) a content locking behavior for presenting the virtual content. Some examples of the present disclosure relate to systems and methods for presenting virtual content having a content locking behavior that is different from a content locking behavior indicated by metadata associated with the virtual content.

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims the benefit of U.S. patent application No. 63 / 554,148, filed February 15, 2024, and U.S. patent application No. 19 / 041,423, filed January 30, 2025, the contents of which are incorporated herein by reference in their entirety. Technical Field

[0003] The present invention generally relates to systems and methods for presenting virtual content (eg, visual virtual content), and more particularly to presenting virtual content with corresponding content locking behavior in a computer-generated environment. Background Art

[0004] Some computer graphics environments provide two-dimensional and / or three-dimensional environments in which at least some of the objects displayed for a user to view are virtual and computer-generated. In some examples, objects are displayed in a three-dimensional environment with a particular orientation (e.g., relative to the computer user's viewpoint). Summary of the Invention

[0005] Some examples of the present disclosure relate to systems and methods for presenting virtual content based on metadata associated with the virtual content and indicating (or defining) a content locking behavior for presenting the virtual content. In some examples, the electronic device uses corresponding metadata indicating the type of content locking behavior for presenting the corresponding virtual content presented in the three-dimensional environment to determine how to present the corresponding virtual content in the three-dimensional environment. In some examples, the metadata indicates multiple content locking behaviors for the corresponding virtual content and a mapping of specific content locking behaviors of the corresponding virtual content to a specific context (such as to a specific operating condition of the electronic device). In some examples, the metadata indicates different content locking behaviors, and these different content locking behaviors are used to present the corresponding virtual content when different coverage criteria are met.

[0006] Some examples of the present disclosure relate to systems and methods for presenting virtual content having a content locking behavior that is different from the content locking behavior indicated by metadata associated with the virtual content. In some examples, an electronic device overlays and presents the corresponding virtual content according to the content locking behavior indicated by the metadata, and presents the corresponding virtual content according to the content locking behavior that is different from the content locking behavior indicated by the corresponding metadata.

[0007] A full description of these examples is provided in the drawings and detailed description, and it should be understood that this summary does not limit the scope of the present disclosure in any way. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] For a better understanding of the various examples described herein, reference should be made to the following detailed description and the following drawings. Throughout the drawings, like reference numerals generally refer to corresponding parts.

[0009] Figure 1 An electronic device presenting an augmented reality environment according to some examples of the present disclosure is illustrated.

[0010] Figures 2A to 2B A block diagram illustrating an example architecture for an electronic device according to some examples of the present disclosure is shown.

[0011] Figure 3A A block diagram illustrating various types of metadata associated with first virtual content, including content locking behavior, according to some examples of the present disclosure.

[0012] Figure 3B A block diagram illustrating various types of content locking behaviors according to some examples of the present disclosure.

[0013] Figure 3C Illustrated is a block diagram showing transitioning of first virtual content between a first content-locking behavior and a second content-locking behavior, optionally based on an overlay input, according to some examples of the present disclosure.

[0014] Figure 3D A flow chart illustrating a method for initiating a process of displaying virtual content according to a detected overlay input according to some examples of the present disclosure is illustrated.

[0015] Figures 4A to 4C The first virtual content using elasticity for head locking according to some examples of the present disclosure is illustrated.

[0016] Figures 5A to 5B The first virtual content being locked by the body according to some examples of the present disclosure is illustrated, and alternatively, the first virtual content is illustrated as transitioning from a content-locking behavior being locked by the head to a content-locking behavior being locked by the body.

[0017] Figures 6A to 6B Resetting the placement and / or orientation of first virtual content according to some examples of the present disclosure is illustrated.

[0018] 7A to 7D A first virtual content that is head-locked according to some examples of the present disclosure is illustrated.

[0019] Figures 8A to 8C Alternative content locking behavior transitions for first virtual content according to some examples of the present disclosure are illustrated.

[0020] Figure 9 A flowchart illustrating a method for presenting virtual content according to metadata associated with the virtual content according to some examples of the present disclosure is illustrated. DETAILED DESCRIPTION

[0021] Some examples of the present disclosure relate to systems and methods for presenting virtual content based on metadata associated with the virtual content and indicating (or defining) a content locking behavior for presenting the virtual content. In some examples, the electronic device uses corresponding metadata indicating the type of content locking behavior for presenting the corresponding virtual content presented in the three-dimensional environment to determine how to present the corresponding virtual content in the three-dimensional environment. In some examples, the metadata indicates multiple content locking behaviors for the corresponding virtual content and a mapping of specific content locking behaviors of the corresponding virtual content to a specific context (such as to a specific operating condition of the electronic device). In some examples, the metadata indicates different content locking behaviors, and these different content locking behaviors are used to present the corresponding virtual content when different coverage criteria are met.

[0022] Some examples of the present disclosure relate to systems and methods for presenting virtual content having a content locking behavior that is different from the content locking behavior indicated by metadata associated with the virtual content. In some examples, an electronic device overlays and presents the corresponding virtual content according to the content locking behavior indicated by the metadata, and presents the corresponding virtual content according to the content locking behavior that is different from the content locking behavior indicated by the corresponding metadata.

[0023] In some examples, a three-dimensional object is displayed in a computer-generated three-dimensional environment in a particular orientation that controls one or more behaviors of the three-dimensional object (e.g., when the three-dimensional object moves within the three-dimensional environment). In some examples, the orientation in which the three-dimensional object is displayed in the three-dimensional environment is selected by a user of the electronic device or automatically selected by the electronic device. For example, when initiating presentation of the three-dimensional object in the three-dimensional environment, the user may select a particular orientation for the three-dimensional object, or the electronic device may automatically select the orientation for the three-dimensional object (e.g., based on the type of the three-dimensional object).

[0024] In some examples, a three-dimensional object may be displayed in a three-dimensional environment in a world-locked orientation, a body-locked orientation, a tilt-locked orientation, or a head-locked orientation, as described below. As used herein, an object displayed in a three-dimensional environment in a body-locked orientation has a distance and orientation offset relative to a portion of the user's body (e.g., the user's torso). Alternatively, in some examples, a body-locked object has a fixed distance from the user, while the orientation of the content is not referenced to any part of the user's body (e.g., it may be displayed in the same cardinal direction relative to the user regardless of head and / or body movement). Additionally or alternatively, in some examples, a body-locked object may be configured to always maintain gravity or horizon alignment (e.g., perpendicular to gravity), such that changes in the roll direction of the head and / or body will not cause the body-locked object to move within the three-dimensional environment. Conversely, translational movement in either configuration will cause the body-locked object to reposition within the three-dimensional environment to maintain the distance offset.

[0025] As used herein, an object displayed in a head-locked orientation in a three-dimensional environment has a distance and orientation offset relative to the user's head. In some examples, the head-locked object moves within the three-dimensional environment when the user's head moves (when the user's viewpoint changes).

[0026] As used herein, an object displayed in a world-locked orientation in a three-dimensional environment has no distance or orientation offset relative to the user.

[0027] As used herein, an object displayed in a three-dimensional environment with a tilt-locked orientation (referred to herein as a tilt-locked object) has a distance offset relative to a user (such as a portion of the user's body (e.g., the user's torso) or the user's head). In some examples, the tilt-locked object is displayed at a fixed orientation relative to the three-dimensional environment. In some examples, the tilt-locked object moves according to a polar (e.g., spherical) coordinate system centered around a pole passing through the user (e.g., the user's head). For example, the tilt-locked object moves in the three-dimensional environment based on the movement of the user's head within a spherical space surrounding the user's head (e.g., centered around the user's head). Thus, if the user tilts their head relative to gravity (e.g., up or down in pitch), the tilt-locked object will follow the head tilt and move radially along the sphere, such that the tilt-locked object is repositioned within the three-dimensional environment at the same distance offset relative to the user as before the head tilt, while optionally maintaining the same orientation relative to the three-dimensional environment. In some examples, if the user moves their head in a roll direction (e.g., clockwise or counterclockwise) relative to gravity, the tilt-locked object is not repositioned within the three-dimensional environment.

[0028] Figure 1An electronic device 101 is illustrated that presents an extended reality (XR) environment (e.g., a computer-generated environment that optionally includes representations of physical and / or virtual objects) according to some examples of the present disclosure. In some examples, such as Figure 1 As shown, the electronic device 101 is a head-mounted display or other head-mounted device configured to be worn on the head of the user of the electronic device 101. In some examples, the electronic device 101 is a system including smart goggles or smart glasses. Figure 2A An example of the electronic device 101 is described with reference to the block diagram of the architecture of FIG. Figure 1 As shown, electronic device 101 and table 106 are located in a physical environment. The physical environment may include physical features, such as physical surfaces (e.g., floor, wall) or physical objects (e.g., table, lamp, etc.). In some examples, electronic device 101 may be configured to detect and / or capture an image of the physical environment including table 106 (shown in the field of view of electronic device 101).

[0029] In some examples, such as Figure 1 As shown, the electronic device 101 includes one or more internal image sensors 114a (eg, as described below with reference to FIG. 1 ) oriented toward the user's face. Figures 2A to 2B ). In some examples, internal image sensor 114a is used for eye tracking (e.g., detecting the user's gaze). Internal image sensor 114a is optionally arranged on the left and right portions of display 120 (e.g., display generation component) to enable eye tracking of the user's left and right eyes. In some examples, electronic device 101 also includes external image sensors 114b and 114c facing outward from the user to detect and / or capture the physical environment of electronic device 101 and / or movements of the user's hands or other body parts.

[0030] In some examples, display 120 has a field of view visible to the user (e.g., which may or may not correspond to the field of view of external image sensors 114b and 114c). Because display 120 is optionally part of a head-mounted device, the field of view of display 120 is optionally the same as or similar to the field of view of the user's eyes. In other examples, the field of view of display 120 may be smaller than the field of view of the user's eyes. In some examples, electronic device 101 may be an optical see-through device, in which display 120 is a transparent or translucent display through which portions of the physical environment can be directly viewed. In some examples, display 120 may be included within a transparent lens and may overlap all or only a portion of the transparent lens. In other examples, the electronic device may be a video pass-through device, in which display 120 is an opaque display configured to display images of the physical environment captured by external image sensors 114b and 114c. Although a single display 120 is shown, it should be understood that display 120 may include a stereoscopic display pair.

[0031] In some examples, in response to a trigger, the electronic device 101 may be configured to display the Figure 1 , the virtual object 104 represented by the cube illustrated in FIG, does not exist in the physical environment but is displayed in the XR environment on top of the real-world table 106 (or a representation thereof). Optionally, in response to detecting the plane of the table 106 in the physical environment 100, the virtual object 104 can be displayed on the surface of the table 106 in the XR environment displayed via the display 120 of the electronic device 101.

[0032] It should be understood that the virtual object 104 is a representative virtual object and may include and render one or more different virtual objects (e.g., virtual objects having various dimensions, such as two-dimensional or other three-dimensional virtual objects) in a three-dimensional XR environment. For example, a virtual object may represent an application or user interface displayed in the XR environment. In some examples, the virtual object may represent content corresponding to an application and / or displayed via a user interface in the XR environment. In some examples, the virtual object 104 is optionally configured to be interactive and responsive to user input (e.g., air gestures, such as air pinch gestures, air tap gestures, and / or air touch gestures), allowing the user to virtually touch, tap, move, rotate, or otherwise interact with the virtual object 104.

[0033] In some examples, electronic device 101 may be configured to communicate with a second electronic device, such as a companion device. Figure 1As illustrated, electronic device 101 can communicate with electronic device 160. In some examples, electronic device 160 corresponds to a mobile electronic device such as a smart phone, tablet computer, smart watch, or other electronic device. Figure 2B 101 and 160 are associated with the same user. Figure 1 In the embodiment of the present invention, electronic device 101 may be positioned (e.g., mounted) on the head of the user, and electronic device 160 may be positioned near electronic device 101, such as positioned in the hand 103 of the user (e.g., hand 103 is holding electronic device 160), and electronic device 101 and electronic device 160 are associated with the same user account of the user (e.g., the user is logged into the user account on electronic device 101 and electronic device 160). Figures 2A to 2B Additional details regarding communications between electronic device 101 and electronic device 160 are provided.

[0034] In some examples, displaying an object in a three-dimensional environment may include interaction with one or more user interface objects in the three-dimensional environment. For example, initiation of display of an object in a three-dimensional environment may include interaction with one or more virtual options / indicators displayed in the three-dimensional environment. In some examples, when display of an object in a three-dimensional environment is initiated, the electronic device may track the user's gaze as input for identifying one or more virtual options / indicators as targets for selection. For example, gaze may be used to identify one or more virtual options / indicators as targets for selection using another selection input. In some examples, a virtual option / indicator may be selected using hand tracking input detected via an input device in communication with the electronic device. In some examples, an object displayed in the three-dimensional environment may be moved and / or reoriented in the three-dimensional environment based on movement input detected via the input device.

[0035] In the following discussion, an electronic device is described that communicates with a display and one or more input devices. It should be understood that the electronic device optionally communicates with one or more other physical user interface devices, such as a touch-sensitive surface, a physical keyboard, a mouse, a joystick, a hand tracking device, an eye tracking device, a stylus, etc. In addition, as described above, it should be understood that the described electronic device, display, and touch-sensitive surface are optionally distributed between two or more devices. Therefore, as used in this disclosure, information displayed on or by an electronic device is optionally used to describe information output by the electronic device for display on an independent display device (touch-sensitive or non-touch-sensitive). Similarly, as used in this disclosure, input received on an electronic device (e.g., touch input received on the touch-sensitive surface of the electronic device, or touch input received on the surface of a stylus) is optionally used to describe input received on an independent input device, and the electronic device receives input information from the independent input device.

[0036] The device typically supports a variety of applications, such as one or more of the following applications: a drawing application, a rendering application, a word processing application, a website creation application, a disk editing application, a spreadsheet application, a gaming application, a telephony application, a video conferencing application, an email application, an instant messaging application, a fitness support application, a photo management application, a digital camera application, a digital video camera application, a web browsing application, a digital music player application, a television channel browsing application, and / or a digital video player application.

[0037] Figures 2A to 2B The block diagram illustrates an example architecture for electronic devices 201 and 260 according to some examples of the present disclosure. In some examples, electronic device 201 and / or device 260 include one or more electronic devices. For example, electronic device 201 can be a portable device, an auxiliary device that communicates with another device, a head-mounted display, etc. In some examples, electronic device 201 corresponds to the above referenced Figure 1 In some examples, the electronic device 260 corresponds to the electronic device 101 described above. Figure 1 An electronic device 160 is described.

[0038] like Figure 2A As illustrated, the electronic device 201 optionally includes various sensors, such as one or more hand tracking sensors 202, one or more position sensors 204A, one or more image sensors 206A (optionally corresponding to Figure 1114a and / or external image sensors 114b and 114c in FIG1 ), one or more touch-sensitive surfaces 209A, one or more motion and / or orientation sensors 210A, one or more eye-tracking sensors 212, one or more microphones 213A or other audio sensors, one or more body-tracking sensors (e.g., torso and / or head-tracking sensors), one or more display generation components 214A (optionally corresponding to Figure 1 The display 120 in the electronic device 201, one or more speakers 216A, one or more processors 218A, one or more memories 220A and / or communication circuits 222A. One or more communication buses 208A are optionally used for communication between the above-mentioned components of the electronic device 201. In addition, as Figure 2B As shown, the electronic device 260 optionally includes one or more position sensors 204B, one or more image sensors 206B, one or more touch-sensitive surfaces 209B, one or more orientation sensors 210B, one or more microphones 213B, one or more display generation components 214B, one or more speakers 216B, one or more processors 218B, one or more memories 220B and / or communication circuits 222B. One or more communication buses 208B are optionally used for communication between the above-mentioned components of the electronic device 260. The electronic devices 201 and 260 are optionally configured to communicate via a wired or wireless connection between the two electronic devices (e.g., via communication circuits 222A, 222B). For example, as Figure 2A As indicated, electronic device 260 may serve as a companion device to electronic device 201 .

[0039] The communication circuits 222A, 222B optionally include circuits for communicating with electronic devices, networks such as the Internet, intranets, wired and / or wireless networks, cellular networks, and wireless local area networks (LANs). The communication circuits 222A, 222B optionally include circuits for communicating using near field communication (NFC) and / or short range communication such as A circuit for communication.

[0040] Processors 218A, 218B include one or more general-purpose processors, one or more graphics processors, and / or one or more digital signal processors. In some examples, memory 220A or 220B is a non-transitory computer-readable storage medium (e.g., flash memory, random access memory, or other volatile or non-volatile memory or storage device) that stores computer-readable instructions, which are configured to be executed by processor 218A or 218B to perform the techniques, processes, and / or methods described below. In some examples, memory 220A and / or 220B may include more than one non-transitory computer-readable storage medium. A non-transitory computer-readable storage medium may be any medium (e.g., not including signals) that can tangibly contain or store computer-executable instructions for use by or in conjunction with an instruction execution system, device, or apparatus. In some examples, the storage medium is a transient computer-readable storage medium. In some examples, the storage medium is a non-transitory computer-readable storage medium. A non-transitory computer-readable storage medium may include, but is not limited to, a magnetic storage device, an optical storage device, and / or a semiconductor storage device. Examples of such storage devices include magnetic disks, optical disks based on compact disc (CD), digital versatile disc (DVD), or Blu-ray technology, and persistent solid-state memory such as flash memory, solid-state drives, etc.

[0041] In some examples, display generation components 214A, 214B include a single display (e.g., a liquid crystal display (LCD), an organic light emitting diode (OLED), or other type of display). In some examples, display generation components 214A, 214B include multiple displays. In some examples, display generation components 214A, 214B may include a display with touch capabilities (e.g., a touch screen), a projector, a holographic projector, a retinal projector, a transparent or translucent display, etc. In some examples, electronic devices 201 and 260 include touch-sensitive surfaces 209A and 209B, respectively, for receiving user input such as tap inputs and swipe inputs or other gestures. In some examples, display generation components 214A, 214B and touch-sensitive surfaces 209A, 209B form a touch-sensitive display (e.g., a touch screen integrated with each of electronic devices 201 and 260 or a touch screen external to each of electronic devices 201 and 260 that communicates with each of electronic devices 201 and 260).

[0042] Electronic devices 201 and 260 optionally include image sensors 206A and 206B, respectively. Image sensors 206A and 206B optionally include one or more visible light image sensors (such as charge-coupled device (CCD) sensors) and / or complementary metal oxide semiconductor (CMOS) sensors operable to obtain images of physical objects from a real-world environment. Image sensors 206A and 206B also optionally include one or more infrared (IR) sensors, such as passive IR sensors or active IR sensors, for detecting infrared light from the real-world environment. For example, an active IR sensor includes an IR emitter for emitting infrared light into the real-world environment. Image sensors 206A and 206B also optionally include one or more cameras configured to capture the movement of physical objects in the real-world environment. Image sensors 206A and 206B also optionally include one or more depth sensors configured to detect the distance of physical objects from electronic devices 201 and 260. In some examples, information from one or more depth sensors may allow a device to identify an object in a real-world environment and distinguish it from other objects in the real-world environment. In some examples, one or more depth sensors may allow a device to determine the texture and / or topography of an object in the real-world environment.

[0043] In some examples, electronic devices 201 and 260 use a combination of a CCD sensor, an event camera, and a depth sensor to detect the physical environment surrounding the electronic devices 201 and 260. In some examples, the image sensors 206A and 206B include a first image sensor and a second image sensor. The first image sensor and the second image sensor work in tandem and are optionally configured to capture different information about physical objects in the real-world environment. In some examples, the first image sensor is a visible light image sensor, and the second image sensor is a depth sensor. In some examples, the electronic devices 201 and 260 use the image sensors 206A and 206B to detect the position and orientation of the electronic devices 201 and 260 and / or the display generation components 214A and 214B in the real-world environment. For example, the electronic devices 201 and 260 use the image sensors 206A and 206B to track the position and orientation of the display generation components 214A and 214B relative to one or more fixed objects in the real-world environment.

[0044] In some examples, electronic devices 201 and 260 include microphones 213A and 213B, respectively, or other audio sensors. Electronic devices 201 and 260 optionally use microphones 213A and 213B to detect sounds from the user and / or the user's real-world environment. In some examples, microphones 213A and 213B include an array of microphones (multiple microphones) that optionally operate in concert, such as to identify ambient noise or locate a sound source in the space of the real-world environment.

[0045] Electronic devices 201 and 260 include position sensors 204A and 204B, respectively, for detecting the position of electronic device 201A and / or display generation component 214A and the position of electronic device 260 and / or display generation component 214B, respectively. For example, position sensors 204A, 204B may include a Global Positioning System (GPS) receiver that receives data from one or more satellites and allows electronic devices 201, 260 to determine the absolute position of the device in the physical world.

[0046] The electronic devices 201 and 260 include orientation sensors 210A and 210B, respectively, for detecting the orientation and / or movement of the electronic device 201 and / or the display generation component 214A and the orientation and / or movement of the electronic device 260 and / or the display generation component 214B, respectively. For example, the electronic devices 201, 260 use the orientation sensors 210A, 210B to track changes in the position and / or orientation of the electronic devices 201, 260 and / or the display generation components 214A, 214B, such as changes relative to physical objects in the real world environment. The orientation sensors 210A, 210B optionally include one or more gyroscopes and / or one or more accelerometers. Data from the orientation sensors 210A, 210B are optionally used to determine whether to reposition or recenter the first virtual content, such as with reference to a real object. Figures 6A to 6B As stated.

[0047] In some examples, electronic device 201 includes hand tracking sensors 202 and / or eye tracking sensors 212 and / or other body tracking sensors, such as leg tracking sensors, torso tracking sensors, and / or head tracking sensors. Hand tracking sensors 202 are configured to track the position / location of one or more parts of a user's hand and / or the movement of one or more parts of a user's hand relative to the augmented reality environment, relative to display generation component 214A, and / or relative to another defined coordinate system. Eye tracking sensors 212 are configured to track the position and movement of a user's gaze (more generally, eyes, face, or head) relative to the real world or augmented reality environment and / or relative to display generation component 214A. In some examples, hand tracking sensors 202 and / or eye tracking sensors 212 are implemented together with display generation component 214A. In some examples, hand tracking sensors 202 and / or eye tracking sensors 212 are implemented separately from display generation component 214A. In some examples, electronic device 201 alternatively does not include hand tracking sensors 202 and / or eye tracking sensors 212. In some such examples, the display generation component 214A may be used by the electronic device 260 to provide an extended reality environment and utilize input and other data collected via other sensors of the electronic device 201 (e.g., one or more position sensors 204A, one or more image sensors 206A, one or more touch-sensitive surfaces 209A, one or more motion and / or orientation sensors 210A, and / or one or more microphones 213A or other audio sensors) as input and data processed by the processor 218B of the electronic device 260.

[0048] In some examples, the hand tracking sensor 202 (and / or other body tracking sensors, such as leg, torso, and / or head tracking sensors) may use an image sensor 206 (e.g., one or more IR cameras, 3D cameras, depth cameras, etc.) that captures three-dimensional information from the real world, including one or more body parts (e.g., the hand, leg, torso of a human user). In some examples, the hand may be resolved with sufficient resolution to distinguish between fingers and their respective positions. In some examples, one or more image sensors 206A are positioned relative to the user to define a field of view and interaction space of the image sensor 206A, in which the finger / hand position, orientation, and / or movement captured by the image sensor is used as input (e.g., to distinguish from the user's resting hand or other hands of other people in the real-world environment). Tracking fingers / hands for input (e.g., gestures, touches, taps, etc.) may be advantageous because it does not require the user to touch, hold, or wear any type of beacon, sensor, or other marker.

[0049] In some examples, eye tracking sensor 212 includes at least one eye tracking camera (e.g., an infrared (IR) camera) and / or an illumination source (e.g., an IR light source, such as an LED) that emits light toward the user's eyes. The eye tracking camera can be pointed toward the user's eyes to receive reflected IR light from the light source directly or indirectly from the eyes. In some examples, both eyes are tracked separately by corresponding eye tracking cameras and illumination sources, and focus / gaze can be determined by tracking both eyes. In some examples, one eye (e.g., the dominant eye) is tracked by one or more corresponding eye tracking cameras / illumination sources.

[0050] Electronic devices 201 and 260 are not limited to Figures 2A to 2B Rather than having a set of components and configurations, the electronic device 201 and / or the electronic device 260 may include fewer components, other components, or additional components in a variety of configurations. In some examples, the electronic device 201 and / or the electronic device 260 may be implemented across multiple electronic devices (e.g., as a system). In some such examples, each (or more) electronic device may each include one or more of the same components discussed above, such as various sensors, one or more display generation components, one or more speakers, one or more processors, one or more memories, and / or communication circuits. One or more people using the electronic device 201 and / or the electronic device 260 are optionally referred to herein as one or more users of the device.

[0051] Now, attention is turned to interaction with one or more virtual objects displayed in a three-dimensional environment presented at an electronic device (e.g., corresponding to electronic device 101). In some examples, the electronic device uses corresponding metadata indicating the type of content locking behavior of the corresponding virtual content presented in the three-dimensional environment to determine how to present the corresponding virtual content in the three-dimensional environment. In some examples, the corresponding metadata indicating the type of content locking behavior of the corresponding virtual content associated with the metadata can be overwritten, causing the electronic device to display the corresponding virtual content with a content locking behavior different from the content locking behavior indicated by the corresponding metadata, or to cause the display of the corresponding virtual content.

[0052] Figure 3A A block diagram illustrating various types of metadata associated with first virtual content, including content locking behavior, according to some examples of the present disclosure.

[0053] Metadata can include data that provides details about other data (e.g., descriptions, definitions, instructions, instructions, information, etc.). In some examples, metadata associated with a software application is programmed by the software application developer. In some examples, a processor of an electronic device presents an instance or object of the software application, such as a user interface of the application, based on the metadata associated with the software application.

[0054] The metadata associated with the first virtual content optionally indicates (or defines) parameters (e.g., preferred parameters) related to the presentation of the first virtual content in the three-dimensional environment, such as display parameters. In some examples, the electronic device uses the metadata to determine how to present the first virtual content in the three-dimensional environment. In some examples, the electronic device presents the first virtual content based on the metadata associated with the first virtual content, such as described below.

[0055] like Figure 3A As shown, in some examples, metadata associated with the first virtual content optionally indicates (or defines) a PPD 304 associated with display of the first virtual content (e.g., a preferred pixel per degree (PPD)). For example, PPD optionally refers to image resolution expressed in terms of the number of pixels visible within a one-degree field of view of a viewer (e.g., the field of view of an electronic device). In some examples, the metadata associated with the first virtual content optionally defines a preferred PPD amount for displaying the first virtual content, optionally for optimal interaction and / or display of features of the first virtual content. For example, a software application developer or other content provider optionally indicates a preferred PPD for viewing the first virtual content, and the electronic device optionally accesses such information to determine how to present the first virtual content.

[0056] like Figure 3A As shown, in some examples, metadata associated with first virtual content optionally indicates (or defines) a field of view (FoV) 306 (e.g., a preferred FoV) associated with the display of the first virtual content. For example, the FoV of the metadata optionally defines a preferred field of view for display 120 and / or the display of the first virtual content via display 120. In some examples, the FoV of the metadata indicates the area or volume of the user's field of view that will be consumed by the display of the first virtual content via display 120. In some examples, the preferred FoV is defined as a function of time. For example, the display of the first virtual content may optionally be playback of a movie, and the metadata associated with the movie may optionally indicate that the media will be consumed at a first FoV at a first timestamp of the movie, and at a second FoV different from the FoV (e.g., greater than or less than the first FoV) at a second timestamp within the playback of the movie that is different from the first timestamp within the playback of the movie. In some examples, pixels per degree 304 are defined relative to the field of view 306.

[0057] like Figure 3AAs shown, in some examples, metadata associated with the first virtual content optionally indicates (or defines) verticality 308 associated with display of the first virtual content in the three-dimensional environment (e.g., preferred verticality). For example, the verticality 308 of the metadata optionally defines the height of the first virtual content (e.g., a vertical position associated with the display of the first virtual content and / or a vertical position associated with a center position of the display of the first virtual content). For example, the verticality 308 optionally indicates that the first virtual content is to be displayed at a first vertical position within the computer-generated environment, optionally relative to the FoV 306. Furthermore, the verticality 308 optionally defines a vertical maximum value and / or a vertical minimum value at which the first virtual content will be displayed via the display 120 (e.g., a maximum and / or minimum vertical pixel position at which the first virtual content will be displayed via the display 120).

[0058] like Figure 3A As shown, in some examples, metadata associated with the first virtual content optionally indicates (or defines) a horizontality 310 associated with the display of the first virtual content (e.g., a preferred horizontality). For example, the horizontality 310 of the metadata optionally defines a preferred horizontal position of the first virtual content (e.g., a horizontal position associated with the display of the first virtual content and / or a lateral position associated with the center position of the display of the first virtual content). For example, the horizontality 310 optionally defines a horizontal maximum value and / or a horizontal minimum value at which the first virtual content will be displayed in the three-dimensional environment via the display 120 (e.g., the maximum and / or minimum horizontal pixel position at which the first virtual content will be displayed via the display 120).

[0059] like Figure 3A As shown, in some examples, metadata associated with the first virtual content optionally indicates (or defines) one or more dimensions 312 (e.g., preferred dimensional amounts) of the presentation of the first virtual content in the three-dimensional environment. For example, dimensions 312 optionally define a preferred length, width, and / or height of the first virtual content within the three-dimensional environment or within and / or relative to the user's viewpoint.

[0060] like Figure 3A As shown, in some examples, metadata associated with the first virtual content optionally indicates (or defines) a depth 314 (e.g., a preferred depth) associated with the display of the first virtual content. For example, depth 314 optionally refers to a distance (e.g., a perceived distance) between a location of the first virtual content and a location associated with a user (e.g., a viewpoint of electronic device 101).

[0061] like Figure 3AAs shown, in some examples, metadata associated with the first virtual content optionally indicates (or defines) a content locking behavior 316 (e.g., a preferred content locking behavior) associated with display of the first virtual content, such as described below with reference to Figure 3B As stated.

[0062] Figure 3B A block diagram illustrating various types of content locking behaviors according to some examples of the present disclosure. For example, metadata associated with a first virtual content may optionally include Figure 3B As another example, the electronic device 101 optionally displays the first virtual content according to one of the content locking behaviors 316 even when the one of the content locking behaviors is not indicated by metadata associated with the first virtual content (e.g., optionally because the electronic device 101 (or electronic device 160) coverage criteria are met), as described below with reference to Figure 3D As stated.

[0063] like Figure 3B As shown, one content lock behavior 316 is world locked 318. For example, when the content lock behavior of the first virtual content is world locked, the first virtual content has no distance or orientation offset relative to the user, such as described above with reference to world locked objects.

[0064] like Figure 3B As shown, one content lock behavior 316 is head-locked 320. For example, when the content lock behavior of the first virtual content is head-locked, the first virtual content may be visually represented as head-locked content, such as described herein with respect to objects displayed in a head-locked orientation in a three-dimensional environment and / or such as head-locked objects. For example, when the content lock behavior of the first virtual content is head-locked, and based on detecting head movement, the electronic device 101 may display the first virtual content that moves within the three-dimensional environment based on the user's head movement, optionally so as to maintain (e.g., lock) the position of the first virtual content on the display 120 and the distance of the first virtual content relative to the user's head. As another example, when head-locked, the first virtual content is locked to a first set of pixels (e.g., a predetermined number or area of pixels) on the display 120 (e.g., displayed via the first set of pixels) and not locked to a second set of pixels (e.g., displayed via the second set of pixels), such that even when the user moves the user's head, the first virtual content remains on the display 120 via the first set of pixels. As another example, when the content locking behavior of the first virtual content is head locked, movement of the display 120 optionally causes movement of the first virtual content relative to the physical environment of the electronic device 101, such as described below with reference to 7A to 7D Shown and described.

[0065] like Figure 3B As shown, a content locking behavior 316 is head-locked 322 using elasticity. For example, when the content locking behavior of the first virtual content is head-locked using elasticity, the electronic device 101 optionally causes the first virtual content to be visually presented as head-locked content according to the elasticity model. In some examples, the elasticity model physically implements user interactions in the virtual environment so that the interactions are governed by physical laws, such as laws related to springs. For example, the user's head position and / or head orientation optionally corresponds to the position of the first end of the spring (e.g., simulating the first end of the spring attached to an object), and the first virtual content optionally corresponds to the mass of the second end of the spring that is different from (e.g., opposite to) the first end of the spring. When the head position and / or orientation is a first head position and / or first orientation corresponding to the first position of the first end of the spring and the first virtual content corresponds to the mass attached to the second end of the spring, the electronic device optionally detects head movement (e.g., head rotation) from the first head position and / or first head orientation to the second head position and / or second head orientation. In response to detecting the head rotation, the electronic device optionally models the deformation of the spring (e.g., based on the amount of head rotation and / or the speed of head rotation) and moves the first virtual content based on the release of energy caused by the movement of the spring toward an equilibrium position (e.g., a stable equilibrium position) relative to a second head position and / or a second head orientation. The speed at which the first virtual content follows the head rotation is optionally a function of the distance between the position of the first virtual content when the electronic device detects the head rotation and the position of the first virtual content corresponding to the relaxed position of the spring (e.g., the equilibrium position), the latter position optionally being the same relative to the user's new viewpoint caused by the head rotation as the position of the first virtual content relative to the user's viewpoint before the head rotation was detected. In some examples, the speed of the first virtual content decreases as the first virtual content moves toward the relaxed position in response to the head rotation. In some examples, the user's head rotates a first amount within a first amount of time, and the movement of the first virtual content to its new position relative to the user's new viewpoint is performed within a second amount of time that is greater than the first amount of time. Thus, when the content locking behavior of the first virtual content is head locked 322 using elasticity, based on the detection of head movement, the electronic device 101 optionally displays the first virtual content that moves within the three-dimensional environment based on the user's head movement and based on the elastic model that simulates the lazy follow movement behavior, such as the reference image. Figures 4A to 4C As shown and described, head locking 322 with elasticity can optionally be used to smooth the movement of the first virtual content in the three-dimensional environment as the user moves (eg, rotates the user's head).

[0066] like Figure 3BAs shown, one content-locking behavior 316 is body-locked 324. For example, when the content-locking behavior of the first virtual content is body-locked, the electronic device 101 optionally causes the first virtual content to visually appear as body-locked content, such as described herein with reference to objects displayed in a body-locked orientation and / or body-locked objects in a three-dimensional environment. For example, when the content-locking behavior of the first virtual content is body-locked, the electronic device 101 optionally does not display the first virtual content that moves within the three-dimensional environment based on the user's head rotation (e.g., the user's head rotation optionally causes the electronic device to reposition the first virtual content in the three-dimensional environment), but rather moves or rotates based on the user's torso.

[0067] like Figure 3B As shown, one content lock behavior 316 is tilt locked 326. For example, when the content lock behavior of the first virtual content is tilt locked, such as described above with reference to the tilt lock object defined above.

[0068] like Figure 3BAs shown, one content locking behavior 316 is horizontally locked 328. For example, when the content locking behavior of the first virtual content is horizontally locked 328, the electronic device 101 optionally causes the first virtual content to visually appear as if it is bound to a horizon line or eye level. For example, when the eye level of the user of the electronic device 101 is a first eye level (e.g., 4 ft, 5 ft, 6 ft, 6.5 ft, or another height in an environment that is the same or approximately the same height as the height of the user's eyes and / or the display 120 relative to the ground (e.g., the floor) of the user's physical environment), the electronic device 101 optionally causes the first virtual content to visually appear as if it is bound to the first eye level (e.g., the center of the first virtual content intersects the horizon line corresponding to the first eye level in the environment and optionally continues to intersect the first eye level), and when the eye level of the user of the electronic device 101 is a second eye level different from the first eye level, the electronic device 101 optionally causes the first virtual content to visually appear as if it is bound to a second eye level (e.g., the center of the first virtual content intersects the horizon line corresponding to the second eye level and optionally continues to intersect the second eye level). As another example, when the content lock behavior of the first virtual content is horizontally locked 328, the first virtual content is optionally aligned with the horizon relative to the eye level of a given user. For example, the electronic device optionally positions the first virtual content at a height aligned with the horizon relative to the user's eye level (e.g., the center of the content is aligned with the horizon). In some examples, when the first virtual content is horizontally locked 328, the first virtual content is locked in a vertical orientation relative to the horizon or the direction of gravity during the user's interaction with the first virtual content. For example, when the first virtual content is locked in a vertical orientation, the electronic device optionally maintains the alignment of the first virtual content (e.g., the user interface of the first virtual content) with the direction of gravity in the user's position. For example, when the first virtual content is locked in a vertical orientation, the electronic device optionally does not rotate the first virtual content in response to detecting a rolling movement of the user's head (e.g., the user's head tilts toward the user's left or right shoulder); instead, the electronic device 101 optionally maintains the vertical orientation of the first virtual content.

[0069] In some examples, the electronic device 101 causes the eye-level positioning of the first virtual content to be reset (e.g., and / or repositioned). For example, a user is optionally viewing the first virtual content while sitting on a couch, and when the user stands up (e.g., which causes the user's eye level to be updated), the electronic device 101 optionally causes the height of the first virtual content relative to the ground of the user's environment to be changed (e.g., the center of the first virtual content intersects the horizontal line corresponding to the updated eye level and optionally continues to intersect the updated eye level) in order to maintain the relationship between the display of the first virtual content and the user's eye level.

[0070] like Figure 3B As shown, content locking behavior 316 is optionally another content locking behavior 330. Another content locking behavior 330 is optionally a content locking behavior that is a combination of one or more features of content locking behaviors 320-328 or features different from content locking behaviors 320-328. For example, another content locking behavior 330 is optionally a body locking 324 using elasticity, such as the elasticity described above with reference to the content locking behavior of head locking 322 using elasticity.

[0071] In some examples, metadata of the first virtual content indicates a plurality of content locking behaviors (e.g., Figure 3B In some examples, the metadata indicates a priority between multiple locking behaviors. For example, the metadata optionally indicates world locking as a first priority (e.g., a first choice), head locking as a second priority (e.g., a second choice), body locking as a third priority (e.g., a third choice), etc., and the electronic device 160 optionally selects the content locking behavior indicated by the specific metadata based on the priority assigned to the content locking behavior indicated by the specific metadata for displaying the first virtual content and, optionally, additionally based on the operating conditions of the electronic device 160. Further details of metadata indicating multiple content locking behaviors and their priority levels are described herein. In some examples, the metadata indicates an association between a given content locking behavior and a given context, and such features and their utilization are described in more detail herein.

[0072] It should be clear that Figure 3B The exemplary content locking behavior of is representative and non-limiting. In addition, it should be clear that the electronic device 101 can use the corresponding metadata indicating the type of content locking behavior of the corresponding virtual content to determine the manner in which the corresponding virtual content is presented in the three-dimensional environment. For example, the electronic device 101 can use the metadata indicating the type of content locking behavior of the corresponding virtual content to determine the manner in which the corresponding virtual content is presented in the three-dimensional environment. Figure 3B The method of presenting the corresponding virtual content corresponding to the corresponding content locking behavior is determined by using metadata of any of the corresponding content locking behaviors exemplified in . It should be noted that the discussion herein about the electronic device 101 using the corresponding metadata is optionally alternatively the electronic device 160 using the corresponding metadata to determine how the electronic device 101 presents the first virtual content via the display 120.

[0073] In some examples, the electronic device 101 overlays and displays the corresponding virtual content or causes the display of the corresponding virtual content according to the metadata associated with the corresponding virtual content. In some examples, the electronic device 101 overlays and displays the corresponding virtual content (or overlays and causes the display of the corresponding virtual content) according to the content locking behavior indicated by the corresponding metadata associated with the corresponding virtual content, so that the electronic device 101 displays the corresponding virtual content with a content locking behavior different from the content locking behavior indicated by the corresponding metadata associated with the corresponding virtual content or causes the display of the corresponding virtual content. It should be noted that the discussion herein about the electronic device 101 performing the overlay display of the corresponding virtual content according to the corresponding metadata is optionally alternatively that the electronic device 160 performs the overlay. In some examples, the metadata indicates multiple content locking behaviors, and the electronic device 101 overlays and displays the corresponding virtual content with a first content locking behavior indicated by the metadata, and displays the corresponding virtual content with a second content locking behavior indicated by the metadata.

[0074] Figure 3C Illustrated is a block diagram showing transitioning between presenting first virtual content according to a first content locking behavior and a second content locking behavior, optionally in response to the electronic device 101 determining that overlay criteria are satisfied, according to some examples of the present disclosure.

[0075] like Figure 3C As shown, the electronic device can lock the behavior according to the first content (such as reference Figure 3B The first content lock transition or override (optionally based on user input) causes display of virtual content (arrow 342) in accordance with the first content lock transition or override (optionally based on user input) to cause display of virtual content in accordance with the second content lock transition or override (such as the reference content lock transition) (arrow 344). Figure 3B The content locking behavior described above but different from the first content locking behavior) causes the display of virtual content. Figure 3C As shown, the electronic device can optionally return (eg, arrow 344) to cause the display of the virtual content according to the first content locking behavior. Figure 3C As shown, the electronic device can cause display of virtual content according to the second content locking behavior (346), and then transition (arrow 344), overwrite, or return (optionally according to user input or automatically in the absence of user input) to cause display of virtual content according to the first content locking behavior. In some examples, the electronic device 101 transitions (e.g., causes a transition) between the first content locking behavior and the second content locking behavior as defined (or indicated) by the metadata. In some examples, the electronic device 101 transitions (e.g., causes a transition) between the first content locking behavior and the second content locking behavior without considering the metadata.

[0076] Figure 3DA flowchart illustrating a method 350 for initiating a process for displaying virtual content in a three-dimensional environment based on a determination that coverage criteria are met according to some examples of the present disclosure is shown. The method 350 is optionally performed by an electronic device (e.g., Figure 2A Electronic equipment 201 or Figure 2B Executed by electronic device 260).

[0077] exist Figure 3D In the method 350, the method 350 includes displaying (352) a first content lock behavior (such as a reference Figure 3B For example, the first content locking behavior is optionally represented by metadata (such as a reference Figure 3A The metadata) indicates.

[0078] exist Figure 3D In some examples, the method 350 includes determining (354) whether the overlay criteria are met. In some examples, the overlay criteria are met in response to receiving an overlay input. The overlay input is optionally an input corresponding to a request to overlay display the first virtual content according to a content lock behavior indicated by metadata associated with the first virtual content. The overlay input is optionally detected via one or more sensors in communication with the electronic device 101, at the electronic device 101, at the electronic device 160, and / or at the display 120. The overlay input is further described elsewhere herein, such as with reference to Figures 5A to 5B Additionally or alternatively, method 350 includes detecting an overlay input. In some examples, as later referenced Figures 5A to 5B The first virtual content 506 in the content lock transitions between the content lock behaviors as described in the satisfied override criteria. In some examples, the override criteria are satisfied in response to detecting certain contexts (e.g., a user is walking, a user is sitting, a temperature at the electronic device 160 is above or below a threshold temperature, a power at the electronic device 160 is above or below a threshold power amount, constrained system resources at the electronic device 160, and / or other contexts).

[0079] exist Figure 3D In the method 350 , based on determining that the overlay criteria are not met, continuing to display ( 354 a ) the first virtual content having the first content lock behavior (eg, without interruption).

[0080] exist Figure 3D In the method 350, the method 350 includes initiating (356) displaying a second content locking behavior (such as reference Figure 3BThe process of displaying the first virtual content of the first virtual content (the content locking behavior that is different from the first content locking behavior) according to the overlay input corresponding to the request to overlay display the first virtual content according to the metadata associated therewith) is described. For example, based on determining that the overlay criteria are met, the electronic device 101 optionally causes the display 120 to change the content locking behavior of the first virtual content from the first behavior, which is optionally indicated by the metadata, to the second behavior, which is optionally indicated by the metadata or not indicated by the metadata, such as the reference Figure 3C In some examples, the second content locking behavior is indicated by metadata and has a lower priority level than the first content locking behavior. In some examples, the second content locking behavior is indicated by metadata based on a mapping of the second content locking behavior to a specific context associated with the satisfaction of the override criteria. In some examples, the first content locking behavior is indicated by metadata, and the second content locking behavior is not indicated by metadata. In some examples, satisfaction of a first coverage criterion (e.g., detecting that the user is walking, the user is sitting, the temperature at the electronic device 160 is higher or lower than a threshold temperature, the wireless connection strength at the electronic device 160 is higher or lower than a threshold cellular connection strength, the power at the electronic device 160 is higher or lower than a threshold power amount, constrained system resources at the electronic device 160, and / or other context) causes the visual lock behavior to change to a second content lock behavior, and satisfaction of a second coverage criterion different from the first coverage criterion (e.g., detecting that the user is walking, the user is sitting, the temperature at the electronic device 160 is higher or lower than a threshold temperature, the power at the electronic device 160 is higher or lower than a threshold power amount, constrained system resources at the electronic device 160, and / or other context) causes the visual lock behavior to change to a third content lock behavior different from the second content lock behavior.

[0081] It should be understood that Figure 3D The method 350 is an example, and more, fewer, or different operations may be performed in the same or different order. Additionally, the operations in the method 350 described above are optionally performed by running an information processing device such as a general-purpose processor (e.g., as described with respect to Figures 2A to 2B said) or one or more functional modules in a dedicated chip and / or through Figures 2A to 2B other components to achieve this.

[0082] Figures 4A to 8C Various examples of electronic devices displaying first virtual content according to different content locking behaviors are illustrated. These figures are intended to provide exemplary embodiments of the present disclosure, but are not intended to be exhaustive of potential embodiments of the present disclosure. Therefore, Figures 4A to 8Cis a representative implementation and is non-limiting. In addition, for ease of reference, it should be noted that Figures 4A to 8C including top views 410 , 510 , 610 , 710 and 810 , respectively; Figures 4A to 8C The first virtual contents 406 , 506 , 606 , 706 , 806 , 807 are optionally the same or different in content; Figures 4A to 8C The three-dimensional environments 402, 502, 602, 702, and 802 optionally include similar or different features; Figures 4A to 8C Tables 404, 504, 604, 704, and 804 optionally include similar or different features; Figures 4A to 8C The viewing boundaries 408a-408b, 508a-508b, 608a-608b, 708a-708b optionally have similar or different characteristics.

[0083] Figures 4A to 4C Illustrated are some examples of head locking using elasticity (e.g., Figure 3B The first virtual content 406 is visually represented by the content locking behavior of utilizing elasticity to lock the head 322. In some examples, Figures 4A to 4C The content locking behavior of the first virtual content 406 in the embodiment is metadata associated with the first virtual content 406 (e.g., Figure 3A The metadata 302, but with Figures 4A to 4C In some examples, Figures 4A to 4C The content locking behavior of the first virtual content 406 in the example is not the content locking behavior indicated by the metadata associated with the first virtual content 406 (e.g., Figures 4A to 4C The content locking behavior of the first virtual content 406 in the embodiment is determined according to an overlay input, which overlays the first virtual content according to the content locking behavior indicated by metadata associated with the first virtual content, such as reference Figure 3D described above).

[0084] exist Figure 4A In the embodiment, the three-dimensional environment 402 includes a first virtual content 406 and a table 404, which optionally represent Figure 1 4. In one example, the first virtual content 406 is a user interface of an application such as a game application, an internet application, or another type of application. In one example, the table 404 is optionally a physical table in a physical environment. As shown in the top view 410, the electronic device 101 provides the user 401 with a field of view (e.g., viewing boundaries 408a-408b) in the three-dimensional environment 402.

[0085] exist Figure 4AIn the embodiment, since the content locking behavior of the first virtual content 406 utilizes elasticity to lock the head, the electronic device 101 optionally enables the first virtual content 406 to be locked as shown in the reference Figure 3B The head locking 322 is performed by utilizing elasticity. For example, Figures 4A to 4B As shown, in response to detecting the rotation of the user's head, the electronic device 101 optionally initiates movement of the first virtual content 406 in the three-dimensional environment 402, such as by Figure 4B As indicated by arrow 407 in the top view 410 in FIG. Figures 4A to 4B , user 401 has rotated the user's head a first amount, such as from Figures 4A to 4B A clockwise rotation of the user 401 (and therefore the electronic device 101 ) is shown in the top view 410 . Figure 4B The position of the first virtual content 406 relative to the viewpoint of the user 401 (eg, relative to the display 120) is different from Figure 4A The position of the first virtual content 406 relative to the viewpoint of the user 401 (e.g., relative to the display 120) in FIG. This difference is optionally due to the reference Figure 3B The first virtual content 406 follows the user's head movement by using the spring-like behavior of the first virtual content 406 described in the head locking 322 using elasticity. Figures 4A to 4B As shown in the head rotation input, the electronic device 101 moves the first virtual content 406 to Figure 4C The position of the image relative to the user's viewpoint (e.g., relative to display 120) in FIG. Figure 4A The position of the first virtual content 406 relative to the user's viewpoint (which is a different position in the three-dimensional environment 402, but Figures 4A to 4B In some examples, when the content locking behavior of the first virtual content 406 utilizes elastic head locking (e.g., Figure 3B When the electronic device 101 is detecting head rotation, the electronic device 101 optionally initiates movement.

[0086] Figures 5A to 5B The first virtual content 506 is illustrated with a body-locked content-locking behavior according to some examples of the present disclosure, and alternatively, the first virtual content 506 is illustrated from a head-locked content-locking behavior (e.g., Figure 3B 320) is converted to a content locking behavior that is locked by the body (e.g., Figure 3B body lock 324).

[0087] In some examples, Figures 5A to 5BThe content locking behavior of the first virtual content 506 in the embodiment is the content locking behavior indicated by the metadata associated with the first virtual content 506. For example, the metadata associated with the first virtual content 506 optionally indicates that the content locking behavior of the first virtual content 506 is physically locked. In some examples, Figures 5A to 5B The content locking behavior of the first virtual content in is not the content locking behavior indicated by the metadata associated with the first virtual content 506 (e.g., Figures 5A to 5B The content locking behavior of the first virtual content in the embodiment is determined according to an overlay input, which overlays the first virtual content 506 according to the content locking behavior indicated by metadata associated with the first virtual content 506, such as reference Figure 3D described above).

[0088] exist Figure 5A , the first virtual content 506 is optionally locked to the body, such as reference Figure 3B As described in the body lock 324 of FIG. As part of the body lock, the electronic device 101 optionally does not reposition the first virtual content 506 within the three-dimensional environment 502 in response to detecting the user's rotational movement. For example, although the user 501 rotates as shown by the user's clockwise rotation in the top view 510, the electronic device 101 optionally maintains the first virtual content 506 in the three-dimensional environment 502 from FIG5A to FIG5B In some examples, the user's translational motion will cause the electronic device 101 to reposition the first virtual content 506 in the three-dimensional environment 502. In some examples, the user's FoV is greater than or equal to the FoV used to simultaneously display all portions of the first virtual content 506, such as Figures 4A to 4C In some examples, the user's FoV is smaller than the FoV used to display all portions of the first virtual content 506. For example, although not shown, the length of the first virtual content 406 may be smaller than the FoV used to display all portions of the first virtual content 506. Figure 4C When the user's FoV is smaller than the FoV for displaying all portions of the first virtual content 506 and the user rotates in a direction toward the obscured portion of the first virtual content 506 (e.g., toward a non-displayed portion of the currently rendered first virtual content 506), the electronic device 101 optionally causes display of the obscured portion of the first virtual content 506 while maintaining the body-locked content-locked behavior.

[0089] also, Figures 5A to 5B Alternatively, the first virtual content 506 according to some examples of the present disclosure is illustrated as being locked from the head-locked content (eg, Figure 3B 320) is converted to a content locking behavior that is locked by the body (e.g., Figure 3B Body lock 324). For example, Figure 5A The content locking behavior of the first virtual content 506 is optionally head-locked (or head-locked with elasticity), such as reference Figure 3B The head lock 320 or head lock with elasticity 322 is described, rather than being locked by the body, and in response to the electronic device 101 detecting the cover input (for example, when presenting the first virtual content with the content locking behavior of the head lock or head lock with elasticity), such as reference Figure 3D The electronic device 101 optionally uses the overlay input Figure 5A The first virtual content 506 is presented as having a body locked content locking behavior, such as in FIG5A to FIG5B The behavior of the first virtual content 506 is shown and described in FIG. 5 (eg, the first virtual content 506 optionally remains positioned in its Figures 5A to 5B In some examples, the overlay input is a rotational motion of the user 501 (e.g., head rotation) that meets certain criteria. For example, based on determining that the rotational motion of the user 501 is at or above a threshold angular velocity (e.g., 5, 10, 15, 20, 25, 30 degrees per second, or another threshold angular velocity), the electronic device 101 optionally causes the user 501 to rotate at or above a threshold angular velocity. Figure 5A The first virtual content 506 is locked from the content according to the header locking behavior (e.g., Figure 3B The head lock 320 or head lock with elasticity 322) is visually transformed into a locking behavior based on the content of the body lock (e.g., Figure 3B The body lock 324) is visually represented, and based on determining that the rotational movement of the user 501 is below the threshold angular velocity, the electronic device optionally abandons the use of Figure 5A The first virtual content 506 is visually displayed from being visually represented according to the head-locked content locking behavior to being visually represented according to the body-locked content locking behavior, and the first virtual content 506 continues to be displayed as being visually represented according to the head-locked content locking behavior. In some examples, the content locking behavior of the first virtual content is automatically selected based on safety, such as when the electronic device 101 transitions the content locking behavior of the first virtual content based on determining that the rotation of the user 501 is at or above the threshold angular velocity discussed above.

[0090] In some examples, from FIG5A to FIG5BIn response to detecting a request to enter text into a keyboard (e.g., a keyboard of a phone or computer such as electronic device 160), a request corresponding to a user accessing a phone, and / or head movement, the first virtual content 506 changes from a head-locked content locking behavior to a body-locked content locking behavior. For example, the first virtual content 506 optionally has a head-locked content locking behavior using elasticity, and in response to detecting a request to enter text into a keyboard (e.g., a keyboard of a phone or computer) (such as the one described below with reference to FIG. 1 ), the first virtual content 506 changes from a head-locked content locking behavior to a body-locked content locking behavior. Figures 8A to 8B ), a request corresponding to a user accessing a call (such as the one referenced below) Figures 8A to 8B ) and / or head movements (such as those described above with reference to Figures 5A to 5B For example, the first virtual content 506 is optionally a user interface of an internet application, such as a web browser application, for which the metadata indicates a preferred content locking behavior of head locking (or head locking with elasticity), and in response to detecting a user request to enter text into the web browser application (or in response to detecting the display of a text input area on the web browser application), the electronic device 101 optionally changes the content locking behavior of the first virtual content 506 from head locking (or head locking with elasticity) to body locking, optionally allowing the user to type text into the web browser application via the user's phone (e.g., electronic device 160). In some examples, in response to detecting a user request to search for a user query entered into a text input of the web browser (e.g., the user clicks an "enter" key, or another key corresponding to a request to initiate a search for a user query), the electronic device 101 optionally changes the content locking behavior of the first virtual content 506 back to head locking or head locking with elasticity. In some examples, the electronic device 101 transitions (e.g., causes a transition) between the first content locking behavior and the second content locking behavior as defined (or indicated) by the metadata. In some examples, the electronic device 101 switches (e.g., causes a switch) between the first content locking behavior and the second content locking behavior without considering the metadata. Figure 3DAs described and illustrated, electronic device 101 can cause virtual content to transition from a first content locking behavior to a second content locking behavior, and then transition the virtual content back to the first content locking behavior. Thus, in some examples, while electronic device 101 is presenting first virtual content 506 with a head-locked content locking behavior, when a user initiates a process involving user input at electronic device 160 (e.g., a touch on a soft keyboard, a touch on a user interface element displayed via electronic device 160, voice input, or another type of user input), electronic device 101 optionally presents first virtual content 506 with a body-locked content locking behavior during the receipt of the user input at electronic device 160. In some examples, electronic device 101 transitions the content locking behavior of the first virtual content from a head-locked content locking behavior to a body-locked content locking behavior based on metadata. For example, the metadata optionally includes one or more indications that the first virtual content will transition the content locking behavior from the head-locked content locking behavior to the body-locked content locking behavior in response to detecting a request to type on a keyboard. In some examples, the electronic device 101 changes the content locking behavior of the first virtual content from a head-locked content locking behavior to a body-locked content locking behavior in response to detecting a request to type on a keyboard, even when the metadata optionally does not include an indication that the first virtual content will change the content locking behavior from a head-locked content locking behavior to a body-locked content locking behavior in response to detecting a request to type on a keyboard.

[0091] Figures 6A to 6B The resetting of the placement and / or orientation of the first virtual content 606 according to some examples of the present disclosure is illustrated. Figure 6A , the first virtual content 606 optionally locks the content according to the body lock behavior (e.g., Figure 3B The first virtual content 606 is visually represented by the body lock 324. Figure 6A The position of the first virtual content 506 in the three-dimensional environment 602 is optionally related to the position of the first virtual content 506 in the three-dimensional environment 602. Figure 5B The same position in the three-dimensional environment 502. Figure 6A As shown, the position of the first virtual content 606 in the three-dimensional environment 602 deviates from the center position of the viewpoint of the user 601 . Figure 6A The user 601 may wish to reset the placement of the first virtual content 606. For example, the user 601 may wish to place the first virtual content 606 relative to Figure 6A At the center position of the viewpoint of user 601 in .

[0092] This example provides resetting or repositioning first virtual content 606 in a three-dimensional environment 602. For example, electronic device 101 optionally initiates resetting or repositioning of first virtual content 606 in response to user input or in the absence of user input. In some examples, electronic device 160 optionally communicates with electronic device 101 and / or display 120. User input requesting a reset of the position of first virtual content 606 is optionally received at electronic device 101 or at electronic device 160 (e.g., a mobile phone, a stylus, a watch), and in response to detecting receipt of the user input requesting a reset of the position of the first virtual content, the position of the first virtual content 606 is reset. For example, in response to detecting receipt of the user input requesting a reset of the position of the first virtual content, electronic device 101 optionally stops repositioning the first virtual content 606. Figure 6A The first virtual content 606 is displayed at an off-center position as shown (e.g., stopped at Figure 6A The center of the first virtual content 606 is displayed at an off-center position relative to the viewpoint of the user 601 as shown), and the first virtual content 606 is displayed at a center position relative to the viewpoint of the user 601 in the three-dimensional environment 602, as shown Figure 6B In some examples, in response to detecting receipt of a user input requesting a reset of the position of the first virtual content, the electronic device 101 visually moves the first virtual content to a center position in the three-dimensional environment 602 relative to the viewpoint of the user 601, such as moving the first virtual content to the center position within an amount of time that is proportional to the amount of displacement between the position of the first virtual content at the time the reset input was received and the position of the center position (e.g., the greater the displacement amount, the greater the amount of time it takes to move the first virtual content to the center position).

[0093] In some examples, a user input requesting a reset of the position of the first virtual content (such as from FIG6A to FIG6B In some examples, user input is detected via a virtual or physical selection of a virtual or physical button on electronic device 160 or via a button (e.g., physical or virtual) on electronic device 101, optionally from a user's hand 103 pointing to the button. In some examples, user input is detected via a sensor (e.g., via a sensor of electronic device 160 or electronic device 101, such as via Figures 2A to 2BThe orientation sensors 210A, 210B of the electronic device 101 detect input requesting a reset of the position of the first virtual content. For example, the user is optionally a passenger in a moving vehicle (such as a moving bus), and the electronic device 101 resets the position or orientation of the first virtual content 606 in a manner that maintains the body-locked functionality of the first virtual content 606 even during turns that the moving vehicle may make. In some examples, the electronic device 101 automatically resets the position of the first virtual content (e.g., without user input), such as when the first virtual content 606 is off-center in the display 120 for a predetermined time period (e.g., 30s, 35s, 45s, 1 min, 2 min, 5 min, or another predetermined time period) and / or when the angle between the viewpoint of the electronic device and the first virtual content 606 is greater than a threshold viewing angle (e.g., greater than 30%, 35%, 45%, 50%, or another threshold viewing angle corresponding to the angle given by the difference between the normal to the first virtual content 606 and the direction of the user's viewpoint). For example, the electronic device 160 optionally initiates the reset in response to detecting that the angle is greater than the threshold viewing angle. In some examples, such as from FIG6A to FIG6B The resetting of the position of the first virtual content shown includes lowering Figure 6A the visual prominence of the first virtual content at its location (e.g., fading, reducing brightness and / or dimming), and increasing Figure 6B The visual prominence of the first virtual content at its location (e.g., fading in, increasing brightness, initiating display).

[0094] 7A to 7D Illustrate some examples of head locking (e.g., Figure 3B The content locking behavior of the first virtual content 706 of the header lock 320). FIG. 7A to FIG. 7B , the head of the user 701 (and therefore the electronic device 101 and the display 120) is rotated clockwise from the perspective of the top view 710 (e.g., the user's torso is not rotated), and in response, the electronic device 101 maintains the placement of the first virtual content 706 on the display 120. FIG. 7B to FIG. 7C , the head of the user 701 (and therefore the electronic device 101 and the display 120) is further rotated clockwise from the perspective of the top view 710 (e.g., the user's torso is not rotated), and in response, the electronic device 101 maintains the placement of the first virtual content 706 on the display 120 with the first virtual content 706 on the display 120. Figure 7A and Figure 7B At the same position in . Figures 7C to 7D , the torso of the user 701 rotates clockwise while the head of the user 701 does not rotate (e.g., the electronic device 101 and the display 120 do not rotate), and in response, the electronic device maintains the position of the first virtual content 706 relative to the first virtual content 706 at Figure 7C As such, when head-locked, the first virtual content 706 is locked to the display 120 such that even when the electronic device 101 and / or the display 120 is moved (e.g., rotated), the first virtual content 706 continues to occupy the same display area (e.g., the same number of display pixels) and / or position on the display 120.

[0095] Figures 8A to 8C It is illustrated that the electronic device 101 according to some examples of the present disclosure transitions the content locking behavior of the first virtual content 806 according to the satisfaction of the overlay criterion.

[0096] exist Figure 8A , the content locking behavior of the first virtual content 806 (e.g., a user interface of a movie application or a game application or another type of application) is optionally locked by the body (e.g., Figure 3B Body lock 324). Figure 8A , the first virtual content 806 is presented simultaneously with a tint 820 (e.g., a virtual lighting and / or shading effect) applied to portions of the display 120 outside of the visual presentation of the first virtual content 806, optionally so as to de-emphasize portions of the display 120 outside of the visual presentation of the first virtual content 806 and emphasize portions of the display 120 within the visual presentation of the first virtual content 806, thereby increasing the user's immersion in the first virtual content 806. While displaying the first virtual content 806 as body-locked content, the electronic device 101 optionally detects that a notification event (e.g., a text message) has been received at the electronic device 101. In response, the electronic device 101 optionally causes display of the notification 805 via the display 120 while causing display of the first virtual content 806 as body-locked content, as Figure 8A Notification 805 optionally visually notifies user 801 that a text message has been received at electronic device 160 .

[0097] In some examples, electronic device 101 detects that an overlay criterion is satisfied (such as an overlay criterion that is satisfied when user 801 attempts to interact with electronic device 160) (e.g., electronic device 101 detects movement of electronic device 101 in the direction of electronic device 160 (e.g., rotation) and / or electronic device 101 detects a change in the relative distance between electronic device 101 and electronic device 160 (e.g., smaller than before notification 805 was displayed)). In some examples, the above-mentioned detection is performed at electronic device 160 and the detection is transmitted to electronic device 101; alternatively, in some examples, the above-mentioned detection is performed at electronic device 101 and the detection is transmitted to electronic device 160. In some examples, when user 801 initiates interaction with electronic device 160 (e.g., user 801 turns / rotates the user's head toward electronic device 160, which orients electronic device 101 toward electronic device 160), electronic device 101 maintains the presentation of first virtual content 806 in three-dimensional environment 802 with the first virtual content 806. Figure 8A in the same location and has the same body locked content locking behavior, such as from FIG8A to FIG8B exemplified. exist Figure 8B , the electronic device 101 removes the tint 820 associated with the presentation of the first virtual content 806, while optionally maintaining the presentation of the first virtual content 806 (e.g., playback in a paused state of playback or a simple visual presentation if, for example, the first virtual content 806 includes media playback) at the same position in the three-dimensional environment 802 that the first virtual content 806 had when the notification 805 was displayed.

[0098] In some examples, when user 801 initiates an interaction with electronic device 160 (e.g., user 801 turns the user's head toward electronic device 160, which orients electronic device 101 toward electronic device 160), electronic device 101 (and / or electronic device 160) causes the content locking behavior of first virtual content 806 to be switched from body locking (e.g., Figure 3B body lock 324) into a head lock (e.g., Figure 3B Head lock 320), such as from Figures 8A to 8C In some examples, when the user 801 initiates an interaction with the electronic device 160 (e.g., the user 801 turns the user's head toward the electronic device 160), the electronic device 101 (and / or the electronic device 160) changes the content locking behavior of the first virtual content 806 from body locking to head locking, and optionally causes the first virtual content 806 to be displayed at a predetermined position relative to the viewpoint of the user 801 and / or a predetermined position on the display 120, such as from Figures 8A to 8CAs shown. For example, when user 801 initiates an interaction with electronic device 160 (e.g., user 801 turns the user's head toward electronic device 160), electronic device 101 (and / or electronic device 160) optionally causes the first virtual content 806 to be reduced in display size and displayed at a lower, right position (e.g., in a corner) of display 120 to provide presentation space for user 801 to see a text message (e.g., corresponding to notification 805) on electronic device 160 via (e.g., through) display 120 and optionally respond to the text message. Alternatively, in some examples, when user 801 initiates an interaction with electronic device 160 (e.g., user 801 turns the user's head toward electronic device 160), electronic device 101 (and / or electronic device 160) optionally causes the first virtual content 806 to stop being displayed via display 120, and electronic device 160 optionally displays the first virtual content 806 at a reduced display size on the display generation component of electronic device 160 via the display generation component of electronic device 160 (e.g., via Figure 2B The display generation component 214B of the electronic device 260 of the embodiment of the present invention displays the first virtual content 806 (e.g., in a two-dimensional form) to provide a presentation space for the user 801 to see the text message on the electronic device 160 via (e.g., through) the display generation component 120 and optionally respond to the text message. In some examples, after the user 801 completes the user interaction with the electronic device 101, the electronic device 160 returns to the state in which the text message is displayed. Figure 8A The configuration illustrated in FIG presents the first virtual content 806. For example, when the user 801 interacts with the electronic device 160, such as with reference to FIG. Figure 8B and 8C As illustrated and described, user 801 optionally indicates via electronic device 160 or via input detected by an input device in communication with electronic device 160 or via input detected by a sensor of electronic device 101 (e.g., electronic device 101 is moved to no longer be oriented in the direction of electronic device 160) that user 801 has completed the user interaction with electronic device 160. In response, electronic device 101 optionally returns to the state in which the user interacts with electronic device 160. Figure 8A The configuration illustrated in , presents the first virtual content 806 , including presenting the first virtual content 806 and a color tone 820 outside the first virtual content 806 , which increases the user's immersion in the first virtual content 806 .

[0099] Any transition described herein as being performed or initiated by electronic device 101 for content locking behaviors may similarly or alternatively be performed or initiated by electronic device 160. Moreover, electronic device 160 optionally performs some, most, or all processing related to presenting (e.g., displaying) the first virtual content via display 120 of electronic device 101 in accordance with any of the described content locking behaviors. Thus, in some examples, electronic device 160 determines the behavior of the first virtual content displayed via display 120 of electronic device 101, optionally independently of whether the behavior is in accordance with metadata associated with the first virtual content.

[0100] In some examples, electronic device 101 presents the first virtual content simultaneously with a user interface element associated with the first virtual content. For example, electronic device 101 optionally presents the first virtual content including a movie simultaneously with subtitles corresponding to the movie. In this example, electronic device 101 optionally presents the first virtual content including the movie with a body-locked content-locked behavior, while simultaneously presenting the subtitles corresponding to the movie with a head-locked content-locked behavior.

[0101] In some examples, electronic device 101 presents first virtual content and second virtual content. In some examples, the first virtual content includes a first user interface of a first application, and the second virtual content includes a second user interface of a second application (e.g., any application different from the first application). In some examples, electronic device 101 simultaneously presents the first virtual content and the second virtual content, having the same content locking behavior or different content locking behaviors, in a row or other relative orientation via display 120.

[0102] In some examples, the content locking behavior that can be displayed with the first virtual content is limited by the developer associated with the first virtual content and / or by device constraints. For example, metadata associated with the first virtual content optionally limits the display of the first virtual content to only be displayed according to the preferred content locking behavior indicated by the metadata.

[0103] In some examples, before or when the electronic device 101 initiates (e.g., is about to) present a first virtual content having a content locking behavior that is different from the content locking behavior indicated by the metadata associated with the first virtual content, the electronic device 101 optionally presents a notification (e.g., a visual notification, such as a text label including "head lock," "body lock," etc.) indicating the preferred content locking behavior indicated by the metadata associated with the first virtual content.

[0104] In some examples, metadata of the first virtual content indicates a plurality of content locking behaviors (e.g., Figure 3B). In some examples, the metadata indicates a priority between multiple locking behaviors. For example, the metadata optionally indicates world locking as a first priority (e.g., a first choice), head locking as a second priority (e.g., a second choice), body locking as a third priority (e.g., a third choice), and the like. In some examples, when the electronic device is restricted from selecting a particular content locking behavior or chooses not to use a particular content locking behavior (e.g., due to electronic device limitations, power amount, amount of available computing resources available for dedicating to a particular content locking behavior, etc.), the electronic device considers the metadata to determine which content locking behavior to display the first virtual content in view of the operating conditions of the electronic device 160. Therefore, in some examples, the electronic device 160 considers the metadata to determine which content locking behavior to display the first virtual content in view of the operating conditions of the electronic device 160. In some examples, the content locking behavior with the first virtual content that can be displayed via the display 120 of the electronic device 101 is determined by the operating parameters of the electronic device 160 and / or the priority data indicated by the metadata. For example, some content locking behaviors involve a higher processing order (e.g., more processing at the electronic device 160), and based on determining that the electronic device 160 is operating at, near, or above a first thermal condition when it is requested to cause display of a first virtual content having a content locking behavior involving a lower processing order, the electronic device 160 optionally forgoes causing display of the first virtual content having a content locking behavior involving a higher processing order (e.g., the content locking behavior of body locking is optionally resource intensive) and causes display of the first virtual content having a content locking behavior involving a lower processing order. Continuing with this example, and based on determining that the electronic device 160 is operating at, near, or above a first thermal condition when it is requested to cause display of the first virtual content having a content locking behavior involving a higher processing order, the electronic device 160 optionally forgoes causing display of the first virtual content having a content locking behavior involving a higher processing order and causes display of the first virtual content having a content locking behavior involving a lower processing order at the electronic device 160 (e.g., head locking or display locking is optionally less resource intensive than the content locking behavior of body locking). Similar operations discussed with reference to determining that the electronic device 160 is operating at, near, or above the first thermal condition may be performed when the electronic device 160 is operating in a lower power operating state, such as in a low power mode.

[0105] In some examples, metadata indicates an association between a given content locking behavior and a desired context, and the electronic device optionally determines the content locking behavior indicated by the metadata based on the desired context. For example, if the metadata indicates that the first virtual content is displayed as body locked if the user is walking (e.g., the movement of the electronic device 101 is below a threshold movement amount (e.g., represented by speed)), the electronic device 101 displays the first virtual content as body locked in response to detecting that the user is walking. As another example, if the metadata indicates that the first virtual content is displayed as world locked if the user is sitting at home (e.g., the electronic device 101 is located at a position corresponding to the home location and / or the electronic device 101 is not moving), the electronic device 101 optionally displays the first virtual content as world locked in response to detecting that the user is sitting at home. Other mappings of contexts and content locking behaviors are envisioned. Therefore, the metadata optionally indicates a mapping of a specific context to a specific content locking behavior (e.g., the metadata indicates different content locking behaviors for different contexts).

[0106] Thus, in accordance with the above, some examples of the present disclosure relate to a method (e.g., performed at a computing system (e.g., at electronic device 101 and / or electronic device 160) in communication with one or more input devices and one or more displays. Figure 9 The method includes receiving (902) a request to display first virtual content via one or more input devices; displaying (904) the first virtual content via one or more displays in response to receiving the request, including: displaying (906) the first virtual content having a first content locking behavior via the one or more displays based on metadata associated with the first virtual content indicating a first content locking behavior; and displaying (908) the first virtual content having a second content locking behavior via the one or more displays based on metadata associated with the first virtual content indicating a second content locking behavior different from the first content locking behavior.

[0107] Additionally or alternatively, the first content locking behavior is one of head locking, head locking with elasticity, body locking, display locking, horizontal locking, world locking or tilt locking, and the second content locking behavior is one of head locking, head locking with elasticity, body locking, display locking, horizontal locking, world locking or tilt locking that is different from the first content locking behavior, or another content locking behavior that is different from the first content locking behavior.

[0108] Additionally or alternatively, metadata associated with the first virtual content indicates a first context for displaying the first virtual content having the first content locking behavior and a second context, different from the first context, for displaying the first virtual content having the second content locking behavior. Displaying the first virtual content having the first content locking behavior is further based on determining that the computing system is operating in the first context, and displaying the first virtual content having the second content locking behavior is further based on determining that the computing system is operating in the second context.

[0109] Additionally or alternatively, the metadata associated with the first virtual content indicates at least a first content locking behavior and a second content locking behavior, a first priority level for displaying the first virtual content with the first content locking behavior, and a second priority level different from the first priority level for displaying the first virtual content with the second content locking behavior.

[0110] Additionally or alternatively, the method includes, when displaying first virtual content having a first content locking behavior according to metadata indicating the first content locking behavior or displaying first virtual content having a second content locking behavior according to metadata indicating the second content locking behavior: detecting satisfaction of an overlay criterion; and in response to detecting satisfaction of the overlay criterion, when satisfaction of the overlay criterion is detected, displaying, via one or more displays, the first virtual content having a third content locking behavior, the third content locking behavior being different from the content locking behavior of the first virtual content, such as a reference Figure 3C and Figure 3DAdditionally or alternatively, in response to receiving a request to display first virtual content having a first content locking behavior or a second content locking behavior according to metadata, a user of the computing system is associated with a first head orientation or a first body orientation; and when user input comprising a head rotation or a body rotation relative to the first head orientation or the first body orientation, respectively, is detected, the overlay criteria are met. Additionally or alternatively, based on determining in response to receiving the request that the metadata indicates the first content locking behavior and the first virtual content has the first content locking behavior, the third locking behavior is the second content locking behavior; and based on determining in response to receiving the request that the metadata indicates the second content locking behavior and the first virtual content has the second content locking behavior, the third locking behavior is the first content locking behavior. Additionally or alternatively, the third content locking behavior is different from the first content locking behavior and the second content locking behavior. Additionally or alternatively, displaying the first virtual content with the third content locking behavior in response to detecting that the overlay criteria are satisfied is further based on determining metadata indicating that the first virtual content will have the third content locking behavior in response to detecting that the overlay criteria are satisfied, or displaying the first virtual content with the third content locking behavior in response to detecting that the overlay criteria are satisfied is independent of whether the determination is made in response to detecting that the overlay criteria are satisfied that the metadata indicates that the first virtual content will have the third content locking behavior.

[0111] Additionally or alternatively, the first content locking behavior is physically locked, and in response to receiving the request, the first virtual content has the first content locking behavior and is displayed at a first location corresponding to a first corresponding location in the physical environment. Additionally or alternatively, the method includes detecting an event corresponding to a viewpoint change of the computing system via one or more input devices; and in response to detecting the event: based on determining that the viewpoint change of the computing system corresponds to a change of viewpoint from a first viewpoint to a second viewpoint, the second viewpoint being within a set of viewpoints for viewing the first virtual content at the first location corresponding to the first corresponding location in the physical environment, continuing to display the first virtual content having the first content locking behavior at the first location corresponding to the first corresponding location in the physical environment via one or more displays. Additionally or alternatively, the method includes detecting an event corresponding to a viewpoint change of the computing system via one or more input devices; and in response to detecting the event, and based on determining that the viewpoint change corresponds to a change in viewpoint from a first viewpoint to a third viewpoint different from the second viewpoint, the third viewpoint being outside a set of viewpoints for viewing the first virtual content at a first position corresponding to a first corresponding position in the physical environment: ceasing to display the first virtual content having the first content locking behavior at the first position corresponding to the first corresponding position in the physical environment; and displaying the first virtual content having the first content locking behavior at a second position corresponding to a second corresponding position in the physical environment via one or more displays, wherein the second corresponding position in the physical environment is different from the first corresponding position in the physical environment. For example, as described above with reference to Figures 6A to 6B, the user is optionally a passenger in a moving vehicle (such as a moving bus), and the event corresponding to the change in the computing system's viewpoint optionally includes a turn of the vehicle while the first virtual content is body locked. In this example, when the angle between the computing system's viewpoint and the first virtual content 606 is greater than a threshold viewing angle for deeming the first virtual content 606 body locked (e.g., greater than 30%, 35%, 45%, 50%, or another threshold viewing angle corresponding to the angle given by the difference between the normal of the first virtual content 606 and the direction of the user's viewpoint), the electronic device 101 optionally resets the position or orientation of the first virtual content 606 in the three-dimensional environment so that the angle between the computing system's viewpoint and the first virtual content 606 is less than the threshold viewing angle, in a manner that maintains the same body locked functionality of the first virtual content 606 that the first virtual content 606 had before the vehicle turned. Additionally or alternatively, the method includes, based on determining that the viewpoint change is from a first viewpoint to a third viewpoint, fading out (e.g., reducing visual salience, reducing brightness, and / or dimming) first virtual content having a first content locking behavior at a first position corresponding to a first corresponding position in the physical environment; and fading in (e.g., initiating display, increasing visual salience, and / or increasing brightness) the first virtual content having the first content locking behavior at a second position corresponding to a second corresponding position in the physical environment.

[0112] Additionally or alternatively, the method includes visually moving first virtual content having a first content locking behavior from a first position corresponding to a first corresponding position in the physical environment to a second position corresponding to a second corresponding position in the physical environment based on determining that the viewpoint change is from the first viewpoint to a third viewpoint.

[0113] Additionally or alternatively, the one or more displays include a head mounted display.

[0114] Additionally or alternatively, the first virtual content includes a game user interface.

[0115] Additionally or alternatively, the first virtual content includes a movie (eg, a user interface of a media playback application that includes the movie in playback).

[0116] Additionally or alternatively, the first virtual content includes a web browser.

[0117] Some examples of the present disclosure relate to an electronic device comprising: one or more processors; a memory; and one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for executing any one of the above methods.

[0118] Some examples of the present disclosure relate to a non-transitory computer-readable storage medium that stores one or more programs, the one or more programs including instructions that, when executed by one or more processors of an electronic device, cause the electronic device to perform any of the above methods.

[0119] Some examples of the present disclosure relate to an electronic device comprising one or more processors, memory, and components for performing any of the above methods.

[0120] Some examples of the present disclosure relate to an information processing apparatus for use in an electronic device, the information processing apparatus including components for performing any one of the above methods.

[0121] For the purpose of explanation, the foregoing description has been described with reference to specific examples. However, the above illustrative discussion is not intended to be exhaustive or to limit the present disclosure to the precise forms disclosed. Many modifications and variations are possible based on the above teachings. The examples are selected and described in order to best illustrate the principles of the present disclosure and its practical application, so as to enable others skilled in the art to best utilize the present disclosure and the various described examples with various modifications suitable for the specific purposes contemplated.

Claims

1. A method comprising: At a computing system in communication with one or more input devices and one or more displays: receiving, via the one or more input devices, a request to display first virtual content; as well as In response to receiving the request, displaying the first virtual content via the one or more displays includes: displaying, via the one or more displays, the first virtual content having the first content locking behavior in accordance with metadata associated with the first virtual content indicating a first content locking behavior; as well as The first virtual content is displayed, via the one or more displays, with a second content locking behavior in accordance with the metadata associated with the first virtual content indicating a second content locking behavior different from the first content locking behavior.

2. The method according to claim 1, wherein: the first content lock behavior being one of head lock, head lock with elasticity, body lock, display lock, horizontal lock, world lock, or tilt lock; and The second content locking behavior is one of head lock, elastic head lock, body lock, display lock, horizontal lock, world lock or tilt lock that is different from the first content locking behavior, or another content locking behavior that is different from the first content locking behavior.

3. The method according to claim 1, wherein: The metadata associated with the first virtual content indicates: a first context, wherein the first context is used to display the first virtual content having the first content locking behavior; as well as a second context different from the first context, the second context being used to display the first virtual content having the second content locking behavior; displaying the first virtual content with the first content locking behavior is further based on determining that the computing system is operating in the first context; and Displaying the first virtual content with the second content locking behavior is further based on determining that the computing system is operating in the second context.

4. The method according to claim 1, wherein: The metadata associated with the first virtual content indicates: at least the first content locking behavior and the second content locking behavior; a first priority level for displaying the first virtual content with the first content locking behavior; as well as A second priority level different from the first priority level is used to display the first virtual content with the second content locking behavior.

5. The method according to claim 1, comprising: When the first virtual content having the first content locking behavior is displayed according to the metadata indicating the first content locking behavior or the first virtual content having the second content locking behavior is displayed according to the metadata indicating the second content locking behavior: The test meets the coverage criteria; as well as In response to detecting that the overlay criteria are satisfied, displaying the first virtual content with a third content lock behavior via the one or more displays when satisfaction of the overlay criteria is detected, the third content lock behavior being different from the content lock behavior of the first virtual content.

6. The method according to claim 5, wherein: in response to receiving the request to display the first virtual content having the first content locking behavior or the second content locking behavior according to the metadata, a user of the computing system is associated with a first head orientation or a first body orientation; and The coverage criterion is met when a user input comprising a head rotation or a body rotation relative to the first head orientation or the first body orientation, respectively, is detected.

7. The method according to claim 5, wherein: In response to receiving the request, determining that the metadata indicates the first content lock behavior and the first virtual content has the first content lock behavior, the third content lock behavior is the second content lock behavior; and Based on determining, in response to receiving the request, that the metadata indicates the second content lock behavior and the first virtual content has the second content lock behavior, the third content lock behavior is the first content lock behavior.

8. The method of claim 5, wherein the third content lock behavior is different from the first content lock behavior and the second content lock behavior.

9. The method according to claim 8, wherein: displaying the first virtual content with the third content lock behavior in response to detecting that the override criteria are satisfied further based on determining that the metadata indicates that the first virtual content is to have the third content lock behavior in response to detecting that the override criteria are satisfied; or Displaying the first virtual content with the third content lock behavior in response to detecting that the override criteria is satisfied is independent of whether determining that the metadata indicates that the first virtual content is to have the third content lock behavior in response to detecting that the override criteria is satisfied.

10. The method of claim 1 , wherein the first content locking behavior is body locking, wherein in response to receiving the request, the first virtual content has the first content locking behavior and is displayed at a first location corresponding to a first corresponding location in a physical environment, and wherein the method comprises: detecting, via the one or more input devices, an event corresponding to a change in viewpoint of the computing system; as well as In response to detecting the event: continuing to display, via the one or more displays, the first virtual content with the first content locking behavior at the first location corresponding to the first corresponding location in the physical environment, based on a determination that the viewpoint change of the computing system corresponds to a change in viewpoint from a first viewpoint to a second viewpoint that is within a set of viewpoints for viewing the first virtual content at the first location corresponding to the first corresponding location in the physical environment; as well as Based on determining that the viewpoint change corresponds to a change of the viewpoint from the first viewpoint to a third viewpoint different from the second viewpoint, the third viewpoint being outside the set of viewpoints for viewing the first virtual content at the first location corresponding to the first corresponding location in the physical environment: ceasing to display the first virtual content having the first content-locking behavior at the first location corresponding to the first corresponding location in the physical environment; as well as The first virtual content having the first content lock behavior is displayed via the one or more displays at a second location corresponding to a second corresponding location in a physical environment, wherein the second corresponding location in the physical environment is different from the first corresponding location in the physical environment.

11. The method according to claim 10, comprising: According to determining that the viewpoint change is from the first viewpoint to the third viewpoint: fading out the first virtual content having the first content-locking behavior at the first location corresponding to the first corresponding location in the physical environment; as well as The first virtual content having the first content lock behavior is faded in at the second location corresponding to the second corresponding location in the physical environment.

12. The method according to claim 10, comprising: According to determining that the viewpoint change is from the first viewpoint to the third viewpoint: The first virtual content having the first content lock behavior is visually moved from the first position corresponding to the first corresponding position in the physical environment to the second position corresponding to the second corresponding position in the physical environment. The method of claim 1 , wherein the first virtual content comprises a game user interface. The method of claim 1 , wherein the first virtual content comprises a movie. The method of claim 1 , wherein the first virtual content comprises a web browser.

16. The method of claim 1, wherein the one or more displays comprises a head-mounted display.

17. An electronic device comprising: one or more processors; Memory; as well as One or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising instructions for executing the method according to any one of claims 1 to 16.

18. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions that, when executed by one or more processors of an electronic device, cause the electronic device to perform the method according to any one of claims 1 to 16.

Images