Head-mounted device with guiding features

Abstract

A head-mountable device may facilitate comfort, guidance, and alertness of a user by providing visual and other outputs with one or more user interface devices. Such outputs may encourage consciousness, alertness, and awareness of the user's movement, characteristics of the environment, and / or the user's condition. These actions may be performed by an output of the head-mountable device, such as a display, a speaker, a haptic feedback device, and / or another output device that interacts with the user.

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims the benefit of U.S. Provisional Patent Application Serial No. 63 / 351,760, filed on June 13, 2022, entitled “HEAD-MOUNTABLE DEVICE WITH GUIDANCE FEATURES,” which is incorporated herein by reference in its entirety and constitutes a part of this U.S. utility model patent application for all purposes. Technical Field

[0003] The present specification relates generally to head mountable devices, and more particularly to head mountable devices that guide and direct a user during an interaction. Background Art

[0004] A user may wear a head-mounted device to display visual information within the user's field of view. The head-mounted device may be used as a virtual reality (VR) system, an augmented reality (AR) system, and / or a mixed reality (MR) system. The user may observe output provided by the head-mounted device, such as visual information provided on a display. The display may optionally allow the user to observe the environment outside the head-mounted device. Other outputs provided by the head-mounted device may include speaker output and / or tactile feedback. The user may further interact with the head-mounted device by providing input for processing by one or more components of the head-mounted device. For example, while the device is mounted to the user's head, the user may provide tactile input, voice commands, and other inputs. BRIEF DESCRIPTION OF THE DRAWINGS

[0005] Certain features of the subject technology are set forth in the appended claims. However, for purposes of explanation, several embodiments of the subject technology are set forth in the following figures.

[0006] Figure 1 Illustrated is a top view of a head-mountable device according to some embodiments of the present disclosure.

[0007] Figure 2 Illustrated is a top view of a head-mountable device worn by a user according to some embodiments of the present disclosure.

[0008] Figure 3 Illustrated are views of a head-mountable device worn by a user according to some embodiments of the present disclosure.

[0009] Figure 4 A flowchart illustrating an example process for operating a head-mountable device to detect and respond to features of an environment and / or movements of a user according to some embodiments of the present disclosure is illustrated.

[0010] Figure 5 A flowchart illustrating an example process for operating a head-mountable device based on a user's profile according to some embodiments of the present disclosure.

[0011] Figure 6 Illustrated are views of a head-mountable device providing a user interface according to some embodiments of the present disclosure.

[0012] Figure 7 Illustrated according to some embodiments of the present disclosure Figure 6 A view of a head mountable device providing a user interface with a modified output.

[0013] Figure 8 Illustrated according to some embodiments of the present disclosure Figure 6 A view of a head mountable device providing a user interface with modified visual characteristics.

[0014] Fig. 9 Illustrated according to some embodiments of the present disclosure Figure 6 A view of a head mountable device providing a user interface with modified visual characteristics.

[0015] Fig.10 Illustrated according to some embodiments of the present disclosure Figure 6 A view of a head mountable device providing a user interface with an indicator.

[0016] Fig.11 Illustrated according to some embodiments of the present disclosure Figure 6 A view of a head-mountable device that provides a user interface and other output.

[0017] Fig.12

[0046] Head-mountable devices that may be used to implement aspects of the subject technology according to some embodiments of the present disclosure are conceptually illustrated. DETAILED DESCRIPTION

[0018] The specific embodiments shown below are intended to be descriptions of various configurations of the subject technology and are not intended to represent the only configuration that the subject technology can be put into practice. The accompanying drawings are incorporated herein and constitute a part of the detailed description. The detailed description includes specific details intended to provide a thorough understanding of the subject technology. However, it will be clear and obvious to those skilled in the art that the subject technology is not limited to the specific details shown herein and can be put into practice without these specific details. In some cases, well-known structures and components are shown in block diagram form to avoid blurring the concept of the subject technology.

[0019] Head-mounted devices, such as head-mounted displays, headphones, goggles, smart glasses, heads-up displays, etc., can perform a range of functions managed by components (e.g., sensors, circuits, and other hardware) included in the wearable device. The head-mounted device can provide an immersive or otherwise natural user experience so that the user can easily focus on enjoying the experience without being distracted by the mechanism of the head-mounted device.

[0020] In some uses, it may be desirable to increase the user's comfort and convenience when wearing and / or operating a head-mountable device. For example, the head-mountable device may facilitate and / or enhance the user's awareness and / or response to various conditions that may be detected by the head-mountable device. Such conditions may include features and / or events in the user's environment, movement of the user and / or head-mountable device, and / or detected activities of the user. By performing such detections and providing appropriate outputs, the head-mountable device may facilitate and / or encourage the user to perform actions that enhance the user's comfort and / or awareness.

[0021] The head-mountable device can promote the comfort, guidance and alertness of the user by providing visual and other outputs using one or more user interface devices. Such outputs can encourage awareness, alertness and understanding of the user's movements, characteristics of the environment and / or the user's situation. These actions can be performed by the output of the head-mountable device, such as a display, a speaker, a tactile feedback device and / or another output device that interacts with the user.

[0022] Reference below Figures 1 to 11 However, those skilled in the art will readily appreciate that the detailed description given herein with respect to these figures is for illustration purposes only and should not be construed as limiting.

[0023] According to some embodiments, for example Figure 1 As shown, the head-mounted device 100 includes a frame 110 that is worn on the user's head. The frame 110 can be positioned in front of the user's eyes to provide information within the user's field of view. The frame 110 can provide a nose pad or another feature to be placed on the user's nose. The frame 110 can be supported on the user's head by a head connector 120. The head connector 120 can be wrapped or extended along opposite sides of the user's head. The head connector 120 may include headphones for wrapping around or otherwise engaging or resting on the user's ears. It should be understood that other configurations can be applied to fix the head-mounted device 100 to the user's head. For example, in addition to or instead of the illustrated components of the head-mounted device 100, one or more straps, straps, bands, covers, caps, or other components can be used. By further example, the head connector 120 may include multiple components for engaging the user's head.

[0024] The frame 110 may provide structure around its peripheral region to support any internal components of the frame 110 in their assembled position. For example, the frame 110 may enclose and support various internal components (including, for example, integrated circuit chips, processors, memory devices, and other circuits) to provide computing and functional operations for the head mountable device 100, as further discussed herein. Any number of components may be included within and / or on the frame 110 and / or the head adapter 120.

[0025] The frame 110 may include and / or support one or more cameras 130 and / or other sensors. The camera 130 may be positioned on or near an outer side 112 of the frame 110 to capture images of a view outside the head mountable device 100. As used herein, the outer side 112 of a portion of a head mountable device is the side facing away from the user and / or toward the external environment. The captured images may be used for display to the user or stored for any other purpose.

[0026] It should be understood that the camera 130 can be one of a variety of input devices provided by the head-mountable device. Such input devices can include, for example, depth sensors, optical sensors, microphones, user input devices, user sensors, and the like, as further described herein.

[0027] The head mountable device may be provided with one or more displays 140 that provide visual output for viewing by a user wearing the head mountable device. Figure 1 As shown, one or more optical assemblies including a display 140 may be positioned on the inner side 114 of the frame 110. As used herein, the inner side of a portion of a head mountable device is the side that faces the user and / or faces away from the external environment. For example, a pair of optical assemblies may be provided, each of which may be movably positioned within the field of view of each of the user's two eyes. Each optical assembly may be adjusted to align with the user's corresponding eye. The movement of each of the optical assemblies may match the movement of the corresponding camera 130. Thus, the optical assembly is able to accurately reproduce, simulate, or augment a view based on the view captured by the camera 130, with the view having an alignment corresponding to the view that the user would naturally have without the head mountable device 100.

[0028] Display 140 may transmit light from the physical environment (e.g., as captured by a camera) for viewing by a user. Such a display may have optical properties, such as lenses for vision correction based on incident light from the physical environment. Additionally or alternatively, display 140 may provide information as a display within the user's field of view. Such information may be provided in lieu of a view of the physical environment or in addition to (e.g., overlaying) the physical environment.

[0029] It should be understood that the display 140 can be one of a variety of output devices provided by the head-mountable device. Such output devices can include, for example, speakers, tactile feedback devices, and the like.

[0030] The physical environment refers to the physical world that people can sense and / or interact with without the help of electronic systems. A physical environment, such as a physical park, includes physical objects, such as physical trees, physical buildings, and physical people. People can directly sense and / or interact with the physical environment, such as through vision, touch, hearing, taste, and smell.

[0031] In contrast, a computer generated reality (CGR) environment refers to a fully or partially simulated environment that a person perceives and / or interacts with via an electronic system. In CGR, a subset of a person's physical movements, or representations thereof, is tracked, and in response, one or more characteristics of one or more virtual objects simulated in the CGR environment are adjusted in a manner that complies with at least one law of physics. For example, a CGR system may detect a person's head turns, and in response, adjust the graphical content and sound field presented to the person in a manner similar to the way such views and sounds change in a physical environment. In some cases (e.g., for accessibility reasons), adjustments to the characteristics of virtual objects in a CGR environment may be made in response to representations of physical movements (e.g., voice commands).

[0032] There are many different types of electronic systems that enable people to sense and / or interact with various CGR environments. Examples include head-mounted systems, projection-based systems, heads-up displays (HUDs), vehicle windshields with integrated display capabilities, windows with integrated display capabilities, displays formed as lenses designed to be placed on people's eyes (e.g., similar to contact lenses), headphones / earpieces, speaker arrays, input systems (e.g., wearable or handheld processors with or without tactile feedback), smart phones, tablet computers, and desktop / laptop computers. A head-mounted system may have an integrated opaque display and one or more speakers. Alternatively, a head-mounted system may be configured to accept an external opaque display (e.g., a smart phone). A head-mounted system may incorporate one or more imaging sensors for capturing images or videos of a physical environment, and / or one or more microphones for capturing audio of a physical environment. A head-mounted system may have a transparent or translucent display instead of an opaque display. A transparent or translucent display may have a medium through which light representing an image is directed to a person's eyes. The display can utilize digital light projection, OLED, LED, uLED, liquid crystal on silicon, laser scanning light source, or any combination of these technologies. The medium can be an optical waveguide, a hologram medium, an optical combiner, an optical reflector, or any combination thereof. In one embodiment, a transparent or translucent display can be configured to selectively become opaque. A projection-based system can employ retinal projection technology that projects a graphic image onto a person's retina. The projection system can also be configured to project a virtual object into a physical environment, such as a hologram or onto a physical surface.

[0033] Reference again Figure 1 The head-mounted device may include a user sensor 170 for detecting a condition of the user, such as a condition of the user's eyes. Such conditions may include eyelid 24 state (e.g., open, closed, partially open or closed, etc.), blinking, eye gaze direction, moisture condition, and the like. The user sensor 170 may also be configured to detect other conditions of the user, as further described herein. Such detected conditions may be applied as a basis for performing certain operations, as further described herein.

[0034] Reference now Figure 2 and Figure 3 , the user can operate the head-mountable device, and the head-mountable device can perform detections about the environment, the head-mountable device itself, and / or the user. Such detections can provide a basis for performing certain operations by the head-mountable device, such as providing output to the user.

[0035] Figure 2 1 illustrates a top view of a head-mountable device being used by a user according to some embodiments of the present disclosure. Figure 2 As shown, the head-mounted device 100 may include one or more sensors, such as a camera 130, an optical sensor, and / or other image sensors for detecting features of the environment (such as physical features 90 of the environment within the field of view of the camera 130 and / or another sensor). Additionally or alternatively, the camera 130 may capture and / or process images based on one or more of a hue space, brightness, a color space, luminosity, and the like. In some embodiments, the sensors may include depth sensors, thermal (e.g., infrared) sensors, and the like. For example, the depth sensor may be configured to measure the distance (e.g., range) to a feature (e.g., an area of ​​a user's face, a body part of a user, and / or a feature or object of the environment) via stereo triangulation, structured light, time of flight, interferometry, and the like.

[0036] By way of further example, the sensor may include a microphone for detecting sound 86 from the environment and / or from the user. It should be understood that a physical feature 90 in the user's environment may not be within the field of view of the user and / or the camera 130 of the head mountable device 100. However, regardless of whether the physical feature 90 is within the field of view of the user and / or the camera 130 of the head mountable device 100, the sound may provide an indication that the physical feature 90 is nearby.

[0037] The head mountable device 100 may include one or more other sensors. Such sensors may be configured to sense substantially any type of characteristic, such as, but not limited to, image, pressure, light, touch, force, temperature, position, motion, etc. For example, the sensor may be a photodetector, a temperature sensor, a light or optical sensor, an atmospheric pressure sensor, a humidity sensor, a magnet, a gyroscope, an accelerometer, a chemical sensor, an ozone sensor, a particle count sensor, and the like.

[0038] The head-mountable device 100 may include an inertial measurement unit (“IMU”) as a sensor that provides information about characteristics of the head-mountable device 100, such as its inertial angle. Such information may be relevant to the user wearing the head-mountable device 100. For example, the IMU may include a six-degree-of-freedom IMU that can calculate the position, velocity, and / or acceleration of the head-mountable device based on six degrees of freedom (x, y, z, θx, θy, and θz). The IMU may include one or more of an accelerometer, a gyroscope, and / or a magnetometer. Additionally or alternatively, the head-mountable device 100 may detect motion characteristics of the head-mountable device 100 with one or more other motion sensors (such as accelerometers, gyroscopes, global positioning sensors, tilt sensors, etc.) for detecting movement and acceleration of the head-mountable device 100. Such detection may provide a basis for performing certain operations by the head-mountable device, such as providing output to the user. For example, an output may be provided to guide future actions of the user in response to the detected movement and / or to verify whether the user is alert and / or aware of the detected movement, such as by detecting a condition of the user that indicates whether the user has shown awareness of the movement (e.g., through a corresponding responsive action).

[0039] like Figure 3 As shown, the head mountable device 100 can be worn on the user's head 10. The user's head 10 can form an angle 40 relative to the user's torso 20 or another body part. For example, the user can pivot the head 10 at the neck 30 to adjust the angle 40. It should be understood that the body parts used for comparison can be any two or more body parts.

[0040] The head mountable device 100 can operate independently and / or in conjunction with one or more external devices 200. For example, the external device 200 can be worn on the torso 20 or other body part of the user. By further example, the external device 200 can be a device that is not worn by the user but is otherwise positioned near the user and / or the head mountable device 100. The head mountable device 100 and / or one or more external devices 200 can monitor their own conditions and / or the conditions of each other and / or the user.

[0041] The head mountable device 100 may provide the user with a view of physical features 90 and / or virtual features 92 as visual output. It will be appreciated that the view may correspond to an image captured by a camera of the head mountable device 100. Additionally or alternatively, the view may include virtual features that may or may not correspond to physical features of the physical environment.

[0042] The head mountable device 100 can detect proximity to a physical feature 90 and / or a virtual feature 92. For example, the head mountable device 100 (e.g., independently and / or in conjunction with the external device 200) can detect a distance 94 from the physical feature 90 to a limb 50 or other body part of a user. Such detection can include detection of the position of the limb 50 or other body part as well as detection of the position of the physical feature 90. Such detection can be performed using a camera, a depth sensor, or other sensor of the head mountable device 100 and / or the external device 200 that detects both the physical feature 90 and the limb 50 or other body part of the user.

[0043] By further example, the head mountable device 100 (e.g., independently and / or in conjunction with the external device 200) can detect the distance 96 from the virtual feature 92 to the user's limb 50 or other body part. Such detection can include detection of the position of the limb 50 or other body part as well as detection of the position of the physical feature 90. Such detection can be performed using a camera, depth sensor, or other sensor of the head mountable device 100 and / or the external device 200 that detects the user's limb 50 or other body part. The detection of the virtual feature 92 can be known based on its generation by the head mountable device 100.

[0044] Detection of physical features 90 and / or virtual features 92 having a position and / or orientation relative to a user (e.g., a limb 50 or other body part) and / or a head-mountable device 100 can provide a basis for providing output to the user. For example, an output can be provided to guide the user's movement relative to the physical features 90 and / or virtual features 92 and / or verify that the user is alert and / or aware of the physical features 90, such as by detecting a user condition indicating whether the user has shown awareness of the physical features 90 (e.g., through corresponding response actions) and / or attempted to interact with the virtual features 92. Other detected conditions such as the user's gaze direction and / or speed can provide a further basis for determining whether to provide an output. Any given detection can be compared to one or more criteria (e.g., thresholds, etc.) to determine what corresponding operation should be performed. Although various detections are described herein, it should be understood that any one or more combinations of detections can be applied. For example, a preliminary detection can be considered, and on this basis, a secondary or other additional detection can be considered to determine whether an operation should be performed. Therefore, any number of detections, including any detection described herein, can be applied continuously or in parallel to determine whether an operation is to be performed. Any additional tests may be applied to override the determination to perform an action based on the preliminary test.

[0045] Figure 4A flowchart illustrating an example process for operating a head-mountable device to detect and respond to features of an environment and / or movements of a user according to some embodiments of the present disclosure is provided. Figure 2 and Figure 3 The process 400 is described with reference to the head mountable device 100. However, the process 400 is not limited to Figure 2 and Figure 3 The head-mounted device 100 of the present invention is described in detail, and one or more blocks (or operations) of the process 400 can be performed by one or more other components or chips of the head-mounted device 100 and / or another device (e.g., the external device 200). The head-mounted device 100 is also presented as an exemplary device, and the operations described herein can be performed by any suitable device. Further for the purpose of explanation, the blocks of the process 400 are described herein as occurring sequentially or linearly. However, multiple blocks of the process 400 may occur in parallel. In addition, the blocks of the process 400 do not have to be performed in the order shown, and / or one or more blocks of the process 400 do not have to be performed and / or may be replaced by other operations.

[0046] In operation 402, the head mountable device may detect a virtual feature and / or a position and / or movement of a user relative to the virtual feature. Such detection may be performed by one or more sensors of the head mountable device and / or an external device.

[0047] In operation 404, the detection performed by one or more sensors can be compared to the criteria to determine whether further actions are to be performed. For example, the detected condition of the virtual feature, user and / or head-mountable device can be compared to a threshold, range or other value to determine whether a response to the detection should be provided. By further example, the distance between the user (e.g., a limb or other body part) and the virtual feature can be detected and compared to determine whether it is within the range of interest. If the detected condition does not meet the criteria, further response can be omitted and / or additional detection can be performed by returning to operation 402.

[0048] In operation 406, the head mountable device may detect physical features in the user's environment and / or the user's position and / or movement relative to the physical features and / or environment. Such detection may be performed by one or more sensors of the head mountable device and / or an external device.

[0049] In some embodiments, additional detection and criteria may be applied. In operation 408, detections performed by one or more sensors may be compared to criteria to determine whether further operations are to be performed. For example, a detected condition of a physical feature of an environment, a user, and / or a head-mounted device may be compared to a threshold, range, or other value to determine whether a response to the detection should be provided. By way of further example, the distance between a user (e.g., a limb or other body part) and a physical feature may be detected and compared to determine whether it is within a range of interest. If the detected condition does not meet the criteria, further responses may be omitted and / or additional detections may be performed by returning to operation 402 and / or operation 406.

[0050] It should be understood that in some embodiments, additional detections and criteria may be applied. For example, instead of or in addition to the detection of operations 402 and / or 406 and the criteria of operations 404 and / or 408, the user's speed may be detected and applied to determine whether to perform further operations (e.g., provide output). In the event that the user is moving slowly (e.g., below a threshold speed), output that would otherwise be provided (e.g., if the detected speed is above a threshold speed or another threshold) may be omitted.

[0051] By way of further example, as an alternative or in addition to the detection of operations 402 and / or 406 and the criteria of operations 404 and / or 408, the user's position and / or orientation may be applied to determine whether to perform further operations (e.g., provide output). In the event that the user is in a particular position and / or orientation (e.g., below a threshold angle relative to the environment and / or another body part), output that would otherwise be provided may be omitted (e.g., if the angle is above a threshold angle or another threshold).

[0052] By way of further example, as an alternative or in addition to the detection of operations 402 and / or 406 and the criteria of operations 404 and / or 408, the user's eye gaze direction can be detected and used to determine whether to perform further operations (e.g., provide output). Where the output includes a view of virtual features and the user is gazing at a particular direction and / or a particular feature (e.g., a virtual feature), it can be inferred that the user is paying attention to the area, and an intention to interact with the virtual features in the area can be inferred. Thus, an output to guide the user can be provided, such as where other detections and criteria so indicate. Where the output includes a view of physical features and the user is gazing at a particular direction and / or a particular feature (e.g., a physical feature), it can be inferred that the user is paying attention to the area, and awareness of the physical features in the area can be inferred. Thus, an output to guide the user can be provided, such as at least until another detected condition changes.

[0053] By way of further example, instead of or in addition to the detection of operations 402 and / or 406 and the criteria of operations 404 and / or 408, detected user activity (e.g., gestures, sounds, or other user input) may be detected and applied to determine whether to perform further actions (e.g., provide output). Output may be provided in the event that the user makes a sound (e.g., voice or other sound output) or gesture that is detected to be above a threshold or having another target characteristic.

[0054] It should be understood that in some embodiments, additional criteria and / or other criteria are not required. For example, the detection of operation 402 and the criteria of operation 404 may be sufficient to determine that an output is to be provided.

[0055] In some embodiments, a user profile may be applied. In operation 410, a user profile may be applied to determine whether a given operation is to be performed. For example, a user profile associated with a given user may be applied to determine whether an operation is appropriate given the user's level of experience, knowledge, preferences, and / or historical activity.

[0056] In operation 412, the detection in the previous operation and / or the suggested operation (e.g., output) in response can be compared with the standard to determine whether to perform the suggested operation. The user profile can set the standard for providing output only under certain conditions. For example, a given user can have a higher level of experience, knowledge, preference and / or historical activity, so that the output guiding other users will be omitted and / or covered for the given user. By further example, a given user can have a lower level of experience, knowledge, preference and / or historical activity, so that the output is determined to be suitable for guiding the given user in response to the detected situation. If the detected situation does not meet the standard, further response can be omitted and / or additional detection can be performed by returning to operation 402 or 406.

[0057] Additionally or alternatively, the profile can be applied by setting and / or adjusting criteria for other operations (e.g., operations 404 and / or 408). For example, the profile can be applied before applying one or more criteria. Such application can be performed when the user begins operating the head-mounted device. Optionally, before performing the detection, the user can be identified and the corresponding user profile can be loaded to set the criteria. Therefore, when performing the detection, user-specific criteria can be easily applied.

[0058] It should be understood that in some embodiments, it is not required to apply a user profile.For example, the detection of operations 402 and 406 and the criteria of operations 404 and 408 may be sufficient to determine that an output is to be provided.

[0059] In operation 414, the head mountable device provides one or more outputs to the user, as further described herein. Such outputs may be provided to guide a user's response to a condition detected by the head mountable device and / or to verify that the user is alert and / or aware of the detected condition. Further operation of the head mountable device may include detecting the condition in operation 402 or 406 to determine whether the previously detected condition still exists.

[0060] Figure 5 A flowchart illustrating an example process for operating a head-mountable device to manage a user's profile according to some embodiments of the present disclosure. For the purpose of explanation, this article mainly refers to Figure 2 and Figure 3 The process 500 is described with reference to the head mountable device 100. However, the process 500 is not limited to Figure 2 and Figure 3 The head-mounted device 100 of the present invention is described in detail, and one or more blocks (or operations) of the process 500 can be performed by one or more other components or chips of the head-mounted device 100 and / or another device (e.g., the external device 200). The head-mounted device 100 is also presented as an exemplary device, and the operations described herein can be performed by any suitable device. Further for the purpose of explanation, the blocks of the process 500 are described herein as occurring sequentially or linearly. However, multiple blocks of the process 500 may occur in parallel. In addition, the blocks of the process 500 do not have to be performed in the order shown, and / or one or more blocks of the process 500 do not have to be performed and / or may be replaced by other operations.

[0061] In operation 502, the head mountable device may detect input or other activity of a user. Such detection may be performed by one or more user input devices, sensors, or a processor of the head mountable device. In operation 504, the detection by one or more user sensors may be compared to criteria to determine whether to update a user profile. If the detected input or other activity meets the criteria, the user profile may be updated in operation 506. If the detected input or other activity does not meet the criteria, the user profile may remain unchanged and / or the head mountable device may continue to monitor for additional detections of input or other activity.

[0062] In some embodiments, the user can provide input commands by operating an input device of the head-mountable device. The operation of the input device can correspond to a selection made using the user interface of the head-mountable device. For example, the head-mountable device can provide a menu of options and / or other user-selectable settings corresponding to how and under what conditions the head-mountable device provides output. Such selections may include allowing all outputs, allowing some outputs, blocking some outputs, and blocking all outputs in response to detected conditions. By further example, the user can select a standard that applies to the detected condition and determine whether to provide an output based on the standard.

[0063] In some embodiments, the head-mounted device can detect user activity to determine a user profile. For example, when a user has operated the head-mounted device for a duration exceeding a threshold, the user profile can be updated to indicate that the user has at least a certain level of experience and is familiar with the operation of the head-mounted device. Tracking of such operations can optionally be limited to the time that the head-mounted device is operated to output a computer-generated reality (such as including at least one virtual feature). By further example, the head-mounted device can provide a training program (e.g., a tutorial) or other operation that helps the user become familiar with the output of the computer-generated reality and one or more virtual features. When the training program is completed, the user profile can be updated to indicate that the corresponding user has completed the training program. Thereafter, certain outputs can be omitted and / or the criteria for analyzing the detected conditions can be adjusted, as discussed herein.

[0064] It should be understood that Figure 5 The process 500 can be found at Figure 4 The operations and / or results of any process may initiate and / or change the operations of another process.

[0065] Reference now Figures 6 to 10 , the head-mountable device can be operated to provide one or more of a plurality of outputs to the user based on and / or in response to the detected condition. It should be understood that although the head-mountable devices are individually depicted as having different components, more than one output may be provided by any given head-mountable device. Therefore, the features of the different head-mountable devices depicted and described herein may be combined together such that more than one mechanism may be provided for any given head-mountable device.

[0066] Figure 6Views of a head-mountable device providing a user interface according to some embodiments of the present disclosure are illustrated. However, for this or any user interface depicted or described herein, not all depicted graphical elements may be used in all implementations, and one or more implementations may include additional or different graphical elements than those shown in the figures. Changes in the arrangement and types of these graphical elements may be made without departing from the spirit or scope of the claims listed herein. Additional components, different components, or fewer components may be provided.

[0067] The head mountable device 100 may also include one or more output devices, such as a display 140, for outputting information to the user. Such output may be based on detection by sensors (e.g., camera 130) and / or other content generated by the head mountable device. For example, the output of the display 140 may provide a user interface 142 that outputs one or more elements of a computer-generated reality, including, for example, virtual features 92. Such elements may be provided in addition to or without a view of physical features of the physical environment, such as within a field of view of a camera. The user interface 142 may also include any other content generated as output by the head mountable device 100, such as notifications, messages, text, images, display features, websites, application features, etc. It should be understood that such content is displayed visually and / or otherwise output as sound, etc.

[0068] Reference now Figure 7 , the output of the user interface may change in response to detection performed by the head-mountable device. Figure 7 As shown, the output of the display 140 may include a view of one or more physical features 90 captured in the physical environment. The display 140 may provide a user interface 142 that outputs the view captured by the camera, for example, including the physical features 90 within the field of view of the camera. The output of the user interface 142 provided by the display may be omitted, excluded, or provided without a view of the virtual features 92. Additionally or alternatively, the user interface 142 may also include any content generated by the head mountable device 100 as output, such as a notification, message, text, image, display feature, website, application feature, etc.

[0069] In some embodiments, an output (e.g., including physical features 90 and optionally excluding virtual features 92) may be provided to prompt an action from the user. Such action may include a change in position, orientation, distance, and / or movement (e.g., relative to physical features 90 and / or virtual features 92), etc. The output may be provided until the desired action is detected.

[0070] Reference now Figure 8, the head-mountable device may be operated to provide another type of visual output that encourages behavior from the user. Figure 8 As shown, virtual features 92 or other visual features can be modified as output to prompt behavior from the user. For example, virtual features 92 can be changed to look blurry, out of focus, or a certain distance from the user. Such changes can include reducing and / or increasing the noise and / or details of virtual features 92. Such changes can be made with respect to any one or more features displayed by the user interface 142 of display 140. Various aspects of virtual features 92 can encourage users to change the way they interact with virtual features 92. For example, virtual features 92 can prompt users to move to resolve observations of virtual features 92. In some embodiments, such visual modifications need not be applied relative to the output of physical features 90.

[0071] In some embodiments, the output may include additional features included with the virtual feature 92. For example, the visual feature may include a visual Figure 1 The visual features may include highlights, glows, shadows, reflections, outlines, borders, text, icons, symbols, emphasis, copy, halos, and / or animations provided with the virtual feature 92. Optionally, such visual features may be provided without changing the appearance of the virtual feature 92. For example, the visual features may be provided around the periphery of the virtual feature 92. Additionally or alternatively, the visual features may have a partial or full overlap (e.g., overlap) relative to the virtual feature 92.

[0072] In some embodiments, the visual feature may change the appearance of the virtual feature 92 itself. For example, the visual feature may be provided as a deformation of the virtual feature 92 from an initial shape. For example, when the user approaches and / or contacts the virtual feature 92, the virtual feature 92 may deform on a side closer to the user.

[0073] In some embodiments, the visual feature can change the visibility of the virtual feature 92. For example, the virtual feature 92 can be depicted as partially or completely transparent (e.g., with reduced opacity). For example, such a visual feature can be provided when the user approaches the virtual feature 92 and / or when the virtual feature 92 is close to the user. Additionally or alternatively, the visual feature can include other changes to the appearance of the virtual feature 92. For example, the visual feature can include changes to the brightness, darkness, contrast, color, saturation, sharpness, blur, resolution, and / or pixelation of the virtual feature 92.

[0074] In some embodiments, the visual feature may change a property of virtual feature 92. For example, virtual feature 92 may have a visual feature that changes the size of virtual feature 92. Additionally or alternatively, the visual feature may change other properties of virtual feature 92, such as shape, aspect ratio, position, orientation, etc.

[0075] Reference now Fig. 9 , the output of the user interface can change in response to detection performed by the head-mountable device. For example, Fig. 9 As shown, one or more visual features 144 may be provided within the user interface 142 and output by the display 140. Such visual features 144 may include any changes in the visual output of the display 140 that are perceptible to the user.

[0076] For example, visual features 144 may have different appearances, brightness, contrast, color, hue, and similar attributes. By further example, visual features 144 may include animations that progress over time to change their appearance, brightness, contrast, color, hue, and similar attributes. One or more visual features may have a brightness greater than the brightness of user interface 142 prior to outputting visual features 144. Various aspects of visual features 144 may encourage the user to respond with a desired behavior.

[0077] Reference now Fig.10 , the head-mounted device can provide indicators to the user to instruct the user to perform certain actions. For example, Fig.10 As shown, an indicator 146 can be provided within the user interface 142 of the display 140. The indicator 146 may include instructions for the user to perform, such as movement, etc. Such actions can be understood as allowing the user to address conditions detected by the head mountable device 100, such as conditions of the environment, the user, and / or the head mountable device. The indicator 146 can be consciously understood by the user as providing an opportunity for autonomous action. It should be understood that such an indicator can be provided as a visual feature and / or through other mechanisms (such as sound, tactile feedback, and similar mechanisms).

[0078] Reference now Fig.11 , other components of the head mountable device 100 may provide one or more other outputs that encourage behavior from the user. For example, the head mountable device 100 may include a speaker 194 for providing audio output 98 (e.g., sounds) to the user. One or more sounds may have a volume level (e.g., in decibels) greater than the volume level of the audio output provided prior to the output of these sounds. The sounds may cause the user to react consciously or subconsciously to the detected condition. By further example, the head mountable device 100 may include a tactile feedback device 184 for providing tactile feedback 88 to the user. The tactile feedback 88 may cause the user to react consciously or subconsciously to the detected condition.

[0079] Additionally or alternatively, it should be understood that various other outputs may be provided to the user. Such outputs may include smells, tactile sensations, and the like.

[0080] Reference now Fig.12 , components of the head-mounted device can be operably connected to provide the performance described herein. Fig.12 A simplified block diagram of an exemplary head mountable device 100 according to one embodiment of the present invention is shown. It should be understood that the components described herein may be provided on one, some, or all of the frame, head adapter, etc. It should be understood that additional components, different components, or fewer components than those illustrated may be utilized within the scope of the subject disclosure.

[0081] like Fig.12 As shown, the head-mounted device 100 may include a processor 150 (e.g., a control circuit) having one or more processing units that include or are configured to access a memory 182 having instructions stored thereon. The instructions or computer program may be configured to perform one or more of the operations or functions described with respect to the head-mounted device 100. The processor 150 may be implemented as any electronic device capable of processing, receiving, or sending data or instructions. For example, the processor 150 may include one or more of the following: a processor, a microprocessor, a central processing unit (CPU), an application-specific integrated circuit (ASIC), a digital signal processor (DSP), or a combination of such devices. As described herein, the term "processor" is intended to cover a single processor or processing unit, multiple processors, multiple processing units, or one or more other appropriately configured computing elements.

[0082] The memory 182 can store electronic data that can be used by the head mountable device 100. For example, the memory 182 can store electronic data or content, such as, for example, user profiles, audio and video files, documents and applications, device settings and user preferences, timing and control signals or data for various modules, data structures or databases, etc. The memory 182 can be configured as any type of memory. By way of example only, the memory 182 can be implemented as random access memory, read-only memory, flash memory, removable memory, or other types of storage elements or combinations of such devices.

[0083] The head-mountable device 100 may also include a display 140 for displaying visual information to a user. The display 140 may provide visual (e.g., image or video) output. The display 140 may be or include an opaque, transparent, and / or translucent display. The display 140 may have a transparent or translucent medium through which light representing an image is directed to the user's eyes. The display 140 may utilize digital light projection, OLED, LED, uLED, liquid crystal on silicon, laser scanning light sources, or any combination of these technologies. The medium may be an optical waveguide, a hologram medium, an optical combiner, an optical reflector, or any combination thereof. In one embodiment, a transparent or translucent display may be configured to selectively become opaque. A projection-based system may employ retinal projection technology that projects a graphic image onto a person's retina. The projection system may also be configured to project virtual features into a physical environment, such as a hologram or on a physical surface. The head-mountable device 100 may include an optical subassembly configured to help optically adjust and properly project image-based content displayed by the display 140 for close viewing. The optical subassembly may include one or more lenses, mirrors, or other optical devices.

[0084] The head mountable device 100 may include a battery 160 that may charge and / or power components of the head mountable device 100. The battery 160 may also charge and / or power components connected to the head mountable device 100.

[0085] The head mountable device 100 may include a microphone 188 as described herein. The microphone 188 may be operably connected to the processor 150 for detection of sound levels and communication of the detection for further processing, as further described herein.

[0086] The head mountable device 100 may include a speaker 194 as described herein. The speaker 194 may be operably connected to the processor 150 to control the speaker output, including the sound level, as further described herein.

[0087] The head mountable device 100 may include an input / output device 186, which may include any suitable components for receiving input from a user, including buttons, keys, body sensors, gesture detection devices, microphones, etc. It should be understood that the input / output device 186 may be, include, or be connected to another device, such as a keyboard, a mouse, a stylus, etc. The input / output device 186 may include one or more output devices, such as a display, a speaker, a tactile feedback device, etc. It should be understood that the input / output device 186 may include separate components that are input devices and output devices.

[0088] The eye tracking sensor 176 can track characteristics of the user wearing the head-mountable device 100, including the condition of the user's eyes (e.g., focal length, pupil size, etc.). For example, the eye sensor can optically capture the view of the eye (e.g., pupil) and determine the direction of the user's gaze. Such eye tracking can be used to determine the location and / or direction of interest relative to the display 140 and / or the elements presented thereon. User interface elements can then be provided on the display 140 based on this information, such as in an area along the direction of the user's gaze or in an area other than the current gaze direction, as further described herein. Detection by the eye tracking sensor 176 can determine user actions interpreted as user input. Such user input can be used alone or in combination with other user inputs to perform certain actions. For example, such sensors can perform facial feature detection, facial motion detection, facial recognition, user emotion detection, user emotion detection, voice detection, and similar detection.

[0089] The head mountable device 100 may include one or more other sensors. Such sensors may be configured to sense any type of characteristic, such as, but not limited to, image, pressure, light, touch, force, temperature, position, motion, etc. For example, the sensor may be a photodetector, a temperature sensor, a light or optical sensor, an atmospheric pressure sensor, a humidity sensor, a magnet, a gyroscope, an accelerometer, a chemical sensor, an ozone sensor, a particle count sensor, etc. By further example, the sensor may be a biosensor for tracking biometric characteristics such as health and activity metrics.

[0090] The head-mounted device 100 may include an inertial measurement unit 172 ("IMU") that provides information about characteristics of the head-mounted device, such as its inertial angles. For example, the IMU may include a six-degree-of-freedom IMU that can calculate the position, velocity, and / or acceleration of the head-mounted device based on six degrees of freedom (x, y, z, θx, θy, and θz). The IMU may include one or more of an accelerometer, a gyroscope, and / or a magnetometer. Additionally or alternatively, the head-mounted device may detect motion characteristics of the head-mounted device with one or more other motion sensors (such as accelerometers, gyroscopes, global positioning sensors, tilt sensors, etc.) for detecting motion and acceleration of the head-mounted device.

[0091] The head mountable device 100 may include an image sensor, a depth sensor 174, a thermal (e.g., infrared) sensor, and the like. By way of further example, the depth sensor 174 may be configured to measure a distance (e.g., range) to a feature (e.g., an area of ​​a user's face) via stereo triangulation, structured light, time of flight, interferometry, and the like. Additionally or alternatively, the facial sensor and / or the device may capture and / or process images based on one or more of hue space, brightness, color space, luminosity, and similar attributes.

[0092] The head mountable device 100 may include a communication element 192 for communicating with one or more servers or other devices using any suitable communication protocol. For example, the communication element 192 may support Wi-Fi (e.g., 802.11 protocol), Ethernet, Bluetooth, high frequency systems (e.g., 1400 MHz, 2.4 GHz, and 5.6 GHz communication systems), infrared, TCP / IP (e.g., any of the protocols used in each layer of the TCP / IP layer), HTTP, BitTorrent, FTP, RTP, RTSP, SSH, any other communication protocol, or any combination thereof. The communication element 192 may also include an antenna for sending and receiving electromagnetic signals.

[0093] The system 2 including the head mountable device 100 may also include an external device 200. The external device 200 may facilitate gesture detection and operate in conjunction with the head mountable device 100, as described herein.

[0094] The external device 200 may include a processor 250 (e.g., a control circuit) having one or more processing units, which include or are configured to access a memory having instructions stored thereon. The instructions or computer program may be configured to perform one or more of the operations or functions described relative to the external device 200. The processor 250 may be implemented as any electronic device capable of processing, receiving or sending data or instructions. For example, the processor 250 may include one or more of the following: a processor, a microprocessor, a central processing unit (CPU), an application specific integrated circuit (ASIC), a digital signal processor (DSP), or a combination of such devices. As described herein, the term "processor" is intended to cover a single processor or processing unit, multiple processors, multiple processing units, or one or more other appropriately configured computing elements.

[0095] The external device 200 may include one or more sensors 270 of a gesture detection system, as described herein. The gesture detection system of the external device 200 may include one or more sensors and / or communication elements. The sensor 270 may include a sensor for detecting a body part of a user, a head-mountable device 100, and / or another external device 200. For example, the gesture detection system may include an IMU, a depth sensor, etc.

[0096] The external device 200 may include a communication element 292 for communicating with one or more servers or other devices using any suitable communication protocol. For example, the communication element 292 may support Wi-Fi (e.g., 802.11 protocol), Ethernet, Bluetooth, high frequency systems (e.g., 1400 MHz, 2.4 GHz, and 5.6 GHz communication systems), infrared, TCP / IP (e.g., any of the protocols used in each layer of the TCP / IP layer), HTTP, BitTorrent, FTP, RTP, RTSP, SSH, any other communication protocol, or any combination thereof. The communication element 292 may also include an antenna for sending and receiving electromagnetic signals.

[0097] Thus, embodiments of the present disclosure provide a head-mountable device that can facilitate comfort, guidance, and alertness of a user by providing visual and other outputs utilizing one or more user interface devices. Such outputs can encourage awareness, alertness, and understanding of the user's movements, characteristics of the environment, and / or the user's condition. These actions can be performed by outputs of the head-mountable device, such as a display, a speaker, a tactile feedback device, and / or another output device that interacts with the user.

[0098] For convenience, various examples of various aspects of the present disclosure are described as clauses below. These examples are provided by way of example and do not limit the subject technology.

[0099] Item A: A head-mountable device comprising: a camera configured to capture a view of a physical environment; a display configured to output a view of a computer-generated reality including virtual features; a sensor configured to detect at least one of a position or movement of a physical feature in the physical environment relative to a user; and a processor configured to operate the display to provide an output including the view of the physical environment in response to detecting the position or movement of the physical feature relative to the user.

[0100] Item B: A head-mountable device comprising: a camera configured to capture a view of a physical environment including physical features; a display configured to output a view of a computer-generated reality including virtual features; a head sensor configured to detect a position of a head; a body sensor configured to detect a position of a body part; and a processor configured to operate the display to output the view of the physical environment in response to at least one of the position of the head or the position of the body part.

[0101] Item C: A head-mountable device comprising: a camera configured to capture a view of a physical environment; a display configured to output a view of a computer-generated reality including virtual features; a storage medium for storing a user profile; a sensor configured to detect physical features in the physical environment; and a processor configured to determine, in response to the user profile and the detection of the physical features, whether to operate the display to output the view of the physical environment.

[0102] One or more of the above clauses may include one or more of the following features. It should be noted that any of the following clauses may be combined with each other in any combination and placed in a corresponding independent clause, for example, clause A, B or C.

[0103] Clause 1: The output includes the view of the physical environment and does not include the view of the virtual feature.

[0104] Clause 2: The processor is further configured to operate the display to modify a visual characteristic of the virtual feature.

[0105] Clause 3: The processor is further configured to operate the display to modify a brightness of the view of the computer-generated reality.

[0106] Clause 4: An eye sensor configured to detect an eye gaze direction of an eye, wherein the processor is configured to operate the display further in response to detection of the eye gaze direction.

[0107] Clause 5: The sensor is further configured to detect a velocity of the user, wherein the processor is further configured to operate the display to provide the output in response to the detection of the velocity.

[0108] Clause 6: A speaker, wherein the processor is further configured to operate the speaker to output sound in response to detecting the position or the movement of the physical feature relative to the user.

[0109] Clause 7: A tactile feedback device, wherein the processor is further configured to operate the tactile feedback device to output tactile feedback in response to detecting the position or the movement of the physical feature relative to the user.

[0110] Clause 8: The head sensor includes an inertial measurement unit.

[0111] Clause 9: The body sensor comprises a depth sensor configured to detect the body part.

[0112] Clause 10: The body sensor includes an additional camera configured to capture a view of the body part.

[0113] Clause 11: The at least one of the position of the head or the position of the body part comprises a change in an angle formed by the head and the body part.

[0114] Clause 12: The output includes the view of the physical environment and does not include the view of the virtual feature.

[0115] Clause 13: The processor is further configured to determine whether to operate the display to output the view of the physical environment without outputting the view of the virtual feature.

[0116] Clause 14: The user profile comprises a record of an amount of time that the view of the computer-generated reality is output for a user corresponding to the user profile.

[0117] Clause 15: The user profile includes a record of selections of a user corresponding to the user profile.

[0118] Clause 16: The user profile includes a criterion; and the processor is further configured to compare the detection of the physical characteristic to the criterion.

[0119] Clause 17: An input device operable to change the user profile.

[0120] As described above, one aspect of the technology of the present invention may include collecting and using data from various sources. The disclosure contemplates that, in some instances, these collected data may include personal information data that uniquely identifies or can be used to contact or locate a specific person. Such personal information data may include demographic data, location-based data, phone numbers, email addresses, twitter IDs, home addresses, data or records related to the user's health or fitness level (e.g., vital sign measurements, medication information, exercise information), date of birth, or any other identification information or personal information.

[0121] The present disclosure recognizes that the use of such personal information data in the present technology can be used to benefit the user. For example, health and fitness data can be used to provide insights into the user's overall health status, or can be used as positive feedback to individuals who use technology to pursue health goals.

[0122] The disclosure anticipates that entities responsible for the collection, analysis, disclosure, transmission, storage or other purposes of such personal information data will comply with sound privacy policies and / or privacy measures. Specifically, such entities should implement and adhere to the use of privacy policies and practices that are recognized as meeting or exceeding the industry or government requirements for maintaining the privacy and security of personal information data. Such policies should be easy for users to access and should be updated as changes in the collection and / or use of data occur. Personal information from users should be collected for legal and reasonable entity purposes and should not be shared or sold outside these legal purposes. In addition, such collection / sharing should be carried out after receiving the informed consent of the user. In addition, such entities should consider taking any necessary steps to protect and safeguard access to such personal information data, and ensure that other entities with access to personal information data comply with their privacy policies and procedures. In addition, such entities can subject themselves to third-party assessments to prove that they comply with widely accepted privacy policies and practices. In addition, policies and practices should be adapted to specific types of personal information data collected and / or accessed, and to applicable laws and standards including considerations of special jurisdictions. For example, in the United States, the collection or acquisition of certain health data may be governed by federal and / or state laws, such as the Health Insurance Portability and Accountability Act (HIPAA); while health data in other countries may be subject to other regulations and policies and should be handled accordingly. Therefore, different privacy measures should be advocated for different types of personal data in each country.

[0123] Regardless of the foregoing, the present disclosure also contemplates implementation schemes in which users selectively block the use or access of personal information data. That is, the present disclosure contemplates hardware elements and / or software elements to prevent or block access to such personal information data. For example, with respect to an advertising delivery service, the technology of the present invention may be configured to allow a user to choose to "opt in" or "opt out" at any time during or after registration for the service to participate in the collection of personal information data. In another example, a user may choose not to provide emotion-related data for a target content delivery service. In another example, a user may choose to limit the length of time that emotion-related data is retained, or completely prohibit the development of basic emotional conditions. In addition to providing "opt-in" and "opt-out" options, the present disclosure also contemplates providing notifications related to access or use of personal information. For example, a user may be notified that their personal information data will be accessed when downloading an application, and then the user may be reminded again just before the personal information data is accessed by the application.

[0124] In addition, the intention of the present disclosure is that personal information data should be managed and processed in a manner that minimizes the risk of unintentional or unauthorized access or use. Once the data is no longer needed, the risk can be minimized by limiting the collection of data and deleting the data. In addition, and when applicable, including in certain health-related applications, data de-identification can be used to protect the privacy of users. De-identification can be promoted when appropriate by removing specific identifiers (e.g., date of birth, etc.), controlling the amount or specificity of stored data (e.g., collecting location data at the city level rather than at the address level), controlling how the data is stored (e.g., aggregating data between users), and / or other methods.

[0125] Thus, while the present disclosure broadly covers the use of personal information data to implement one or more of the various disclosed embodiments, the present disclosure also contemplates that various embodiments may also be implemented without access to such personal information data. That is, various embodiments of the present technology will not fail to function properly due to the lack of all or a portion of such personal information data. For example, content may be selected and delivered to a user by inferring preferences based on non-personal information data or an absolute minimum amount of personal information, such as content requested by a device associated with the user, other non-personal information available to a content delivery service, or publicly available information.

[0126] As used herein, the phrase "at least one of" following a list of items, any of which is separated by the terms "and" or "or", modifies the list as a whole, rather than each member of the list (i.e., each item). The phrase "at least one of" does not require selection of at least one of each item listed; rather, the phrase allows for a meaning that includes at least one of any one item and / or at least one of any combination of items and / or at least one of each item. For example, the phrase "at least one of A, B, and C" or "at least one of A, B, or C" each refers to only A, only B, or only C; any combination of A, B, and C; and / or at least one of each of A, B, and C.

[0127] The predicate words "configured to," "operable to," and "programmed to" do not imply any specific tangible or intangible modification of a subject matter but are intended to be used interchangeably. In one or more specific implementations, a processor configured to monitor and control an operation or component may also mean that the processor is programmed to monitor and control the operation or that the processor is operable to monitor and control the operation. Similarly, a processor configured to execute code may be interpreted as a processor programmed to execute code or operable to execute code.

[0128] Phrases such as aspect, this aspect, another aspect, some aspects, one or more aspects, a specific implementation, this specific implementation, another specific implementation, some specific implementations, one or more specific implementations, an embodiment, this embodiment, another embodiment, some embodiments, one or more embodiments, configuration, this configuration, another configuration, some configurations, one or more configurations, subject technology, disclosure, the present disclosure, other variations, etc. are for convenience and do not mean that the disclosure involving such one or more phrases is essential to the subject technology, or that such disclosure applies to all configurations of the subject technology. Disclosures involving such one or more phrases may apply to all configurations or one or more configurations. Disclosures involving such one or more phrases may provide one or more examples. Phrases such as aspect or some aspects may refer to one or more aspects, and vice versa, and this applies similarly to the other aforementioned phrases.

[0129] The word "exemplary" is used herein to mean "serving as an example, instance, or illustration." Any implementation described herein as "exemplary" or as an "example" is not necessarily to be construed as preferred or advantageous over other implementations. Furthermore, to the extent that the terms "including," "having," and the like are used in the specification or claims, such terms are intended to be inclusive, similar to the way the term "comprising" is interpreted when used as a transitional word in a claim.

[0130] All structural and functional equivalents to the elements of the various aspects described throughout this disclosure that are known or later become known to those of ordinary skill in the art are expressly incorporated herein by reference and are intended to be covered by the claims. In addition, nothing disclosed herein is intended to be made available to the public regardless of whether the disclosure is explicitly stated in the claims. Pursuant to 35 U.S.C. §112, sixth paragraph, no claim element shall be construed unless the element is expressly stated using the phrase “means for” or, in the case of a method claim, the element is stated using the phrase “step for”.

[0131] The previous description is provided to enable any person skilled in the art to practice the various aspects described herein. Various modifications to these aspects are apparent to those skilled in the art, and the general principles defined herein may be applied to other aspects. Therefore, the claims are not intended to be limited to the aspects shown herein, but are intended to make the full scope consistent with the language claims, wherein the reference to the singular element is not intended to mean "only one", but to refer to "one or more", unless specifically noted. Unless otherwise specifically stated, the term "some" refers to one or more. Male pronouns (e.g., his) include female and neutral (e.g., her and its), and vice versa. Titles and subtitles (if any) are used only for convenience and do not limit the subject disclosure.

Claims

1. A head-mounted device, comprising: a camera configured to capture a view of a physical environment; a display configured to output a view of the computer-generated reality including the virtual features; a sensor configured to detect at least one of a position or a motion of a physical feature in the physical environment relative to a user; and A processor is configured to, in response to detecting the position or movement of the physical feature relative to the user, operate the display to provide an output including an indication of the physical feature.

2. The head mountable device of claim 1, wherein the output includes the view of the physical environment without including the view of the virtual feature.

3. The head mountable device of claim 1, wherein the processor is further configured to operate the display to modify a visual characteristic of the virtual feature.

4. The head mountable device of claim 1, wherein the processor is further configured to operate the display to modify a brightness of the view of the computer-generated reality.

5. The head-mountable device of claim 1 , further comprising an eye sensor configured to detect an eye gaze direction of an eye, wherein the processor is configured to operate the display further in response to detection of the eye gaze direction.

6. The head mountable device of claim 1, wherein the sensor is further configured to detect a velocity of the user, wherein the processor is further configured to operate the display to provide the output in response to the detection of the velocity.

7. The head-mountable device of claim 1 , further comprising a speaker, wherein the processor is further configured to operate the speaker to output sound in response to detecting the position or movement of the physical feature relative to the user.

8. The head-mountable device of claim 1 , further comprising a tactile feedback device, wherein the processor is further configured to operate the tactile feedback device to output tactile feedback in response to detecting the position or movement of the physical feature relative to the user.

9. A head-mounted device, comprising: a camera configured to capture a view of a physical environment including physical features; a display configured to output a view of the computer-generated reality including the virtual features; a head sensor configured to detect a position of a head; a body sensor configured to detect a position of a body part; and A processor is configured to operate the display to output an indication of the physical characteristic in response to at least one of the position of the head or the position of the body part.

10. The head mountable device of claim 9, wherein the head sensor comprises an inertial measurement unit.

11. The head mounted device of claim 9, wherein the body sensor comprises a depth sensor configured to detect the body part.

12. The head mountable device of claim 9, wherein the body sensor comprises an additional camera configured to capture a view of the body part.

13. The head mountable device of claim 9, wherein the at least one of the position of the head or the position of the body part comprises a change in an angle formed by the head and the body part.

14. The head mountable device of claim 9, wherein the output includes the view of the physical environment without including the view of the virtual feature.

15. A head-mountable device, comprising: a camera configured to capture a view of a physical environment; a display configured to output a view of the computer-generated reality including the virtual features; A storage medium, wherein the storage medium is used to store a user configuration file; a sensor configured to detect a physical feature in the physical environment; and A processor is configured to determine, in response to the user profile and the detection of the physical characteristic, whether to operate the display to output an indication of the physical characteristic.

16. The head mountable device of claim 15, wherein the processor is further configured to determine whether to operate the display to output the view of the physical environment without outputting the view of the virtual feature.

17. The head mountable device of claim 15, wherein the user profile comprises a record of an amount of time that the view of the computer-generated reality is output for a user corresponding to the user profile.

18. The head mountable device of claim 15, wherein the user profile comprises a record of selections of a user corresponding to the user profile.

19. The head mountable device according to claim 15, wherein: The user profile includes criteria; and The processor is further configured to compare the detection of the physical characteristic to the standard.

20. The head mountable device of claim 15, further comprising an input device operable to change the user profile.

Images