Fitting guidance for head-mountable devices

Abstract

A head-mountable device and / or another electronic device can provide guidance for optimal placement of the head-mountable device. The head-mountable device and / or another electronic device can be operated to position the head-mountable device in a manner that guides a user to achieve correct alignment of components with respect to the user and maximize user comfort. For example, the head-mountable device and / or another device can include sensors for detecting features of a user's face, forces distributed on the face when worn, and / or aligned with the face (e.g., an eye). By further examples, the head-mountable device and / or another device can detect a change in adjustment and infer user discomfort based on the frequency and / or magnitude of such a change. By further examples, the head-mountable device and / or another device can detect a change in a feature of a user's face before, during, and / or after use of the head-mountable device.

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims the benefit of U.S. Provisional Application No. 63 / 357,522, filed on June 30, 2022, entitled “FIT GUIDANCE FOR HEAD-MOUNTABLE DEVICES,” the entire contents of which are incorporated herein by reference. Technical Field

[0003] The present specification generally relates to head-mountable devices, and more particularly to fit guidance for head-mountable devices. Background Art

[0004] A user may wear a head-mounted device to display visual information within the user's field of view. The head-mounted device may be used as a virtual reality (VR) system, an augmented reality (AR) system, and / or a mixed reality (MR) system. The user may observe output provided by the head-mounted device, such as visual information provided on a display. The display may optionally allow the user to observe the environment outside the head-mounted device. Other outputs provided by the head-mounted device may include speaker output and / or tactile feedback. The user may further interact with the head-mounted device by providing input for processing by one or more components of the head-mounted device. For example, while the device is mounted to the user's head, the user may provide tactile input, voice commands, and other inputs. BRIEF DESCRIPTION OF THE DRAWINGS

[0005] Certain features of the subject technology are set forth in the appended claims. However, for purposes of explanation, several embodiments of the subject technology are set forth in the following figures.

[0006] Figure 1 Illustrated is a top view of a head-mountable device according to some embodiments of the present disclosure.

[0007] Figure 2 Illustrated are perspective views of an electronic device for measuring distances to different facial regions of a user according to some embodiments of the present disclosure.

[0008] Figure 3 A perspective view of an electronic device for detecting a condition of a head-mountable device worn by a user according to some embodiments of the present disclosure is illustrated.

[0009] Figure 4 Illustrated is a perspective view of an electronic device for detecting a condition of a head-mountable device worn by a user according to some embodiments of the present disclosure.

[0010] Figure 5A perspective view of an electronic device for detecting a condition of a facial area of ​​a user after using a head-mountable device according to some embodiments of the present disclosure is illustrated.

[0011] Figure 6 Illustrated is a rear view of a head-mountable device according to some embodiments of the present disclosure.

[0012] Figure 7 Illustrated is a side view of a head-mountable device for detecting a condition of a user's facial area including eyes according to some embodiments of the present disclosure.

[0013] Figure 8 Illustrated are perspective views of an electronic device and a head-mountable device for detecting a condition of a head-mountable device worn by a user according to some embodiments of the present disclosure.

[0014] Fig. 9 Illustrated is a method for detecting a condition of a head-mounted device worn by a user according to some embodiments of the present disclosure. Figure 8 A perspective view of an electronic device and a head-mountable device.

[0015] Fig.10 Illustrated are perspective views of an electronic device and a head-mountable device for detecting a condition of a head-mountable device worn by a user according to some embodiments of the present disclosure.

[0016] Fig.11 A flowchart illustrating a process having operations performed by a head-mountable device and / or an electronic device according to some embodiments of the present disclosure is illustrated.

[0017] Fig.12 A flowchart illustrating a process having operations performed by a head-mountable device and / or an electronic device according to some embodiments of the present disclosure is illustrated.

[0018] Fig.13 A flowchart illustrating a process having operations performed by a head-mountable device and / or an electronic device according to some embodiments of the present disclosure is illustrated.

[0019] Fig.14 Block diagrams of head-mountable devices and electronic devices according to some embodiments of the present disclosure are illustrated. DETAILED DESCRIPTION

[0020] The specific embodiments shown below are intended to be descriptions of various configurations of the subject technology and are not intended to represent the only configuration that the subject technology can be put into practice. The accompanying drawings are incorporated herein and constitute a part of the specific embodiments. The specific embodiments include specific details intended to provide a thorough understanding of the subject technology. However, it will be clear and obvious to those skilled in the art that the subject technology is not limited to the specific details shown herein and can be put into practice without these specific details. In some cases, well-known structures and components are shown in block diagram form to avoid blurring the concept of the subject technology.

[0021] Head-mounted devices, such as head-mounted displays, headphones, goggles, smart glasses, heads-up displays, etc., can perform a range of functions managed by the components (e.g., sensors, circuits, and other hardware) included in the wearable device.

[0022] Many functions performed by a head mountable device are best experienced when the components are in their most preferred positions and orientations relative to a user wearing the head mountable device. For example, a head mountable device may include a display that visually outputs display-based information toward the user's eyes. The position and orientation of the display relative to the eyes depends at least in part on how the head mountable device is positioned on the user's face.

[0023] Additionally, when on the user's face, the head mountable device may provide greater comfort in certain positions than in other positions. For example, the placement may determine where and how forces (e.g., weight and / or tension) of the head mountable device are applied to the face. Face engaging portions of the head mountable device may be selected to engage specific portions of the face, but if such face engaging portions are placed in positions other than those intended, the user's experience may not be optimal. However, a head mountable device with a more preferred placement may allow a user to comfortably wear and operate the head mountable device for longer durations.

[0024] A user or another person placing the head-mountable device on the user's face may not be able to recognize whether the head-mountable device is in the best position to achieve these results. Therefore, it may be desirable to provide guidance and / or feedback to the user to help place the head-mountable device in a preferred position.

[0025] The system of the present disclosure may provide a head-mounted device with an interface element to provide guidance for optimal placement of the head-mounted device. The head-mounted device and / or another electronic device may be operated to guide the user to position the head-mounted device in a manner that achieves proper alignment of the components relative to the user and maximizes user comfort. For example, the head-mounted device and / or another device may include sensors for detecting features of the user's face, forces distributed on the face when worn, and / or alignment with the face (e.g., eyes). By further example, the head-mounted device and / or another device may detect changes in adjustments and infer user discomfort based on the frequency and / or amplitude of such changes. By further example, the head-mounted device and / or another device may detect changes in features of the user's face before, during, and / or after use of the head-mounted device.

[0026] The following references Figures 1 to 14 However, those skilled in the art will readily appreciate that the detailed description given herein with respect to these figures is for illustration purposes only and should not be construed as limiting.

[0027] According to some embodiments, for example Figure 1 As shown, the head-mountable device 100 includes a frame 110 and an optical seal 200. The frame 110 can be worn on the head of a user. The frame 110 can be positioned in front of the user's eyes to provide information within the user's field of view. The frame 110 and / or the optical seal 200 can provide nose pads and / or other portions to rest on the user's nose, forehead, cheeks, and / or other facial features as further described herein.

[0028] The frame 110 can be supported on the user's head by the head connector 120. The head connector 120 can be wrapped around or extend along opposite sides of the user's head. The head connector 120 can optionally include earphones for wrapping around or otherwise engaging or resting on the user's ears. It should be understood that other configurations can be applied to secure the head-mounted device 100 to the user's head. For example, one or more straps, bands, ties, covers, caps, or other components can be used in addition to or instead of the illustrated components of the head-mounted device 100. By further example, the head connector 120 can include multiple components for engaging the user's head. The head connector 120 can extend from the frame 110 and / or the optical seal 200.

[0029] The frame 110 may provide structure around its peripheral area to support any internal components of the frame 110 in their assembled position. For example, the frame 110 may enclose and support various internal components (including, for example, integrated circuit chips, processors, memory devices, and other circuits) to provide computing and functional operations for the head mountable device 100, as further discussed herein. Although several components are shown within the frame 110, it should be understood that some or all of these components may be located anywhere within or on the head mountable device 100. For example, one or more of these components may be positioned within the head adapter 120, the optical seal 200, and / or the frame 110 of the head mountable device 100.

[0030] The head mountable device 100 may include one or more user sensors for tracking characteristics of a user wearing the head mountable device 100. Such sensors may be located at, included with, and / or associated with the frame 110, the optical seal 200, and / or the head adapter 120. For example, the user sensor may include or be associated with the HMD sensor 170, the pressure sensor 270 of the optical seal 200, and / or the head adapter's head engagement sensor 122.

[0031] One or more sensors may be provided to detect the fit of the optical seal 200 relative to the user's face. For example, the frame 110 and / or another component of the head mountable device 100 may include an optical sensor for detecting light within the optical seal 200, as further described herein. By further example, the optical seal 200 and / or another component of the head mountable device 100 may include a force sensor 270 for detecting forces applied to an area of ​​the user's face, as further described herein. By further example, the head connector 120 and / or another component of the head mountable device 100 may include a head connector sensor 122 for detecting tension or another condition in the head connector 120. Operation of such sensors may be helpful in determining which of a plurality of optical seals is recommended for a particular user.

[0032] By further example, the user sensor may perform facial feature detection, facial motion detection, facial recognition, eye tracking, user mood detection, user emotion detection, voice detection, and the like. Such eye tracking may be used to determine the location of information to be displayed on the display 140 and / or a portion of a view (e.g., an object) to be analyzed by the head mounted device 100. By further example, the user sensor may be a biosensor for tracking biometric characteristics such as health and activity metrics. The user sensor may include a biosensor configured to measure biometrics such as electrocardiogram (ECG) characteristics, skin resistivity, and other electrical properties of the user's body. Additionally or alternatively, the biosensor may be configured to measure body temperature, exposure to UV radiation, and other health-related information.

[0033] The frame 110 may include and / or support one or more cameras 130. The cameras 130 may be positioned on or near an outer side 112 of the frame 110 to capture images of a view outside the head mountable device 100. As used herein, the outer side of a portion of a head mountable device is the side that faces away from the user and / or toward the external environment. The captured images may be used for display to the user or stored for any other purpose. Each of the cameras 130 may be movable along the outer side 112. For example, a track or other guide may be provided to facilitate movement of the cameras 130 in the track or other guide.

[0034] The head mountable device 100 may include a display 140 that provides visual output for viewing by a user wearing the head mountable device 100. One or more displays 140 may be positioned on or near an inner side 114 of the frame 110. As used herein, an inner side 114 of a portion of a head mountable device is a side that faces toward the user and / or away from the external environment.

[0035] Display 140 may transmit light from the physical environment (e.g., as captured by a camera) for viewing by a user. Such display 140 may include optical features, such as lenses for vision correction based on incident light from the physical environment. Additionally or alternatively, display 140 may provide information as a display within the user's field of view. Such information may be provided in lieu of a view of the physical environment or in addition to (e.g., overlaying) the physical environment.

[0036] The physical environment refers to the physical world that people can sense and / or interact with without necessarily needing the help of electronic devices. The computer-generated reality environment refers to a fully or partially simulated environment that people sense and / or interact with with the help of electronic devices. Examples of computer-generated realities include mixed reality and virtual reality. Examples of mixed reality may include augmented reality and augmented virtuality. Some examples of electronic devices that enable people to sense various computer-generated real environments and / or interact with various computer-generated real environments include head-mounted systems, projection-based systems, head-up displays (HUDs), vehicle windshields with integrated display capabilities, windows with integrated display capabilities, displays formed as lenses designed to be placed on people's eyes (e.g., similar to contact lenses), headphones / earpieces, speaker arrays, input systems (e.g., wearable or handheld controllers with or without tactile feedback), smart phones, tablets, and desktop / laptop computers. The head-mounted device may have an integrated opaque display, a transparent or translucent display, or be configured to receive an external opaque display (e.g., a smart phone).

[0037] Although the light seal 200 is schematically shown as having a particular size and shape, it should be understood that the size and shape of the light seal 200 (particularly at the inner side 214 of the light seal 200) can be sized and shaped to accommodate the face of a user wearing the head mounted device 100. For example, the inner side 214 can provide a shape that generally matches the contours of the user's face around the user's eyes, as further described herein. The inner side 214 can be provided with one or more features that allow the light seal 200 to conform to the user's face to enhance comfort and prevent light from entering the light seal 200 at points of contact with the face. For example, the inner side 214 can provide a flexible, soft, elastic and / or compliant structure.

[0038] When the user wears the head mountable device 100, the optical seal 200 can be maintained in a fixed position and orientation relative to the user's face and head with the inner side 214 of the optical seal 200 against the user's face and / or the head adapter 120 against the user's head. In addition, in such a configuration, the frame 110 can also be maintained in a fixed position and orientation relative to the user's face and head. Given the variety of head and facial shapes that different users may have, it may be desirable to provide the optical seal 200 with customization and interchangeability so that the frame 110 is in a desired position and orientation relative to the user's face and head during use.

[0039] Reference now Figure 2, the shape of a user's face can be measured to subsequently determine how a given head-mountable device should be positioned to optimize user comfort and alignment with features of the user's face. A device with sensors can be operated to detect and / or measure one or more areas of a user's face. Such detection and measurement can be used to determine how a head-mountable device should be positioned so that its optical seal comfortably engages appropriate areas of the user's face. Such detection and measurement can also serve as a baseline for the user's initial condition, against which additional detection and measurement can be compared.

[0040] like Figure 2 As shown, the electronic device 300 may provide an external sensor 310 that is operable to measure the distance to multiple areas of the face 10. Such areas may include areas that will be engaged by the optical seal when the user wears the head-mountable device. For example, these areas may include the forehead 20, the nose 30, one or both eyes 50 and / or one or both cheeks 40.

[0041] The external sensor 310 may include one or more types of sensors. For example, the external sensor 310 may include one or more image sensors, depth sensors, thermal (e.g., infrared) sensors, etc. By way of further example, the depth sensor may be configured to measure the distance (e.g., range) to an object (e.g., an area of ​​a user's face) via stereo triangulation, structured light, time of flight, interferometry, etc. Additionally or alternatively, the external sensor 310 and / or the device may capture and / or process images based on one or more of a hue space, brightness, color space, luminosity, etc.

[0042] exist Figure 2 , by way of example, external sensor 310 is depicted as a component of an electronic device. Examples of such electronic devices include a portable computing device, a tablet device, a laptop computer, a smart phone, a smart watch, or other suitable device that includes one or more sensors. Additionally or alternatively, external sensor 310 can be a component of a head-mountable device (such as a head-mountable device to be worn by a user and / or another head-mountable device). In some embodiments, electronic device 300 can be maintained in a fixed position relative to face 10, or the electronic device can be moved to map different areas of the user's face.

[0043] The external sensor 310 can measure the distance from the external sensor 310 to each of multiple areas of the user's face. For example, the external sensor 310 can measure the distance to the forehead 20, the distance to the nose 30, the distance to the cheek 40, and the like. The external sensor 310 can measure any other area of ​​the face, such as the eyes and / or other parts that will not be directly engaged by the optical seal. It should be understood that other areas of the face can be detected and / or measured. Additionally or alternatively, one or more distance measurements can be made for each of the various areas, such as multiple sections relative to the forehead 20, nose 30, and / or cheeks 40. Based on the distance measurement results, a head-mountable device can be selected that optionally has a customized optical seal that is selected to have various portions that match the contours of the user's face.

[0044] Reference now Figure 3 The head mountable device may include an optical seal selected to match the contours of the user's face. The head mountable device may also include a feature for monitoring the alignment and engagement of the head mountable device on the user's face.

[0045] For example, Figure 3 As shown, the optical seal 200 may include a forehead portion 220 for engaging the forehead of a user, a nose portion 230 for engaging the nose of the user, and a cheek portion 240 for engaging the cheeks of the user. By further example, the optical seal 200 may also include side portions 216 that are configured to engage the sides of the user's face (e.g., along the sideburns of the user's head). Any number of other portions may be provided, including sub-components of the portions described herein. Different optical seals may differ from each other at least with respect to dimensions along different portions thereof. For example, different optical seals may have different thicknesses along different portions to accommodate the faces of a variety of different users. A given optical seal may be selected for use with a given user having facial features for engagement by the optical seal, and a target position for the head-mounted device may be determined for optimal comfort and / or alignment (e.g., alignment with the user's eyes).

[0046] While the head mountable device 100 may have a targeted alignment for the entire device, specific features of the head mountable device 100 may adjust their respective positions and / or orientations to align with features of the user. For example, each display 140 may be adjusted to align with a corresponding eye of the user. By further example, each display 140 may be moved along one or more axes until the center of each display 140 is aligned with the center of the corresponding eye. Thus, the distance between the displays 140 may be set based on the interpupillary distance of the user. IPD is defined as the distance between the centers of the pupils of the user's eyes.

[0047] A pair of displays 140 may be mounted to the frame 110 and spaced apart by a distance. The distance between the pair of displays 140 may be designed to correspond to the IPD of the user. The distance may be adjustable to account for the different IPDs of different users who may wear the head mountable device 100. For example, either or both of the displays 140 may be movably mounted to the frame 110 to allow the displays 140 to be moved or translated laterally to make the distance larger or smaller. Any type of manual or automatic mechanism may be used to allow the distance between the displays 140 to be an adjustable distance. For example, the displays 140 may be mounted to the frame 110 via a slidable track or guide that allows manual or electronically actuated movement of one or more of the displays 140 to adjust the distance therebetween.

[0048] Additionally or alternatively, the display element may be moved to a target position based on a desired visual effect corresponding to the user's perception of the display 140 when the display 140 is positioned at the target position. The target position may be determined based on the user's focal length and / or the optical elements of the system. For example, the user's eyes and / or the optical elements of the system may determine how the visual output of the display 140 will be perceived by the user. The distance between the display 140 and the user's eyes and / or the distance between the display 140 and one or more optical elements may be changed to place the display 140 at a corresponding focal length, within a corresponding focal length, or outside a corresponding focal length. Such adjustments may be useful to accommodate a particular user's eyes, corrective lenses, and / or desired optical effects.

[0049] It should be understood that positioning the entire head mountable device may also change the position and / or orientation of the display 140 relative to the user's eyes. Thus, the head mountable device may provide guidance to help the user achieve alignment of the head mountable device relative to the user while also performing additional adjustments, such as movement of the display 140.

[0050] The optical seal or other components of the head-mountable device may also include sensors that operate to detect and / or measure one or more forces on the user's face. Such detection and measurement can be used to determine the alignment and fit of the head-mountable device with the user's face.

[0051] like Figure 3 As shown, the optical seal 200 or other components of the head-mounted device 100 can provide a pressure sensor 270 that is operable to measure the magnitude of the force applied to multiple areas of the user's face. Such areas may include areas that are engaged by the optical seal 200 when the user wears the head-mounted device 100. For example, these areas may include the forehead, the nose, and / or one or both cheeks. Therefore, the pressure sensor 270 can be positioned at the forehead portion 220, the side portion 216, the nose portion 230, and / or the cheek portion 240.

[0052] The pressure sensor 270 may include one or more types of sensors. The pressure sensor 270 may include a component that converts the mechanical movement and / or deformation of the optical seal 200 into an electrical signal. The pressure sensor 270 may include one or more force sensors, contact sensors, capacitive sensors, strain gauges, impedance touch sensors, piezoelectric sensors, cameras, pressure sensors, photodiodes, and / or other sensors. The pressure sensor 270 can detect both the presence and magnitude of a force, as well as a known distribution of the force over a given area.

[0053] Each pressure sensor 270 can measure the pressure (i.e., the force distributed over an area) applied to the user's face in its vicinity. For example, the pressure sensor 270 can measure the pressure and / or force applied to the user's forehead, nose, cheeks, and / or temples. It should be understood that other areas of the face that make contact can be detected and / or measured. Additionally or alternatively, one or more measurements can be made for each of the various areas (such as multiple sections relative to the forehead, nose, and / or cheeks).

[0054] Based on the pressure and / or force measurements, it may be determined that an adjustment to the head-mountable device is recommended. For example, a target alignment may be an alignment in which forces at different regions are evenly distributed or otherwise balanced. By further example, an adjustment may be recommended in the event that pressure and / or force are measured to be too high in a given region (e.g., above a threshold associated with a limit of a user's comfort range at that region). It should be understood that a threshold for one region of a user's face may be different from a threshold for another region of the user's face. For example, a threshold within which a particular user's forehead may comfortably withstand pressure and / or force may be greater than a threshold within which a user's cheek may comfortably withstand pressure and / or force. Therefore, an adjustment may be recommended to reduce pressure and / or force by shifting pressure and / or force in one region to another region. By further example, the recommended adjustment may include adjusting the tension of a head connector.

[0055] Reference now Figure 4 and Figure 5 , the head-mountable device can provide a user interface on another electronic device to prompt and / or guide adjustments to the head-mountable device to achieve target alignment.

[0056] like Figure 4As shown, the system 2 may include a head mountable device 100 and an electronic device 300 that is optionally operable separately from the head mountable device 100. The electronic device 300 may provide an external sensor 310, such as a camera that captures images of the head mountable device 100 and / or a user (not shown). In some embodiments, the electronic device 300 may include one or more image sensors, depth sensors, thermal (e.g., infrared) sensors, and the like. In some embodiments, the external sensor 310 may be operated to detect the alignment of the head mountable device 100 on the user's face 10. For example, based on a known structure of the head mountable device 100 (e.g., having a reference marker), the electronic device 300 may determine the position and / or orientation of the entire head mountable device 100. Additionally or alternatively, the electronic device 300 may measure the position and / or orientation of the head mountable device 100, such as the frame 110 and / or the optical seal ( Figure 5 The distance 90 between the frame 110 and / or the optical seal and one or more areas of the face (e.g., chin, cheeks, sideburns, top of the head, etc.) and / or the user's face 10 can be determined. For example, the distance 90 between the frame 110 and / or the optical seal and one or more areas of the face (e.g., chin, cheeks, sideburns, top of the head, etc.) can be determined. Based on previous scans of the user's face and the selected optical seal, the alignment can be compared to the target alignment to determine whether the head mountable device is being worn in a preferred arrangement.

[0057] like Figure 5 As shown, the electronic device 300 can be operated to detect the alignment of the head mountable device 100 on other areas of the user's face 10 (e.g., using the external sensor 310). For example, the distance 94 between the head adapter 120 and the ear 22 can be determined. The alignment can be compared to the target alignment to determine whether the head mountable device 100 is being worn in the preferred arrangement. By further example, the angle 92 between the head adapter 120 and the frame 110 can be determined. The angle 92 can be compared to the target angle to determine whether the head mountable device 100 is being worn in the preferred arrangement.

[0058] In some embodiments, the distance, angle, or other feature can be detected by the HMD sensor 170 of the head mountable device 100. For example, the HMD sensor 170 can detect the distance 90 between the head mountable device 100 and / or one or more regions of the user's face 10. By further example, the HMD sensor 170 can detect the distance 94 between the head adapter 120 and the ear 22. By further example, the HMD sensor 170 can detect the angle 92 between the head adapter 120 and the frame 110.

[0059] In some embodiments, features of the face 10 may be detected by the HMD sensor 170 and / or the external sensor 310. For example, the HMD sensor 170 and / or the external sensor 310 may detect deformations of the face 10, such as changes in the contour and / or shape of the face 10 when the head-mountable device is applied. Such changes may be identified as stretching, bunching, pulling, compressing, shifting, and manipulating tissues of the face 10, which may cause discomfort to the user. Such changes may be tracked as changes (e.g., movement) of the skin or other tissue relative to the initial condition of the face 10. In the event that such changes exceed one or more corresponding thresholds, the head-mountable device 100 and / or the electronic device 300 may provide an output, as further described herein.

[0060] Based on the detected position and / or orientation of the head mountable device 100 and / or other conditions thereof relative to the user, the electronic device 300 and / or the head mountable device 100 may compare the current alignment with the target alignment. Based on the result of the comparison, the electronic device 300 and / or the head mountable device 100 may determine a recommended adjustment.

[0061] like Figure 6 As shown, the head mountable device 100 can detect alignment when being worn by a user. For example, the HMD sensor 170 can detect and / or track the user's eyes 50. Based on the detected position and / or orientation of the eyes 50 relative to the HMD sensor 170, the position and / or orientation of the head mountable device 100 relative to the user's face can be determined. Additionally or alternatively, such detection can be performed relative to the forehead 20, nose 30, cheeks 40, and / or other parts of the user. In some embodiments, the engagement of the optical seal 200 against various parts of the user (as described herein) and / or changes in the optical seal 200 (e.g., compression) can be detected.

[0062] Reference now Figure 7 , the electronic device 300 can be operated to detect the condition and / or features of the face after using the head-mountable device. For example, Figure 7As shown, after the head-mounted device (not shown) has been removed from the user's face 10, the face can be scanned. When applied to the face, the head-mounted device may have temporarily deformed and / or manipulated the user's face. In the time period after the head-mounted device is removed, the condition can provide an indication of the effect caused. For example, when the tissue of the face 10 responds to the removal of the head-mounted device, additional blood flow can be provided to the area that was previously compressed by the head-mounted device (e.g., pressure from the optical seal). Such conditions can be optically, thermally or otherwise detectable, such as by an external sensor 310 of the electronic device 300 and / or another electronic device. For example, the face 10 can show an affected area 60 at different parts of the face 10, such as at the forehead 20, the nose 30 and / or the cheek 40. The detection performed after the head-mounted device is removed can be compared with the detection performed before the head-mounted device is applied. The changes may include changes in color, hue, color, morphology, contour, texture, thermal conditions (e.g., temperature), etc. Such changes may be measured and / or quantified based on optical, thermal, distance, and / or other measurements. The change between an initial condition (i.e., before applying the head mountable device) and a final condition (i.e., after removing the head mountable device) may be compared to a threshold. In the event that the magnitude of the change exceeds the threshold, an adjustment may be recommended. It should be understood that such changes may be intended to reduce the magnitude of the change and / or to distribute the change more evenly.

[0063] Reference now Figure 8 and Fig. 9 , changes made to the alignment of a head-mountable device can be detected and tracked over a period of time. For example, Figure 8 As shown, the head mountable device 100 can have an initial position and / or orientation relative to the user's face 10.

[0064] like Fig. 9 As shown, the user can manually and / or otherwise adjust the position and / or orientation of the head mountable device 100 relative to the user's face 10. Such adjustments can be made at the user's discretion at any time during use of the head mountable device 100. The head mountable device 100 and / or the electronic device 300 can be operated to detect and / or track such adjustments over a period of time.

[0065] For example, the head mountable device 100 may detect its position and / or orientation via one or more onboard sensors. For example, the head mountable device 100 may include an initial measurement unit 196 (“IMU”) that provides information about characteristics of the head mountable device 100, such as its inertial angles. For example, the IMU 196 may include a six-degree-of-freedom IMU that may be based on six degrees of freedom (x, y, z, θ, and y). x ,θ yand θ z ) calculates the position, velocity and / or acceleration of the head mountable device. The IMU 196 may include one or more of an accelerometer, a gyroscope and / or a magnetometer. Additionally or alternatively, the head mountable device 100 may detect motion characteristics of the head mountable device 100 with one or more other motion sensors (such as accelerometers, gyroscopes, global positioning sensors, tilt sensors, etc.) for detecting movement and acceleration of the head mountable device 100. Additionally or alternatively, the HMD sensor 170 may be operable to detect relative movement relative to the user's face (e.g., eyes). By further example, the external sensor 310 of the electronic device 300 may be operated to detect movement of the head mountable device 100 relative to the user's face 10.

[0066] Frequent and / or significant adjustments to the alignment of the head mountable device 100 relative to the user's face may indicate a poor fit of the head mountable device 100. For example, the user may tend to adjust the head mountable device based on slippage of the alignment of the head mountable device 100 relative to the face 10. By further example, the user may tend to adjust the head mountable device 100 based on an overly tight fit and / or pressure applied to the user's face 10. When the frequency and / or magnitude of adjustments of the head mountable device 100 relative to the user's face 10 exceeds a threshold, the head mountable device 100 and / or the electronic device 300 may determine a recommended adjustment.

[0067] Reference now Fig.10 , other characteristics of the user can be detected and applied to infer various levels of user comfort. Fig.10 As shown, the head-mountable device 100 can be worn on the face 10 of the user. The face 10 of the user can form an angle 72 relative to the torso 80 or another body part of the user. For example, the user can pivot the face 10 at the neck 70 to adjust the angle 72. It should be understood that the body parts used for comparison can be any two or more body parts. The head-mountable device 100 can operate independently and / or in conjunction with one or more electronic devices 300. For example, the electronic device 300 can be worn on the torso 80 or other body part of the user. By further example, the electronic device 300 can be a device that is not worn by the user but is otherwise positioned near the user and / or the head-mountable device 100. The head-mountable device 100 and / or one or more electronic devices 300 can monitor their own conditions and / or the conditions of each other and / or the user.

[0068] Additionally or alternatively, one or more HMD sensors 170 of the head mountable device 100 may be operated to detect conditions of the user, including conditions of other parts of the user's body, such as the torso 80 and / or neck 70. Such sensors may be directed toward areas of interest, including outward from the head mountable device 100.

[0069] Detections made about the user may be performed to infer the user's level of comfort and / or discomfort. For example, a particular angle of the user's neck may cause discomfort, and such angles, when detected, may be the basis for recommending adjustments to the head mountable device 100. By further example, the user's movements may be detected to infer the user's activities. For example, the rise and fall of the chest at the torso 80 may be detected to determine rapid breathing and / or anxiety of the user. By further example, features of the user's eyes may be detected to infer the user's emotional state. By further example, microphones of the head mountable device 100 and / or electronic device 300 may be operated to detect audible output provided by the user.

[0070] The detectable conditions described herein may indicate a user's physical and / or emotional state. Such detections may be performed alone or in combination to infer other conditions of the user, such as pain, sadness, discomfort, eyestrain, dizziness, nausea, state of consciousness, alertness, anxiety, bad mood, etc. Such detections may provide a basis for recommending adjustments to the head-mountable device.

[0071] In some embodiments, the electronic device 300 can communicate with the head mountable device 100 such that the detection and / or recommended adjustment can be determined by the head mountable device 100 and sent to the electronic device 300. It should be understood that the detection of the head mountable device 100 and the electronic device 300 can be combined to determine the recommended adjustment.

[0072] The electronic device 300 and / or the head mountable device 100 may include a display that outputs a user interface. It should be understood that the electronic device 300 may be operated by a person who is not the user wearing the head mountable device. Therefore, an additional person may receive guidance to help the user make any recommended adjustments.

[0073] The display may output one or more visual elements. For example, the display may include an indicator, such as an arrow, a compass, a heat map, a reticle, a crosshair, a dot, a line, etc. The indicator may be an instruction to move the head mountable device 100 in a particular manner. For example, if the head mountable device 100 is not in target alignment, the indicator may show the direction in which the user should move the head mountable device 100 to achieve target alignment.

[0074] Other types of outputs may be provided to prompt the user to make adjustments. For example, the output may include instructions to move the head mountable device in a particular manner. Additionally or alternatively, content may be removed or modified until the user makes the recommended adjustments. For example, visual elements may be presented as blurred, blocked, obscured, dimmed, and / or transparent until the user makes the recommended adjustments. Additionally or alternatively, content may be added or modified until the user makes the recommended adjustments. For example, visual elements may be presented as highlighted, opaque, and / or brighter until the user makes the recommended adjustments.

[0075] It should be understood that the adjustment of the user interface as described herein can be repeated as needed to achieve different target alignments after consecutive durations.Thus, the output can be dynamically updated based on multiple detections and determinations as described herein.

[0076] It should also be understood that the purpose of adjusting the current alignment and / or achieving the target alignment may include multiple stages. For example, the user may be prompted to perform a series of adjustments to achieve each alignment in a different target alignment.

[0077] It should also be understood that these measures can be temporary. For example, the user can be prompted to take certain actions. Thereafter, the user can resume operation according to the previous mode until it is determined again to make the recommended adjustment.

[0078] Other recommendations may include adjusting the fit and / or configuration of the head mountable device 100. The head mountable device 100 may recommend to the user that the fit, position, orientation, and / or tightness of the head mountable device 100 on the user's head be adjusted. For example, the recommended adjustment may be to the tightness of the head adapter.

[0079] By further example, the head mountable device 100 may recommend to the user that the head mountable device 100 be adjusted to provide a different effect for the user. Such adjustments may include swapping components, removing components, and / or adding components, such as a counter-balance to adjust the weight distribution of the head mountable device 100. In some embodiments, the recommended adjustment may include replacing the optical seal with a different optical seal to provide a different engagement on the user's face.

[0080] Fig.11 A flow chart illustrating an example process 1100 for guiding a user using adjustment assistance. For purposes of explanation, this document primarily refers to Figure 1 , Figures 3 to 6 and Figures 8 to 10 The head mountable device 100 and / or Figure 2 , Figure 4 , Figure 5 and Figures 7 to 10The process 1100 is described with reference to the electronic device 300. However, the process 1100 is not limited to Figure 1 , Figures 3 to 6 and Figures 8 to 10 The head mountable device 100 and / or Figure 2 , Figure 4 , Figure 5 and Figures 7 to 10 The electronic device 300 of the head-mounted device, and one or more blocks (or operations) of process 1100 may be performed by different components of the head-mounted device and / or one or more other devices. Further for the purpose of explanation, the blocks of process 1100 are described herein as occurring sequentially or linearly. However, multiple blocks of process 1100 may occur in parallel. In addition, the blocks of process 1100 do not have to be performed in the order shown, and / or one or more blocks of process 1100 do not have to be performed and / or may be replaced by other operations.

[0081] Process 1100 may begin when a head-mountable device and / or electronic device detects a user's face (1102). Such detection may be performed by one or more sensors of the head-mountable device and / or electronic device. Additionally or alternatively, detection may be performed in response to an operating state of the head-mounted device (e.g., on / off state, application launch, user input command, etc.).

[0082] The head mountable device and / or the electronic device may detect a current alignment of the head mountable device relative to the user's face (1104). For example, an eye sensor may detect the user's eyes and determine their position relative to the head mountable device. By further example, a pressure sensor of the head mountable device may measure one or more forces applied to one or more regions of the face. Such regions may include the user's forehead, nose, and / or cheeks. By further example, the detection of the current alignment may be performed by another electronic device, as further described herein.

[0083] The head mountable device and / or the electronic device may compare the current alignment of the head mountable device to a target alignment (1106). The target alignment may be an alignment in which a component of the head mountable device (such as a display) is aligned with a feature of the user's face (such as an eye) (e.g., within a certain range). Additionally or alternatively, the target alignment may be a target alignment in which the head mountable device engages the user's face with relatively greater comfort than provided by other alignments. For example, in the target alignment, forces may be distributed in a uniform distribution and / or in a manner that is distributed according to the ability of facial regions to withstand such forces.

[0084] Based on the current alignment, the target alignment, and a comparison therebetween, the head-mountable device and / or the electronic device can determine whether an adjustment is recommended, and if so, what adjustment is recommended (1108). For example, the head-mountable device and / or the electronic device can determine the change in position and / or orientation required to change from the current alignment to the target alignment. In some embodiments, the adjustment can be to a frame, an optical seal, a head connector, and / or another component of the head-mountable device. For example, the recommended adjustment can include tightening or loosening the head connector, which can change the engagement of the optical seal on the user's face. Such a recommendation can be based at least in part on detection by a head connector sensor of the head connector.

[0085] Optionally, the determination of the recommended adjustment may be based at least in part on the operating mode and / or activity of the head mountable device and / or the user. For example, the head mountable device and / or the electronic device may identify and / or provide an indication of the magnitude and / or type of movement of the user involved in the active operation, program, application, and / or activity. A specific alignment and / or adjustment may be recommended to maintain engagement with the user's face during such an operating mode. Thus, the head mountable device and / or other device may determine a recommended alignment and / or adjustment for a duration (e.g., for the entire duration of the operating mode).

[0086] The head-mountable device and / or electronic device may provide an output to the user based on the recommended adjustment, if any (1110). For example, the head-mountable device and / or electronic device may provide a visual output on a display, a sound, or other output conveying to the user an indication of the recommended alignment and / or adjustment. The user may then take appropriate actions to implement the recommended adjustment. The output may include instructions for implementing the recommended adjustment, as further described herein.

[0087] Fig.12 A flow chart illustrating an example process 1200 for guiding a user using adjustment assistance. For purposes of explanation, this document primarily refers to Figure 1 , Figures 3 to 6 and Figures 8 to 10 The head mountable device 100 and / or Figure 2 , Figure 4 , Figure 5 and Figures 7 to 10 The process 1200 is described with reference to the electronic device 300. However, the process 1200 is not limited to Figure 1 , Figures 3 to 6 and Figures 8 to 10 The head mountable device 100 and / or Figure 2 , Figure 4 , Figure 5 and Figures 7 to 10The electronic device 300 of the head-mounted device, and one or more blocks (or operations) of process 1200 may be performed by different components of the head-mounted device and / or one or more other devices. Further for the purpose of explanation, the blocks of process 1200 are described herein as occurring sequentially or linearly. However, multiple blocks of process 1200 may occur in parallel. In addition, the blocks of process 1200 do not have to be performed in the order shown, and / or one or more blocks of process 1200 do not have to be performed and / or may be replaced by other operations.

[0088] Process 1200 may begin when a head-mountable device and / or electronic device detects a user's face (1202). Such detection may be performed by one or more sensors of the head-mountable device and / or electronic device. Additionally or alternatively, detection may be performed in response to an operating state of the head-mounted device (e.g., on / off state, application launch, user input command, etc.).

[0089] The head mountable device and / or the electronic device may detect an initial alignment of the head mountable device relative to the user's face (1204). For example, an eye sensor or other user sensor may detect the user's eyes or other facial parts and determine their positions relative to the head mountable device. By further example, the detection of the current alignment may be performed by another electronic device, as further described herein.

[0090] The head mountable device and / or the electronic device may detect any changes in the alignment of the head mountable device with the target alignment (1206). For example, an eye sensor or other user sensor may detect a change in the position and / or orientation of the head mountable device relative to the eye or other facial part. By further example, an IMU of the head mountable device may track movement of the head mountable device, which may be associated with or otherwise used to detect changes in alignment relative to the face. By further example, the electronic device may track movement of the head mountable device externally.

[0091] Based on the initial alignment and any changes to the alignment, a comparison may be performed to determine the degree, magnitude, and / or frequency of adjustments over a time period (1208). If the adjustments exceed a threshold and / or are within a threshold amount of time, it may be inferred that the user is over-adjusting the head mountable device. In such cases, it may be further determined that a particular adjustment is appropriate to reduce the need for the user to make frequent manual adjustments.

[0092] The head-mountable device and / or electronic device may determine whether an adjustment is recommended, and if so, what adjustment is recommended (1210). For example, the head-mountable device and / or electronic device may determine that the amplitude, range, and / or frequency of manual adjustments are excessive. In some embodiments, the recommended adjustment may be an adjustment to a frame, an optical seal, a head connector, and / or another component of the head-mountable device. For example, the recommended adjustment may include tightening or loosening the head connector, which may change the engagement of the optical seal on the user's face. Such a recommendation may be based at least in part on detection by a head connector sensor of the head connector.

[0093] Optionally, the determination of the recommended adjustment may be based at least in part on the operating mode and / or activity of the head mountable device and / or the user. For example, the head mountable device and / or the electronic device may identify and / or provide an indication of the magnitude and / or type of movement of the user involved in the active operation, program, application, and / or activity. A specific alignment and / or adjustment may be recommended to maintain engagement with the user's face during such an operating mode. Thus, the head mountable device and / or other device may determine a recommended alignment and / or adjustment for a duration (e.g., for the entire duration of the operating mode).

[0094] The head-mountable device and / or electronic device may provide an output to the user based on the recommended adjustment, if any (1212). For example, the head-mountable device and / or electronic device may provide a visual output on a display, a sound, or other output conveying to the user an indication of the recommended alignment and / or adjustment. The user may then take appropriate actions to implement the recommended adjustment. The output may include instructions for implementing the recommended adjustment, as further described herein.

[0095] Fig.13 A flow chart illustrating an example process 1300 for guiding a user using adjustment assistance. For purposes of explanation, this document primarily refers to Figure 1 , Figures 3 to 6 and Figures 8 to 10 The head mountable device 100 and / or Figure 2 , Figure 4 , Figure 5 and Figures 7 to 10 The process 1300 is described with reference to the electronic device 300. However, the process 1300 is not limited to Figure 1 , Figures 3 to 6 and Figures 8 to 10 The head mountable device 100 and / or Figure 2 , Figure 4 , Figure 5 and Figures 7 to 10The electronic device 300 of the head-mounted device, and one or more blocks (or operations) of the process 1300 may be performed by different components of the head-mounted device and / or one or more other devices. Further for the purpose of explanation, the blocks of the process 1300 are described herein as occurring sequentially or linearly. However, multiple blocks of the process 1300 may occur in parallel. In addition, the blocks of the process 1300 do not have to be performed in the order shown, and / or one or more blocks of the process 1300 do not have to be performed and / or may be replaced by other operations.

[0096] Process 1300 may begin when the head-mountable device and / or electronic device detects a condition of a user (1302). Such detection may be performed by one or more sensors of the head-mountable device and / or electronic device. Such detection may include depth scanning, image capture, thermal mapping, etc. The head-mountable device and / or electronic device may detect an initial condition relative to facial features of the user. For example, the sensor may detect the eyes, forehead, nose, ears, and / or cheeks of the user. Such detection may optionally be performed before applying the head-mountable device and / or when the head-mountable device is applied to the face of the user.

[0097] The head-mountable device and / or electronic device may detect any changes in the user's condition (1304). For example, sensors may detect changes in the user's position, orientation, shape, temperature, or other condition. Such changes may occur in areas such as the user's eyes, forehead, nose, ears, and / or cheeks. Such detection may optionally be performed after applying the head-mountable device (e.g., while the user is wearing the head-mountable device) and / or after removing the head-mountable device from the user's face.

[0098] Based on the initial condition and any changes in the user's condition, a comparison may be performed to determine the extent and / or magnitude of such changes (1306). If the change (i.e., the difference from the initial condition to the changed condition) exceeds a threshold and / or persists for more than a threshold amount of time, it may be inferred that the user is experiencing excessive interaction with the head mountable device. In such cases, it may be further determined that a particular adjustment is appropriate to enhance the user's comfort.

[0099] The head-mountable device and / or electronic device may determine whether an adjustment is recommended, and if so, what adjustment is recommended (1308). For example, the head-mountable device and / or electronic device may determine that the amplitude and / or range and / or frequency of the manual adjustment is excessive. In some embodiments, the recommended adjustment may be an adjustment to a frame, an optical seal, a head connector, and / or another component of the head-mountable device. For example, the recommended adjustment may include tightening or loosening the head connector, which may change the engagement of the optical seal on the user's face. Such a recommendation may be based at least in part on detection by a head connector sensor of the head connector.

[0100] Optionally, the determination of the recommended adjustment may be based at least in part on the operating mode and / or activity of the head mountable device and / or the user. For example, the head mountable device and / or the electronic device may identify and / or provide an indication of the magnitude and / or type of movement of the user involved in the active operation, program, application, and / or activity. A specific alignment and / or adjustment may be recommended to maintain engagement with the user's face during such an operating mode. Thus, the head mountable device and / or other device may determine a recommended alignment and / or adjustment for a duration (e.g., for the entire duration of the operating mode).

[0101] The head-mountable device and / or electronic device may provide an output to the user based on the recommended adjustment, if any (1310). For example, the head-mountable device and / or electronic device may provide a visual output on a display, a sound, or other output conveying to the user an indication of the recommended alignment and / or adjustment. The user may then take appropriate actions to implement the recommended adjustment. The output may include instructions for implementing the recommended adjustment, as further described herein.

[0102] Reference now Fig.14 , components of the head-mounted device can be operably connected to provide the performance described herein. Fig.14 A simplified block diagram of an exemplary head mountable device 100 and an electronic device 300 according to one embodiment of the present invention is illustrated. It should be understood that the components described herein can be disposed on one, some, or all of the HMD module, the optical seal, and / or the fixing element. It should be understood that additional components, different components, or fewer components than those illustrated can be utilized within the scope of the subject disclosure.

[0103] like Fig.14 As shown, the head-mountable device 100 may include a processor 150 (e.g., a control circuit) having one or more processing units, which include or are configured to access a memory 152 having instructions stored thereon. The instructions or computer program may be configured to perform one or more of the operations or functions described with respect to the head-mountable device 100. The processor 150 may be implemented as any electronic device capable of processing, receiving, or sending data or instructions. For example, the processor 150 may include one or more of the following: a microprocessor, a central processing unit (CPU), an application-specific integrated circuit (ASIC), a digital signal processor (DSP), or a combination of such devices. As described herein, the term "processor" is intended to cover a single processor or processing unit, multiple processors, multiple processing units, or one or more other appropriately configured computing elements.

[0104] The memory 152 can store electronic data that can be used by the head mountable device 100. For example, the memory 152 can store electronic data or content, such as audio and video files, documents and applications, device settings and user preferences, timing and control signals or data for various modules, data structures or databases, etc. The memory 152 can be configured as any type of memory. By way of example only, the memory 152 can be implemented as a random access memory, a read-only memory, a flash memory, a removable memory, or other types of storage elements, or a combination of such devices.

[0105] The head-mountable device 100 may also include a display 140 for displaying visual information to a user. The display 140 may provide visual (e.g., image or video) output. The display 140 may be or include an opaque, transparent, and / or translucent display. The display 140 may have a transparent or translucent medium through which light representing an image is directed to the user's eyes. The display 140 may utilize digital light projection, OLED, LED, uLED, liquid crystal on silicon, laser scanning light sources, or any combination of these technologies. The medium may be an optical waveguide, a hologram medium, an optical combiner, an optical reflector, or any combination thereof. In one embodiment, a transparent or translucent display may be configured to selectively become opaque. A projection-based system may employ retinal projection technology that projects a graphic image onto a person's retina. The projection system may also be configured to project a virtual object into a physical environment, such as a hologram or on a physical surface. The head-mountable device 100 may include an optical subassembly configured to help optically adjust and properly project image-based content displayed by the display 140 for close viewing. The optical subassembly may include one or more lenses, mirrors, or other optical devices.

[0106] The head mountable device 100 may also include a camera 130 for capturing a view of the external environment, as described herein. The view captured by the camera may be presented by the display 140 or otherwise analyzed to provide a basis for output on the display 140.

[0107] The head mountable device 100 may include an input / output component 186, which may include any suitable component for connecting the head mountable device 100 to other devices. Suitable components may include, for example, an audio / video jack, a data connector, or any additional or alternative input / output component. The input / output component 186 may include a button, a key, or another feature that may act as a keyboard for user operation.

[0108] The head mountable device 100 may include a microphone 188 as described herein. The microphone 188 may be operably connected to the processor 150 for detection of sound levels and communication of the detection for further processing, as further described herein.

[0109] The head mountable device 100 may include a speaker 190 as described herein. The speaker 190 may be operably connected to the processor 150 to control the speaker output, including the sound level, as further described herein.

[0110] The head mountable device 100 may include communication circuitry 192 for communicating with one or more servers or other devices using any suitable communication protocol. For example, the communication circuitry 192 may support Wi-Fi (e.g., 802.11 protocol), Ethernet, Bluetooth, high frequency systems (e.g., 900 MHz, 2.4 GHz, and 5.6 GHz communication systems), infrared, TCP / IP (e.g., any of the protocols used in each layer of the TCP / IP layer), HTTP, BitTorrent, FTP, RTP, RTSP, SSH, any other communication protocol, or any combination thereof. The communication circuitry 192 may also include an antenna for transmitting and receiving electromagnetic signals.

[0111] As described herein, the head mountable device 100 may include one or more HMD sensors 170 operable to identify, detect, and / or measure multiple regions of the face 10 .

[0112] The head mountable device 100 may include one or more pressure sensors 270 for detecting forces applied to areas of the user's face, as described herein.

[0113] The head mountable device 100 may include one or more head engagement sensors 122 for detecting tension or another condition in the head engagement device 120, as described herein.

[0114] The head mountable device 100 may include one or more other sensors. Such sensors may be configured to sense substantially any type of characteristic, such as, but not limited to, images, pressure, light, touch, force, temperature, position, motion, and the like. For example, the sensor may be a photodetector, a temperature sensor, a light or optical sensor, an atmospheric pressure sensor, a humidity sensor, a magnet, a gyroscope, an accelerometer, a chemical sensor, an ozone sensor, a particle count sensor, and the like. By further example, the sensor may be a biosensor for tracking biometric characteristics such as health and activity metrics. Other user sensors may perform facial feature detection, facial motion detection, facial recognition, eye tracking, user emotion detection, user emotion detection, voice detection, and the like. The sensor may include a camera 130 that may capture image-based content of the outside world.

[0115] The head mountable device 100 may include a haptic device 194 that provides tactile feedback with tactile sensations to the user. The haptic device 194 may be implemented as any suitable device configured to provide force feedback, vibration feedback, tactile sensations, etc. For example, in one embodiment, the haptic device 194 may be implemented as a linear actuator that is configured to provide intermittent tactile feedback, such as taps or knocks.

[0116] The head mountable device 100 may include a battery that may charge and / or power components of the head mountable device 100. The battery may also charge and / or power components connected to the head mountable device 100.

[0117] System 2 including head mountable device 100 may also include electronic device 300. Electronic device 300 may facilitate alignment detection, provide output to a user, and / or operate in conjunction with head mountable device 100 as described herein.

[0118] The electronic device 300 may include a processor 350 (e.g., a control circuit) having one or more processing units, which include or are configured to access a memory having instructions stored thereon. The instructions or computer program may be configured to perform one or more of the operations or functions described relative to the electronic device 300. The processor 350 may be implemented as any electronic device capable of processing, receiving or sending data or instructions. For example, the processor 350 may include one or more of the following: a processor, a microprocessor, a central processing unit (CPU), an application specific integrated circuit (ASIC), a digital signal processor (DSP), or a combination of such devices. As described herein, the term "processor" is intended to cover a single processor or processing unit, multiple processors, multiple processing units, or one or more other appropriately configured computing elements.

[0119] The electronic device 300 may include one or more external sensors 310 that are operable to identify, detect, and / or measure multiple areas of the face 10 and / or head-mountable device, as described herein. For example, the external sensor 310 may include a depth sensor, an IMU, etc.

[0120] The electronic device 300 may include a display 340 for displaying visual information to a user. The display 340 may provide visual (e.g., image or video) output. The display 340 may utilize digital light projection, OLED, LED, uLED, liquid crystal on silicon, laser scanning light source, or any combination of these technologies.

[0121] The electronic device 300 may include one or more cameras 330. The camera 330 may capture a view of the head mountable device 100 and / or the user. The view captured by the camera 330 may be presented by the display 340 or otherwise analyzed to provide a basis for output on the display 340.

[0122] The electronic device 300 may include a communication element 392 for communicating with one or more servers or other devices using any suitable communication protocol. For example, the communication element 392 may support Wi-Fi (e.g., 802.11 protocol), Ethernet, Bluetooth, high frequency systems (e.g., 1400 MHz, 2.4 GHz, and 5.6 GHz communication systems), infrared, TCP / IP (e.g., any of the protocols used in each layer of the TCP / IP layer), HTTP, BitTorrent, FTP, RTP, RTSP, SSH, any other communication protocol, or any combination thereof. The communication element 392 may also include an antenna for sending and receiving electromagnetic signals.

[0123] Thus, embodiments of the present disclosure provide a head-mounted device and / or another electronic device that can be operated to guide a user to position the head-mounted device in a manner that achieves proper alignment of components relative to the user and maximizes user comfort. For example, the head-mounted device and / or another device may include sensors for detecting features of the user's face, forces distributed on the face when worn, and / or alignment with the face (e.g., eyes). By further example, the head-mounted device and / or another device can detect changes in adjustments and infer user discomfort based on the frequency and / or amplitude of such changes. By further example, the head-mounted device and / or another device can detect changes in features of the user's face before, during, and / or after use of the head-mounted device.

[0124] For convenience, various examples of various aspects of the present disclosure are described as clauses below. These examples are provided by way of example and do not limit the subject technology.

[0125] Item A: A head-mountable device, comprising: a sensor configured to detect movement of the head-mountable device relative to a face; a processor configured to: determine whether the movement within a time period exceeds a threshold; and output an instruction to adjust the head-mountable device if the movement within the time period exceeds the threshold.

[0126] Item B: An electronic device comprising: a camera; a processor configured to: operate the camera to capture a first view of features of a face before a head-mounted device is applied; operate the camera to capture a second view of the features of the face after the head-mounted device is applied; determine whether a difference between the features in the first view and the features in the second view exceeds a threshold; and if the difference exceeds the threshold, output an instruction to adjust the head-mounted device.

[0127] Item C: A head-mounted device, comprising: a frame; a head connector configured to secure the frame to a face; a first sensor supported by the frame and configured to detect pressure between the frame and the face; a second sensor supported by the head connector and configured to detect tension in the head connector; and a processor configured to: determine whether at least one of the pressure or the tension exceeds a threshold; and if at least one of the pressure or the tension exceeds the threshold, output an instruction to adjust the head-mounted device.

[0128] One or more of the above clauses may include one or more of the following features. It should be noted that any of the following clauses may be combined with each other in any combination and placed in a corresponding independent clause, for example, clause A, B or C.

[0129] Clause 1: The sensor is an inertial measurement unit.

[0130] Clause 2: The sensor is a pressure sensor operable by the processor to detect pressure against the face.

[0131] Clause 3: The sensor is an eye sensor operable by the processor to capture a view of an eye.

[0132] Item 4: A frame supporting the sensor and the processor; and an optical seal for engaging the face, the optical seal being removably coupled to the frame, wherein the instructions include instructions to replace the optical seal with a different optical seal.

[0133] Clause 5: A frame supporting the sensor and the processor; and a head adapter configured to secure the frame to a head, wherein the instructions include instructions to adjust the head adapter.

[0134] Clause 6: A depth sensor, wherein the processor is further configured to operate the depth sensor to detect a detection area of ​​the face corresponding to the feature.

[0135] Clause 7: The processor is further configured to: detect whether the detection area of ​​the face corresponding to the feature is a target area for engagement of the head-mounted device; and if the detected area is not the target area, output the instruction to adjust the head-mounted device.

[0136] Item 8: The head-mounted device comprises: a frame supporting a display; and a head connector configured to secure the frame to the face, wherein the processor is further configured to: detect an angle between the head connector and the frame; and output the instruction to adjust the head-mounted device when the angle is within an additional threshold.

[0137] Item 9: The processor is further configured to: a frame supporting a display; and a head connector configured to secure the frame to the face, wherein the processor is further configured to: detect the distance between the head connector and the ear; and output the instruction to adjust the head-mounted device if the distance is within an additional threshold.

[0138] Clause 10: The difference between the feature in the first view and the feature in the second view comprises a difference in color.

[0139] Clause 11: The head-mountable device comprises: a frame that supports a display; and an optical seal that engages the face, the optical seal being removably connected to the frame, wherein the instructions include instructions to replace the optical seal with a different optical seal.

[0140] Clause 12: The head mountable device comprises: a frame supporting a display; and a head adapter configured to secure the frame to a head, wherein the instructions comprise instructions to adjust the head adapter.

[0141] Item 13: The first sensor is configured to detect a first pressure between the frame and a first area of ​​the face; and the head-mountable device also includes an additional sensor, which is supported by the frame and configured to detect a second pressure between the frame and a second area of ​​the face, wherein the processor is configured to output the instruction when the difference between the first pressure and the second pressure exceeds an additional threshold.

[0142] Item 14: A camera configured to detect features of the face, wherein the processor is further configured to: operate the camera to capture a first view of the features before the head-mountable device is applied; operate the camera to capture a second view of the features after the head-mountable device is applied; determine whether a difference between the features in the first view and the features in the second view exceeds an additional threshold; and output the instruction if the difference exceeds the additional threshold.

[0143] Clause 15: A light seal for engaging the face, the light seal containing the first sensor, the light seal removably coupled to the frame.

[0144] Clause 16: The instructions include instructions to replace the light seal with a different light seal.

[0145] Clause 17: The instructions include instructions to adjust the head engager.

[0146] As described above, one aspect of the present technology may include collecting and using data. The present disclosure contemplates that, in some instances, these collected data may include personal information or other data that uniquely identifies or can be used to locate or contact a specific person. The present disclosure contemplates that entities responsible for collecting, disclosing, analyzing, storing, transmitting, or otherwise using such personal information or other data will comply with established privacy policies and / or privacy practices. The present disclosure also contemplates embodiments in which users can selectively block the use or access of personal information or other data (e.g., managed to minimize the risk of unintentional or unauthorized access or use).

[0147] Unless otherwise specified, an element mentioned in the singular does not mean unique, but refers to one or more. For example, "a" module may refer to one or more modules. An element prefixed with "a", "an", "the" or "said" does not exclude the existence of additional identical elements without further limitations.

[0148] Headings and subheadings, if any, are used for convenience only and do not limit the invention. The word "exemplary" is used to mean used as an example or illustration. To the extent that the terms "including," "having," and the like are used, such terms are intended to be inclusive in a manner similar to the term "comprising" as being interpreted to include when used as transition words in the claims. Relational terms such as "first" and "second," and the like may be used to distinguish one entity or action from another without necessarily requiring or implying any actual such relationship or order between such entities or actions.

[0149] Phrases such as aspect, this aspect, another aspect, some aspects, one or more aspects, a specific implementation, this specific implementation, another specific implementation, some specific implementations, one or more specific implementations, an embodiment, this embodiment, another embodiment, some embodiments, one or more embodiments, configuration, this configuration, another configuration, some configurations, one or more configurations, subject technology, disclosure, the present disclosure, other variations, etc. are for convenience and do not mean that the disclosure involving such one or more phrases is essential to the subject technology, or that such disclosure applies to all configurations of the subject technology. Disclosures involving such one or more phrases may apply to all configurations or one or more configurations. Disclosures involving such one or more phrases may provide one or more examples. Phrases such as aspect or some aspects may refer to one or more aspects, and vice versa, and this applies similarly to the other aforementioned phrases.

[0150] The phrase "at least one" preceding a list of items, with any of the items separated by the terms "and" or "or," modifies the list as a whole rather than each member of the list. The phrase "at least one" does not require selection of at least one item; rather, the phrase allows for a meaning that includes at least one of any one item and / or at least one of any combination of items and / or at least one of each item. By way of example, each of the phrases "at least one of A, B, and C" or "at least one of A, B, or C" refers to A only, B only, or C only; any combination of A, B, and C; and / or at least one of each of A, B, and C.

[0151] It should be understood that the specific order or level of the disclosed steps, operations or processes is an illustration of an exemplary method. Unless otherwise clearly stated, it is understandable that the specific order or level of steps, operations or processes can be performed in different orders. Some of the steps, operations or processes can be performed simultaneously. The attached method claims (if any) present the elements of each step, operation or process in an exemplary order, and are not meant to be limited to the specific order or level presented. These can be performed in serial, linear, parallel or different orders. It should be understood that the instructions, operations and systems described can usually be integrated together in a single software / hardware product, or be packaged in multiple software / hardware products.

[0152] In one aspect, the term "coupled" or the like may refer to a direct connection. On the other hand, the term "coupled" or the like may refer to an indirect connection.

[0153] Terms such as top, bottom, front, back, side, horizontal, vertical, etc. refer to an arbitrary frame of reference, not the usual gravitational frame of reference. Thus, such terms may extend upward, downward, diagonally, or horizontally in a gravitational frame of reference.

[0154] The present disclosure is provided to enable those skilled in the art to practice the various aspects described herein. In some cases, well-known structures and components are shown in block diagram form to avoid blurring the concepts of the subject technology. The present disclosure provides various examples of the subject technology, and the subject technology is not limited to these examples. Various modifications of these aspects will be apparent to those skilled in the art, and the principles described herein may be applied to other aspects.

[0155] All structural and functional equivalents to the elements of the various aspects described throughout this disclosure that are known or later become known to those of ordinary skill in the art are expressly incorporated herein by reference and are intended to be covered by the claims. In addition, nothing disclosed herein is intended to be made available to the public regardless of whether the disclosure is explicitly stated in the claims. Pursuant to 35 U.S.C. §112, paragraph 6, no claim element shall be construed unless the element is expressly stated using the phrase "a method for" or, in the case of a method claim, the element is stated using the phrase "a step for."

[0156] The title, background, brief description of the drawings, abstract, and drawings are hereby incorporated into the present disclosure and are provided as illustrative examples of the present disclosure, rather than as limiting descriptions. It is believed that they will not be used to limit the scope or meaning of the claims. In addition, it can be seen in the detailed description that, for the purpose of simplifying the present disclosure, the description provides illustrative examples, and various features are combined together in various specific implementations. The disclosed method should not be interpreted as reflecting the intention that the claimed subject matter requires more features than those expressly recited in each claim. On the contrary, as reflected in the claims, the inventive subject matter lies in less than all the features of a single disclosed configuration or operation. The claims are thereby incorporated into the specific embodiments, with each claim itself as a separately claimed subject matter.

[0157] The claims are not intended to be limited to the aspects described herein, but are to be given the full scope consistent with the language of the claims and encompassing all legal equivalents. Nevertheless, none of the claims encompass subject matter that is inconsistent with applicable patent law requirements and should not be interpreted in such a manner.

Claims

1. A head-mounted device, comprising: a sensor configured to detect movement of the head-mountable device relative to a face; A processor, the processor being configured to: determining whether the movement within a time period exceeds a threshold; and If the movement within the time period exceeds the threshold, an instruction to adjust the head mountable device is output.

2. The head-mountable device of claim 1, wherein the sensor is an inertial measurement unit.

3. The head mountable device of claim 1, wherein the sensor is a pressure sensor operable by the processor to detect pressure against the face.

4. A head-mountable device according to claim 1, wherein the sensor is an eye sensor operable by the processor to capture a view of an eye.

5. The head mountable device according to claim 1, further comprising: a frame supporting the sensor and the processor; as well as A light seal for engaging the face portion, the light seal being removably coupled to the frame, wherein the instructions include instructions for replacing the light seal with a different light seal.

6. The head mountable device according to claim 1, further comprising: a frame supporting the sensor and the processor; as well as A head adapter is configured to secure the frame to a head, wherein the instructions include instructions to adjust the head adapter.

7. An electronic device comprising: camera; A processor, the processor being configured to: operating the camera to capture a first view of features of the face prior to applying the head mountable device; operating the camera to capture a second view of the feature of the face after applying the head mountable device; determining whether a difference between the feature in the first view and the feature in the second view exceeds a threshold; as well as If the difference exceeds the threshold, an instruction to adjust the head mountable device is output.

8. The electronic device of claim 7, further comprising a depth sensor, wherein the processor is further configured to operate the depth sensor to detect a detection area of ​​the face corresponding to the feature.

9. The electronic device according to claim 8, wherein the processor is further configured to: detecting whether the detection area of ​​the face corresponding to the feature is a target area for engagement by the head mountable device; and If the detected area is not the target area, the instruction to adjust the head mountable device is output.

10. The electronic device according to claim 7, wherein the head-mountable device comprises: a frame supporting a display; as well as a head adapter configured to secure the frame to the face, The processor is further configured to: detecting an angle between the head engager and the frame; and If the angle is within an additional threshold, outputting the instruction to adjust the head mountable device.

11. The electronic device according to claim 7, wherein the processor is further configured to: a frame supporting the display; and a head adapter configured to secure the frame to the face, The processor is further configured to: detecting a distance between the head adapter and the ear; and If the distance is within an additional threshold, outputting the instruction to adjust the head mountable device. 12 . The electronic device of claim 7 , wherein the difference between the feature in the first view and the feature in the second view comprises a difference in color.

13. The electronic device according to claim 7, wherein the head-mountable device comprises: a frame supporting a display; as well as A light seal for engaging the face portion, the light seal being removably coupled to the frame, wherein the instructions include instructions for replacing the light seal with a different light seal.

14. The electronic device according to claim 7, wherein the head-mountable device comprises: a frame supporting a display; as well as A head adapter is configured to secure the frame to a head, wherein the instructions include instructions to adjust the head adapter.

15. A head-mountable device, comprising: frame; a head adapter configured to secure the frame to a face; a first sensor supported by the frame and configured to detect pressure between the frame and the face; a second sensor supported by the head engager and configured to detect tension in the head engager; as well as A processor, the processor being configured to: determining whether at least one of the pressure or the tension exceeds a threshold; and If at least one of the pressure or the tension exceeds the threshold, an instruction to adjust the head mountable device is output.

16. The head mountable device according to claim 15, wherein: The first sensor is configured to detect a first pressure between the frame and a first area of ​​the face; and The head-mountable device also includes an additional sensor supported by the frame and configured to detect a second pressure between the frame and a second area of ​​the face, wherein the processor is configured to output the instruction if the difference between the first pressure and the second pressure exceeds an additional threshold.

17. The head mountable device of claim 15, further comprising a camera configured to detect features of the face, wherein the processor is further configured to: operating the camera to capture a first view of the feature prior to applying the head mountable device; operating the camera to capture a second view of the feature after applying the head mountable device; determining whether a difference between the feature in the first view and the feature in the second view exceeds an additional threshold; as well as If the difference exceeds the additional threshold, the instruction is output.

18. The head mountable device of claim 15, further comprising an optical seal for engaging the face, the optical seal containing the first sensor, the optical seal being removably coupled to the frame.

19. The head mountable device of claim 18, wherein the instructions include instructions to replace the optical seal with a different optical seal.

20. The head mountable device of claim 15, wherein the instructions include instructions to adjust the head adapter.

Images