System with display and sensor hiding structure

Abstract

The invention relates to a system with a display and sensor hiding structure. A head-mounted device may have a head-mounted support structure. A rear-facing display may present an image to an eye-fit zone at the rear of the head-mounted support structure. A forward-facing common visual display may be supported on a front side of the head-mounted support structure, away from the back-facing display. The forward-facing display may have pixels formed in an active area in which an image is displayed, and may have an annular inactive boundary area surrounding the pixels. A decorative cover structure, such as an annular shroud member, may overlap the optical component in the ineffective boundary region. The optical component may be received within a through-hole opening in the decorative cover structure and / or may be operated through a transparent portion of the decorative cover structure.

Description

[0001] This application is a divisional application of the invention patent application with application number 202180078238.4, application date September 8, 2021, and invention title "System with Hidden Structure of Display and Sensor".

[0002] This patent application claims priority to U.S. Provisional Patent Application No. 63 / 081,225, filed on September 21, 2020, which is incorporated herein by reference in its entirety. Technical Field

[0003] This disclosure relates generally to electronic devices, and more specifically to electronic devices such as head-mounted devices. Background Technology

[0004] Electronic devices, such as head-mounted devices, may have input-output components. These input-output components may include components such as displays and sensors. Summary of the Invention

[0005] A head-mounted device may have a head-mounted support structure. A rear-facing display can present images to an eye box at the rear of the head-mounted support structure. A front-facing common view display can be supported on the front side of the head-mounted support structure, away from the rear-facing displays.

[0006] The forward-facing display may have pixels forming an effective area in which an image is displayed, and may have an annular ineffective area surrounding these pixels. A display overlay may overlap with the effective area and the ineffective area.

[0007] Optical components can operate through the overlay in the ineffective area. These optical components may include scintillation sensors, ambient light sensors, cameras, 3D image sensors such as structured light 3D sensors and time-of-flight 3D image sensors, and infrared illumination systems that provide infrared illumination for the tracking camera under dim ambient lighting conditions.

[0008] Decorative overlay structures, such as ring-shaped covers, can overlap with optical components in the invalid area. The ring-shaped cover can be mounted adjacent to the display overlay in the invalid area.

[0009] These optical components can be received within through-hole openings in the housing and / or operated through transparent portions of the housing. These transparent portions can be formed from a polymer material in the housing, from window components such as glass components inserted into window openings in the housing, and / or from other transparent structures. A coating can be formed on the portions of the housing that overlap with the optical components to help conceal these overlapping components so that they are not visible, while allowing them to operate satisfactorily. Attached Figure Description

[0010] Figure 1 It is a side view of an exemplary electronic device, such as a head-mounted device, according to one implementation scheme.

[0011] Figure 2 It is a schematic diagram of an exemplary system with electronic equipment according to one implementation scheme.

[0012] Figure 3 This is a front view of an exemplary head-mounted device according to one implementation scheme.

[0013] Figure 4 This is a front view of an illustrative shield according to one implementation scheme.

[0014] Figure 5 This is a front view of a portion of an exemplary shield with a curved perimeter according to one embodiment.

[0015] Figure 6 It is a front view of a portion of an exemplary front display according to one implementation scheme.

[0016] Figure 7 This is a cross-sectional top view of a portion of an exemplary display according to one embodiment.

[0017] Figure 8 This is a cross-sectional top view of a portion of an exemplary head-mounted device having a display and a shield according to one embodiment.

[0018] Figure 9 It is a cross-sectional side view of a portion of an exemplary shield having through-hole openings for accommodating optical components, according to one embodiment.

[0019] Figure 10 This is a cross-sectional side view of a portion of an exemplary shield having a window member with a through-hole opening according to one embodiment.

[0020] Figure 11 This is a cross-sectional side view of a portion of a head-mounted device with a cover over the display, according to one embodiment.

[0021] Figure 12 This is a cross-sectional side view of an exemplary head-mounted device optical component mounting arrangement with an optical component window coating according to one embodiment.

[0022] Figure 13 This is a cross-sectional side view of an exemplary head-mounted device optical component mounting arrangement using a shield through-hole opening according to one embodiment.

[0023] Figure 14It is a cross-sectional side view of an exemplary head-mounted device optical component mounting arrangement according to one embodiment, having a window formed by a transparent window component (such as a coated glass layer or a light-transmitting polymer layer). Detailed Implementation

[0024] Head-mounted devices may include a head-mounted support structure that allows the device to be worn on a user's head. The head-mounted device may have a display supported by the head-mounted support structure for presenting visual content to the user. The display may include a rear-facing display that presents images to an eye-fitting area at the rear of the head-mounted support structure. The display may also include a forward-facing display. The forward-facing display may be mounted to the front of the head-mounted support structure and can be viewed by the user when the head-mounted device is not worn on the user's head. Forward-facing displays, sometimes referred to as public-viewable displays, may also be viewable by others near the head-mounted device.

[0025] Optical components, such as image sensors and other light sensors, can be housed in the head-mounted device. In an exemplary configuration, the optical components are mounted below the peripheral portion of the display cover that protects the front-facing display.

[0026] Figure 1 This is a side view of an illustrative head-mounted electronic device. (Example:) Figure 1 As shown, the head-mounted device 10 may include a head-mounted support structure 26. The head-mounted support structure 26 may have walls or other structures that separate internal regions of the device 10, such as internal region 42, from external regions surrounding the device 10, such as external region 44. Electrical components 40 (e.g., integrated circuits, sensors, control circuits, light-emitting diodes, lasers and other light-emitting devices, other control circuits and input-output devices, etc.) may be mounted on printed circuits and / or other structures within the device 10 (e.g., in internal region 42).

[0027] To present an image to a user for viewing from an eye-fitting zone, such as eye-fitting zone 34, device 10 may include a rear-facing display, such as display 14R, and lenses, such as lens 38. These components may be mounted in an optical module, such as optical module 36 (e.g., a lens barrel), to form a corresponding left and right optical system. For example, there may be a left rear-facing display for presenting an image to the user's left eye via a left lens in the left eye-fitting zone and a right rear-facing display for presenting an image to the user's right eye in the right eye-fitting zone. When the head-mounted support structure 26 rests against the outer surface of the user's face (face surface 30), the user's eyes are located in the eye-fitting zone 34 at the rear R of device 10.

[0028] The headband support structure 26 may include a main support structure, such as a main shell portion 26M (sometimes referred to as the main portion or shell). The main shell portion 26M may extend from the front side F of the device 10 to the opposite rear side R of the device 10. On the rear side R, the main shell portion 26M may have a padded structure to enhance user comfort when the portion 26M rests against the facial surface 30. If desired, the headband support structure 26 may include an optional headband, such as a strap 26B, and / or other structures that allow the device 10 to be worn on the user's head.

[0029] Device 10 may have a publicly visible, front-facing display, such as display 14F mounted on the front side F of the main housing portion 26M. When the user is not wearing device 10, display 14F may be viewable by the user and / or may be viewable by others near device 10. As an example, display 14F may be visible on the front side F of device 10 to an external viewer, such as viewer 50 viewing device 10 in direction 52.

[0030] exist Figure 2 The diagram illustrates an exemplary system that may include a head-mounted device. Figure 2 As shown, system 8 may have one or more electronic devices 10. Device 10 may include a head-mounted device (e.g., Figure 1 Device 10), accessories such as controllers and headsets, computing equipment (e.g., cellular phones, tablet computers, laptop computers, desktop computers and / or telecomputing equipment that supplies content to the head-mounted device) and / or other devices that communicate with each other.

[0031] Each electronic device 10 may have a control circuit 12. The control circuit 12 may include storage and processing circuitry for controlling the operation of the device 10. The control circuit 12 may include storage devices such as hard disk drive storage devices, non-volatile memory (e.g., electrically programmable read-only memory configured to form a solid-state drive), volatile memory (e.g., static or dynamic random access memory), etc. The processing circuitry in the control circuit 12 may be based on one or more microprocessors, microcontrollers, digital signal processors, baseband processors, power management units, audio chips, graphics processing units, application-specific integrated circuits (ASICs), and other integrated circuits. Software code may be stored on the storage devices in the control circuit 12 and run on the processing circuitry in the control circuit 12 to implement control operations for the device 10 (e.g., data acquisition operations, operations involving adjusting components of the device 10 using control signals, etc.). The control circuit 12 may include wired and wireless communication circuitry. For example, the control circuit 12 may include radio frequency transceiver circuitry, such as cellular telephone transceiver circuitry, wireless local area network transceiver circuitry (e.g., WiFi). ® Circuits), millimeter-wave transceiver circuits, and / or other wireless communication circuits.

[0032] During operation, the communication circuitry of the devices in System 8 (e.g., the communication circuitry of the control circuitry 12 of Device 10) can be used to support communication between electronic devices. For example, one electronic device can transmit video data, audio data, control signals, and / or other data to another electronic device in System 8. The electronic devices in System 8 can use wired and / or wireless communication circuitry to communicate over one or more communication networks (e.g., the Internet, a local area network, etc.). The communication circuitry can be used to allow Device 10 to receive data from and / or provide data to external equipment (e.g., tethered computers, portable devices such as handheld devices or laptops, online computing equipment such as remote servers or other remote computing equipment, or other electrical equipment).

[0033] Each device 10 in system 8 may include an input-output device 22. The input-output device 22 may be used to allow a user to provide user input to the device 10. The input-output device 22 may also be used to acquire information about the environment in which the device 10 operates. Output components in the input-output device 22 may allow the device 10 to provide output to a user and may be used to communicate with external electrical equipment.

[0034] like Figure 2 As shown, input-output device 22 may include one or more displays, such as display 14. Display 14 may include a rear-facing display, such as... Figure 1 The display 14R. Device 10 may include, for example, left and right components such as a left scanning mirror display device and a right scanning mirror display device or other image projector, a silicon-based liquid crystal display device, a digital mirror device or other reflective display device; a left and right display panel based on a light-emitting diode pixel array (e.g., a thin-film organic light-emitting display having a polymer or semiconductor substrate such as a silicon substrate, or a display device based on a pixel array formed from a crystalline semiconductor light-emitting diode die); a liquid crystal display panel; and / or other left and right display devices that provide images to the left and right eye-adaptive regions for viewing by the user's left and right eyes respectively. Display components such as these components (e.g., a thin-film organic light-emitting display having a flexible polymer substrate or a display based on a pixel array formed from a crystalline semiconductor light-emitting diode die on a flexible substrate) may also be used to form the front-facing display of device 10, such as... Figure 1 The 14F monitor (sometimes referred to as a front-facing monitor, front monitor, or public viewing monitor).

[0035] During operation, display 14 (e.g., display 14R and / or 14F) can be used to display visual content (e.g., still and / or moving images, text, graphics, movies, games, and / or other visual content, including pictures and pass-through video from camera sensors) to the user of device 10. The content presented on display 14 may include, for example, virtual objects and other content provided to display 14 by control circuitry 12. This virtual content may sometimes be referred to as computer-generated content. Computer-generated content may be displayed in the absence of real-world content, or may be combined with real-world content. In some configurations, real-world images may be captured by a camera (e.g., a forward-facing camera, sometimes referred to as a front-facing camera), and computer-generated content may be electronically overlaid on portions of the real-world image (e.g., when device 10 is a virtual reality headset).

[0036] Input-output device 22 may include sensor 16. Sensor 16 may include, for example, a 3D sensor (e.g., a 3D image sensor such as a structured light sensor that emits a light beam and uses a 2D digital image sensor to acquire image data for a 3D image from a point or other light spot generated when a target is illuminated by the light beam, a binocular 3D image sensor that uses two or more cameras in a binocular imaging arrangement to acquire 3D images, a 3D lidar (light detection and ranging) sensor (sometimes referred to as a time-of-flight camera or 3D time-of-flight camera), a 3D radio frequency sensor, or other sensors that acquire 3D image data), a camera (e.g., a 2D infrared and / or visible digital image sensor), and a gaze tracking sensor (e.g., a gaze tracking system based on an image sensor and, if necessary, also based on a light source emitting one or more light beams, which, after reflection from the user's eye, use an image). Sensors include: tracking sensors, touch sensors, capacitive proximity sensors, light-based (optical) proximity sensors, other proximity sensors, force sensors (e.g., strain gauges, capacitive force sensors, resistive force sensors, etc.), sensors such as switch-based contact sensors, gas sensors, pressure sensors, humidity sensors, magnetic sensors, audio sensors (microphones), ambient light sensors, flicker sensors that acquire time-varying information about ambient lighting conditions such as the presence of time-varying ambient light intensity associated with artificial lighting, microphones for acquiring voice commands and other audio inputs, sensors configured to acquire information about motion, position, and / or orientation (e.g., accelerometers, gyroscopes, compasses, and / or inertial measurement units that include all of these sensors or a subgroup of one or both of these sensors), and / or other sensors.

[0037] User input and other information can be acquired using sensors and other input devices in input-output device 22. If desired, input-output device 22 may include other devices 24 such as haptic output devices (e.g., vibrating components), light-emitting diodes, lasers and other light sources (e.g., light-emitting devices that emit light to illuminate the environment surrounding device 10 when ambient light levels are low), speakers such as earphones for generating audio output, circuitry for receiving wireless power, circuitry for wirelessly transmitting power to other devices, batteries and other energy storage devices (e.g., capacitors), joysticks, buttons and / or other components.

[0038] Such as combination Figure 1 As described, the electronic device 10 may have a head-mounted support structure such as a head-mounted support structure 26 (e.g., a head-mounted housing structure such as a housing wall, strap, etc.). The head-mounted support structure may be configured to be worn on a user's head during operation of the device 10 (e.g., against the user's face, thereby covering the user's eyes) and may support a display 14, a sensor 16, other devices 24, other input-output devices 22, and control circuitry 12 (e.g., see...). Figure 1 Component 40 and optical module 36).

[0039] Figure 3 This is a front view of device 10 in an exemplary configuration, where device 10 has a common visual display such as display 14F. Figure 3 As shown, the support structure 26M of device 10 may have right and left portions such as 26R and 26L, which are connected by an inserted nose bridge portion such as 26NB. The portion 26NB may have a curved outer surface such as a nose bridge surface 90, which is configured to receive and rest against the user's nose to help support the main housing portion 26M on the user's head.

[0040] The display 14F may have active areas configured to display images, such as an active area AA, and inactive areas IA where no images are displayed. The outline of the active area AA may be rectangular, a rectangle with rounded corners, teardrop-shaped portions on the left and right sides of the device 10, a shape with straight edges, a shape with curved edges, a shape with peripheral edges having both straight and curved portions, and / or other suitable outlines. Figure 3 As shown, the effective area AA may have a curved recess at the bridge portion 26NB of the main housing portion 26. The presence of the nose-shaped recess in the effective area AA helps to fit the effective area AA within the available space of the housing portion 26M without unduly restricting the size of the effective area AA.

[0041] The effective area AA contains a pixel array. Pixels can be, for example, light-emitting diode pixels formed on a flexible display panel substrate using thin-film organic light-emitting diodes or crystalline semiconductor light-emitting diode dies (sometimes referred to as micro-light-emitting diodes). If desired, configurations in which the display 14F uses other display technologies may also be used. Exemplary arrangements of light-emitting diode displays, such as organic light-emitting diode displays formed on a flexible substrate (e.g., a substrate formed from a bendable polyimide layer or other flexible polymer sheet), are sometimes described herein as examples. Pixels in the effective area AA can be formed in a display device such as... Figure 3 On the display panel 14P (e.g., a flexible organic light-emitting diode display panel). In some configurations, the outline of the effective area AA (and optionally the display panel 14P) may have a peripheral edge comprising straight segments or a combination of straight and curved segments. A configuration in which the entire outline of the effective area AA (and optionally the display panel 14P) is characterized by a curved peripheral edge may also be used.

[0042] The display 14F may have invalid areas, such as invalid area IA, that do not contain pixels and do not display images. Invalid area IA may form an invalid boundary area extending along one or more portions of the peripheral edge of valid area AA. Figure 3 In an exemplary configuration, the invalid region IA has an annular shape surrounding the valid region AA and forming an invalid boundary. In this type of arrangement, the width of the invalid region IA can be relatively constant, and the inner and outer edges of the region IA can be characterized by straight and / or curved segments, or can be curved along the entire length of the edge. For example, the outer edge of the region IA (e.g., the periphery of the display 14F) can have a curved profile extending parallel to the curved edge of the valid region AA.

[0043] In some configurations, device 10 may operate in conjunction with other devices in system 8, such as wireless controllers and other accessories. These accessories may have magnetic sensors that sense the direction and intensity of magnetic fields. Device 10 may have one or more electromagnets configured to emit magnetic fields. The magnetic fields may be measured by wireless accessories near device 10, allowing the accessories to determine their orientation and position relative to device 10. This allows the accessories to wirelessly provide device 10 with real-time information about their current location, orientation, and movement, enabling the accessories to function as wireless controllers. Accessories may include wearable devices, handheld devices, and other input devices.

[0044] In an exemplary configuration, device 10 may have a coil, such as exemplary coil 54, extending around the periphery of display 14F (e.g., below the inactive area IA or other portion of display 14F). Coil 54 may have any suitable number of turns (e.g., 1-10, at least 2, at least 5, at least 10, 10-50, less than 100, less than 25, less than 6, etc.). These turns may be formed on a substrate by metal traces, by wires, and / or by other conductive lines. During operation, control circuitry 12 may supply an alternating current (AC) drive signal to coil 54. The drive signal may have a frequency of at least 1 kHz, at least 10 kHz, at least 100 kHz, at least 1 MHz, less than 10 MHz, less than 3 MHz, less than 300 kHz, or less than 30 kHz (as an example). When AC current flows through coil 54, a corresponding magnetic field is generated near device 10. Electronic devices located near device 10, such as wireless controllers with magnetic sensors, can use the magnetic field as a reference, enabling the wireless controllers to determine their orientation, position, and / or movement relative to device 10 to provide input to device 10.

[0045] As an example, consider a handheld wireless controller used to control the operation of device 10. During operation, device 10 uses coil 54 to emit a magnetic field. When the handheld wireless controller is moved, the controller's magnetic sensor can monitor the controller's position and movement relative to device 10 by monitoring the strength, orientation, and changes in strength and / or orientation of the magnetic field emitted by coil 54 as the user moves the controller through the air. The electronic device can then wirelessly transmit information about the controller's position and orientation to device 10. In this way, the user can manipulate the handheld controller, wearable controller, or other external accessories to provide air gestures, pointing inputs, directional inputs, and / or other user inputs to device 10.

[0046] Device 10 may have optical components (e.g., Figure 2The components of the optical sensor (among the components of sensor 16) can be mounted in any suitable location on the head-mounted support structure 26 (e.g., on headband 26B, on main housing portion 26M, etc.). Optical components and other components can be rear-facing (e.g., when mounted on the back of device 10), side-facing (e.g., left or right), down-facing or up-facing, front-facing (e.g., when mounted on the front of device 10), mounted in any combination of these directions (e.g., forward, right, and down), and / or mounted in other suitable orientations. In an exemplary configuration, at least some of the components of device 10 are mounted outwardly facing forward (and optionally side-facing and / or up and down). For example, a forward-facing camera for through-video can be configured to be mounted on the left and right sides of the front of device 10, in which the cameras diverge slightly along the horizontal dimension such that the fields of view of these cameras overlap to some extent when capturing a wide-angle image of the environment in front of device 10. If needed, the captured images may include portions of the user’s surrounding environment below, above, and to the sides of the area directly in front of the device 10.

[0047] To help conceal components such as optical elements from the outside of device 10, it is desirable to cover some or all of these components with a decorative overlay structure. The overlay structure may include transparent portions (e.g., windows for optical elements) characterized by sufficient optical transparency to allow the overlapping optical elements to operate satisfactorily. For example, an ambient light sensor may be covered with a layer that appears opaque to an external viewer to help conceal the sensor from view, but allows sufficient ambient light to pass through to enable satisfactory ambient light measurements. As another example, optical elements emitting infrared light may be overlapped with a visually opaque material that is transparent to infrared light.

[0048] In the exemplary configuration, the optical components of device 10 can be mounted on... Figure 3In the invalid region IA, the decorative overlay structure can be formed as an annular shape overlapping the optical components in the invalid region IA. The decorative overlay structure can be formed from ink, polymer structures, including metals, glass, other materials, and / or combinations of these materials. In an exemplary configuration, the decorative overlay structure can be formed from an annular member having an area matching the occupied area of ​​the invalid region IA. For example, if the valid region AA includes a left and right portion having a teardrop shape, the annular member can have a curved edge following the curved periphery of the teardrop-shaped portion of the valid region AA. The annular member can be formed from one or more polymer structures (e.g., the annular member can be formed from a polymer ring). Because the annular member helps to conceal the overlapping components so that they are not visible, the annular member is sometimes referred to as a shield or annular shield member. The appearance of the shield or other decorative overlay structure can be characterized by neutral colors (white, black, or gray) or non-neutral colors (e.g., blue, red, green, gold, rose gold, etc.).

[0049] If needed, the display 14F may have a protective display overlay. The overlay may overlap with the active area AA and the inactive area IA (e.g., when viewed from...). Figure 1 The entire front surface of the device 10 during observation in direction 52 may be covered by a covering layer. The covering layer, sometimes referred to as the outer shell wall or transparent outer shell wall, may have a rectangular outline, an outline with teardrop portions, an elliptical outline, or other shapes with curved and / or straight edges.

[0050] The cover layer may be formed of transparent materials such as glass, polymers, transparent crystalline materials such as sapphire, light-transmitting ceramics, other transparent materials, and / or combinations of these materials. As an example, the protective display cover layer of display 14F may be formed of safety glass (e.g., laminated glass comprising a light-transmitting glass layer and a laminated polymer film). Optional coatings may be applied to the surface of the display cover layer. If desired, the display cover layer may be chemically strengthened (e.g., using an ion-exchange process to form a scratch-resistant outer material layer under compressive stress). In some configurations, the display cover layer may be formed of a stack of two or more material layers (e.g., a first structural glass layer and a second structural glass layer, a rigid polymer layer bonded to a glass layer or another rigid polymer layer, etc.) to enhance the performance of the cover layer.

[0051] In the effective area AA, the display overlay may overlap with the pixels of the display panel 14P. The display overlay in the effective area AA is preferably transparent to allow viewing of the image presented on the display panel 14P. In the ineffective area IA, the display overlay may overlap with an annular shield or other decorative overlay structure. The shield and / or other overlay structure (e.g., an opaque ink coating on the inner surface of the display overlay and / or structure) may be sufficiently opaque to help conceal some or all of the optical components in the ineffective area IA so that they are not visible. Windows may be provided in the shield or other decorative overlay structure to help ensure satisfactory operation of the optical components overlapped by these structures. Windows may be formed by apertures, may be formed by areas of the shield or other decorative overlay structure that have been locally thinned to enhance light transmittance, may be formed by window members with desired light transmittance characteristics that have been inserted into mating openings in the shield, and / or may be formed by other shield window structures.

[0052] exist Figure 3 In the example, device 10 includes optical components such as optical components 60, 62, 64, 66, 68, 70, 72, 74, 76, 78, and 80 (as an example). These optical components (e.g., from...) Figure 2 Each optical component in the selected optical sensor, light-emitting device, etc. of the sensor 16 can be configured to detect light and, if necessary, to emit light (e.g., ultraviolet, visible, and / or infrared light).

[0053] In an exemplary configuration, optical component 60 can sense ambient light (e.g., visible ambient light). Specifically, optical component 60 may have a photodetector that senses changes in ambient light intensity over time. As an example, if a user is operating in an environment with an artificial light source, the light source may emit light at a frequency associated with its wall power supply (e.g., 60 Hz AC mains). The photodetector of optical component 60 can sense the artificial light from the artificial light source, characterized by intensity fluctuations at 60 Hz. Control circuitry 12 can use this information to adjust clocks or other timing signals associated with the operation of the image sensor in device 10 to help avoid unwanted interference between the light source frequency and the frame rate or other frequencies associated with image capture operations. Control circuitry 12 can also use measurements from optical component 60 to help identify the presence and type of artificial light. In this way, control circuitry 12 can detect the presence of light such as fluorescence or other light with known non-ideal color characteristics and can compensate for color shift adjustments (e.g., white point adjustment) for color-sensitive components such as cameras and displays. Because the optical component 60 can measure fluctuations in light intensity, it is sometimes referred to as a flicker sensor or an ambient light frequency sensor.

[0054] Optical component 62 may be an ambient light sensor. The ambient light sensor may include one or more photodetectors. In a single photodetector configuration, the ambient light sensor may be a monochromatic sensor that measures ambient light intensity. In a multi-photodetector configuration, each photodetector may be composed of overlapping optical filters that allow different wavelength bands (e.g., different visible and / or infrared passbands) to pass through. The optical filter passbands may overlap at their edges. This allows optical component 62 to function as a color ambient light sensor that measures both ambient light intensity and ambient light color (e.g., by measuring the color coordinates of the ambient light). During operation of device 10, control circuitry 12 may take action based on the measured ambient light intensity and color. As an example, the white point of a display or image sensor may be adjusted based on the measured ambient light color, or other display or image sensor color adjustments may be performed. The intensity of the display may be adjusted based on light intensity. For example, the brightness of display 14F may be increased under bright ambient light conditions to enhance the visibility of the image on the display, and the brightness of display 14F may be decreased under dim lighting conditions to save power. Image sensor operation and / or light source operation may also be adjusted based on ambient light readings.

[0055] The optical components in the effective area IA may also include components along the sides of the device 10, such as optical components 80 and 64. Optical components 80 and 64 may be pose tracking cameras used to help monitor the orientation and movement of the device 10. Optical components 80 and 64 may be visible light cameras (and / or cameras sensitive to visible and infrared wavelengths) and may be combined with an inertial measurement unit to form a visual inertial odometry (VIO) system.

[0056] Optical components 78 and 66 may be visible light cameras that capture real-time images of the environment surrounding device 10. These cameras, sometimes referred to as scene cameras or pass-through video cameras, capture moving images when the user's eyes are positioned within the eye-fitting zone 34 at the rear of device 10. These moving images are displayed in real-time on display 14R for the user's viewing. By displaying pass-through images (pass-through video) to the user in this manner, real-time information about the user's surroundings is provided. If desired, virtual content (e.g., computer-generated images) may be overlaid on a portion of the pass-through video. Device 10 can also operate in a non-pass-through video mode, in which optical components 78 and 66 are turned off, and only movie content, game content, and / or other virtual content that does not contain real-time real-world images are presented to the user.

[0057] The input-output device 22 of device 10 can acquire user input for controlling the operation of device 10. As an example, a microphone in device 10 can acquire voice commands. Buttons, touch sensors, force sensors, and other input devices can acquire user input from a user's finger or other external object touching device 10. In some configurations, it may be desirable to monitor the user's gestures or other body parts' movements. This allows the user's hand position or other body part position to be replicated in games or other virtual environments, and allows the user's hand movements to act as gestures (air gestures) for controlling the operation of device 10. Cameras operating in visible and infrared wavelengths, such as tracking cameras (e.g., optics 76 and 68), can be used to capture user input such as gesture input. Tracking cameras such as these can also track references and other identifiable features on these controllers and other external accessories (attached device 10 of system 8) during the use of controllers to control the operation of device 10. If needed, the tracking camera can help determine the position and orientation of a handheld or wearable controller that senses its position and orientation by measuring the magnetic field generated by coil 54. The use of a tracking camera can therefore help track hand movements and controller movements used to move pointers and other virtual objects displayed to the user, and can otherwise assist in the operation of the control device 10.

[0058] The tracking camera can operate satisfactorily in the presence of sufficient ambient light (e.g., bright visible ambient light conditions). In dim environments, supplementary light sources such as supplementary infrared light sources (e.g., optics 82 and 84) can provide supplementary illumination. Each infrared light source may include one or more light-emitting devices (light-emitting diodes or lasers) and may be configured to provide a fixed and / or steerable infrared beam as supplementary illumination for the tracking camera. The infrared light sources can be turned off in bright ambient light conditions if needed and can be turned on in response to the detection of dim ambient light (e.g., using the ambient light sensing capability of optics 62).

[0059] The three-dimensional sensors in device 10 can be used to perform biometric identification operations (e.g., facial recognition for authentication), to determine the three-dimensional shape of objects in a user's environment (e.g., mapping the user's environment to create a matching virtual environment for the user), and / or to otherwise acquire three-dimensional content during operation of device 10. As an example, optics 74 and 70 can be three-dimensional structured light image sensors. Each three-dimensional structured light image sensor may have one or more light sources that provide structured light (e.g., a dot projector that projects an infrared dot array onto the environment, a structured light source that generates a line grid, or other structured light components that emit structured light). Each three-dimensional structured light image sensor may also include a flood illuminator (e.g., a light-emitting diode or laser that emits a wide infrared beam). Using flood illumination and structured light illumination, optics 74 and 70 can capture facial images, images of objects in the environment surrounding device 10, etc.

[0060] Optical component 72 may be an infrared three-dimensional time-of-flight camera that uses time-of-flight measurements of emitted light to acquire three-dimensional images of objects in the environment surrounding device 10. Optical component 72 may have a longer range and a narrower field of view compared to the three-dimensional structured light cameras of optical components 74 and 70. The operating range of optical component 72 may be 30 cm to 7 m, 60 cm to 6 m, 70 cm to 5 m, or other suitable operating ranges (as examples).

[0061] Figure 4 This is a front view of an exemplary annular decorative overlay structure for device 10. Figure 4 An exemplary annular shield 100 may be mounted in the ineffective region IA below the inner surface of the display overlay of the display 14F. This helps to conceal the optical components and other internal parts of the device 10 so that they are not visible from the outside of the device 10. The shield 100 may be formed from one or more unbroken annular members and / or may be formed from multiple shield segments attached using adhesives, fasteners or other attachment structures. If desired, the shield 100 may be formed from multiple members clamped together along some or all of their lengths. In exemplary configurations sometimes described herein as examples, the shield 100 may be formed from an inner workpiece (e.g., an inner full ring or partial ring) and may be formed from one or more outer workpieces (e.g., one or more strips or covering members of material, full rings, one or more partial rings, etc.), the inner workpiece sometimes referred to as an inner shield member, shield trim or shield trim member, and the outer workpiece sometimes referred to as a shield cover, cover or shield cap.

[0062] like Figure 4As shown, the housing 100 may have optical component windows for accommodating optical components 60, 62, 64, 84, 66, 68, 70, 72, 74, 76, 78, 82, and 80. The optical component windows may be formed by through-hole openings in the housing 100, by recesses or other portions not fully penetrating the housing 100, by optical window members inserted into the through-hole openings of the housing, and / or by other housing optical component window structures. The display 14F may have a display cover layer having corresponding optical component windows (through-hole openings, recessed areas, window members inserted into through-hole openings, etc.) and / or formed of a monolithic material with desired optical properties (e.g., the display cover layer is formed of one or more material layers such as glass and / or polymers that have sufficient transparency in the operating wavelength range of the overlapping optical components to allow the optical components to operate satisfactorily through the cover layer without forming openings or other window structures in the cover layer).

[0063] The shield 100 can have any suitable shape. For example, the outline of the shield 100 can be as follows: Figure 4 The rectangle shown may have a teardrop shape on the left and right sides of the device 10, may have an elliptical outline, and / or may have other outlines with curved edge segments and / or straight edge segments. Figure 5 This is a front view of a portion of the shield 100, showing how the inner and outer edges of the shield 100 may be curved (e.g., to follow a teardrop shape). If desired, the shield 100 may have peripheral edges that are curved along most or all of its length.

[0064] The width of the shield 100 may be constant along its length, or the shield 100 may have portions that are wider than other portions. The thickness of the shield 100 (e.g., the thickness of the shield 100 along its length) Figure 4 The orientation of the screen (the size of the screen entering the page) can be smaller than the width of the shield 100 (the shield 100 along the edge of the screen). Figure 4 The orientation of the shield (its lateral dimension within the page), or the thickness of the shield may be equal to or greater than the width of the shield. The shield may have a two-dimensional shape (e.g., shield 100 may have a shape located in the lateral dimension within the page). Figure 4 The shield may have a planar shape in the XZ plane (e.g., a shape with a curved cross-sectional profile and / or a shape characterized by an inner surface and / or an outer surface with a composite curvature). In the illustrative configuration, most or all of the inner and outer surfaces of the shield have surfaces with composite curvature.

[0065] Optical components below the invalid region IA may include components that operate in combination with each other on the left and right sides of device 10. For example, scene cameras, tracking cameras, and / or structured light cameras in device 10 may be formed in pairs, each of which includes a left camera and a corresponding right camera. As an example, the left scene camera and the right scene camera may operate together to capture overlapping images that provide a wide field of view to device 10 for acquiring pass-through video. The left tracking camera and the right tracking camera may operate together to track a user's hand or other external objects. The left structured light camera or other 3D camera and the right structured light camera or other 3D camera may be used together to capture 3D images of the user's environment. To enhance the performance of the left and right optical components in these types of paired component arrangements, it is desirable to maintain precise alignment between the left and right optical components. To help maintain the alignment between the left and right optical components on the respective left and right sides of device 10, device 10 may be provided with one or more housing structures that help support the optical components.

[0066] like Figure 6 As shown, for example, device 10 may be provided with an internal support structure such as a bracket 102 that helps support the optical component 104 on the left and right sides of device 10. The optical component 104 may be, for example, shown in... Figure 3 The optical component is located below the invalid region IA. The bracket 102 may be formed of hard metal and / or other rigid materials (e.g., rigid polymers, carbon fiber composites, or other fiber composites). A bridge recess in the bracket 102 (e.g., in the portion of the bracket 102 near the bridge of the nose 26NB) helps the bracket 102 conform to the shape of the user's face. The bracket 102 may have an elongated shape extending along a portion of the length of the invalid region IA (e.g., on the lower edge of the device 10).

[0067] The bracket 102 can be attached to the device 10 using attachment structures (adhesives, fasteners, press-fit connections, and / or other attachment mechanisms) that allow the bracket 102 to float relative to the rest of the housing portion 26M during a drop event. The rigidity of the bracket 102 and its ability to shift to some extent relative to other housing structures without significantly deforming its shape helps to keep the components on the left and right sides of the device 10 aligned with each other during periods of excessive stress, such as when the device 10 is subjected to high stress during an accidental drop event.

[0068] exist Figure 6In the example, the bracket 102 is mounted below the ineffective area IA and has a nose bridge recess with curved edges, which is configured to accommodate the user's nose when the device 10 is worn on the user's head. The bracket 102 may have other shapes if desired. The optical component 104 may be attached to the respective left and right sides of the bracket 102 and / or other support structures in the device 10 (e.g., shield 100) using adhesives, fasteners, press-fit connectors, and / or other attachment structures.

[0069] Figure 7 This is a top-view cross-section of a portion of device 10. (See image.) Figure 7 As shown, the shield 100 may overlap with one or more optical components 104 in the inactive region IA. The inactive region IA may form an annular boundary around the active region AA. For example, the display 14F may have a display overlay such as a display overlay 92. The display overlay 92 may be formed of glass, polymer, ceramic, crystalline material (such as sapphire), other materials, and / or combinations of these materials. The display overlay 92 may comprise a single material layer or multiple stacked material layers. In the active region AA, pixels P in the display panel 14P display an image that can be viewed through the display overlay 92. The shield 100 may not be present in the active region AA (e.g., the shield may have an annular shape surrounding an opening above the display panel 14P, such as...). Figure 7 (As shown), or the shield 100 may optionally have a portion overlapping the display panel 14P (sometimes referred to as a cover or shield structure). The cover may be completely transparent or partially transparent. In the inactive region IA, the shield 100 overlaps with the optical component 104. The optical component 104 may be an optical component that emits and / or detects light passing through the transparent portions of the display cover 92 and the shield 100 and / or through optical component windows formed by recesses, through-hole openings, window members, and / or other window structures in the display cover 92 and the shield 100.

[0070] The display cover layer 92 may include a flat surface and / or a curved surface. In an exemplary configuration, most or all of the inner and outer surfaces of the display cover layer 92 have curvature.

[0071] The display overlay 92 may include curved surfaces that can be flattened into a plane without distortion (sometimes referred to as developable surfaces or curved surfaces without composite curvature). Surfaces such as these may overlap with the effective region AA as an example. The curved surfaces of the display overlay 92 may also include curved surfaces characterized by composite curvature (e.g., surfaces that can only be flattened into a plane with distortion, sometimes referred to as non-developable surfaces). Some or all portions of the inner and outer surfaces of the display overlay 92 in the ineffective region IA may be characterized by composite curvature as an example. This allows the periphery of the display 14F to transition smoothly away from the effective region and provides the device 10 with an attractive appearance and compact shape. The composite curvature of the display overlay 92 in the ineffective region IA also facilitates the placement of optical components below the ineffective region IA in a desired orientation. The inner and outer surfaces of the display overlay 92 in the effective region AA may have composite curvature, may be developable surfaces, or may include both developable surface regions and composite curvature regions.

[0072] Image data and other data acquired by the optical components can be digitally warped to compensate for optical distortion associated with the display cover layer 92. To help minimize optical distortion, one or more optical components may optionally be oriented in a direction parallel to or nearly parallel to the surface normal of the portion of the optical component overlapping the surface of the display cover layer.

[0073] As an example, consider Figure 7 Optical component 104. For example... Figure 7 As shown, some optical components, such as the exemplary optical component 104B operating in direction 112, may face forward in a portion of the display cover 92 where the surface normal of the display cover 92 is oriented parallel to or nearly parallel to the Y-axis (e.g., direction 112 may be parallel to or nearly parallel to the Y-axis). Figure 7 (The Y-axis). Other optical components, such as exemplary optical component 104A operating in direction 110, may be angled away from the forward direction at a non-zero angle (e.g., by at least 10°, at least 20°, less than 90°, less than 50°, or other suitable amount). Direction 110 may be parallel or nearly parallel to the surface normal of the overlapping surface of the display overlay 92 (e.g., aligned with it within 30°, within 20°, within 10°, or by other suitable amount), and may be located at... Figure 7 In or at an angle to the XY plane (e.g., by oriented optical component 104A, except that direction 110 is as shown in the image) Figure 7 In addition to being angled away from the +Y direction, direction 110 is also angled upwards in the +Z direction or downwards in the -Z direction.

[0074] In this type of arrangement, the display cover 92 may have a composite curvature in the inactive region IA, and the shield 100 may have a shape with a cross-sectional profile mirroring the cross-sectional profile of the display cover 92 in the inactive region IA (e.g., the outer and / or inner surfaces of the shield 100 in the inactive region IA may be composite curvature surfaces). When components such as optical components 104A and 104B are mounted to the shield 100 and / or otherwise supported by the support structure of the device 10 for operation via the shield 100 and the display cover 92, the curved shapes of the display cover 92 and the shield 100 can help allow these components to face a desired orientation (e.g., a forward-facing orientation for components such as optical component 104B, or an angled orientation away from the forward-facing orientation for components such as optical component 104A).

[0075] As an example, the optical components mounted to the left and right sides of the nose bridge portion 26NB can be oriented to the left and to the right, respectively, to a certain extent in the +Y forward direction (e.g., to ensure a sufficient field of view for a pair of cameras). As another example, the curved shape of the display cover 92 and the shield 100 along the lower edge of the device 10 allows components in this portion to point downwards to an extent out of the XY plane, which helps to orient cameras such as tracking cameras toward the user's hand.

[0076] Display panel 14P can be a flexible display, such as a flexible organic light-emitting diode display with a flexible substrate or a light-emitting diode display formed from a crystalline semiconductor light-emitting diode die mounted on a flexible substrate. This allows display panel 14P and the pixels forming the effective area AA of display panel 14P to bend around a bending axis extending parallel to the vertical axis Z, thereby helping to wrap display 14F and housing portion 26M on the curved surface of the user's face. If desired, display panel 14P can be a lens display configured to display three-dimensional images (e.g., an autostereoscopic display with a series of parallel biconvex lenses, each biconvex lens overlapping a corresponding set of multiple pixel columns).

[0077] The outer and inner surfaces of the display cover layer 92 may have the same shape (e.g., these surfaces may be parallel to each other), or the outer and inner surfaces may have different shapes. In a flexible arrangement where the display panel 14P of the display 14F is flexible, it is desirable to configure the inner surface of the display cover layer 92 in the effective area AA to present a bent surface shape that matches the bent outward-facing surface of the display panel 14P (e.g., the inner surface of the display cover layer 92 in the effective area AA and (if desired) the outer surface may be a developable surface without a compound curvature to match the developable outward-facing surface of the display panel 14P).

[0078] The shield 100 and display cover 92 can be attached to the main housing portion 26M using adhesives, screws and other fasteners, press-fit connectors and / or other attachment mechanisms. Figure 8 An exemplary configuration is shown in which the shield 100 and the display cover 92 are attached to the front edge of the housing wall in the main housing portion 26M using adhesive. Figure 8 In the example, the shield 100 has an inner shield member such as a shield trim 100A and a corresponding outer shield member such as a shield cover 100B. The shield trim 100A and the shield cover 100B may be formed of metal, polymer, ceramic, glass, other materials, and / or combinations of these materials. In an exemplary example, the shield trim 100A is formed of a black polymer or other dark-colored material, and the shield cover 100B is formed of a translucent polymer. The outer surface of the shield cover 100B may be smooth to provide the shield 100 with a decoratively attractive appearance.

[0079] A pressure-sensitive adhesive layer (see, for example, adhesive 114) can be used to attach the cover 100B to the cover trim 100A. The adhesive can also be used to attach the display cover 92 and the cover 100 to the housing portion 26M. (See also...) Figure 8 As shown, for example, a first adhesive such as adhesive 122 can be used to attach the display cover 92 to the shield 100 (e.g., to a flange in the shield trim 100A). A second adhesive such as adhesive 124 can then be used to attach the shield 100 (e.g., shield trim 100A) to an adjacent lip of the wall in the main housing portion 26M.

[0080] In some configurations, adhesives 122 and 124 may be formed of the same type of material. In exemplary configurations, adhesives 122 and 124 are different. The housing portion 26M may have a wall with a lip shape, which generates shear force on the adhesive 124 when the display 14F is attached to the housing portion 26M by pressing it against the housing portion 26M in the -Y direction. In this type of case, it is desirable to form the adhesive 124 with an adhesive that can satisfy the bonding under the presence of shear force, such as molten hot melt adhesive (thermoplastic adhesive) or other liquid adhesive rather than pressure-sensitive adhesive. If desired, the adhesive 124 may be exposed to a curing agent (ultraviolet light, moisture, etc.) before the display 14F is assembled into the housing 26M.

[0081] It is expected that device 10 can be repaired. For example, if a user exposes display 14F to excessive force during a drop event, it is expected that display 14F can be replaced with a new display. This can be achieved by heating adhesive 124 to loosen the bond formed by adhesive 124. In order to help prevent display cover 92 from separating from cover 100 when adhesive 124 is softened by heat, adhesive 122 may be provided with a temperature softening point higher than the temperature softening point of adhesive 124 (for example, adhesive 122 may be a two-part hot melt adhesive with a melting point higher than the melting point of adhesive 124).

[0082] In the ineffective region IA, optical components overlapping by the display cover 92 and the shield 100 can emit and / or receive light through the shield 100 and the display cover 92. The display cover 92 may be formed of laminated glass or other light-transmitting material that allows light from each overlapping optical component 104 to pass through the display cover 92. If desired, partial recesses or through-hole openings may be formed in portions of the display cover 92. Optional optical component window members 116 may then be inserted into the display cover 92 (e.g., in window region 118). As an example, the display cover 92 may be formed of one or more glass layers and / or polymer layers and may be characterized by a first level of transmittance at the operating wavelength of the optical component 104, while the window member 116 may be formed of polymers, glass, and / or other materials characterized by a second level of transmittance greater than the first level at the operating wavelength. In other exemplary arrangements, no window member is inserted into the display cover 92 (e.g., it may be omitted when the display cover 92 is sufficiently transparent on its own to allow light from the component optics 104 to pass through). Figure 8 Optional window component 116).

[0083] The shield 100 may have an optical component window in the window area 118 to accommodate the overlapping optical components 104. The optical components 104 can operate at ultraviolet, visible, and / or infrared wavelengths. Figure 8 In the example of optical component 104, the protective cover 100A has been provided with through-hole openings such as opening 120, while the protective cover 100B has no opening in the window region 118. This effectively forms a window recess in the protective cover 100 that aligns with the optical component 104. The protective cover 100A may be formed of a black polymer or other light-absorbing material, so the formation of opening 120 in the protective cover 100A helps ensure that sufficient light can pass through the window region 118 to allow the optical component 104 to operate satisfactorily. The portion of the protective cover 100B that overlaps with opening 120 may be transparent (e.g., a light-transmitting polymer).

[0084] To help conceal the optical component 104 so that it is not visible. Figure 8The inner surface of the protective cover 100B has been covered with a coating 126. Coating 126 can be used to provide the window area 118 with the desired appearance and optical properties to ensure the satisfactory operation of the optical component 104. Coating 126 can be a thin-film interference filter formed by a stack of thin-film dielectric layers with alternating refractive index values ​​(the refractive index and thickness are selected to produce the desired transmission and reflection spectra of the filter), can be an ink layer (e.g., a polymer layer including dyes, pigments, and / or other colorants), and / or can be any other suitable coating with the desired optical properties.

[0085] As an example, consider the case where optical component 104 emits and / or receives infrared light. In this type of arrangement, coating 126 may be opaque at visible wavelengths and transparent at infrared wavelengths. This helps to conceal optical component 104 so that it is not visible from the outside of device 10, while allowing infrared light associated with the operation of optical component 104 to pass through shield 100 and display overlay 92.

[0086] As another example, consider the case where the optical component 104 is an ambient light sensor. In this configuration, the coating 126 may exhibit a visible light transmittance of 1% to 8% (as an example). This allows sufficient visible ambient light to reach the ambient light sensor so that the sensor can perform ambient light readouts. At the same time, the transmittance of the coating 126 may be low enough that it helps reduce the visibility of the optical component 104 from outside the device 10.

[0087] As these examples illustrate, the display 14F's optical components, such as... Figure 8 The overlapping area of ​​the optical components 104 may be provided with an optical component window structure in the display cover layer 92 and / or shield 100 to help accommodate the optical components.

[0088] If necessary, the shield 100 may be provided with through-hole openings to accommodate overlapping optical components. For example... Figure 9 As shown, for example, the shield 100 may include one or more sub-layers (e.g., decorative elements, covers, and / or other layers). A through-hole opening 130 may extend from the inner surface of the shield 100 to the outer surface of the shield 100. The through-hole opening 130 may be aligned with an optical component 104. The optical component 104 may be mounted behind the through-hole opening 130 and / or may be partially or completely received within the through-hole opening 130, as... Figure 9 As shown. This allows light to be emitted and / or received by the optical component 104 without being blocked by the shield 100.

[0089] exist Figure 10 In the exemplary configuration, the shield 100 also includes one or more sub-layers (e.g., trim pieces, covers, and / or other layers). For example... Figure 10As shown, a through-hole opening is formed in the cover 100 in alignment with the optical component 104 and can be filled with an optical component window member 132 (e.g., a glass or polymer component, or a window structure formed of other materials and / or combinations of these materials). The optical component window member 132 has optical properties (e.g., transmittance, reflectance, absorptivity, haze, etc.) that allow the optical component 104 to satisfactorily emit and / or receive light through the window region 118. As an example, the window member 132 may be formed of glass that is transparent to infrared light and opaque or transparent to visible light.

[0090] Such as combination Figure 3 and Figure 4 As described, multiple optical components, such as optical component 104, may exist in the invalid region IA. Each optical component may potentially have a different type of optical component window structure in the shield 100 and / or display overlay 92 to accommodate the component. For example, some areas of the shield 100 may have a combination of Figure 9 The opening of the receiving component, and other areas of the shield 100 may have insertable optical window components such as Figure 10 The window member 132, and / or other areas of the shield 100 may have partial shield openings (e.g., non-through-hole recesses), such as Figure 8 The opening 120 (which may optionally be covered with a layer such as coating 126 to modify the optical properties of the shield 100).

[0091] Figure 11 It is a cross-sectional side view of a part of a head-mounted device with a fully or partially transparent shield covering the front of the device. (e.g.) Figure 11 As shown, the head-mounted device 10 may include a display panel 14P of a forward-facing display 14. The display panel 14P may be a lens display (e.g., an autostereoscopic display having a biconvex lens 14P' configured to display a three-dimensional image to a user).

[0092] exist Figure 11 In this arrangement, the display cover layer 92 includes an inner and outer surface with composite curvature in the inactive region IA (e.g., an annular region extending along the periphery of the display cover layer 92). The inner and outer surfaces of the display cover layer 92 in the active region AA may also have composite curvature, or one or both of these surfaces may be developable surfaces. Figure 11 In the example, the inner and outer surfaces of the display overlay 92 have composite curvature in both the ineffective region IA and the effective region AA (e.g., these surfaces may not have any developable surfaces), which helps to give the device 10 an attractive appearance.

[0093] Figure 11The device 10's enclosure includes an enclosure trim 100A and an enclosure cover 100B. The enclosure trim 100A may have an annular shape and may extend around the periphery of the display 14. The enclosure cover 100B, which may be formed of a material such as a polymer, may have a contour equal to or nearly equal to the contour of the display cover layer 92 and may substantially cover the entire front surface of the device 10. With this type of arrangement, the enclosure cover 100B completely overlaps with the display panel 14P. The polymer constituting the enclosure cover 100B may have an overall color (e.g., a colorant such as dyes and / or pigments that provide the desired optical transmittance properties to the enclosure cover 100B). For example, the enclosure cover 100B may be colored such that the enclosure cover 100B exhibits a visible light transmittance of 30% to 80%, at least 20%, at least 40%, less than 95%, less than 90%, less than 85%, less than 75%, 60%, or other suitable amounts. By configuring the cover 10B to present a partial light transmittance (e.g., 30% to 80% or other suitable value), the cover 100B can help visually conceal internal components such as the lens 14P' and other structures of the display panel 14P so that they are not visible (e.g., when the display panel 14P is not in use).

[0094] The inner surface of the cover 100B may also be provided with an optical layer, such as an optical layer (optical film) 146. Layer 146 may have a texture that produces haze and / or light-scattering particles. The haze helps to conceal the structure of the display panel 14P so that it is not visible from the outside of the device 10. Layer 146 may also have a micro-louver structure or other features that help suppress off-axis light transmission (e.g., layer 146 may have a privacy structure that reduces the transmission of light rays that are not parallel to the Y-axis). Because layer 146 may contain haze and / or privacy structures, layer 146 may sometimes be referred to as a privacy layer, a haze layer, and / or a privacy and haze layer.

[0095] In an exemplary configuration, layer 146 may have a flexible substrate layer covered with a frosted coating. The frosted coating may be a pad-printed polymer coating containing embedded light-scattering microparticles (e.g., inorganic light-scattering microparticles such as titanium dioxide microparticles). The flexible substrate layer may be a privacy film such as a micro-louvered structure film or other privacy layer that prevents off-axis (away from the Y-axis) viewing of the display panel 14P.

[0096] The haze of layer 146 can be provided using any suitable haze structure (e.g., a hazy polymer coating with a thickness of 3 to 10 micrometers on a flexible privacy film or other substrate, a laminated hazy film, or other layers exhibiting 3% to 40% haze or other suitable values, sometimes referred to as a haze coating). Haze can be provided by embedded light-scattering particles and / or surface textures (e.g., textures in layer 146 or optionally on the surface of the cover 100B). The haze provided by the haze coating of layer 146 and / or other haze structures is preferably provided close enough to the display panel 14P that the resolution of the display panel 14P is not significantly affected. Simultaneously, the presence of haze (e.g., the haze coating of layer 146) helps to conceal lenses and other structures in layer 146 when they are not in use, making them invisible.

[0097] The device 10 may have an air gap between the display panel 14P and the cover 100B (e.g., an air gap such as air gap 144 may exist between any coating and / or film (such as haze layer 146) on the inward-facing side of the cover 100B and between the opposing upper surfaces of the display panel 14P (and the lens 14P' and pixels on the display panel 14P). The presence of air gap 144 helps ensure satisfactory operation of the lens 14P'. A bracket 156 helps support the display panel 14P.

[0098] To help conceal internal components from view, an opaque masking layer, such as layer BM-1, may be formed on the inner surface of the display cover 92 in the inactive area IA. Adhesive 122 may attach the display cover 92 to the edge of the cover 100B. Additional opaque masking material (see, for example, cover opaque masking layer BM-2) may be formed on the inner surface of the cover 100B in the inactive area IA. Adhesive 114 may be used to attach the cover trim 100A to the cover 100B. Adhesive 124 may be used to attach the cover trim 100A to the housing portion 26M. Adhesive 160 may be used to attach the bracket 156 (which is adhesively attached to the rear of the display panel 14P) to the cover 100B.

[0099] exist Figure 11In the example, the outer surface 148 and inner surface 150 of the display overlay 92 have a composite curvature in the inactive region IA and the active region AA. The outer surface 152 and the opposite inner surface 154 of the shield cover 100B may have a matching composite curvature in the inactive region IA. In the active region AA, the outer surface 152 and inner surface 154 of the shield cover 100B may be developable surfaces (e.g., surfaces without composite curvature that exhibit a curved cross-sectional profile bent around a single bending axis such as axis 142). In this example, axis 142 is an axis extending parallel to the Z-axis. The display panel 14P may exhibit the same amount of bending around axis 142 and may also be characterized by a developable surface (e.g., the pixel array on the outer surface of the display panel 14P may have a developable surface).

[0100] The amount of bending of the cover 100B around axis 142 and the corresponding amount of bending of the display panel 14P around this axis can be selected to help the device 10 conform to the curvature of the user's face.

[0101] exist Figure 11 In the exemplary configuration, the cover 100B does not have any area with a composite curvature overlapping the display panel 14P. Instead, the portion of the cover 100B that overlaps with the display panel 14P has a deployable inner surface and a deployable outer surface. If desired, one or both of the outer surface 152 and the inner surface 154 may have a composite curvature. For example, the outer surface 152 may have a composite curvature and may be configured to establish a uniform thickness of the air gap 140 beneath some or all of the inner surface 150 of the display cover layer 92. Figure 11 In the example, there is an air gap 140 with uneven thickness between the display cover 92 and the shield cover 100B.

[0102] The bracket 156 may be formed of a metal sheet or other support structure and may be characterized by an inner and outer surface that are developable surfaces (e.g., surfaces that are bent around axis 142 and do not contain areas with composite curvature). By avoiding composite curvature in the structure that supports and directly overlaps with the display panel 14P, the display panel 14P may be formed of a flexible substrate such as a polyimide substrate that is bent around axis 142 without the risk of wrinkles or other artificial marks that might be introduced if the display panel 14P had areas with composite curvature.

[0103] Figure 11 The shield and other structures of the device 10 (e.g., an opaque masking layer coating, such as layers BM-1 and BM-2, for example, a black ink layer) may be configured to form an optical window for the optical component 104.

[0104] Figure 12The diagram illustrates how an opaque masking layer BM-2 on a shield cover 100B can have a window opening filled with a coating such as coating 170. Optical components 104 (e.g., a scintillation sensor, ambient light sensor, and / or other photodetectors) can be aligned with the window opening. A transparent cover portion can overlap with the window opening, or a cover opening can overlap with the window opening. Layer BM-2 can be opaque, which helps prevent internal components of device 100 from being seen from the outside of device 10. The presence of the opening in layer BM-2 allows optical components 104 to operate satisfactorily (e.g., to receive and measure ambient light). Coating 170 can be configured to allow optical components 104 to operate while helping to visually conceal them. As an example, coating 170 can be formed of an ink layer having a visible light transmittance of 2% to 25%, at least 1%, at least 2%, at least 4%, less than 80%, less than 30%, or other suitable amounts, while layer BM-2 can have a visible light transmittance of less than 2%, less than 1%, or less than 0.5% (as an example).

[0105] Figure 13 This is another illustrative cross-sectional side view of the mounting arrangement of optical components in a head-mounted device. Figure 13 The arrangement utilizes through-hole openings in the shield trim 100A and the shield cover 100B. These through-hole openings are aligned with openings in the display opaque masking layer BM-1 (and optionally with corresponding openings in the cover opaque masking layer BM-2). Optional coatings such as coating 164 may cover the optical windows formed by these openings. Coating 164 and Figure 14 Other openings may be aligned with optical component 104, which may be mounted behind the shield and / or may have portions protruding into through-hole openings in the shield. In the first exemplary configuration, Figure 13 The optical component 104 is an infrared illuminator (e.g., an infrared light-emitting diode). In this type of arrangement, the coating 164 may be formed of an ink layer that blocks visible light and is transparent to infrared light, a thin-film interference filter, or other filter layer (e.g., a filter layer that blocks visible light and transmits infrared light). In the second exemplary configuration, Figure 13 The optical component 104 is a camera (e.g., a camera through which visible light passes, an infrared camera, and / or other cameras that operate at visible and / or infrared wavelengths). In this arrangement, coating 164 may be omitted (to allow visible and / or infrared light to pass through), may be configured to form an anti-reflective coating, and / or may be otherwise configured to operate in conjunction with the camera.

[0106] Figure 14This is a cross-sectional side view of an exemplary head-mounted device optical component mounting arrangement having an optical component window formed by a transparent window member. The transparent window member 166 (e.g., a glass or polymer layer) can be mounted in through-hole openings in the shroud trim 100A and the shroud cover 100B, and can be aligned with openings in the opaque masking layer BM-1 on the optical component 104 and the display cover 92 (and, if desired, with openings in the opaque masking layer BM-2 on the shroud cover 100B). A filter coating 168 can be provided on the window member 166. In this exemplary configuration, Figure 14 The optical component 104 is a three-dimensional camera such as a time-of-flight camera or a structured light camera, and can operate at infrared wavelengths. The filter coating 168 in this type of arrangement can be transparent to infrared light and can be transparent to visible light or opaque to visible light (e.g., the filter coating 168 can be an infrared-transparent and visible-light-blocking filter). The filter coating 168 can be formed from ink, a thin-film interference filter, or other filter structures.

[0107] The presence of the window member 166, which can be configured to exhibit relatively little optical distortion, can help enhance the optical performance of the optical component 104. If desired, the optical component compatible surface area for the optical component window of the optical component 104 can be formed directly in the shroud cover 100B (e.g., such that the shroud cover 100B can overlap with the optical component 104 without forming a through-hole opening in the shroud cover 100B).

[0108] According to one embodiment, a head-mounted device is provided, comprising: a head-mounted support structure; a first display and a first lens, the first display and the first lens being supported by the head-mounted support structure and configured to provide a first image to a first eye-adaptive region; a second display and a second lens, the second display and the second lens being supported by the head-mounted support structure and configured to provide a second image to a second eye-adaptive region; a forward-facing display supported on the front side of the head-mounted support structure, the forward-facing display having an effective area in which a third image is displayed and an annular ineffective area surrounding the effective area where no image is displayed, and the forward-facing display having a display overlay overlapping the effective area and the ineffective area; an optical component located in the ineffective area; and a cover structure overlapping the ineffective area below the display overlay.

[0109] According to another embodiment, the cover structure includes a shield having a shield trim and a shield cover, the shield cover containing a light-transmitting polymer, the shield trim containing a dark polymer, the shield cover being attached to the shield trim using an adhesive, and the head-mounted device including a coating on the inner surface of the shield cover overlapping the optical component.

[0110] According to another embodiment, the covering structure includes a ring-shaped polymer structure surrounding the effective region.

[0111] According to another embodiment, the annular polymer structure has a through-hole opening aligned with the optical component.

[0112] According to another embodiment, the annular polymer structure has an opening, and the head-mounted device includes a glass component in the opening aligned with the optical component.

[0113] According to another embodiment, the annular polymer structure has a recess aligned with the optical component.

[0114] According to another embodiment, the annular polymer structure includes a first polymer component and a second polymer component attached by an adhesive, and the recess is formed by a through-hole in the first polymer component.

[0115] According to another embodiment, the second polymer component includes a light-transmitting polymer that overlaps with the through-hole in the first polymer component.

[0116] According to another embodiment, the head-mounted device includes a coating on the inner surface of the light-transmitting polymer that overlaps with the through-hole opening.

[0117] According to another embodiment, the polymer component comprises a black polymer.

[0118] According to another embodiment, the head-mounted device includes: a first adhesive layer configured to attach the display cover to the annular polymer structure; and a second adhesive having a melting point lower than that of the first adhesive layer, the second adhesive layer being configured to attach the annular polymer structure to the head-mounted support structure.

[0119] According to another embodiment, the cover structure includes a polymer layer separated from the display cover layer by an air gap, the polymer layer having a surface with a composite curvature overlapping the ineffective area and a developable surface overlapping the effective area.

[0120] According to one embodiment, a head-mounted device is provided, comprising: a head-mounted support structure; a rear-facing display supported by the head-mounted support structure, the rear-facing display being configured to provide visual content to an eye-friendly area at the rear side of the head-mounted support structure; a common-view forward-facing display supported on the front side of the head-mounted support structure, the common-view forward-facing display having an effective area containing pixels configured to display an image, and having an annular ineffective area surrounding the effective area without pixels; a display overlay for the forward-facing display, the display overlay overlapping the effective area and the annular ineffective area; an annular shield member overlapping the display overlay in the ineffective area and surrounding the effective area; and optical components overlapping the annular shield member.

[0121] According to another implementation, these optical components include a scintillation sensor and an ambient light sensor.

[0122] According to another embodiment, the head-mounted device includes a cover attached to the annular shield member, the flash sensor and the ambient light sensor being aligned with an opening in the annular shield member and covered by the cover.

[0123] According to another embodiment, the annular shield member and the shield cover have through-hole openings aligned with these optical components.

[0124] According to another embodiment, these optical components include a camera.

[0125] According to another embodiment, these optical components include an ambient light sensor, the annular shield member having a recessed portion with a coating through which the ambient light sensor measures ambient light.

[0126] According to another embodiment, the head-mounted device includes a bracket below a portion of the annular shield member, the display cover having a nose bridge recess, and a first optical component of the optical components attached to the bracket on one side of the nose bridge recess, and a second optical component of the optical components attached to the bracket on the opposite side of the nose bridge recess.

[0127] According to another embodiment, the annular shield member includes a portion that is transparent at a certain wavelength, and the optical components include optical components that receive light that has passed through that portion of the annular shield member at that wavelength.

[0128] According to another embodiment, the annular shield member includes a surface with a composite curvature.

[0129] According to one embodiment, a head-mounted device is provided, comprising: a head-mounted support structure; a left lens located on the left side of the head-mounted support structure; a right lens located on the right side of the head-mounted support structure; a left display and a right display configured to provide respective left-rear and right-rear images viewable from a left-corrected eye area and a right-corrected eye area through the left lens and the right lens; a common viewing display located on the head-mounted support structure and facing away from the left and right displays, the common viewing display having pixels configured to display a common viewing image and having an invalid annular boundary surrounding the pixels; a display overlay layer covering the common viewing display; and a polymer layer overlapping the pixels and located between the pixels and the display overlay layer.

[0130] According to another embodiment, the polymer layer is separated from these pixels by an air gap.

[0131] According to another embodiment, the display cover is separated from the polymer layer by an air gap.

[0132] According to another embodiment, the display overlay has an inner surface and an outer surface with a composite curvature that overlap with these pixels.

[0133] According to another embodiment, the polymer layer has a developable surface that overlaps with these pixels.

[0134] According to another embodiment, the head-mounted device includes optical components located within the invalid annular boundary.

[0135] According to another embodiment, these optical components include cameras, the display overlay having a surface with a composite curvature in the invalid annular region, and the cameras are configured to capture images in different corresponding directions through corresponding portions of the surface with the composite curvature.

[0136] According to another embodiment, the polymer layer is configured to exhibit a visible light transmittance of 30% to 80%.

[0137] According to another embodiment, the polymer layer has a hazy coating that overlaps with these pixels.

[0138] The foregoing description is merely illustrative and various modifications can be made to the described implementation scheme. The described implementation scheme can be implemented independently or in any combination.

Claims

1. A head-mounted device, comprising: Headband support structure; A first display and a first lens, the first display and the first lens being supported by the head-mounted support structure and configured to provide a first image to a first eye-adaptive area; A second display and a second lens, the second display and the second lens being supported by the head-mounted support structure and configured to provide a second image to a second eye-adaptive zone; A curved glass cover layer overlaps with the first display and the second display, and is supported on the front side of the head-mounted support structure; An optical component configured to sense light passing through the curved glass cover; as well as A covering structure extending beneath a curved glass cover layer, wherein the covering structure includes a polymer layer separated from the curved glass cover layer by an air gap.

2. The head-mounted device of claim 1, wherein the covering structure includes a shield having a shield trim and a shield cover, wherein the shield cover comprises a light-transmitting polymer, wherein the shield trim comprises a dark polymer, wherein the shield cover is attached to the shield trim with an adhesive, and wherein the head-mounted device further includes a coating on the inner surface of the shield cover that overlaps with the optical component.

3. The head-mounted device of claim 1, wherein the covering structure comprises an annular polymer structure extending around the periphery of the curved glass cover.

4. The head-mounted device of claim 3, wherein the annular polymer structure has a through-hole opening aligned with the optical component.

5. The head-mounted device of claim 3, wherein the annular polymer structure has an opening, and the head-mounted device further comprises a glass member located in the opening and aligned with the optical component.

6. The head-mounted device of claim 3, wherein the annular polymer structure has a recess aligned with the optical component.

7. The head-mounted device of claim 6, wherein the annular polymer structure comprises a first polymer member and a second polymer member attached by an adhesive, and wherein the recess is formed by a through-hole in the first polymer member.

8. The head-mounted device of claim 7, wherein the second polymer component comprises a light-transmitting polymer that overlaps with the through-hole in the first polymer component.

9. The head-mounted device according to claim 8, further comprising: A coating is applied to the inner surface of the translucent polymer that overlaps with the through-hole.

10. The head-mounted device of claim 9, wherein the first polymer component comprises a black polymer.

11. The head-mounted device according to claim 3, further comprising: A first adhesive layer is configured to attach the curved glass cover to the annular polymer structure; as well as A second adhesive having a lower melting point than the first adhesive layer, wherein the second adhesive layer is configured to attach the annular polymer structure to the headband support structure.

12. The head-mounted device of claim 1, wherein the polymer layer has a surface with a composite curvature overlapping a first portion of the curved glass cover layer, and has a deployable surface overlapping a second portion of the curved glass cover layer.

13. A head-mounted device, comprising: Headband support structure; A rear-facing display, supported by the head-mounted support structure, is configured to provide visual content to an eye-friendly area at the rear of the head-mounted support structure. A glass cover layer that overlaps with the rear-facing display and is supported on the front side of the head-mounted support structure; An annular protective shield component, the annular protective shield component being overlapped by the glass covering layer; A protective cover, the protective cover being connected to the annular protective cover component; as well as Optical components, which are overlapped by the annular shield member.

14. The head-mounted device of claim 13, wherein the optical components include a scintillation sensor and an ambient light sensor.

15. The head-mounted device of claim 14, wherein the flicker sensor and the ambient light sensor are aligned with an opening in the annular shield member and are covered by the shield cover.

16. The head-mounted device of claim 15, wherein the annular shield member and the shield cover have through-hole openings aligned with the optical component, and wherein the optical component includes a camera.

17. The head-mounted device of claim 13, wherein the optical component includes an ambient light sensor, and wherein the annular shield member includes a recessed portion having a coating through which the ambient light sensor measures ambient light.

18. The head-mounted device according to claim 13, further comprising: A bracket located below a portion of the annular shield member, wherein the glass cover has a nose bridge recess, and wherein a first optical component of the optical components is attached to the bracket on one side of the nose bridge recess, and wherein a second optical component of the optical components is attached to the bracket on the opposite side of the nose bridge recess.

19. The head-mounted device of claim 13, wherein the annular shield member includes a portion that is transparent at a certain wavelength, and wherein the optical component includes an optical component that receives light that has passed through the portion of the annular shield member at the wavelength.

20. The head-mounted device of claim 13, wherein the annular shield member has a surface with a composite curvature.

Images