System with display and sensor

Abstract

The present disclosure relates to systems with displays and sensors. A head-mounted device can have a head-mounted support structure (26). A rear-facing display (14R, 14L) can present images to an eyebox (34) located at a rear of the head-mounted support structure. A forward-facing public viewable display (14F) can be supported on a front side of the head-mounted support structure, facing away from the rear-facing display. The forward-facing display can have pixels forming an active area (AA) in which images are displayed, and can have an annular inactive border area (IA) surrounding the pixels. The active area can have a curved perimeter edge with a bridge of the nose recess. The inactive border area can have a perimeter extending parallel to the perimeter edge of the active area. The forward-facing display can have a cover layer (92) having an developable surface overlapping the active area and an annular surface having compound curvature overlapping the inactive area. An optical component can operate through the cover layer in the inactive area.

Description

[0001] This application is a divisional application of Chinese patent application No. 202180078271.7, filed on September 8, 2021, entitled "System with Display and Sensor". Technical Field

[0002] This disclosure relates generally to electronic devices, and more specifically to electronic devices such as head-mounted devices. Background Technology

[0003] Electronic devices, such as head-mounted devices, may have input-output components. These input-output components may include components such as displays and sensors. Summary of the Invention

[0004] A head-mounted device may have a head-mounted support structure. When a user wears the head-mounted support structure, a rear-facing display can present an image to an eye-friendly area at the rear of the head-mounted support structure. The head-mounted support structure may have a curved rear surface that wraps around the user's head.

[0005] A forward-facing public view display can be supported on the front side of the head-mounted support structure, facing away from these rear-facing displays. The forward-facing display may have a curved shape that wraps around the front of the head-mounted support structure and the user's head.

[0006] The forward-facing display may have pixels forming an effective area in which an image is displayed, and may have an annular ineffective boundary region surrounding these pixels. The effective area may have a curved peripheral edge with a bridge-like indentation. The outline of the effective area on each side of the display may have a teardrop shape or other curved shape. The periphery of the ineffective boundary region may extend parallel to the peripheral edge of the effective area.

[0007] The forward-facing display may have a display cover layer with a deployable surface overlapping the effective area. The pixels in the effective area may be supported on a flexible display substrate bent about a bending axis extending perpendicularly through the center of the support structure. The bent flexible display may have a deployable surface abutting or adjacent to the inner surface of the display cover layer, or abutting or adjacent to the inner surface of a protective cover layer. If desired, the bent flexible display may be attached to the deployable inner surface of the display cover layer, and the display cover layer may have a corresponding outer surface overlapping the display, characterized by a composite curvature.

[0008] The edge of the display cover layer can be swept backward from the effective region and can be characterized by a curved cross-sectional profile. In an exemplary configuration, the surface of the cover layer in the annular ineffective region has a composite curvature. The surface of the display cover layer in the effective region can be a developable surface or can have a composite curvature.

[0009] Optical components can operate through the overlay in the ineffective area. These optical components may include scintillation sensors, ambient light sensors, cameras, 3D image sensors such as structured light 3D sensors and time-of-flight 3D image sensors, and infrared illumination systems configured to provide infrared illumination for the tracking camera in dim ambient lighting conditions. Attached Figure Description

[0010] Figure 1 It is a side view of an exemplary electronic device, such as a head-mounted device, according to one implementation scheme.

[0011] Figure 2 It is a schematic diagram of an exemplary system with electronic equipment according to one implementation scheme.

[0012] Figure 3 This is a front view of an exemplary head-mounted device according to one implementation scheme.

[0013] Figure 4 This is a cross-sectional top view of an exemplary head-mounted device according to one implementation scheme.

[0014] Figure 5A This is a cross-sectional side view of an exemplary head-mounted device according to one implementation scheme.

[0015] Figure 5B This is a cross-sectional side view of another exemplary head-mounted device according to one embodiment.

[0016] Figure 6 This is a front view of the upper left portion of an exemplary head-mounted device with a public visual display according to one embodiment.

[0017] Figure 7 , Figure 8 , Figure 9 , Figure 10 , Figure 11 and Figure 12 This is a front view of a portion of an illustrative head-mounted device according to the implementation plan.

[0018] Figure 13 This is an exploded cross-sectional top view of a portion of an exemplary head-mounted device according to one embodiment.

[0019] Figure 14 This is a cross-sectional side view of a portion of an exemplary head-mounted device with a display according to one embodiment.

[0020] Figure 15 , Figure 16 and Figure 17It is a cross-sectional side view of an exemplary display cover layer that overlaps with an exemplary optical component according to the implementation scheme. Detailed Implementation

[0021] Head-mounted devices may include a head-mounted support structure that allows the device to be worn on a user's head. The head-mounted device may have a display supported by the head-mounted support structure for presenting visual content to the user. The display may include a rear-facing display that presents images to an eye-fitting area at the rear of the head-mounted support structure. The display may also include a forward-facing display. The forward-facing display may be mounted to the front of the head-mounted support structure and can be viewed by the user when the head-mounted device is not worn on the user's head. Forward-facing displays, sometimes referred to as public-viewable displays, may also be viewable by others near the head-mounted device.

[0022] Optical components, such as image sensors and other light sensors, can be housed in the head-mounted device. In an exemplary configuration, the optical components are mounted below the peripheral portion of the display cover that protects the front-facing display.

[0023] Figure 1 This is a side view of an illustrative head-mounted electronic device. (Example:) Figure 1 As shown, the head-mounted device 10 may include a head-mounted support structure 26. The support structure 26 may have walls or other structures that separate internal regions of the device 10, such as internal region 42, from external regions surrounding the device 10, such as external region 44. Electrical components 40 (e.g., integrated circuits, sensors, control circuits, light-emitting diodes, lasers and other light-emitting devices, other control circuits and input-output devices, etc.) may be mounted on printed circuits and / or other structures within the device 10 (e.g., in internal region 42).

[0024] To present an image to a user for viewing from an eye-friendly area, such as eye-friendly area 34, device 10 may include a rear-facing display, such as display 14R, and lenses, such as lens 38. These components may be mounted in an optical module, such as optical module 36 (e.g., a lens barrel), to form a corresponding left and right optical system. For example, there may be a left rear-facing display for presenting an image to the user's left eye via a left lens in the left eye-friendly area and a right rear-facing display for presenting an image to the user's right eye in the right eye-friendly area. When structure 26 abuts against the outer surface of the user's face (face surface 30), the user's eyes are located in eye-friendly area 34 at the rear R of device 10.

[0025] The support structure 26 may include a main support structure, such as a main housing portion 26M (sometimes referred to as the main portion). The main housing portion 26M may extend from the front side F of the device 10 to the opposite rear side R of the device 10. On the rear side R, the main housing portion 26M may have a padded structure to enhance user comfort when the portion 26M rests against the facial surface 30. If desired, the support structure 26 may include an optional headband, such as a strap 26B, and / or other structures that allow the device 10 to be worn on the user's head.

[0026] Device 10 may have a publicly visible, front-facing display, such as display 14F mounted on the front side F of the main housing portion 26M. When the user is not wearing device 10, display 14F may be viewable by the user and / or may be viewable by others near device 10. As an example, display 14F may be visible on the front side F of device 10 to an external viewer, such as viewer 50 viewing device 10 in direction 52.

[0027] exist Figure 2 The diagram illustrates an exemplary system that may include a head-mounted device. Figure 2 As shown, system 8 may have one or more electronic devices 10. Device 10 may include a head-mounted device (e.g., Figure 1 Device 10), accessories such as controllers and headsets, computing equipment (e.g., cellular phones, tablet computers, laptop computers, desktop computers and / or telecomputing equipment that supplies content to the head-mounted device) and / or other devices that communicate with each other.

[0028] Each electronic device 10 may have a control circuit 12. The control circuit 12 may include storage and processing circuitry for controlling the operation of the device 10. The circuit 12 may include storage devices such as hard disk drive storage devices, non-volatile memory (e.g., electrically programmable read-only memory configured to form a solid-state drive), volatile memory (e.g., static or dynamic random access memory), etc. The processing circuitry in the control circuit 12 may be based on one or more microprocessors, microcontrollers, digital signal processors, baseband processors, power management units, audio chips, graphics processing units, application-specific integrated circuits (ASICs), and other integrated circuits. Software code may be stored on the storage devices in the circuit 12 and run on the processing circuitry in the circuit 12 to implement control operations for the device 10 (e.g., data acquisition operations, operations involving adjusting components of the device 10 using control signals, etc.). The control circuit 12 may include wired and wireless communication circuitry. For example, the control circuit 12 may include radio frequency transceiver circuitry, such as cellular telephone transceiver circuitry, wireless local area network transceiver circuitry (e.g., WiFi). ® Circuits), millimeter-wave transceiver circuits, and / or other wireless communication circuits.

[0029] During operation, the communication circuitry of the devices in System 8 (e.g., the communication circuitry of the control circuitry 12 of Device 10) can be used to support communication between electronic devices. For example, one electronic device can transmit video data, audio data, control signals, and / or other data to another electronic device in System 8. The electronic devices in System 8 can use wired and / or wireless communication circuitry to communicate over one or more communication networks (e.g., the Internet, a local area network, etc.). The communication circuitry can be used to allow Device 10 to receive data from and / or provide data to external equipment (e.g., tethered computers, portable devices such as handheld devices or laptops, online computing equipment such as remote servers or other remote computing equipment, or other electrical equipment).

[0030] Each device 10 in system 8 may include an input-output device 22. The input-output device 22 may be used to allow a user to provide user input to the device 10. The input-output circuitry 22 may also be used to acquire information about the environment in which the device 10 operates. Output components in the circuitry 22 may allow the device 10 to provide output to a user and may be used to communicate with external electrical equipment.

[0031] like Figure 2 As shown, input-output device 22 may include one or more displays, such as display 14. Display 14 may include a rear-facing display, such as... Figure 1 The display 14R. Device 10 may include, for example, left and right components such as a left scanning mirror display device and a right scanning mirror display device or other image projector, silicon-based liquid crystal display device, digital mirror device or other reflective display device; a left and right display panel based on a light-emitting diode pixel array (e.g., an organic light-emitting display having a polymer or semiconductor substrate or a display device based on a pixel array formed from a crystalline semiconductor light-emitting diode die); a liquid crystal display panel; and / or other left and right display devices that provide images to the left and right eye-adaptive areas for viewing by the user's left and right eyes respectively. Display components such as these components (e.g., an organic light-emitting display having a flexible polymer substrate or a display based on a pixel array formed from a crystalline semiconductor light-emitting diode die on a flexible substrate) may also be used to form the front-facing display of device 10, such as... Figure 1 The front-facing display 14F (sometimes referred to as a front-facing display, front display, or public view display).

[0032] During operation, display 14 (e.g., display 14R and / or 14F) can be used to display visual content (e.g., still and / or moving images, text, graphics, movies, games, and / or other visual content, including pictures and pass-through video from camera sensors) to the user of device 10. The content presented on display 14 may include, for example, virtual objects and other content provided to display 14 by control circuitry 12. This virtual content may sometimes be referred to as computer-generated content. Computer-generated content may be displayed in the absence of real-world content, or may be combined with real-world content. In some configurations, real-world images may be captured by a camera (e.g., a forward-facing camera, sometimes referred to as a front-facing camera), and computer-generated content may be electronically overlaid on portions of the real-world image (e.g., when device 10 is a virtual reality headset).

[0033] Input-output device 22 may include sensor 16. Sensor 16 may include, for example, a 3D sensor (e.g., a 3D image sensor such as a structured light sensor that emits a light beam and uses a 2D digital image sensor to acquire image data for a 3D image from a point or other light spot generated when a target is illuminated by the light beam, a binocular 3D image sensor that uses two or more cameras in a binocular imaging arrangement to acquire 3D images, a 3D lidar (light detection and ranging) sensor (sometimes referred to as a time-of-flight camera or 3D time-of-flight camera), a 3D radio frequency sensor, or other sensors that acquire 3D image data), a camera (e.g., a 2D infrared and / or visible digital image sensor), and a gaze tracking sensor (e.g., a gaze tracking system based on an image sensor and, if necessary, also based on a light source emitting one or more light beams, which, after reflection from the user's eye, use an image). Sensors include: tracking sensors, touch sensors, capacitive proximity sensors, light-based (optical) proximity sensors, other proximity sensors, force sensors (e.g., strain gauges, capacitive force sensors, resistive force sensors, etc.), sensors such as switch-based contact sensors, gas sensors, pressure sensors, humidity sensors, magnetic sensors, audio sensors (microphones), ambient light sensors, flicker sensors that acquire time-varying information about ambient lighting conditions such as the presence of time-varying ambient light intensity associated with artificial lighting, microphones for acquiring voice commands and other audio inputs, sensors configured to acquire information about motion, position, and / or orientation (e.g., accelerometers, gyroscopes, compasses, and / or inertial measurement units that include all of these sensors or a subgroup of one or both of these sensors), and / or other sensors.

[0034] User input and other information can be acquired using sensors and other input devices in input-output device 22. If desired, input-output device 22 may include other devices 24 such as haptic output devices (e.g., vibrating components), light-emitting diodes, lasers and other light sources (e.g., light-emitting devices that emit light to illuminate the environment surrounding device 10 when ambient light levels are low), speakers such as earphones for generating audio output, circuitry for receiving wireless power, circuitry for wirelessly transmitting power to other devices, batteries and other energy storage devices (e.g., capacitors), joysticks, buttons and / or other components.

[0035] Such as combination Figure 1 As described, the electronic device 10 may have a head-mounted support structure such as a head-mounted support structure 26 (e.g., a head-mounted housing structure such as a housing wall, strap, etc.). The head-mounted support structure may be configured to be worn on a user's head during operation of the device 10 (e.g., against the user's face, thereby covering the user's eyes) and may support the display 14, sensor 16, other components 24, other input-output devices 22, and control circuitry 12 (e.g., see...). Figure 1 Component 40 and optical module 36).

[0036] Figure 3 This is a front view of device 10 in an exemplary configuration, where device 10 has a common visual display such as a front-facing display 14F. Figure 3 As shown, the support structure 26M of device 10 may have right and left portions such as 26R and 26L, which are connected by an inserted nose bridge portion such as 26NB. The portion 26NB may have a curved outer surface such as a nose bridge surface 90, which is configured to receive and rest against the user's nose to help support the main housing portion 26M on the user's head.

[0037] The display 14F may have active areas configured to display images, such as an active area AA, and inactive areas IA where no images are displayed. The outline of the active area AA may be rectangular, a rectangle with rounded corners, teardrop-shaped portions on the left and right sides of the device 10, a shape with straight edges, a shape with curved edges, a shape with peripheral edges having both straight and curved portions, and / or other suitable outlines. Figure 3 As shown, the effective area AA may have a curved recess at the bridge portion 26NB of the main housing portion 26. The presence of the nose-shaped recess in the effective area AA helps to fit the effective area AA within the available space of the housing portion 26M without unduly restricting the size of the effective area AA.

[0038] The effective area AA contains a pixel array. Pixels can be, for example, light-emitting diode pixels formed on a flexible display panel substrate using thin-film organic light-emitting diodes or crystalline semiconductor light-emitting diode dies (sometimes referred to as micro-light-emitting diodes). If desired, configurations in which the display 14F uses other display technologies may also be used. Exemplary arrangements of light-emitting diode displays, such as organic light-emitting diode displays formed on a flexible substrate (e.g., a substrate formed from a bendable polyimide layer or other flexible polymer sheet), are sometimes described herein as examples. Pixels in the effective area AA can be formed in a display device such as... Figure 3 On the display panel 14P (e.g., a flexible organic light-emitting diode display panel). In some configurations, the outline of panel 14P may have peripheral edges comprising straight segments or a combination of straight and curved segments. Configurations in which the entire outline of panel 14P is characterized by curved peripheral edges may also be used.

[0039] The display 14F may have invalid areas, such as invalid area IA, that do not contain pixels and do not display images. Invalid area IA may form an invalid boundary area extending along one or more portions of the peripheral edge of valid area AA. Figure 3 In an exemplary configuration, the invalid region IA has an annular shape surrounding the valid region AA. In this type of arrangement, the width of the invalid region IA can be relatively constant, and the inner and outer edges of the region IA can be characterized by straight and / or curved segments, or can be curved along the entire length of the edge. For example, the outer edge of the region IA (e.g., the periphery of the display 14F) can have a curved profile extending parallel to the curved edge of the valid region AA.

[0040] In some configurations, device 10 may operate in conjunction with other devices in system 8, such as wireless controllers and other accessories. These accessories may have magnetic sensors that sense the direction and intensity of magnetic fields. Device 10 may have one or more electromagnets configured to emit magnetic fields. The magnetic fields may be measured by wireless accessories near device 10, allowing the accessories to determine their orientation and position relative to device 10. This allows the accessories to wirelessly provide device 10 with real-time information about their current location, orientation, and movement, enabling the accessories to function as wireless controllers. Accessories may include wearable devices, handheld devices, and other input devices.

[0041] In an exemplary configuration, device 10 may have a coil, such as exemplary coil 54, extending around the periphery of display 14F (e.g., below the inactive area IA or other portion of display 14F). Coil 54 may have any suitable number of turns (e.g., 1-10, at least 2, at least 5, at least 10, 10-50, less than 100, less than 25, less than 6, etc.). These turns may be formed on a substrate by metal traces, by wires, and / or by other conductive lines. During operation, control circuitry 12 may supply an alternating current (AC) drive signal to coil 54. The drive signal may have a frequency of at least 1 kHz, at least 10 kHz, at least 100 kHz, at least 1 MHz, less than 10 MHz, less than 3 MHz, less than 300 kHz, or less than 30 kHz (as an example). When AC current flows through coil 54, a corresponding magnetic field is generated near device 10. Electronic devices located near device 10, such as wireless controllers with magnetic sensors, can use the magnetic field as a reference, enabling the wireless controllers to determine their orientation, position, and / or movement relative to device 10 to provide input to device 10.

[0042] As an example, consider a handheld wireless controller used to control the operation of device 10. During operation, device 10 uses coil 54 to emit a magnetic field. When the handheld wireless controller is moved, the controller's magnetic sensor can monitor the controller's position and movement relative to device 10 by monitoring the strength, orientation, and changes in strength and / or orientation of the magnetic field emitted by coil 54 as the user moves the controller through the air. The electronic device can then wirelessly transmit information about the controller's position and orientation to device 10. In this way, the user can manipulate the handheld controller, wearable controller, or other external accessories to provide air gestures, pointing inputs, directional inputs, and / or other user inputs to device 10.

[0043] Device 10 may have optical components (e.g., Figure 2The components of the optical sensor (among the components of sensor 16) can be mounted in any suitable location on the head-mounted support structure 26 (e.g., on headband 26B, on main housing portion 26M, etc.). Optical components and other components can be rear-facing (e.g., when mounted on the back of device 10), side-facing (e.g., left or right), down-facing or up-facing, front-facing (e.g., when mounted on the front of device 10), mounted in any combination of these directions (e.g., forward, right, and down), and / or mounted in other suitable orientations. In an exemplary configuration, at least some of the components of device 10 are mounted outwardly facing forward (and optionally side-facing and / or up and down). For example, a forward-facing camera for through-video can be configured to be mounted on the left and right sides of the front of device 10, in which the cameras diverge slightly along the horizontal dimension such that the fields of view of these cameras overlap to some extent when capturing a wide-angle image of the environment in front of device 10. If needed, the captured images may include portions of the user’s surrounding environment below, above, and to the sides of the area directly in front of the device 10.

[0044] To help conceal components such as optical elements from the outside of device 10, it is desirable to cover some or all of these components with a decorative overlay structure. The overlay structure may include transparent portions (e.g., windows for optical elements) characterized by sufficient optical transparency to allow the overlapping optical elements to operate satisfactorily. For example, an ambient light sensor may be covered with a layer that appears opaque to an external viewer to help conceal the sensor from view, but allows sufficient ambient light to pass through to enable satisfactory ambient light measurements. As another example, optical elements emitting infrared light may be overlapped with a visually opaque material that is transparent to infrared light.

[0045] In the exemplary configuration, the optical components of device 10 can be mounted on... Figure 3In the invalid region IA, the decorative overlay structure can be formed as an annular shape overlapping the optical components in the invalid region IA. The decorative overlay structure can be formed from ink, polymer structures, structures including metals, other materials, and / or combinations of these materials. In an exemplary configuration, the decorative overlay structure can be formed from an annular member having an area matching the occupied area of ​​the invalid region IA. For example, if the valid region AA includes a left and right portion having a teardrop shape, the annular member can have a curved edge following the curved periphery of the teardrop-shaped portion of the valid region AA. The annular member can be formed from one or more polymer structures (e.g., the annular member can be formed from a polymer ring). Because the annular member helps to conceal the overlapping components so that they are not visible, the annular member is sometimes referred to as a shield or annular shield member. The appearance of the shield or other decorative overlay structure can be characterized by neutral colors (white, black, or gray) or non-neutral colors (e.g., blue, red, green, gold, rose gold, etc.).

[0046] If needed, the display 14F may have a protective display overlay. The overlay may overlap with the active area AA and the inactive area IA (e.g., when viewed from...). Figure 1 The entire front surface of the device 10 during observation in direction 52 may be covered by a covering layer. The covering layer, sometimes referred to as the outer shell wall or transparent outer shell wall, may have a rectangular outline, an outline with teardrop portions, an elliptical outline, or other shapes with curved and / or straight edges.

[0047] The cover layer may be formed of transparent materials such as glass, polymers, transparent crystalline materials such as sapphire, light-transmitting ceramics, other transparent materials, and / or combinations of these materials. As an example, the protective display cover layer of display 14F may be formed of safety glass (e.g., laminated glass comprising a light-transmitting glass layer and a laminated polymer film). Optional coatings may be applied to the surface of the display cover layer. If desired, the display cover layer may be chemically strengthened (e.g., using an ion-exchange process to form a scratch-resistant outer material layer under compressive stress). In some configurations, the display cover layer may be formed of a stack of two or more material layers (e.g., a first structural glass layer and a second structural glass layer, a rigid polymer layer bonded to a glass layer or another rigid polymer layer, etc.) to enhance the performance of the cover layer.

[0048] In the effective area AA, the display overlay may overlap with the pixels of the display panel 14P. The display overlay in the effective area AA is preferably transparent to allow viewing of the image presented on the display panel 14P. In the ineffective area IA, the display overlay may overlap with an annular shield or other decorative overlay structure. The shield and / or other overlay structure (e.g., an opaque ink coating on the inner surface of the display overlay and / or structure) may be sufficiently opaque to help conceal some or all of the optical components in the ineffective area IA so that they are not visible. Windows may be provided in the shield or other decorative overlay structure to help ensure satisfactory operation of the optical components overlapped by these structures. Windows may be formed by apertures, may be formed by areas of the shield or other decorative overlay structure that have been locally thinned to enhance light transmittance, may be formed by window members with desired light transmittance characteristics that have been inserted into mating openings in the shield, and / or may be formed by other shield window structures.

[0049] exist Figure 3 In the example, device 10 includes optical components such as optical components 60, 62, 64, 66, 68, 70, 72, 74, 76, 78, and 80 (as an example). These optical components (e.g., from...) Figure 2 Each optical component in the selected optical sensor, light-emitting device, etc. of the sensor 16 can be configured to detect light and, if necessary, to emit light (e.g., ultraviolet, visible, and / or infrared light).

[0050] In an exemplary configuration, optical component 60 can sense ambient light (e.g., visible ambient light). Specifically, optical component 60 may have a photodetector that senses changes in ambient light intensity over time. As an example, if a user is operating in an environment with an artificial light source, the light source may emit light at a frequency associated with its wall power supply (e.g., 60 Hz AC mains). The photodetector of component 60 can sense the artificial light from the artificial light source, characterized by intensity fluctuations at 60 Hz. Control circuitry 12 can use this information to adjust clocks or other timing signals associated with the operation of the image sensor in device 10 to help avoid unwanted interference between the light source frequency and the frame rate or other frequencies associated with image capture operations. Control circuitry 12 can also use measurements from component 60 to help identify the presence and type of artificial light. In this way, control circuitry 12 can detect the presence of light such as fluorescence or other light with known non-ideal color characteristics and can perform compensating color shift adjustments (e.g., white point adjustment) on color-sensitive components such as cameras and displays. Because the optical component 60 can measure fluctuations in light intensity, the component 60 is sometimes referred to as a flicker sensor or an ambient light frequency sensor.

[0051] Optical component 62 may be an ambient light sensor. The ambient light sensor may include one or more photodetectors. In a single photodetector configuration, the ambient light sensor may be a monochromatic sensor that measures ambient light intensity. In a multi-photodetector configuration, each photodetector may be composed of overlapping optical filters that allow different wavelength bands (e.g., different visible and / or infrared passbands) to pass through. The optical filter passbands may overlap at their edges. This allows component 62 to function as a color ambient light sensor that measures both ambient light intensity and ambient light color (e.g., by measuring the color coordinates of the ambient light). During operation of device 10, control circuitry 12 may take action based on the measured ambient light intensity and color. As an example, the white point of a display or image sensor may be adjusted based on the measured ambient light color, or other display or image sensor color adjustments may be performed. The intensity of the display may be adjusted based on light intensity. For example, the brightness of display 14F may be increased under bright ambient light conditions to enhance the visibility of the image on the display, and the brightness of display 14F may be decreased under dim lighting conditions to save power. Image sensor operation and / or light source operation may also be adjusted based on ambient light readings.

[0052] The optical components in the effective area IA may also include components such as components 80 and 64 along the sides of the device 10. Optical components 80 and 64 may be pose tracking cameras used to help monitor the orientation and movement of the device 10. Components 80 and 64 may be visible light cameras (and / or cameras sensitive to visible and infrared wavelengths) and may be combined with an inertial measurement unit to form a visual inertial odometry (VIO) system.

[0053] Optical components 78 and 66 may be visible light cameras that capture real-time images of the environment surrounding device 10. These cameras, sometimes referred to as scene cameras or pass-through video cameras, capture moving images when the user's eyes are positioned within the eye-fitting zone 34 at the rear of device 10. These moving images are displayed in real-time on display 14R for the user's viewing. By displaying pass-through images (pass-through video) to the user in this manner, real-time information about the user's surroundings is provided. If desired, virtual content (e.g., computer-generated images) may be overlaid on a portion of the pass-through video. Device 10 can also operate in a non-pass-through video mode, in which components 78 and 66 are turned off, and only movie content, game content, and / or other virtual content that does not contain real-time real-world images are provided to the user.

[0054] The input-output device 22 of device 10 can acquire user input for controlling the operation of device 10. As an example, a microphone in device 10 can acquire voice commands. Buttons, touch sensors, force sensors, and other input devices can acquire user input from a user's finger or other external object touching device 10. In some configurations, it may be desirable to monitor the user's gestures or other body parts' movements. This allows the user's hand position or other body part position to be replicated in games or other virtual environments, and allows the user's hand movements to act as gestures (air gestures) for controlling the operation of device 10. Cameras operating in visible and infrared wavelengths, such as tracking cameras (e.g., optics 76 and 68), can be used to capture user input such as gesture input. Tracking cameras such as these can also track references and other identifiable features on these controllers and other external accessories (attached device 10 of system 8) during the use of controllers to control the operation of device 10. If needed, the tracking camera can help determine the position and orientation of a handheld or wearable controller that senses its position and orientation by measuring the magnetic field generated by coil 54. The use of a tracking camera can therefore help track hand movements and controller movements used to move pointers and other virtual objects displayed to the user, and can otherwise assist in the operation of the control device 10.

[0055] The tracking camera can operate satisfactorily in the presence of sufficient ambient light (e.g., bright visible ambient light conditions). In dim environments, supplementary light sources such as supplementary infrared light sources (e.g., optics 82 and 84) can provide supplementary illumination. Each infrared light source may include one or more light-emitting devices (light-emitting diodes or lasers) and may be configured to provide a fixed and / or steerable infrared beam as supplementary illumination for the tracking camera. The infrared light sources can be turned off in bright ambient light conditions if needed and can be turned on in response to the detection of dim ambient light (e.g., using the ambient light sensing capability of optics 62).

[0056] The three-dimensional sensors in device 10 can be used to perform biometric identification operations (e.g., facial recognition for authentication), to determine the three-dimensional shape of objects in a user's environment (e.g., mapping the user's environment to create a matching virtual environment for the user), and / or to otherwise acquire three-dimensional content during operation of device 10. As an example, optics 74 and 70 can be three-dimensional structured light image sensors. Each three-dimensional structured light image sensor may have one or more light sources that provide structured light (e.g., a dot projector that projects an infrared dot array onto the environment, a structured light source that generates a line grid, or other structured light components that emit structured light). Each three-dimensional structured light image sensor may also include a flood illuminator (e.g., a light-emitting diode or laser that emits a wide infrared beam). Using flood illumination and structured light illumination, optics 74 and 70 can capture facial images, images of objects in the environment surrounding device 10, etc.

[0057] Optical component 72 may be an infrared three-dimensional time-of-flight camera that uses time-of-flight measurements of emitted light to acquire three-dimensional images of objects in the environment surrounding device 10. Component 72 may have a longer range and a narrower field of view compared to the three-dimensional structured light cameras of optical components 74 and 70. The operating range of component 72 may be 30 cm to 7 m, 60 cm to 6 m, 70 cm to 5 m, or other suitable operating ranges (as an example).

[0058] Figure 4 This is a top view of device 10 in an exemplary arrangement in which the display 14F and the main housing portion 26M have been configured to be curved around a curved surface (curved face surface 30) surrounding the user's face. Specifically, the rear surface 96 of the housing portion 26M on the rear side R of device 10 may have a curve around an axis 98 (e.g., in...). Figure 4 The example shows a curved shape (parallel to the vertical Z-axis). Comfort is enhanced when wearing the device 10 by smoothly wrapping the outer shell portion 26M over the curved surface of the user's head.

[0059] like Figure 4 As shown, the display 14F and other structures on the front of the device 10 may have protective coverings, such as a display cover 92 (e.g., the front of the housing portion 26M, which may sometimes be referred to as a front housing wall, a transparent dielectric housing wall, or a dielectric housing member). In some embodiments, the display cover 92 may include areas characterized by curved surfaces that can be flattened into a plane without distortion (sometimes referred to as developable surfaces or curved surfaces without composite curvature). The display cover 92 may also include areas characterized by composite curvature (e.g., surfaces that can only be flattened into a plane with distortion, sometimes referred to as non-developable surfaces).

[0060] In the effective area AA of the display 14F, the overlay layer 92 overlaps with the pixel P array in the display panel 14P. In the ineffective area IA, the overlay layer 92 does not overlap with any pixels, but may overlap with optical components such as... Figure 3 The optical components are overlapped as shown. To help reduce the size and weight of device 10, display 14F may have a curved shape that wraps around the front of the user's head, parallel to the face surface 30 and parallel to the curved rear surface 96 of the housing portion 26M. For example, display panel 14P may have a shape that allows panel 14P to bend around a bending axis 94 (e.g., in...). Figure 4 The example shows a flexible substrate bent along a bending axis parallel to the Z-axis. In the effective region AA of the display 14F, the display cover layer 92 may have an inner surface and a corresponding curved outer surface, the inner surface having a curved cross-sectional profile conforming to the bending of the display panel 14P. In the ineffective region IA, the display cover layer 92 may also be curved (e.g., having a tighter bending radius and a larger curvature than in the effective region AA). If desired, a polymer layer (sometimes referred to as a shield or polymer member) may be interposed between the display cover layer 92 and the display panel 14P. The polymer layer may be separated from the pixels of the panel 14P by air gaps and from the inner surface of the display cover layer 92 by air gaps (as an example).

[0061] Figure 5A This is a cross-sectional side view of the display 14F viewed along the -X direction. (As shown) Figure 5A As shown, in the exemplary configuration, the cross-sectional profile of the display panel 14P (in a plane parallel to the YZ plane) can be straight rather than curved. This helps prevent wrinkling or other distortions in the flexible substrate material of the display panel 14P when it is bent around the bending axis 94 to wrap around the curved surface of the user's face. In this example, the display panel 14P may have a developable surface (e.g., a surface with a curved cross-sectional profile but without any composite curvature). Figure 5A Panel 14P may be attached to the inner surface of layer 92 (e.g., with adhesive). In this case, the inner surface of layer 92 may be a deployable surface that mates with the outward-facing deployable surface of panel 14P. The corresponding outer surface of layer 92 in the active region AA may be a deployable surface or may be a surface with a composite curvature. In the inactive region IA, layer 92 may include an inner surface and / or an outer surface with a composite curvature, and / or the inner surface and / or the outer surface may be deployable surfaces. If desired, the entire outer surface of layer 92 may have a composite curvature (in both the active region AA and the inactive region IA), the inner surface of layer 92 in the active region AA may be a deployable surface to which panel 14P is laminated with adhesive, and the inner surface of layer 92 in the inactive region IA may have a composite curvature and / or may be a deployable surface.

[0062] Figure 5B Another exemplary configuration of the display 14F is shown. For example... Figure 5B As shown in the cross-sectional side view, the display cover layer 92 may have a cross-sectional profile that curves across the entire layer 92, if desired. In this type of arrangement, the surface of the inactive region IA of the display cover layer 92 may have a composite curvature, and the active region AA of the display cover layer 92 may also have a composite curvature (e.g., layer 92 may not contain any region with a developable surface). A polymer layer, such as polymer layer 130, sometimes referred to as a shield or shield cover, may be interposed between the inner surface of the display cover layer 92 and the opposing outer surface of the display panel 14P. The outer surface of the display panel 14P may be a developable surface (e.g., the display panel 14P may be bent about axis 94). In the active region AA, where the polymer layer 130 overlaps with the pixels of the panel 14P, the polymer layer 130 may also be bent about axis 94 (e.g., the inner and outer surfaces of the polymer layer 130 in the active region AA may be developable surfaces). In the inactive region IA, the inner and outer surfaces of the polymer layer 130 may have a composite curvature. The air gap can separate panel 14P from the inner surface of layer 130, and can also separate the outer surface of layer 130 from the inner surface of layer 92.

[0063] Other arrangements of layer 130 may be used if desired. For example, the side of layer 130 facing the display panel 14P may have a developable surface in the effective area AA, while the side of layer 130 facing layer 92 may have a composite curvature in the effective area AA (e.g., layer 130 may have a non-uniform thickness). Layer 92 may also have different configurations. For example, the outer surface of layer 92 may have a composite curvature, while the inner surface of layer 92 in the effective area AA and / or area IA may be a developable surface. Other arrangements in which layer 92 and / or layer 130 have variable thicknesses may also be used. In the ineffective area IA, multiple polymer structures may be joined. For example, in area IA, an annular polymer member, sometimes referred to as a shield decoration, may be joined to layer 130, which may form a shield cover member extending across the entire front side of device 10. If desired, shield decorations and shield covers may sometimes be referred to as forming shields, shield members, etc., individually or collectively. Layer 130 may include coloring (e.g., dyes, pigments, and / or other colorants). For example, layer 130 may be colored to present 30%-80% visible light transmittance to help shield internal structures in device 10, such as display panel 14P, from being seen when not in use.

[0064] Figure 6 This is a front view of a portion of the display 14F and the display cover layer 92. The inner and outer surfaces of the display cover layer 92 that directly overlap with the effective area AA and the display panel 14P may be developable surfaces and / or may include areas with composite curvatures. In an illustrative configuration, such as... Figure 4 and Figure 5A As described, the inner surface of the cover layer 92 in region AA can be bent about the bending axis 94 without exhibiting curvature about any axis orthogonal to axis 94. The outer surface of layer 92 in region AA can be a developable surface or a surface with a composite curvature. A developable surface is used for the inward-facing side of the display cover layer 92 (and, if desired, a developable surface is used for...). Figure 5B The optional layer 130 (the inward-facing side) helps ensure that the display panel 14P does not wrinkle or otherwise become damaged during the bending of the panel 14P to form a curved display shape that conforms to the shape of the user's head.

[0065] The display panel 14P may have an outward-facing surface that is a deployable surface in the effective area AA. The display panel surface may be adhered to the corresponding deployable inner surface of layer 130 or the corresponding deployable inner surface of layer 92, or may be spaced apart from the inner surfaces of layer 130 and / or layer 92 by an air gap (as an example).

[0066] If desired, a portion or all of the inner and outer surfaces of the display overlay 92 in the inactive region IA may be characterized by a composite curvature. This allows the periphery of the display 14F to smoothly transition away from the active region and provides the device 10 with an attractive appearance and compact shape. The composite curvature of the display overlay 92 in the inactive region IA also facilitates the placement of optical components below the inactive region IA in a desired orientation. If desired, all regions of layer 92 may have a composite curvature (e.g., the inner and outer surfaces of layer 92 may have a composite curvature in both region IA and region AA).

[0067] exist Figure 6 In an exemplary configuration, the display cover layer 92 has curved peripheral edges and the inward-facing and outward-facing surfaces of the display cover layer 92 have a composite curvature in the ineffective region IA, along which the display cover layer 92... Figure 6 The cross-sectional profile of each line in the exemplary line 100 is curved (e.g., Figure 6 In the example, the entire peripheral annular invalid region of the display 14F is partially covered by the display cover 92, which has an inner and outer surface with a composite curvature. This type of shape of the display cover 92 can be produced by glass forming, polymer molding, machining, and / or other display cover manufacturing techniques. Other arrangements may also be used (e.g., configurations in which the display cover 92 has at least some developable surfaces (inner and / or outer surfaces) in the invalid region IA). Figure 6 The arrangement is illustrative.

[0068] Figure 7 , Figure 8 and Figure 9This is a front view of the exemplary upper left portion of the display overlay 92. The device 10 may have a symmetrical right overlay portion. Figure 7 The example illustrates how the peripheral edges of the display overlay 92 can have straight edges (e.g., a roughly rectangular shape with straight edges) and rounded corners. Figure 8 In the example, the display overlay 92 has a teardrop shape on the upper left and upper right sides. Figure 9 The diagram shows how the upper corner of the display overlay 92 may have a swept curve (e.g., to help soften the visual appearance of the device 10 when viewed from the front).

[0069] Figure 10 , Figure 11 and Figure 12 This is a front view of the exemplary lower left portion of the display overlay 92. (Example) Figure 10 As shown, the lower half of the cover layer 92 can be characterized by a rectangular shape with rounded corners. Figure 10 The covering layer 92 may have Figure 7 The upper portion of the shape of the type shown (as an example). In the bridge portion of device 10, the cover layer 92 may have a recessed, curved bridge edge shape (see, for example, curved edge surface 90). Figure 11 In the exemplary arrangement, the display overlay 92 has teardrop-shaped lower left and lower right sides (e.g., can be used with...). Figure 8 The types shown are the left and right teardrop shapes used together in the display overlay. Figure 12 This illustrates how the lower portion of the display overlay 92 can have a more gradually curved profile.

[0070] Generally speaking, when viewed from the front of the device 10, the upper and lower portions of the cover layer 92 may have any suitable contour. The shape of the cover layer 92 may be determined by factors such as aesthetics, size, ability to facilitate proper placement of optical components in the ineffective region IA, and ability to provide the desired coverage of the effective region (overlapping with the effective region AA). Figure 7 , Figure 8 and / or Figure 9 Any of the exemplary shapes in the exemplary shape of the upper portion of the device 10 shown may be related to Figure 10 , Figure 11 and Figure 12 Any of the exemplary shapes in the illustrative shape of the lower portion of the device 10 shown are used in combination. The overall shape of the cover layer 92 may be symmetrical about the bridge of the nose (e.g., the left and right halves of the layer 92 may exhibit mirror symmetry). Figure 7 , Figure 8 , Figure 9 , Figure 10 , Figure 11 and Figure 12The shape shown is illustrative. Other shapes can be used if needed.

[0071] Figure 13 This is an exploded cross-sectional top view of a portion of device 10, illustrating how the display overlay 92 may have portions overlapping with the display panel 14P and portions overlapping with decorative overlay structures such as a shield 102 (e.g., an annular shield portion sometimes referred to as shield decoration or shield decoration member, which may optionally be attached in region IA to a shield cover covering the display 14F, such as an optional polymer layer 130). The decorative overlay structures in the invalid region IA may be formed by an opaque masking layer (e.g., a layer of black ink) and / or other coatings on the inner surface of the display overlay 92 and / or on the shield, by separate structures formed of metal, polymer, glass, or other materials, and / or other structures that may help conceal the overlapping components 104. Component 104 may include sensor 16 and... Figure 2 Other input-output devices 22. For example, component 104 may be an optical component, such as... Figure 3 Components 60, 62, 64, 84, 66, 68, 70, 72, 74, 76, 78, 82, and 80. In the inactive region IA, the cover layer 92 may have curved inner and outer surfaces (e.g., surfaces with composite curvature). The shield 102 (and, if desired, layer 130 in region IA) may optionally have corresponding inner and outer surfaces (e.g., surfaces with composite curvature). Component 104 can be operated via optical component windows in shield 102 (and optionally in layer 130 in region IA) and corresponding areas in layer 92. These windows may be formed by recesses and / or through-hole openings in the cover 102 (and optionally in the layer 130) and / or layer 92, by window members installed within openings in the cover 102 (and optionally in the layer 130) and / or layer 92, by portions of the cover 102 (and optionally in the layer 130) and / or layer 92 exhibiting sufficient optical transparency to allow the overlapping components to operate satisfactorily, and / or by other structures in the cover 102 (and optionally in the layer 130) and / or window 92.

[0072] If desired, component 104 may include components of a camera (e.g., a visible and / or infrared image sensor, a time-of-flight sensor, a structured light 3D sensor, etc.) that are sensitive to optical distortions imposed by the curved shape of the curved inner and / or outer surfaces of the cover layer 92. For example, the camera or other optical component 104 may operate via a portion of the cover layer 92 in the invalid region IA characterized by an outer surface with a composite curvature and an inner surface or developable inner surface with a composite curvature. In this type of case, the control circuitry of device 10 may be configured to digitally compensate for optical distortions introduced when light (e.g., real-world image light) passes through layer 92 to reach the camera or other optical sensor. As an example, for each optical component operating via layer 92 (e.g., via a portion of layer 92 in the invalid region IA including an inner surface and / or outer surface with a composite curvature), the amount of image distortion (e.g., stretching, displacement, trapezoidal distortion, barrel distortion, pincushion distortion, and / or other optical distortions) imposed by layer 92 may be measured and characterized. During operation of device 10, image data captured by the camera and / or other sensor data acquired by optical components overlapped by layer 92 can be compensated accordingly (e.g., an equal and opposite amount of digital image warping can be applied to the captured image data to remove known distortion effects of layer 92). In this way, high-quality (undistorted) images and / or other sensor data can be acquired by a camera and / or other optical components operating through the curved portion of layer 92. This allows layer 92 to be given an attractive shape (e.g., a shape having one or more surfaces characterized by a composite curvature).

[0073] When assembled into device 10, the display cover 92 and shield 102 (and optionally layer 130) can be mounted to exposed edge portions of a polymer housing structure, metal housing wall, or other housing structure within the main housing portion 26M. For example, the main housing portion 26M may have polymer sidewall members extending around the periphery of the display cover 92 and supporting the peripheral edge of the display cover 92. The shield 102 may have an annular shape extending along the edge of the display cover 92 in the inactive region IA. In an exemplary configuration, the display cover 92 is attached to the shield 102 (and / or layer 130) using an adhesive, and the shield 102 (and / or layer 130) is attached to the exposed front edge of the sidewall in the main housing portion 26M using an adhesive. Component 104 may be attached to shield 102 (and / or layer 130) and / or supported on an internal housing structure (e.g., bracket, frame member, etc.) and aligned with the optical window in shield 102 (and / or layer 130) and the corresponding portion of layer 92.

[0074] Figure 14 This is a cross-sectional side view of a portion of display 14F. Figure 14In the example, display panel 14P is a three-dimensional display panel having a pixel P array superimposed by biconvex lenses 106 (e.g., display panel 14P is for viewers such as...). Figure 1 An automated stereoscopic display that generates glasses-free 3D images for viewer 50. As an example, lens 106 may be composed of a semi-cylindrical lens element extending along a column of pixels (e.g., in...). Figure 14 In the example, a lens element extending parallel to the Z dimension is formed. If necessary, lens 106 can be omitted (e.g., display panel 14P may have an array of pixels P that are not overlapped by lens 106 to form a two-dimensional display).

[0075] Air gaps, such as gap 114, can separate the display panel 14P of the display 14F from the display cover layer 92. Optional layer 130 can be formed on... Figure 14 Within the gap 114, layer 130 has an outer surface separated from layer 92 by a first air gap and an opposite inner surface separated from lens 106 and pixels P of display panel 14P by a second air gap. In the arrangement where lens 106 is present, the absence of air gap 114 (and the resulting direct contact between the inner surface of layer 130 and lens 106) allows lens 106 to operate satisfactorily. Display cover layer 92 and optional layer 130 may be formed of transparent materials such as glass, polymers, light-transmitting ceramics, crystalline materials such as sapphire, one or more sublayers of these materials, and / or other materials that have been laminated together (e.g., using adhesives, etc.). Configurations in which layer 92 is a glass layer and layer 130 is a polymer layer are sometimes described herein as examples.

[0076] A coating may be provided on one or more layers of the display overlay 92. For example... Figure 14 As illustrated in the exemplary configuration, the display overlay 92 may include layers such as layer 108 formed of one or more sublayers (e.g., glass and / or polymer layers), a polymer layer that helps provide the safety glass function to layer 92 (see, for example, exemplary polymer film 112, which has been attached to the inner surface of glass layer 108 to form a laminated glass layer), and a coating 110 on the (outward-facing) front surface of layer 92 (e.g., the outer surface of glass layer 108). Coating 110 may be, for example, an anti-reflective coating formed of one or more inorganic dielectric layers and / or other layers, the thickness and refractive index values ​​of which are selected to minimize visible light reflection from the outermost surface of layer 92 and help maintain the desired appearance of layer 92 (e.g., a neutral tone). If desired, the display panel 14P may be a touch-sensitive display (e.g., a display consisting of capacitive touch sensor circuitry superimposed or combined with capacitive touch sensor circuitry). In a configuration where display 14F is a touch-sensitive display, the outermost surface of layer 92 may be coated with an oleophobic coating (e.g., a fluoropolymer layer).

[0077] To help strengthen layer 92, layer 108 may be formed of chemically strengthened glass (e.g., a glass layer that has been treated in an ion exchange bath to bring the outer surface of the glass layer under compression relative to the interior of the glass layer). This helps layer 108 resist scratches and breakage. Layer 108 may be formed of a single glass layer, a single polymer layer, a stack of two laminated glass layers (e.g., a first and second glass layer laminated together with polymer layers), a stack of two polymer layers, three or more polymer layers and / or glass layers, etc. If desired, layer 108 may be formed of a mixed layer stack including one or more glass layers attached to one or more polymer layers. As an example, layer 92 may include a rigid structural polymer layer covered with a thin glass layer (e.g., a glass layer attached to the structural polymer layer using heat and / or pressure, or a glass layer attached to the structural polymer layer using a polymer adhesive layer). In this type of arrangement, the thin glass layer helps protect the structural polymer layer from scratches.

[0078] If desired, one or more structures in layer 92 (e.g., coating 110, the layer forming layer 108, layer 112, optional layer 130, etc.) may be provided with dyes, pigments, or other colorants that produce a desired neutral hue (e.g., gray or black) or a non-neutral hue (e.g., red). Thin metal coatings, polarizers, and / or other structures may also be incorporated into layer 92 to help provide layer 92 with desired optical properties and / or a desired appearance.

[0079] If necessary, the portion of layer 92 overlapping with optical component 104 and / or other portions of layer 92 may be coated with a coating that helps prevent scratches that could adversely affect the optical quality of component 104. Figure 15 As shown, for example, the display overlay 92 may have a transparent layer such as a transparent layer 116 (e.g., one or more polymer layers, glass layers, and / or other materials such as...). Figure 14 (Other transparent layers of layer 108). Transparent layer 116 may be covered with one or more coatings, such as coating 118. Layer 118 may be a thin film layer formed of an inorganic material (e.g., oxides, nitrides, diamond-like carbon, etc.) that helps resist scratches. This type of approach can be used, for example, to ensure that the portion of the display overlay layer 92 that overlaps with the optical component 104 does not become blurred due to scratches when layer 116 is formed of a material such as a polymer that may be easily scratched when exposed to excessive friction from sharp external objects. Layer 118 may sometimes be referred to as a hard coating and may have a higher hardness (e.g., a higher Mohs hardness) compared to layer 116. Layer 118 may be a thin film coating with a thickness of less than 3 micrometers, less than 2 micrometers, less than 1 micrometer, less than 0.5 micrometers, or other suitable thickness.

[0080] Figure 16A cross-sectional side view of the display cover 92 illustrates another way to help prevent unwanted scratches on the surface of the display cover 92 that overlaps with the optical component 104. As demonstrated in this example, the outer surface of the display cover 92 may be provided with recesses such as recesses 120 (e.g., shallow circular recesses or recesses with a rectangular shape or other area). This places the recessed display cover surface 124 of the recess 120 below the surrounding outer surface 122 of the layer 92. When the device 10 is placed on a desktop or other surface, the non-recessed portion of the surface of the layer 92 (outer surface 122) will contact the desktop surface and will thereby help prevent the desktop surface from contacting the recessed portion (surface 124) of the surface of the layer 92. Therefore, the recessed surface 124 overlapping with the component 104 will remain scratch-free. Thus, even when the layer 92 is exposed to excessive wear, blurring will generally not occur in the area of ​​the layer 92 that overlaps with the component 104.

[0081] Layer 92 may be formed of a material having optical properties compatible with the overlapping optical component 104. For example, if the optical component partially overlapped by layer 92 in the ineffective region IA is configured to operate at visible and infrared wavelengths, that portion of layer 92 may be provided with sufficient visible and infrared transparency to allow the overlapping component to operate satisfactorily at visible and infrared wavelengths. In arrangements where the material from the body of layer 92 does not have the desired optical properties for the optical component, an optical component window member (e.g., a window material disk, such as an infrared transparent disk, and, if necessary, visible transparent glass or other inserted window member) may be mounted within an opening in layer 92 that overlaps with the optical component.

[0082] As an example, consider an arrangement in which layer 92 is transparent to visible light but has low transmittance at infrared wavelengths. Optical components in this type of arrangement can operate at infrared wavelengths. To ensure that the optical components can emit and / or receive infrared light through layer 92, layer 92 may be provided with through-hole openings and infrared-transparent optical component window members, such as infrared-transparent disks. The infrared-transparent window members may be formed of a material different from the material forming layer 92 and may be mounted within the through-hole openings in layer 92. This type of arrangement in… Figure 17 As shown in the cross-sectional side view, the display cover layer 92 has an optical component window member 92W disposed in a through-hole opening in the layer 92. The member 92W may be a glass optical component window member that is transparent to infrared light (and optionally transparent to visible light), while the surrounding portion of the layer 92 may be formed of different materials (e.g., polymers, different glass materials, etc.). By providing an infrared-transparent window in the layer 92, infrared optical components (e.g.,...) are... Figure 17The optical component 102 can emit and / or receive infrared light through the display overlay 92 (e.g., through a window in the display overlay), even when the layer 92 is formed of a non-infrared transparent material. This method can be used to provide an optical component window with any suitable optical properties (e.g., desired amounts of opacity, transmittance, reflection, absorption and / or blurring, desired polarization characteristics, etc.) that differ from those of the rest of the layer 92.

[0083] According to one embodiment, a head-mounted device is provided, comprising: a head-mounted support structure; rear-facing displays supported by the head-mounted support structure, the rear-facing displays being configured to provide visual content to an eye-friendly area at the rear of the head-mounted support structure; a common-view forward-facing display panel having pixels configured to display images; and a display overlay overlapping the common-view forward-facing display panel, the display overlay having a composite curvature surface overlapping the pixels.

[0084] According to another embodiment, the publicly visible forward display panel includes a flexible display panel on which the pixels are positioned, the flexible display panel is bent about a bending axis, and the head-mounted support structure has a curved rear surface configured to conform to a curved facial surface.

[0085] According to another embodiment, the display cover layer includes a glass layer.

[0086] According to another embodiment, the head-mounted device includes a polymer layer located between the glass layer and the flexible display panel, a first air gap separating the polymer layer from the glass layer, and a second air gap separating the flexible display panel from the polymer layer.

[0087] According to another embodiment, the display overlay includes an anti-reflective coating located on the glass layer.

[0088] According to another embodiment, the head-mounted device includes optical components that are partially overlapped by the display overlay having the composite curvature surface.

[0089] According to another embodiment, these optical components include cameras, and the head-mounted device includes an annular polymer component that forms a decorative overlay structure that overlaps with the cameras and surrounds the pixels.

[0090] According to another embodiment, the display cover layer includes a polymer layer having a recess that overlaps with a given one of the optical components.

[0091] According to another implementation, these optical components include a scintillation sensor and an ambient light sensor.

[0092] According to another embodiment, these optical components include pose cameras and scene cameras, the pose cameras being configured to measure device motion and the scene cameras being configured to capture real-time pass-through video displayed on these rear-facing displays.

[0093] According to another embodiment, these optical components include a pair of structured light cameras and a time-of-flight camera.

[0094] According to another embodiment, the display overlay includes a polymer layer with a through-hole opening that contains an infrared transparent window member overlapping one of the optical components.

[0095] According to another embodiment, the head-mounted device includes a scratch-resistant hard coating located on the display cover.

[0096] According to another embodiment, the forward-facing display panel includes biconvex lenses.

[0097] According to another embodiment, the forward-facing display panel has a nose bridge recess.

[0098] According to one embodiment, a head-mounted device is provided, comprising: a head-mounted support structure; a left lens located on the left side of the head-mounted support structure; a right lens located on the right side of the head-mounted support structure; a left display and a right display configured to provide respective left-rear and right-rear images viewable from a left-adaptive area and a right-adaptive area through the left lens and the right lens; a common-viewable display panel facing away from the left and right displays, the common-viewable display panel having pixels configured to display a common-viewable image; and a display overlay, a first portion of which overlaps with the pixels, a second portion of which surrounds the first portion of the display overlay in an annular shape without overlapping the pixels, and the second portion of the display overlay including a surface having a composite curvature.

[0099] According to another embodiment, the head-mounted device includes: an ambient light sensor overlapped by the second portion of the display overlay; a light source overlapped by the second portion of the display overlay, the light source being configured to provide infrared illumination in response to an ambient light measurement performed using the ambient light sensor; and a pair of cameras overlapped by the second portion of the display overlay and configured to capture infrared images when the infrared illumination is provided.

[0100] According to another implementation, the publicly visible display panel is bent around the bending axis.

[0101] According to another embodiment, the second portion of the display cover has a curved peripheral edge.

[0102] According to another embodiment, the display cover layer includes laminated glass.

[0103] According to another embodiment, these pixels form an effective display area in which the public visual image is displayed, the effective display area having curved peripheral edges and a bridge-shaped recess.

[0104] According to another embodiment, the head-mounted device includes an anti-reflective coating on the laminated glass; and optical components that emit infrared light through the display cover.

[0105] According to another embodiment, the optical component includes a structured light 3D camera.

[0106] According to another embodiment, the first portion of the display overlay includes a surface with a composite curvature.

[0107] According to one embodiment, a head-mounted device is provided, comprising: a head-mounted support structure; a first display and a first lens supported by the head-mounted support structure and configured to provide a first image to a first eye-adaptive region; a second display and a second lens supported by the head-mounted support structure and configured to provide a second image to a second eye-adaptive region; a forward-facing display facing away from the first display and the second display; and a display cover layer overlapping the forward-facing display and including a portion having a composite curvature surface.

[0108] According to another embodiment, the forward-facing display includes a flexible display panel that is bent around a bending axis and has a deployable surface.

[0109] According to another embodiment, the display overlay has a portion that overlaps with the flexible display panel and has a stretchable surface.

[0110] According to another embodiment, the display overlay covers a surface with a composite curvature.

[0111] According to one embodiment, a head-mounted device having a front and a rear portion is provided, comprising: a head-mounted housing having a front housing layer at the front portion; a first display and a first lens supported by the head-mounted housing and configured to provide a first image to a first eye-adapting area at the rear portion; a second display and a second lens supported by the head-mounted housing and configured to provide a second image to a second eye-adapting area at the rear portion; and an optical component partially overlapped by a surface having a composite curvature of the front housing layer.

[0112] According to another embodiment, the head-mounted device includes a foldable display panel configured to produce an image that can be viewed through a portion of the front housing layer.

[0113] According to another embodiment, the front housing layer includes a display cover layer, and the composite curvature surface includes the outer surface of the display cover layer that covers the entire outer surface of the display cover layer.

[0114] According to another embodiment, the optical component includes a camera configured to operate through the display overlay.

[0115] According to one embodiment, a head-mounted device having a front and a rear portion is provided, comprising: a head-mounted housing; a first display and a first lens located within the head-mounted housing and configured to provide a first image to a first eye-adapting area at the rear portion; a second display and a second lens located within the head-mounted housing and configured to provide a second image to a second eye-adapting area at the rear portion; a display panel having a curved cross-sectional profile and a deployable surface; and a display cover layer located at the front portion and overlapping the curved display panel, the display cover layer having opposing inner and outer surfaces, the outer surface having a composite curvature, the inner surface being a deployable surface, and the display panel being attached to the inner surface of the display cover layer.

[0116] The foregoing description is merely illustrative and various modifications can be made to the described implementation scheme. The described implementation scheme can be implemented independently or in any combination.

Claims

1. A head-mounted device having a front and a rear portion, the head-mounted device comprising: A head-mounted housing having a front housing layer at the front; A first display and a first lens, the first display and the first lens being supported by the head-mounted housing and configured to provide a first image to a first eye-adaptive zone at the rear; A second display and a second lens, the second display and the second lens being supported by the head-mounted housing and configured to provide a second image to a second eye-adaptive zone at the rear; as well as An optical component, which is partially overlapped by the front outer shell layer having a surface with a composite curvature.

2. The head-mounted device according to claim 1, further comprising: A bent display panel, the bent display panel being configured to produce an image that can be viewed through an additional portion of the front housing layer.

3. The head-mounted device according to claim 2, wherein, The front housing layer includes a display overlay, and wherein the composite curvature surface includes the outer surface of the display overlay.

4. The head-mounted device according to claim 3, wherein, The optical components include a camera configured to operate through the display overlay.

5. The head-mounted device according to claim 3, wherein, The bending display panel includes a flexible display panel with a stretchable surface.

6. The head-mounted device according to claim 5, wherein, The additional portion of the front outer shell layer has an additional deployable surface that overlaps with the flexible display panel.

7. The head-mounted device according to claim 1, wherein, The optical components include an ambient light sensor, and the head-mounted device further includes: A light source, which is overlapped by the front housing layer and configured to provide infrared illumination in response to ambient light measurement using the ambient light sensor; and A pair of cameras, which are overlapped by the front housing layer and configured to capture infrared images when the infrared illumination is provided.

8. The head-mounted device according to claim 1, wherein, The front outer shell layer comprises laminated glass.

9. The head-mounted device according to claim 1, wherein, The optical components include a structured light 3D camera.

10. The head-mounted device according to claim 1, wherein, The front outer shell layer has opposite inner and outer surfaces, the outer surface having the composite curvature surface, and the inner surface being a developable surface.

11. A head-mounted device having a front and a rear portion, the head-mounted device comprising: Headset-style casing; A first display and a first lens, located within the head-mounted housing, are configured to provide a first image to a first eye-adaptive zone at the rear. A second display and a second lens, located within the head-mounted housing, are configured to provide a second image to a second eye-adaptive zone at the rear. The display panel has a curved cross-sectional profile and a deployable surface; as well as A display cover layer is located at the front and overlaps with the display panel, wherein the display cover layer has opposite inner and outer surfaces, the outer surface has a composite curvature, the inner surface is a developable surface, and the display panel is attached to the inner surface of the display cover layer.

12. The head-mounted device of claim 11, further comprising optical components, the optical components being overlapped by the display overlay.

13. The head-mounted device according to claim 11, wherein, The optical components include a pair of structured light cameras and a time-of-flight camera.

14. A head-mounted device, comprising: Headband support structure; A rear-facing display, supported by the head-mounted support structure, is configured to provide visual content to an eye-friendly area at the rear of the head-mounted support structure. A glass outer shell layer, wherein the glass outer shell layer has a portion having a composite curvature; as well as An optical component, which is overlapped by a portion of the glass housing layer having the composite curvature, wherein the optical component includes a pair of structured light cameras and a time-of-flight camera.

15. The head-mounted device of claim 14, further comprising a polymer layer on the glass outer shell layer, wherein, An air gap separates the polymer layer from the glass shell layer.

16. The head-mounted device of claim 14, further comprising an anti-reflective coating located on the glass housing layer.

17. The head-mounted device according to claim 14, wherein, The optical components include a camera, and the head-mounted device also includes an annular polymer component that forms a decorative overlay structure that overlaps with the camera.

18. The head-mounted device of claim 14, further comprising a polymer layer having a recess that overlaps with a given optical component.

19. The head-mounted device according to claim 14, wherein, The optical components include a scintillation sensor and an ambient light sensor.

20. The head-mounted device of claim 14, further comprising a polymer layer having a through-hole opening, the through-hole opening including an infrared transparent window member overlapping one of the optical components.

Images