Head-mounted device with side dimmer

Abstract

The present invention discloses an optical device for a head-mounted display assembly for mounting on a user's head, the optical device being a side shield of the head-mounted display that alters the peripheral light entering the head-mounted display.

Description

Technical Field

[0001] This application relates to a head-mounted display assembly including a side dimmer, preferably having at least one optical element; a device including the assembly; a processor; a storage device including instructions for controlling the device; and a method of operating the assembly. Background Technology

[0002] Augmented reality (AR) and virtual reality (VR) devices provide digital virtual images to the human eye. In the case of a VR device, or an AR device used in a VR mode, it can be advantageous to occlude the real world to enhance the immersive experience. Such headsets may include light blockers to block ambient light.

[0003] In some situations, individuals may need to be situationally aware and see the real world in their surroundings. Users can remove the light-blocking components to achieve this. Summary of the Invention

[0004] This application provides an optical device for a head-mounted display assembly for mounting on a user's head. The optical device is a side shield of the head-mounted display that alters the ambient light entering the head-mounted display.

[0005] The side shield can be a controllable optical device. This optical device is controllable to alter the transmission of ambient light entering the head-mounted display.

[0006] The optical device may include a dimming film mounted on a substrate, the dimming film being controllable to alter light transmission. An anti-reflective coating and / or a hard coating may be formed on either side of the dimming film.

[0007] The dimming film can be formed on a substrate. The substrate can be flexible.

[0008] The optical device may include a liquid crystal layer disposed between a first electrode and a second electrode, wherein a potential applied between the first electrode and the second electrode determines the transmission of light in the optical device. One of the first electrode and the second electrode may include multiple individually addressable electrodes, allowing for different control of light transmission in different regions of the liquid crystal material.

[0009] A head-mounted display (HMD) device may include two optical elements, each positioned on one side of the HMD device. The HMD device also includes one or more optical lenses in the field of view of a user's eyes. The HMD device may also include a left lens in the field of view of the user's left eye and a right lens in the field of view of the user's right eye. The HMD device may further include a controller for independently controlling the two optical elements located on each side of the HMD device to control the left and right lenses.

[0010] An assembly includes: an optical device for a head-mounted display assembly for mounting to a user's head, the optical device being a side shield of the head-mounted display that alters ambient light entering the head-mounted display; and at least one additional optical element.

[0011] The at least one additional optical element may be an optical device in the user's field of view of the head-mounted display. The at least one additional optical element may include at least one of the following: a waveguide, a brightness adjustment component, a lens, an image generating device, a reflection reduction layer, or a protective layer.

[0012] A head-mounted display device that may include the component.

[0013] An apparatus comprising: an optical device for a head-mounted display assembly for mounting to a user's head, the optical device being a side shield of the head-mounted display device that alters ambient light entering the head-mounted display device; at least one processor; and at least one storage device containing instructions configured to use the at least one processor to cause the apparatus to control one or more properties of a liquid crystal LC layer of the optical device.

[0014] The device can be configured to be mounted on a person's head, wherein additional optical units are stacked and positioned within the field of view of the person's eye. The device may also include a first lens and a second lens, the first lens including a first electrode of the LC layer, and the second lens including a second electrode of the LC layer. The field of view of the eye can be a first field of view of a first eye, and the first lens is configured to be positioned within the first field of view in use, and the second lens is configured to be positioned within the second field of view of a second human eye on the person's head in use.

[0015] The device may be at least one of an augmented reality display device, a virtual reality display device, or a mixed reality display device.

[0016] The side shield can be controlled based on one or more of the following: ambient light in the environment where the headset is used; the light level around the headset; user control input; the application running on the headset; the content viewed on the headset; the location of the headset; the date; or a time of day.

[0017] A method of operating an optical device for a head-mounted display assembly for mounting to a user's head, the optical device being a side shield of the head-mounted display device that alters ambient light entering the head-mounted display device, the method comprising: selectively controlling the light transmission of the optical device.

[0018] When the head-mounted display is mounted on a user's head, the head-mounted display assembly may also include another optical device in the user's field of view, the method comprising independently controlling the optical device as a side shield and another optical device. Attached Figure Description

[0019] Figure 1 A representation of an example head-mounted display equipped with a side dimmer is shown;

[0020] Figure 2 Displays control of head-mounted displays equipped with side dimmers (such as...) Figure 1 A representation of a system architecture example (shown).

[0021] Figure 3 A representation of a first example implementation of a side dimmer is shown;

[0022] Figure 4 A representation of a second example implementation of a side dimmer is shown;

[0023] Figure 5 A representation of an example head-mounted display device including a liquid crystal and adaptive optics lenses is shown;

[0024] Figure 6 Displays the operation Figure 4 An example representation of a head-mounted display device system;

[0025] Figure 7 The representation of the example device is shown schematically. Detailed Implementation

[0026] Many different aspects have been described above. It should be recognized that other aspects may be provided by combining any two or more of the above aspects.

[0027] Various other aspects are also described in the following detailed description and the appended claims.

[0028] refer to Figure 1The illustration shows an exemplary head-mounted display device 80, which typically includes a frame that includes a left arm 83, a right arm 81, and a frame 85.

[0029] The face frame 85 houses a left lens 84 and a right lens 82. In one example, a left eye shield 88 may be attached to the left arm 83 and adjacent to the face frame 85. In another example, a right eye shield 86 may be attached to the right arm 81 and adjacent to the face frame 85. A light shield may be integrated into the head-mounted display device 80 or detached from it. The light shield may be located above and / or below the eyes and / or the left and right arms, may be an integral structure surrounding the head-mounted display device, may be an integral structure forming portions of the left and right arms, or may be a separate structure above and below the arms. The purpose of the side shields is to control the level of ambient light entering the head-mounted display device from their respective sides, as discussed below.

[0030] In one example, an ambient light sensor 90 may be disposed on the faceplate 85, located between the right lens 82 and the left lens 84. In one example, a left-side light sensor 96 may be disposed in the left arm 83 of the head-mounted display. In one example, a right-side light sensor 92 may be disposed in the right arm 83. There may be multiple light sensors, only one light sensor, or no light sensor at all.

[0031] A left-side user input control 98 may be located in the left arm of the head-mounted display device. A right-side user input control 94 may be located in the right-side arm 81.

[0032] The control circuit system, including the processor and memory, can be located in faceplate 85.

[0033] Figure 1 The components and their positions shown are exemplary. In particular, sensors and input control components may be located in different positions, one or all of the components may be omitted, or additional sensors or control inputs may be included.

[0034] refer to Figure 2 This illustrates an exemplary architecture of a device utilizing side controls, such as a device for a head-mounted display utilizing a variable side dimmer, such as... Figure 1 The head-mounted display device 80.

[0035] In one example, architecture 100 includes a controller 102, which includes a processor 120, a memory 122, a content control unit 126, a viewing control unit 128, a position control unit 130, and a timing control unit 132.

[0036] In one example, controller 102 receives signals from a right-side photosensitive unit 104, a left-side photosensitive unit 108, an ambient light sensor 106, a left-side user input control unit 110, and a right-side user input control unit 124.

[0037] In one example, controller 102 generates signals to a right shield unit 112, a right spectacle lens unit or light engine optics assembly 114, a left spectacle lens unit or light engine optics assembly 116, and a left shield unit 118.

[0038] In one example, depending on the implementation associated with the head-mounted display device 80, such as augmented reality (AR), virtual reality (VR), etc., the controller 102 operates to control a right lens unit 114 positioned in front of a user's right eye and a left lens unit 116 positioned in front of a user's left eye. The processor 120, memory 122, and other components of the controller 102 operate as needed to control the left lens unit 114 and the right lens unit 116.

[0039] In addition, the controller 102 operates to control the right eye shield unit 112 and the left eye shield unit 118 together or independently.

[0040] The left shield unit 118 and the right shield unit 112 are controllable optical elements. These optical elements are controlled to control the light transmission from the outside of the head-mounted display to the inside of the head-mounted display, respectively, on the user's left and right sides. Therefore, these optical elements have a dimming function, allowing a certain range of light to pass through. In extreme cases, the range can be from allowing all light (100%) to not allowing any light (0%) to pass through.

[0041] Figure 3 This is an exemplary embodiment of an optical element used to implement the left shield unit 118 or the right shield unit 112. Although a specific dimming technique based on a liquid crystal layer has been described, this is merely exemplary, and many other dimming techniques can be used, such as electrochromic, suspended particle devices (SPD), polymer-dispersed liquid crystals (PDLC), and electrophoresis.

[0042] The optical element may include a substrate layer 140, which may be cellulose triacetate (TAC), polyethylene terephthalate (PET), glass, or another transparent polymer. The substrate is... Figure 3 The example shown is flat, but it can be curved. The shape of the substrate is determined by implementing the side shield.

[0043] One surface of the substrate layer 140 may have an optional hard coating 142 deposited thereon, and may have an optional anti-reflective coating 144 (applied to the hard coating 142 if present, otherwise applied to the substrate layer 140).

[0044] A dimming film 146 is applied to the other surface of the substrate layer 140. The dimming film may be a liquid crystal (LC) layer, an electrochromic layer, an electrophoretic layer, etc.

[0045] Another surface of the dimming film 146 may have an optional hard coating 148 deposited thereon, and may have an optional anti-reflective coating 150 (applied to the hard coating 148 if present, otherwise applied to the dimming layer 146).

[0046] Figure 4 This is another exemplary implementation that illustrates in more detail an example electrode structure of an example segmented dimmer, which can be used to implement dimming. In one example, the side shields 86, 88 can be according to... Figure 4 It is implemented using the structure.

[0047] The example segmented dimmer includes a liquid crystal layer 166, comprising liquid crystal molecules 182n. Each side of the liquid crystal layer 166 has a top plate 162 and a bottom plate 164. A plurality of spacers 1801 to 180n are disposed in the liquid crystal layer 166 to maintain a gap between the bottom plate 164 and the top plate 162.

[0048] Example top plate 162 includes an alignment layer 172 adjacent to liquid crystal layer 166, an electrode layer 170 adjacent to alignment layer 172, and a TAC (cellulose triacetate) film 168 adjacent to electrode layer 170. Electrode layer 170 may be an indium tin oxide (ITO) layer.

[0049] Example substrate 164 includes an alignment layer 178 adjacent to liquid crystal layer 166, an electrode layer 176 adjacent to alignment layer 178, and a TAC (cellulose triacetate) film 174 adjacent to electrode layer 176. Electrode layer 170 may be an indium tin oxide (ITO) layer.

[0050] Voltage is applied across electrode 170 and electrode layer 176 to control dimming and light transmission through LC layer 166.

[0051] In the illustrated example, electrode layer 176 is formed of a plurality of conductive strips 1761 to 176n. A common voltage may be applied to each electrode strip, or different voltages may be applied to some or all of the electrode strips to control dimming.

[0052] Alternative structures for electrode layer 176 can be implemented. Electrode layer 176 can be multiple pixels that can be individually driven, or multiple regions each comprising multiple pixels, which can be individually driven. Dozens or hundreds of pixels can be controlled independently. Pixels or regions can be formed in any shape, such as squares or hexagons.

[0053] Another alternative structure for electrode layer 176 is an active matrix of pixels, each driven by a TFT (thin-film transistor), thereby allowing independent control of thousands or more pixels.

[0054] Generally speaking, there are no restrictions on dimming techniques or structures, including electrode design, for implementing dimming functions.

[0055] Each of the right lens unit 112 and the left lens unit 116 may include, for example, Figure 4 The segmented dimmer shown has voltage applied to the electrodes within it, which is controlled by controller 102.

[0056] refer to Figure 2 The operation of the modified head-mounted display device in one example is further explained, and in particular the control of the dimming function of the side shields 86, 88.

[0057] In this example, an optional ambient light sensor 106 is configured to sense ambient light in the environment where the head-mounted display 80 is used and to provide a measurement of that ambient light to the controller 102. This measurement may be an indication of ambient brightness. In response to this measurement of ambient light, the controller 102 may control dimming provided by one or both of the right-side shield unit 112 and the left-side shield unit 118. The head-mounted display may be equipped with more than one ambient light sensor, and the processor may control dimming provided by one or both of the right-side shield unit 112 and the left-side shield unit 118 based on the average value from multiple sensors. The processor may control dimming provided by one or both of the right-side shield unit 112 and the left-side shield unit 118 based on ambient light measurements detected on the corresponding side.

[0058] An optional right light sensor unit 104 is configured to sense light at the right side of the head-mounted display and provide a measurement of the light level to the controller 102. This measurement can be an indication of brightness. In response to this measurement of the right-side light, the controller 102 can control the dimming provided by the right-side shield unit 112.

[0059] An optional left light sensor unit 108 is configured to sense light at the left side of the head-mounted display and provide a measurement of the light level to the controller 102. This measurement can be an indication of brightness. In response to this measurement of the left light, the controller 102 can control the dimming provided by the left shield unit 118.

[0060] In other examples, no light sensor may be present.

[0061] An optional right-side user input control unit 124 receives user input to control the dimming level applied to the right-side shield unit 112. In this way, the user can control the dimming level applied to the right-side shield unit 112.

[0062] An optional left-side user input control unit 110 receives user input to control the dimming level applied at the left-side shield unit 118. In this way, the user can control the dimming level applied to the left-side shield unit 118.

[0063] The right-side user input control unit 124 or the left-side user input control unit 110 can control the dimming of both the right-side shield unit 112 and the left-side shield unit 118. Only one of the right-side user input control unit 124 or the left-side user input control unit 110 can be provided to control both the right-side shield unit 112 and the left-side shield unit 118. Alternative dimming controls can be automated, for example, based on input from a light sensor, and a user input control unit may not be provided to control the dimming.

[0064] The content control unit 126 can monitor applications implemented on the head-mounted display device, or the current state of applications implemented on the head-mounted display device, or has information related to the current application and / or its state, and can control the controller 102 to control one or both of the right shield unit 112 or the left shield unit 118 depending on the current application implemented on the head-mounted display device or the current state of the applications implemented on the head-mounted display device.

[0065] The observation control unit 128 can monitor the current field of view of the head-mounted display device, or has information related to the current field of view of the head-mounted display device, and can control one or both of the right shield unit 112 or the left shield unit 118 depending on the current field of view control controller 102 of the head-mounted display device.

[0066] The position control unit 130 can monitor the position of the head-mounted display device, or the position of having the head-mounted display device, and can, depending on the position control controller 102, control one or both of the right shield unit 112 or the left shield unit 118. This position can be an indoor or outdoor indication.

[0067] The timing control unit 132 can monitor the date or time of a day, or has the date or time of a day, and can control the controller 102 to control one or both of the right shield unit 112 or the left shield unit 118 depending on the date or time of a day.

[0068] The memory 122 may store computer program code that, when executed by the processor 120 or any other control element such as the controller 102, causes the head-mounted display to perform the operations described.

[0069] A head-mounted display device with a side dimmer is provided, which can be controlled to change the amount of ambient light in the range of 100% to 0%. This control can be automated or user-controlled depending on various conditions.

[0070] Users can switch from providing 100% ambient occlusion (equivalent to having a physical light shield) to 0% occlusion (equivalent to having a full view of the real-world surroundings without a light shield) without removing the headset or physically removing (or adding) the light shield from their VR or AR environment. Users can switch between blurred and transparent ambient views without removing, adding, or replacing the shield.

[0071] When using an AR headset in VR mode, ambient light transmission through the side shields can be controlled to as low as 1%, 0.03%, or 0.01%. The dimmer shields prevent light from leaking into the headset from the sides.

[0072] The field of view from ambient light or the environment can cause one or more of the following: reflections from lens optics (such as AR optics) in the user's field of view may reduce the size of the user's pupils (making the image appear less bright), may distract the user, may reduce the contrast of the image seen by the user, may increase glare on the image seen by the user, and may reduce the user's sense of immersion or presence. These problems are solved by providing a variable dimmer in the ambient light.

[0073] In applications using fixed, opaque shields to prevent ambient light from entering the head-mounted display, the resulting decrease in peripheral vision can be unsafe and socially uncomfortable. For example, with a fixed opaque shield, the user would be in complete darkness if the product malfunctions or loses power. This problem is solved by providing a variable dimmer in the peripheral vision that becomes transparent when not powered on.

[0074] Other advantages are achieved by providing variable dimmers in the perimeter. For example, dimming can be achieved independently at different levels by controlling the dimmers on each side, blocking sunlight from the left or right.

[0075] In more complex arrangements, a portion of one or two side shields can be dimmed separately from the rest of the side shields, for example, by controlling the dimming level of one or more pixels or segments of the shield, rather than the entire shield. This dimming control allows for variations in dimming based on external uneven lighting conditions or user preferences. (See above for reference.) Figure 4 An embodiment of the electrode layer 176 used for this control is described.

[0076] There are many methods to achieve spatial or local dimming, including defining multiple direct drive segments, passive matrix addressing, and active matrix addressing using a TFT backplane. (See above for reference.) Figure 4 An embodiment of the electrode layer 176 used for this control is described.

[0077] Various dimming techniques can be used, including EC, SPD, and LC. The disclosed functionality is not limited to any specific dimming technique. While some of these may be driven to a range of gray levels, for gray levels that cannot achieve the same grayscale effect (e.g., dual-state systems), a halftone approach can be used, driving only a very small subset of pixels to the opposite state, so that the average of the spatial multiplexing is gray. Gray levels can be continuous, meaning that for a given dimming technique with a dimming transmission range of Tmin to Tmax, any intermediate transmission range can also be achieved.

[0078] Current non-AR headsets that block light from the sides are not dual-axis molded, which would be desirable for industrial design and consumer acceptance. Dual-axis means that the surface of the dimmer is curved on two axes—like the surface of a sphere.

[0079] The side shields can be integrated into the head-mounted display frame or removed using magnets or other mechanical clips. Removable side shields are configured to be electrically connected to the control circuitry during installation.

[0080] As described above, side shields are used in head-mounted displays, such as AR or VR headsets.

[0081] Such AR or VR headsets may include other liquid crystal devices within the user's field of view, which may, for example, function as or be used therein as switchable lens devices or beam control devices. For instance, the device may be or include an adaptive optics lens containing a liquid crystal device according to any example herein. This device may be or include a head-mounted display device, which may be referred to as a head-mounted display (HMD).

[0082] This liquid crystal device can be used in a wide range of applications, including ophthalmic lenses (such as spectacle lenses), virtual reality (VR), mixed reality (MR) and augmented reality (AR) head-mounted displays; optical projectors; photographic equipment; and communication equipment.

[0083] LC optical lens devices can be used as push-type and / or pull-type lenses or combined push / pull-type lenses in augmented reality (AR) head-mounted displays, such as... Figure 5 As shown.

[0084] The head-mounted display device 40 includes a support frame 42 that supports optical components arranged in optical series in front of the user's eyes.

[0085] At least one optical component (such as Figure 5 One or more of the optical components shown may be considered as corresponding to or being parts of an assembly, which may be considered as a display stack containing at least one liquid crystal cell according to the examples herein. In the examples (such as...) Figure 4(Example), this component includes a stack of liquid crystal cells according to the example herein. Figure 5 In the example, push lens 48a includes at least one stack of liquid crystal cells, pull lens 48b includes at least one stack of liquid crystal cells, and the components include push lens 48a, waveguide 50, pull lens 48b, variable dimmer device 46 (which is an example of a brightness adjustment component), and front window / lens 44.

[0086] Stacked liquid crystal cells can be aligned along a common optical axis. However, in some cases, as long as light passing through the assembly passes through the stacked liquid crystal cells, the optical axes of at least two stacked liquid crystal cells can be offset from each other in a direction parallel to the radial electrode pattern plane of at least one liquid crystal cell. For clarity, Figure 5 The optical components are provided for only one half of the head-mounted display, but a matching set of optical components is also provided for the other half of the head-mounted display.

[0087] The waveguide 50 of the head-mounted display device displays left and right views of one or more virtual reality objects, which the user perceives as 3D objects. Alternatively, other mechanisms can be used to display the left / right views of one or more virtual reality objects, such as, for example, laser projection.

[0088] The degree to which a user's left and right eyes need to rotate relative to each other, so that the left and right views of the virtual reality object simultaneously point to the fovea of ​​the corresponding left and right eyes (the part of the retina responsible for sharp central vision, which is essential for activities that are critical to visual detail), determines the distance at which the user perceives the virtual reality object. This mechanism is called convergence.

[0089] Therefore, the liquid crystal device described in this article can provide a less complex and / or higher quality system for actively adjusting the focal length via optical components mounted in front of each eye to compensate for focal length differences between virtual objects and the real-world environment visible to the user of the head-mounted display. For example, this allows for a consistent integration of perception with actual image depth, thereby enhancing user comfort.

[0090] exist Figure 5 In this head-mounted display 40, light from the real-world environment surrounding the head-mounted display 40 is at least partially transmitted to the user's eyes through optical components. In this example, the optical components are at least partially transparent. In a bright field, the brightness of the outdoor environment can be significantly higher than indoors, such as approximately 100 times higher. This can cause virtual objects to appear washed out and difficult to see when the user operates the head-mounted display outdoors unless the brightness of the light transmitted from the environment to the user is properly controlled. Figure 5In this device, the variable dimmer device 46 controls the amount of light transmitted through the optical components and toward the eyes, for example, to reduce the brightness of ambient light transmitted toward the user from bright conditions, and can be used to provide ambient dimming to darken the ambient light transmitted through the head-mounted display device 40.

[0091] The variable dimmer device 46 can provide so-called global dimming, in which the brightness of light from the environment is adjusted by substantially the same amount across the plane of the variable dimmer device 46 facing the user (e.g., reducing the brightness of light by substantially the same amount across the entire surface area of ​​the variable dimmer device 46). In other words, global dimming allows the brightness of light transmitted through the variable dimmer device 46 to be controlled in a substantially spatially uniform manner (e.g., to provide a substantially spatially uniform reduction in brightness across the user's field of view).

[0092] The variable dimmer device 46 may also or alternatively provide local dimming, wherein the variable dimmer device 46 can be adjusted to control the brightness of light transmitted from the environment on an area basis (where an area may correspond to a single pixel or multiple pixels). Local dimming may involve adjusting the brightness of a portion of the variable dimmer device 46 that is smaller than the entire surface area, for example, in a sub-region smaller than the surface area of ​​the variable dimmer device 46. However, in other cases, local dimming may involve adjusting the brightness across the entire surface area of ​​the variable dimmer device 46, but adjusting different amounts in at least two portions of the surface area.

[0093] Although Figure 5 Not shown, but it should be understood that the head-mounted display 40 may be configured to acquire, for example, brightness data from a light sensor of the head-mounted display 40, indicating the brightness of light in the environment surrounding the head-mounted display 40. For example, if a first side 49a of the head-mounted display 40 is configured to face a user, wherein the head-mounted display 40 is mounted on the user's head, the head-mounted display 40 may include a light sensor to detect the brightness of light at a second side 49b of the head-mounted display 40, opposite to the first side 49a. A variable dimmer device 46 may be controlled, at least in part, based on the brightness data, to adjust the brightness of light transmitted from the second side of the head-mounted display 40 toward the user, thereby improving the visibility of virtual objects displayed to the user by the head-mounted display 40.

[0094] When using a head-mounted display device 40, Figure 5In the example described herein, the first lens of at least one stack of liquid crystal cells (push lens 48a) is located between the waveguide 50 and the eye. Light representing a virtual object is generated and transmitted to the waveguide 50, which guides the light through the push lens 48a and into the eye. The push lens 48a has a focusing effect to focus the light representing the virtual object, making the object appear focused to the user. For example, the virtual object can be generated such that it is focused on a focal plane at infinity. The push lens 48a then allows the virtual object to be focused at a focal plane closer to the user than infinity, allowing the user to focus more comfortably on the virtual object. The focal plane at which the virtual object will be focused, and thus the focusing force exerted by the push lens 48a, can be determined based on eye-tracking data, such as data obtained by a suitable sensor discussed further below, indicating the direction of the user's gaze.

[0095] In the example, the liquid crystal device includes electrical terminals electrically connected to a bus. These electrical terminals, for example, allow a potential difference to be applied across the bus and thus across each set of concentric rings. As explained above, the potential applied to the electrical terminals can be controlled by a suitable control system.

[0096] refer to Figure 6 According to some examples, system 55 includes a processor that operates based on computer program code stored in memory 52 to control image generation driver chip 53, causing the image generation system to generate images of left / right views of one or more virtual reality objects, through which a user can perceive 3D images of virtual reality objects and display the images via waveguide 50.

[0097] Although Figure 6 Not shown, it is important to understand that there can still be two waveguides: one waveguide is used to display the left view image of the virtual reality object to the left eye, and the other waveguide is used to display the right view image of the virtual reality object to the right eye, as further referenced. Figure 6 The discussion further suggests that there may be two image generation systems: one for generating an image of the left view of the virtual reality object, and another for generating an image of the right view of the virtual reality object (although in some cases, a single image generation system may generate two images, or the image generation system may generate a single image to be displayed to both eyes). See below for reference. Figure 7 The image generation system is further discussed. Input from the sensors is fed into the processor, enabling the processor to control the position of virtual reality objects displayed by waveguide 50, thereby seamlessly overlaying one or more virtual reality objects onto the user's view of the real environment.

[0098] Based on inputs fed to processor 51 from one or more sensors 54 that sense movement of the user's eye and / or based on the content displayed by waveguide 50, processor 51 controls adaptive lens driver chip 38 to achieve the optical focusing power (diopters) required for generating the aforementioned optical image of the waveguide display output at a distance from the user's eye, at which distance the virtual content the user is determined to view (e.g., by tracking the user's eyes) will be perceived by the user (via the aforementioned convergence mechanism). The driver chip is an example of a controller, which may be implemented in hardware, e.g., via a suitably configured circuit system. In some cases, the driver chip may include or be considered to implement at least one processor.

[0099] Figure 7 The hardware architecture of device 60 according to a further example is schematically illustrated. According to the examples herein, device 60 includes at least one stack of liquid crystal cells. Figure 7 In this configuration, device 60 is mounted on a person's head, such as a user's head, and during use, the stack of liquid crystal units is located within the field of view of the eyes. Figure 7 In the example, device 60 is an AR headset for displaying virtual images to the wearer of the headset and can be used with... Figure 5 The head-mounted display device 40 is similar to or the same as the head-mounted display device 40. However, in other examples, including those with... Figure 7 Devices with similar hardware architectures (60 devices in total) can be configured for different purposes and may include additional components and / or omissions. Figure 7 At least one component shown.

[0100] Figure 7 The illustrated device 60 includes an optical system 62, an image generation system 64, at least one processor 66, a memory 68, at least one sensor 70, a user input / output interface 72, a communication system 74, and at least one other hardware system 76. The components of device 60 are interconnected via at least one bus 78, which may be or include any suitable interface or bus for transmitting data between the illustrated components.

[0101] The optical system 62 includes a first component and a second component, which in this example are a first display stack 62a and a second display stack 62b, respectively. The first display stack 62a contains a first set of optical components, for example, arranged in a layered stack. When the device 60 is in use and mounted on the head, the device 60 is configured to allow light from the external environment to be at least partially transmitted through the first display stack 62a and toward the user's first eye. In other words, when the device 60 has a first side configured to face the user (e.g., ...), Figure 5When the first side 49a is in use, the first display stack 62a is arranged to direct light from the second side toward the first eye (in this case, through the first display stack 62a). In this case, the first display stack 62a includes Figure 5 The optical components shown are a push lens 48a, a waveguide 50, a pull lens 48b (where push lens 48a and pull lens 48b are each examples of liquid crystal devices according to the examples herein), a variable dimming device 46, and a front window / lens 44. The push lens 48a and / or pull lens 48b of the first display stack 62a can be considered as a first lens according to the examples herein, which includes at least one of the liquid crystal cell stacks. This first lens is configured in use to be located within a first field of view of a first eye (e.g., a user's first eye).

[0102] exist Figure 7 In this embodiment, the second display stack 62b includes a second set of optical components, which in this example are identical to the first set of optical components but configured to transmit light to the user's second eye when using the device 60. In other words, the second display stack 62b is arranged to direct light from a second side of the device 60 toward the second eye. Therefore, in this example, the push lens and / or pull lens of the second display stack 62b can be considered as a second lens comprising at least one of the liquid crystal cell stacks according to the example herein. In use, the second lens is configured to be located in a second field of view of the second eye (e.g., the user's second eye). It should be understood that in use, the first lens may be visible only to the first eye, or to both the first and second eyes, and the second lens may be visible only to the second eye, or to both the first and second eyes.

[0103] The spatial arrangement of the elements of the second display stack 62b in at least one layer stack may reflect the spatial arrangement of the corresponding elements of the first display stack 62a in the corresponding layer stack of the first optical arrangement 62a, as reflected in the sagittal plane of the device 60 (which may be referred to as the longitudinal plane of the device 60, and for example, separating the left and right sides of the device when in use). However, in other cases, the first and second display stacks 62a, 62b may have different structures from each other. It should be understood that the optical system 62 may include other components, such as Figure 7 Other optical components not shown.

[0104] Device 60 also includes an image generation system 64 for generating an image of a virtual object to be displayed to a user of device 60, such that the user perceives the virtual object as superimposed on the external environment, which the user can at least partially see through optical system 62. Image generation system 64 may be or may include a display device for generating an image (e.g., an image of the virtual object) for display to the user by device 60. The display device may be a liquid crystal display (LCD), a light-emitting diode (LED) display such as an organic light-emitting diode (OLED) display, an electroluminescent (EL) display, etc. Figure 7 In this example, the image generation system 64 communicates optically with the optical system 62. For example, if device 60 is... Figure 5 In the form of a head-mounted display device 40, the image generation system 64 can be housed by a support frame 42. Light representing virtual objects generated by the image generation system 62 can be transmitted directly (e.g., without passing through another optical component) or via at least one other optical component to an optical system (e.g., transmitted to such an optical system as...). Figure 5 (Waveguide 50 shown). In some cases, the image generation system may include two display devices, a first for a first eye and a second for a second eye, for example, if it is desired to display a first image to the first eye and a second image to the second eye. In other examples, a single display device may be used to generate the image to be displayed to both the first and second eyes.

[0105] exist Figure 7 In this example, the image generation system 64 is shown as a separate system from the optical system 62. However, in other examples, the image generation system may be part of the optical system. For example, components of the optical system, such as a display stack, may include the image generation system, such as a display device.

[0106] The device 60 may have at least one processor 66, which may be a single processor or multiple processors of one or more types. Components of the at least one processor 66 may be implemented using appropriately programmed hardware, for example, in the form of a circuit system. The at least one processor 66 may include a central processing unit (CPU), a graphics processing unit (GPU), and / or a neural processing unit (NPU), which may be referred to as a neural network accelerator.

[0107] In some examples, devices, such as Figure 7 The device 60 includes a drive circuit connected to at least one electrical connection to an electrode pattern of a stack of liquid crystal cells to apply a potential difference across one or more groups of electrodes of the liquid crystal cells in the stack. The applied potential difference (such as the amplitude and / or timing of the applied potential difference) may be determined by at least one processor 66 and / or drive circuitry (such as a controller implemented by at least a portion of the drive circuitry) based on instructions stored in a memory.

[0108] If the potential difference is determined by the driving circuit, the determination of the potential difference can be initiated by instructions received from at least one processor, such as instructing to display a virtual object and thus activate one or more electrode groups to make the virtual object appear focused to the user. In this way, the driving circuit can be independent of the at least one processor from which it receives instructions. In other words, the operation of the driving circuit can, for example, be independent of the at least one processor used to control the driving circuit, thereby achieving the same effect regardless of the at least one processor coupled to the driving circuit (provided that at least one processor provides appropriate instructions to the driving circuit to determine a suitable potential difference).

[0109] The potential difference can be generated by at least one driver of the driving circuit (such as...) Figure 6 An adaptive lens driver chip 38) applies an electrical connection, which is an example of a driver. Applying a potential difference via at least one driver can be considered as "driving" an electrode pattern via an electrical connection. The driver circuit may be in the form of at least one system-on-a-chip (SoC).

[0110] Memory 68 may be or include volatile and / or non-volatile memory available to a computer. Memory 68 may include random access memory (RAM) and / or read-only memory (ROM). Memory 68 may be removable or non-removable from device 60. Memory 68 stores instructions for controlling device 60 according to the examples herein, such as activating one or more electrode groups of liquid crystal cells in a liquid crystal cell stack. For example, activation of an electrode group refers to applying a potential difference between at least two connectors connected to the electrode group. The instructions may be in the form of computer-readable and / or executable instructions, such as computer program instructions. Although in Figure 7 In this context, memory 68 is shown as a component separate from at least one processor 66, but in some cases, memory 68 may be or include internal memory of at least one processor 66, in which case at least one processor 66 and memory 68 may be at least partially integrated into the same system or component.

[0111] At least one sensor 70 in this example is configured to acquire eye-tracking data of the device during use, which, as those skilled in the art will understand, may indicate, for example, the direction in which at least one of the user's eyes is looking. Eye-tracking data may be acquired for each eye, or for a combination of a single eye or both eyes of the user. Suitable sensors for acquiring eye-tracking data include a camera 70a for acquiring an image of at least one of the user's eyes, an inertial measurement unit (IMU) 70b for determining the orientation of the device 60, and at least one position sensor 70c (such as a Global Positioning System (GPS) sensor) for determining the position of the device 60. Those skilled in the art will understand that the IMU 70b may include at least one accelerometer or gyroscope for determining the orientation of the device 60. The focusing effect of at least one liquid crystal cell may be controlled based on the eye-tracking data, for example, as described above, to reduce eye strain for the user.

[0112] Device 60 also includes a user input / output interface 72 through which a user can interact with device 60 to control various aspects of device 60. For example, user input / output interface 72 may be or include input devices such as buttons, touch screens, sliders, controllers, or any other suitable devices for conveying user requests to device 60 to control device 60.

[0113] Device 60 includes a communication system 74 for receiving data from a remote system, for example, via a suitable telecommunications network (such as a wireless network) or via some other type of network or connection. Communication system 74 may include input / output interfaces, such as a Bluetooth connector, a Universal Serial Bus (USB) connector, or a network connector, for receiving data from the remote system.

[0114] Figure 7 The device 60 includes at least one additional hardware system 76, such as a power source, like a battery, for supplying power to the electrical components of the device 60.

[0115] Some examples of optical focusing devices have been described above, but the same techniques can be applied to other fields, such as, for example, beam steering optical systems.

[0116] Other examples relate to methods of operating a liquid crystal device according to any example in this document.

[0117] The term “substantially” as used in this article can be considered to mean that two elements are “substantially the same” when they are identical within manufacturing tolerances, identical within measurement uncertainty, and / or differ from each other by no more than 5%.

[0118] The example here refers to liquid crystal (LC) materials. Liquid crystal materials are examples of materials with switchable refractive indices or materials with changing refractive indices.

[0119] The described apparatus, components, and devices are used in exemplary embodiments other than adjustable lenses and optical components. Other exemplary embodiments include, but are not limited to, image generation systems, read-only memories, network connections, USB, Bluetooth systems, power supply methods, and related technologies. In addition to any modifications explicitly mentioned above, those skilled in the art will understand that various other modifications can be made to the described exemplary embodiments within the scope of this invention.

[0120] Apart from any modifications explicitly mentioned above, those skilled in the art will understand that various other modifications can be made to the described embodiments within the scope of this invention.

[0121] The applicant hereby discloses each individual feature described herein, as well as any combination of two or more such features, provided that such features or combinations can be implemented as a whole based on the description as a whole, in accordance with common general knowledge of those skilled in the art, regardless of whether such features or combinations of features solve any problem disclosed herein, and not to limit the scope of the claims. The applicant notes that aspects of the invention may consist of any such individual feature or combination of features.

Claims

1. An optical device for a head-mounted display assembly, characterized in that, The head-mounted display assembly is designed to be mounted on a user's head, and the optical device is a side shield of the head-mounted display that alters the ambient light entering the head-mounted display.

2. The optical device according to claim 1, characterized in that: The side shield is a controllable optical device.

3. The optical device according to claim 2, wherein the optical device is controllable to change the transmission of ambient light entering the head-mounted display device.

4. The optical device according to any one of claims 1 to 3, characterized in that, It includes a dimming film mounted on a substrate, which is controllable to change the transmission of light.

5. The optical device according to claim 4, characterized in that, An anti-reflective coating and / or a hard coating are formed on either side of the dimming film.

6. The optical device according to claim 4 or 5, characterized in that, The dimming film is formed on the substrate.

7. The optical device according to claim 6, characterized in that, The substrate is curved.

8. The optical device according to any one of claims 1 to 7, characterized in that, It includes: a liquid crystal layer disposed between a first electrode and a second electrode, wherein the potential applied between the first electrode and the second electrode determines the transmission of light in the optical device.

9. The optical device according to claim 8, characterized in that, One of the first electrode and the second electrode includes a plurality of individually addressable electrodes, enabling different control of light transmission in different regions of the liquid crystal material.

10. A head-mounted display device, characterized in that, The device includes two optical devices as described in any one of claims 1 to 9, each of the two optical devices being disposed on one side of the head-mounted display device, and the head-mounted display device further includes one or more optical lenses in the field of view of the user's eyes.

11. The head-mounted display device according to claim 10, characterized in that, The left lens in the user's left eye's field of vision, and the right lens in the user's right eye's field of vision.

12. The head-mounted display device according to claim 11, characterized in that, It also includes a controller for independently controlling the two optical devices located on each side of the head-mounted display to control the left lens and the right lens.

13. A component, characterized in that, Include: Optical devices for head-mounted display (HMD) components for mounting on a user's head, the optical devices being side shields of the HMD that alter ambient light entering the HMD. as well as At least one additional optical element.

14. The component according to claim 13, characterized in that, The at least one additional optical element is an optical device within the user's field of view of the head-mounted display.

15. The component according to claim 14, characterized in that, The at least one additional optical element comprises at least one of the following: a waveguide, a brightness adjustment component, a lens, an image generating device, a reflection reduction layer, or a protective layer.

16. A head-mounted display device, characterized in that, It includes the components as described in any one of claims 13 to 15.

17. A device, characterized in that, Include: Optical devices for head-mounted display (HMD) components for mounting on a user's head, the optical devices being side shields of the HMD that alter ambient light entering the HMD. At least one processor; as well as At least one storage device contains instructions configured to use the at least one processor to enable the device to control one or more properties of the liquid crystal LC layer of the optical device.

18. The device according to claim 17, characterized in that, It is configured to be mounted on a person's head, with additional optical units stacked and positioned within the field of view of the person's eyes.

19. The device according to claim 18, characterized in that, It also includes: a first lens and a second lens, the first lens including a first electrode of the LC layer and a first electrode, and the second lens including a second electrode of the LC layer and a first electrode.

20. The device according to claim 19, characterized in that, The field of view of the eye is the first field of view of the first eye, and the first lens is configured to be positioned in the first field of view during use, and the second lens is configured to be positioned in the second field of view of the second human eye on the head during use.

21. The device according to any one of claims 13 to 20, characterized in that, The device is at least one of an augmented reality display device, a virtual reality display device, or a mixed reality display device.

22. The device according to any one of claims 13 to 20, characterized in that, The side shield is controlled based on one or more of the following: ambient light in the environment where the headset is used; the light level around the headset; user control input; the application running on the headset; the content viewed on the headset; the location of the headset; the date; or a time of day.

23. A method of operating an optical device for a head-mounted display assembly, characterized in that, The head-mounted display assembly is for mounting to a user's head, and the optical device is a side shield of the head-mounted display that alters the ambient light entering the head-mounted display. The method includes selectively controlling the light transmission of the optical device.

24. The method according to claim 23, characterized in that, in, When the head-mounted display is mounted on a user's head, the head-mounted display assembly also includes another optical device in the user's field of view, and the method includes independently controlling the optical device that serves as the side shield and another optical device.

Images