Transparent micro LED display for VR head-mounted viewer
By setting a sparse LED array on a transparent flexible substrate and performing packaging processing, the problem of difficulty in effectively utilizing sparse LED arrays in the prior art is solved, and an efficient and high-brightness display effect is achieved, while maintaining the basic change of optical properties.
Patent Information
- Application Number
- CN202380059983.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-06-15
- Filing Date
- 2023-06-14
- Publication Date
- 2025-03-28
AI Technical Summary
The prior art is difficult to effectively utilize sparse light emitting diode (LED) arrays, especially to maintain optical properties while maintaining complex systems while improving efficiency and increasing brightness.
Efficient packaging and protection of LEDs are achieved while maintaining the transparency of light by placing a sparse LED array on a transparent flexible substrate and encapsulating it between the rigid substrate and the transparent flexible substrate using an adhesive layer.
It realizes the efficient application of sparse LED arrays in complex systems, improves the efficiency and brightness of the display, while maintaining the basic unchanged optical properties and enhancing the user experience.
Smart Images

Figure CN119731574A_ABST
Abstract
Description
[0001] priority
[0002] This patent application claims the benefit of priority to U.S. Provisional Patent Application Serial No. 63 / 352,517, filed on June 15, 2022, which is hereby incorporated by reference in its entirety. Technical Field
[0003] The present disclosure relates to sparse light emitting diode (LED) arrays, systems, and applications. Background Art
[0004] LEDs provide a highly efficient and relatively small light source compared to traditional light sources. The use of LEDs has evolved from systems that provide pure illumination to more complex systems that use the light in a variety of ways rather than just providing area lighting. As a result, efforts are underway to improve the technology for using LED arrays, as well as to find additional uses for LED arrays. BRIEF DESCRIPTION OF THE DRAWINGS
[0005] Figure 1 A cross-sectional side view of an example of a light source is shown.
[0006] Figure 2 It shows that it can include Figure 1 A block diagram of an example of a light source visualization system.
[0007] Figure 3 and Figure 4 Shows Figure 1 Figures showing side views of a light source in various stages of assembly.
[0008] Figure 5A-5D Cross-sectional views of sparse arrays of LEDs according to some examples are respectively shown.
[0009] Figure 6 Shown is a top view of an example panel in accordance with various embodiments of the disclosed subject matter.
[0010] Figure 7 An example of a panel having a single tile is shown in accordance with various embodiments of the disclosed subject matter.
[0011] Figure 8A-B An example of a panel having multiple display tiles in accordance with various embodiments of the disclosed subject matter is shown.
[0012] Fig. 9A and Fig. 9B Examples of sparse LED array arrangements according to various embodiments of the disclosed subject matter are shown.
[0013] Fig.10 An example display is shown in accordance with various embodiments of the disclosed subject matter.
[0014] Fig.11 An example system in accordance with various embodiments of the disclosed subject matter is shown.
[0015] Fig.12 An example of a general device in accordance with some embodiments is shown.
[0016] Figure 13A-13G Process operations for fabricating a sparse array are shown in accordance with some embodiments.
[0017] Fig.14 Shown according to Figure 13A-13G The process operations shown in FIG. 1 are examples of methods for manufacturing sparse arrays.
[0018] Fig.15 An example of a process for operating a VR head mounted viewer according to various embodiments of the disclosed subject matter is shown.
[0019] Fig.16 A block diagram illustrating an example of a system in accordance with various embodiments of the disclosed subject matter is shown.
[0020] Fig.17 An example VR head mounted viewer is shown in accordance with various embodiments of the disclosed subject matter.
[0021] Fig.18 Another example VR head mounted viewer is shown in accordance with various embodiments of the disclosed subject matter.
[0022] Fig.19 An example VR head mounted viewer is shown in accordance with various embodiments of the disclosed subject matter.
[0023] Fig. 20 An example VR head mounted viewer is shown in accordance with various embodiments of the disclosed subject matter.
[0024] Throughout the several views, corresponding reference numerals indicate corresponding parts. The elements in the drawings are not necessarily drawn to scale. The configurations shown in the drawings are merely examples and should not be construed as limiting in any way. DETAILED DESCRIPTION
[0025] The use of transparent displays enabled by micro-LEDs as described herein may be able to extend the user experience by providing signage, interactive menus, entry criteria, public information, and many other situations. For example, the user experience may be enhanced by allowing rich augmented reality (AR) and / or virtual reality (VR) experiences, entertainment, and many other situations.
[0026] For the purposes of this document, the term "micro-LED" is intended to be synonymous with an LED in a sparse array of LEDs as defined herein. Efforts are currently underway to improve micro-LED display technology. For example, displays (such as direct-view displays and projection displays) may use micro-LEDs to improve efficiency and increase brightness. Note that the terms "substantially transparent" and "transparent" are used interchangeably herein to refer to a material (such as a metal oxide or very thin metal) through which light from a micro-LED passes without being substantially (more than a few percent) absorbed or reflected.
[0027] In a direct-view micro-LED display, the LEDs may occupy a relatively small share of the display area. Because most of the display area is unaffected by the LEDs, the LEDs may not substantially change the optical properties of the surface on which they are assembled. For example, in the presence of LEDs mounted on a black surface, the black surface may remain black. Similarly, in the presence of LEDs mounted on a reflective surface, the reflective surface may remain reflective. Other examples and optical surface properties may also be used.
[0028] In some examples, micro-LEDs can be assembled onto a transparent flexible substrate. The transparent flexible substrate can then be laminated onto a substrate having desired optical properties, such as reflectivity, etc. Using a transparent flexible substrate in this manner can allow micro-LEDs to be applied to curved or irregularly shaped substrates, which may be incompatible with micro-LED assembly techniques using rigid flat substrates, such as wafers.
[0029] In some examples, the flexible substrate can be laminated to the substrate with the LED side facing down using a transparent adhesive having a thickness sufficient to encapsulate the micro-LEDs. For these and other examples, the transparent substrate and adhesive can also serve as a barrier that can protect the micro-LEDs from environmental influences. Because the transparent substrate can provide protection for the micro-LEDs, the transparent substrate can reduce or eliminate the need to use an additional transparent cover or protective layer to provide protection for the micro-LEDs.
[0030] Figure 1 A cross-sectional side view of an example of a light source 100 is shown. The light source 100 can include a sparse array of LEDs 102 (e.g., "micro-LEDs") disposed on a transparent flexible substrate 104 and a rigid substrate 106 adhered to the transparent flexible substrate 104 with an adhesive layer 108 such that the sparse array of LEDs 102 is located between the rigid substrate 106 and the transparent flexible substrate 104. The sparse array of LEDs 102 can be encapsulated in an adhesive 110 of the adhesive layer 108.
[0031] The transparent flexible substrate 104 may be a polymer sheet having a relatively high transmittance, or equivalently, a relatively low loss, due to absorption and scattering in the visible portion of the electromagnetic spectrum, such as between wavelengths of about 400 nm and about 700 nm. Suitable materials for the transparent flexible substrate 104 may include transparent polyimide (PI), polyethylene naphthalate (PEN), polyethylene terephthalate (PET), etc. The transparent flexible substrate 104 may have a thickness between about 20 μm and about 200 μm, although thicknesses outside this thickness range may also be used.
[0032] A sparse array of LEDs 102 may be disposed on a transparent flexible substrate 104. For purposes of this document, the term "sparse" is intended to mean that the light generating surface area of the array is less than or significantly less than the total surface area of the array. For example, the fill factor (e.g., the ratio of the light generating surface area to the total surface area) of the array may be less than or equal to a specified threshold, such as 10%, 5%, 4%, 3%, 2%, 1%, or another suitable threshold. As a specific example, the LEDs 102 may be arranged in a rectangular array, where the center-to-center spacing along one dimension is represented by the spacing x. Each LED 102 may have a light generating area sized along one dimension by a dimension s. The ratio of s divided by x may be less than or equal to 0.1. In the orthogonal dimension, a similar ratio applies, where the linear dimension of the light generating area is less than or equal to one-tenth of the linear center-to-center spacing of the LEDs 102. Combining the two linear dimensions, the surface area of the light generating area of the LEDs 102 is less than or equal to 1% of the surface area of the array. In some examples, the light generating area of each LED may be less than 200 μm on a side. In some examples, the light generating area of each LED can be less than 50 μm on a side. Electrical traces can be deposited on the transparent flexible substrate 104 to power the LEDs 102 (e.g., deliver current to and from the LEDs 102). In some examples, the electrical traces can be metal traces that are narrow enough to be invisible under typical viewing conditions. In some examples, the electrical traces can be formed of one or more transparent conductive materials, such as indium tin oxide (ITO). Each of these examples of electrical traces (e.g., narrow metal traces and transparent conductive materials) can be considered to provide transparent electrical traces.
[0033] In some examples, a sparse array of LEDs 102 may include two or more LEDs 102 that emit light at the same wavelength (or color). In some examples, a sparse array of LEDs 102 may include LEDs 102 that all emit light at the same wavelength. For example, a device such as a display may include a sparse array of LEDs 102 that all emit red light, a sparse array of LEDs 102 that all emit green light, and a sparse array of LEDs 102 that all emit blue light. In some examples, a sparse array of LEDs 102 may include two or more LEDs 102 that emit light at different wavelengths. For example, a device such as a display may include a sparse array of LEDs 102, some of which emit red light, some of which emit green light, and some of which may emit blue light. The red, green, and blue LEDs 102 may be arranged in repeating clusters, where each cluster forms a color pixel of the device. In some examples, the sparse array of LEDs 102 can include at least one LED that emits light at a visible wavelength (e.g., between about 400 nm and about 700 nm). In some examples, the sparse array of LEDs 102 can include at least one LED that emits light at an infrared wavelength (e.g., greater than about 700 nm). Such infrared wavelengths can be used for biometric sensing or other sensing techniques.
[0034] Because the sparse array of LEDs 102 (including the light emitting areas of the LEDs 102, corresponding electrical traces, and any corresponding circuitry) can have a relatively small fill factor, a majority of the surface area of the sparse array of LEDs 102 can be transparent. For example, light incident on the sparse array of LEDs 102 (or incident from or on the transparent flexible substrate 104) mostly passes through the sparse array of LEDs 102, with only a relatively small portion being blocked by the light emitting areas and electrical traces of the sparse array of LEDs 102.
[0035] As a result, a sparse array of LEDs 102 can generate light on a surface and / or optical element (such as on a rigid substrate 106 described below) with additional functionality. For example, the surface and / or optical element can include a reflector with a specified reflectivity value. As another example, the surface and / or optical element can include a spectral filter with a specified reflectivity, transmittance, or absorptivity at one or more specified wavelengths. Other suitable functionality can also be used.
[0036] The rigid substrate 106 may be adhered to the transparent flexible substrate 104. In some examples, the rigid substrate 106 may be transparent. Suitable applications for the transparent rigid substrate 106 may include building windows, head-up displays, augmented reality head-mounted view devices, etc. Suitable transparent materials for the transparent rigid substrate 106 may include glass, laminated glass, polycarbonate, or engineered plastics such as polymethyl methacrylate (PMMA).
[0037] In some examples, the rigid substrate 106 can be reflective. In some examples, the rigid surface can be specularly reflective (e.g., can have a relatively smooth reflective surface that causes relatively little scattering or diffusion when reflected). Suitable applications for the reflective rigid substrate 106 can include mirrors, such as vehicle rearview mirrors or side mirrors that can display information. Specifically, the specular reflective surface of the rigid substrate 106 can perform the function of reflecting light from the rear of the vehicle, and the sparse array of LEDs 102 can display information superimposed on the reflected light.
[0038] In some examples, rigid substrate 106 may be protective and / or decorative, such as a housing material for a mobile device such as a smartphone. Rigid substrate 106 may include other suitable optical properties, and also perform other suitable functions.
[0039] The rigid substrate 106 can be flat (e.g., substantially flat) or curved. The curved substrate can be used in a vehicle windshield, an augmented reality head-mounted viewer, a wearable device, or other suitable device. In some examples, the rigid substrate 106 is formed as a single unitary body. In other examples, the rigid substrate 106 can include multiple rigid substrate elements. For example, multiple rigid substrate elements can be used to create a folding display in a smartphone or other mobile device. As described below, a custom tool can support such a curved substrate during a lamination process.
[0040] The adhesive can adhere the rigid substrate 106 to the transparent flexible substrate 104. In some examples, the adhesive can be formed into an adhesive layer 108 so that the sparse array of LEDs 102 is located between the rigid substrate 106 and the transparent flexible substrate 104. Other suitable configurations can also be used. Suitable materials for the adhesive of the adhesive layer 108 can include silicone, epoxy silicone, acrylic film, epoxy film, etc.
[0041] In some examples, the adhesive of the adhesive layer 108 may be formed of a material having a refractive index that may match or substantially match the refractive index of the transparent flexible substrate 104 and / or the rigid substrate 106, or may be formed of a material having a refractive index that may be between the refractive indexes of the transparent flexible substrate 104 and the rigid substrate 106. Selecting the refractive index in this manner may reduce or eliminate reflections at the interface between the adhesive layer 108 and the transparent flexible substrate 104 and / or at the interface between the adhesive layer 108 and the rigid substrate 106. For example, the adhesive of the adhesive layer 108 may be formed of a material having a refractive index between about 1.4 and about 1.7. Using a refractive index in the range of about 1.4 to about 1.7 may reduce unwanted reflections between the adhesive layer 108 and the transparent flexible substrate 104 and unwanted reflections between the adhesive layer 108 and the rigid substrate 106. An optional thin film anti-reflective coating may also be used to help reduce or eliminate unwanted reflections at one or more interfaces between adjacent different materials or between a material and air.
[0042] In some examples, bonding layer 108 can fully encapsulate the sparse array of LEDs 102. By fully encapsulating the sparse array of LEDs 102, bonding layer 108 can protect the sparse array of LEDs 102 from environmental impacts and can form a smooth, unbroken interface with rigid substrate 106. To fully encapsulate the sparse array of LEDs 102, the adhesive of bonding layer 108 can have a sufficiently low resin viscosity so that the adhesive flows around LEDs 102 when deposited. In addition, to fully encapsulate the sparse array of LEDs 102, bonding layer 108 can be thick enough to fully cover the topography of the sparse array of LEDs 102.
[0043] Figure 2 It shows that it can include Figure 1 10 is a block diagram of an example of a visualization system 10 of a light source 100. The visualization system 10 may include a wearable housing 12, such as a head-mounted viewer or goggles. The housing 12 may mechanically support and house the elements detailed below. In some examples, one or more of the elements detailed below may be included in one or more additional housings that may be separated from the wearable housing 12 and may be coupled to the wearable housing 12 wirelessly and / or via a wired connection. For example, a separate housing may reduce the weight of the wearable goggles, such as by including batteries, radios, and other elements. The housing 12 may include one or more batteries 14 that may power any or all of the elements detailed below. The housing 12 may include circuitry that may be electrically coupled to an external power source, such as a wall outlet, to charge the battery 14. The housing 12 may include one or more radios 16 to wirelessly communicate with a server or network via a suitable protocol, such as WiFi.
[0044] The visualization system 10 may include one or more sensors 18, such as optical sensors, audio sensors, tactile sensors, thermal sensors, gyroscope sensors, time-of-flight sensors, triangulation-based sensors, and the like. In some examples, one or more of these sensors may sense the location, position, and / or orientation of the user. In some examples, one or more of the sensors 18 may generate a sensor signal in response to the sensed location, position, and / or orientation. The sensor signal may include sensor data corresponding to the sensed location, position, and / or orientation. For example, the sensor data may include a depth map of the surrounding environment. In some examples, such as for an augmented reality system, one or more of the sensors 18 may capture real-time video images of the surrounding environment near the user.
[0045] The visualization system 10 may include one or more video generation processors 20. The one or more video generation processors 20 may receive scene data representing a three-dimensional scene from a server and / or a storage medium, such as a set of position coordinates of an object in the scene or a depth map of the scene. The one or more video generation processors 20 may receive one or more sensor signals from one or more sensors 18. In response to the scene data representing the surrounding environment and at least one sensor signal representing the location and / or orientation of the user relative to the surrounding environment, the one or more video generation processors 20 may generate at least one video signal corresponding to a view of the scene. In some examples, the one or more video generation processors 20 may generate two video signals, one for each eye of the user, the two video signals representing views of the scene from the perspective of the left eye and the right eye of the user, respectively. In some examples, the one or more video generation processors 20 may generate more than two video signals and combine the video signals to provide one video signal for both eyes, two video signals for both eyes, or other combinations.
[0046] The visualization system 10 may include one or more light sources 22 (such as Figure 1 Light source 100). Suitable light sources 22 may include light emitting diodes, monolithic light emitting diodes, multiple light emitting diodes, light emitting diode arrays, light emitting diode arrays disposed on a common substrate, segmented light emitting diodes disposed on a single substrate and having individually addressable and controllable (and / or controllable in groups and / or molecular sets) light emitting diode elements, micro light emitting diode (micro-LED) arrays, etc. In some examples, one or more of light sources 22 may include a sparse array of LEDs disposed on a transparent flexible substrate, and a rigid substrate adhered to the transparent flexible substrate using an adhesive layer, such that the sparse array of LEDs is located between the rigid substrate and the transparent flexible substrate.
[0047] The light emitting diode may be a white light emitting diode. For example, the white light emitting diode may emit excitation light, such as blue light or violet light. The white light emitting diode may include one or more phosphors that may absorb some or all of the excitation light and, in response, may emit phosphor light (such as yellow light) having a wavelength greater than the wavelength of the excitation light.
[0048] One or more light sources 22 may include light generating elements having different colors or wavelengths. For example, the light source may include a red light emitting diode that may emit red light, a green light emitting diode that may emit green light, and a blue light emitting diode that may emit blue light. The red light, green light, and blue light are combined in a particular ratio to produce any suitable color that is visually perceptible in the visible portion of the electromagnetic spectrum.
[0049] The visualization system 10 may include one or more modulators 24. The modulators 24 may be implemented in one of at least two configurations.
[0050] In a first configuration, the modulator 24 may include a circuit that can directly modulate the light source 22. For example, the light source 22 may include an array of light emitting diodes, and the modulator 24 may directly modulate the electrical power, voltage, and / or current directed to each light emitting diode in the array to form modulated light. The modulation may be performed in an analog manner and / or in a digital manner. In some examples, the light source 22 may include an array of red light emitting diodes, an array of green light emitting diodes, and an array of blue light emitting diodes, and the modulator 24 may directly modulate the red light emitting diodes, the green light emitting diodes, and the blue light emitting diodes to form modulated light to produce a particular image.
[0051] In a second configuration, the modulator 24 may include a modulation panel, such as a liquid crystal panel. The light source 22 may generate uniform illumination or near uniform illumination to illuminate the modulation panel. The modulation panel may include pixels. Each pixel may selectively attenuate a corresponding portion of the modulation panel area in response to an electrical modulation signal to form modulated light. In some examples, the modulator 24 may include a plurality of modulation panels that may modulate light of different colors. For example, the modulator 24 may include a red modulation panel that may attenuate red light from a red light source (such as a red light emitting diode), a green modulation panel that may attenuate green light from a green light source (such as a green light emitting diode), and a blue modulation panel that may attenuate blue light from a blue light source (such as a blue light emitting diode).
[0052] In some examples of the second configuration, the modulator 24 may receive uniform white light or nearly uniform white light from a white light source, such as a white light emitting diode. The modulation panel may include a wavelength selective filter on each pixel of the modulation panel. The panel pixels may be arranged in groups, such as three or four groups, where each group may form a pixel of a color image. For example, each group may include a panel pixel with a red filter, a panel pixel with a green filter, and a panel pixel with a blue filter. Other suitable configurations may also be used.
[0053] The visualization system 10 may include one or more modulation processors 26 that may receive a video signal (such as from one or more video generation processors 20) and in response may generate an electrical modulation signal. For configurations in which the modulator 24 directly modulates the light source 22, the electrical modulation signal may drive the light source 24. For configurations in which the modulator 24 includes a modulation panel, the electrical modulation signal may drive the modulation panel.
[0054] The visualization system 10 may include one or more beam combiners 28 (also referred to as beam splitters 28) that may combine light beams of different colors to form a single polychromatic light beam. For configurations in which the light source 22 may include a plurality of light emitting diodes of different colors, the visualization system 10 may include one or more wavelength-sensitive (e.g., dichroic) beam splitters 28 that may combine light of different colors to form a single polychromatic light beam.
[0055] The visualization system 10 can direct the modulated light toward the eyes of the viewer in one of at least two configurations. In the first configuration, the visualization system 10 can be used as a projector and can include suitable projection optics 30 that can project the modulated light onto one or more screens 32. The screen 32 can be positioned at a suitable distance from the user's eyes. The visualization system 10 can optionally include one or more lenses 34 that can position a virtual image of the screen 32 at a suitable distance from the eyes, such as a close-focus distance, such as 500mm, 750mm, or another suitable distance. In some examples, the visualization system 10 can include a single screen 32 so that the modulated light can be directed toward both eyes of the user. In some examples, the visualization system 10 can include two screens 32 so that the modulated light from each screen 32 can be directed toward the corresponding eye of the user. In some examples, the visualization system 10 can include more than two screens 32. In a second configuration, the visualization system 10 can direct the modulated light directly into one or both eyes of the viewer. For example, projection optics 30 may form an image on the retina of one eye of a user, or may form an image on each retina of both eyes of a user.
[0056] For some configurations of the augmented reality system, the visualization system 10 may include an at least partially transparent display so that the user can view the user's surroundings through the display. For such configurations, the augmented reality system may generate modulated light corresponding to an enhancement of the surroundings, rather than the surroundings themselves. For example, in the example of a retailer displaying chairs, the augmented reality system may direct modulated light corresponding to the chairs, rather than the rest of the room, toward the screen or toward the user's eyes.
[0057] Figure 3 and Figure 4 Shows Figure 1 1 and 2. Side views of light source 100 in various stages of assembly. Assembling light source 100 in this manner can help avoid air occlusions that can degrade the appearance and optical performance of the finished device. Other assembly techniques can also be used.
[0058] exist Figure 3 In the embodiment of the present invention, a sparse array of LEDs 102 has been arranged (e.g., mounted, grown, deposited, or otherwise formed) on a transparent flexible substrate 104. The transparent flexible substrate 104 has been removably mounted in or on a frame 302. A laminating tool 304 can advance the frame 302 toward an adhesive layer 306 that has been deposited on a support film 308. Alternatively, the laminating tool 304 can advance the adhesive layer 306 toward the frame 302, or advance the two toward each other. The sparse array of LEDs 102 will contact the adhesive layer 306 that has been deposited on the support film 308. The adhesive of the adhesive layer 306 can be in a solid form at room temperature. The adhesive has been applied to the support film 308 and has been covered by a cover film (not shown). A vacuum laminator having a temperature range that allows the adhesive to flow and conformally cover the topography of the LED array can laminate the adhesive layer 306 to the sparse array of LEDs 102 to encapsulate the sparse array of LEDs 102 in the adhesive layer 108. After lamination, the support film 308 may then be removed.
[0059] exist Figure 4 In the lamination tool 404 (optionally, with Figure 3106 ) can advance the transparent flexible substrate 104 and the adhesive layer 108 toward the rigid substrate 106, wherein the sparse array of LEDs 102 is encapsulated in the adhesive layer 108. Alternatively, the lamination tool 404 can advance the rigid substrate 106 toward the transparent flexible substrate 104 and the adhesive layer 108, or toward each other. The lamination tool can laminate the adhesive layer 108 onto the rigid substrate 106, wherein the sparse array of LEDs 102 is encapsulated in the adhesive layer 108. After the adhesive layer 108 has been laminated to the rigid substrate 106, the entire layered structure can be subjected to temperature cycling, exposure to ultraviolet light, or other suitable curing techniques to cure the adhesive.
[0060] In the above example, the transparent flexible substrate 104 has been laminated with the LED side facing the rigid substrate 106, so that the LED 102 is located between the two substrates and encapsulated by the adhesive. Alternatively, the transparent flexible substrate 104 can be laminated with the LED side facing away from the rigid substrate 106, so that the LED 102 is exposed, and the transparent flexible substrate 104 is located between the exposed LED 102 and the rigid substrate 106.
[0061] In some examples, additional components can be assembled onto the transparent flexible substrate, such as integrated circuits (ICs), micro ICs, or transistors for display backplanes. In addition, additional layers can be integrated into the device to form a capacitive or resistive touch screen.
[0062] In some embodiments, the LED includes a plurality of semiconductor layers grown on a substrate (e.g., a sapphire substrate) that will be fabricated into pixels. The substrate can be any substrate capable of growing an epitaxial layer thereon, such as sapphire. The substrate can have a pattern on which an epitaxial layer is grown. The pixel can be formed of gallium nitride (GaN), having an n-type semiconductor, a p-type semiconductor, and an active region between the n-type semiconductor and the p-type semiconductor adjacent to the substrate. The active region can be, for example, a multi-quantum well structure in which light emitted from the pixel is generated. After processing, in some embodiments, the substrate can be removed.
[0063] Prior to etching the epitaxial GaN layer, a die layer of a chip scale package (CSP) that allows for uniform current distribution and optical coupling may be deposited or otherwise formed. For example, uniform current injection in a p-type semiconductor may be obtained by depositing a transparent conductive oxide (TCO) layer such as indium tin oxide (ITO), indium zinc oxide (IZO), zinc oxide (ZnO), or tin oxide (SnO) on the p-type semiconductor. Each of these TCO layers may be considered a transparent coating.
[0064] Figure 5AA cross-sectional view of a sparse array of LEDs 500a according to some examples is shown. LED 500a may include an epitaxial stack 510 of n-type and p-type semiconductors (e.g., GaN, InGaN, AlInGaP, GaAs, InGaAs). The thickness of epitaxial stack 510 may range from about 3 μm to about 15 μm, typically about 5 μm. The n-type semiconductor and p-type semiconductor of epitaxial stack 510 may be electrically contacted with traces 514 on substrate 516 via n-contact 512a and p-contact 512b, respectively. The n-contact 512a and p-contact 512b (or interconnect material) may be formed of a metal or compound, such as Au, Sn, AuSn, In, anisotropic conductive film (ACF) / ACInk, self-aligned contact (SAC). The thickness of n-contact 512a and p-contact 512b may range from about 0.02 μm to about 5 μm, typically about 0.1 μm. The trace 514 may be formed of a TCO material. The thickness of the trace 514 may range from about 0.5 μm to about 10 μm, typically about 1 μm. The n-contact 512a and the p-contact 512b may be patterned and formed of a metal such as copper (Cu), nickel (Ni), gold (Au), silver (Ag), and / or titanium (Ti), which may be deposited on the epitaxial stack 510, for example. The substrate 516 may be a rigid or flexible substrate as described above, formed of, for example, glass, PET, polyamideimide, polyetherimide, or transparent polyimide. The thickness of the substrate 516 may range from about 50 μm to about 1000 μm, typically about 100 μm. The metal conductor 518 may make contact with the trace 514 to route power and other signals to the epitaxial stack 510. The metal conductor 518 may be formed of a metal or compound such as Au, Cu, Al, Ti, Ni, or Mo. The thickness of metal conductor 518 may range from about 0.5 μm to about 30 μm, typically about 1 μm.
[0065] In some embodiments, light conversion layer 520 containing phosphor particles may be disposed on or adjacent to epitaxial stack 510. For example, light conversion layer 520 may convert light emitted by epitaxial stack 510 into white light.
[0066] As shown, lens 530 and / or other optical elements can be disposed above epitaxial stack 510. Lens 530 and / or other optical elements can be bonded in a bonding layer. Although not shown, another substrate can be disposed on lens 530.
[0067] Figure 5B FIG. 5 shows a cross-sectional view of another sparse array of LEDs 500b according to some examples. As indicated, Figure 5B LED 500b and Figure 5AThe difference between LED 500a and LED 500a is the presence of submount 522 (for convenience, the optional light conversion layer 520 and lens 530 are not included). Figure 5B ). The base 522 may be a rigid substrate formed, for example, of glass or silicon. The thickness of the base 522 may range from about 5 μm to about 100 μm, typically about 20 μm. The interconnect material may be the same on both sides of the base 522.
[0068] In some embodiments, the minimum xy dimension of the vertically singulated LEDs can be about 3 μm by about 3 μm, and the maximum xy dimension can be about 15 μm by about 15 μm. In various embodiments, the minimum xy dimension of the lateral and flip-chip LEDs can be about 3 μm by about 6 μm, and the maximum xy dimension can be about 50 μm by about 75 μm. In this case, a 127 μm by 127 μm panel has 200 pixels per inch (ppi), has a 40×40 μm micro-IC, a 25×25 μm LED base, 2×10 μm by 127 μm traces to supply the micro-IC, 2×10 μm by <50 μm traces to supply the LEDs, and the total opaque or translucent area of the tile is 5765 μm 2 , the total area of each pixel in 200ppi is 16129μm 2 , and the fractional area is 35% covered and 65% transparent. Similarly, a 362μm×362μm panel has 70ppi, with a 40×40μm micro-IC, a 25×25μm LED base, 2×10μm×362μm traces to supply the micro-IC, and 2×10μm×<150μm traces to supply the LEDs, for a total opaque or translucent area of 12465μm 2 , the total area of each pixel at 70ppi is 131044μm 2 , and the fractional area is 10% covered and 90% transparent. Any of these can provide sufficient transparency for the panel to be seen through the panel. That is, in a sparse display, the distance between the LEDs of the sparse array of LEDs allows for display of at least one of alphanumeric and image information while providing visibility through the transparent material.
[0069] As described above, displays have always had a viewing side that emits light and a side full of electronics and components that operate to produce light and images. Transparent displays enabled by micro-LEDs can have an emitting side and a backplane side. In some applications, it may be desirable to emit light from one side of the display and not emit light from the opposite side; however, in other applications, this limitation may be impractical, and true light leakage prevention can be addressed by means other than inherent design. In the current embodiments described herein, the ideal surface for transparent display integration can have utility from the outside in and from the inside out, and in many use cases, these are exclusive. Therefore, displays that can provide images of similar quality from both sides can greatly enhance the utility of displays while effectively utilizing their size and integration efforts.
[0070] Figure 5C A cross-sectional view of another sparse array of LEDs is shown according to some examples. Figure 5C The flip chip or lateral LED 500c can be a micro-LED that emits substantially equivalently from both sides, meaning that transparent contacts and areas exist on both the n-side and the p-side of the structure to make electrical contact with both the n-side and the p-side of the structure. Figure 5C As shown in , LED 500c may include a p-type semiconductor 532a and an n-type semiconductor 532b on opposite sides of an active region 532c that may include a multi-quantum well structure. A transparent contact 534a may be provided on the p-type semiconductor 532a. Similarly, a transparent protective coating 536 or pattern that mimics the transparent contact 534a may be formed on the n-type semiconductor 532b. The p-type semiconductor 532a and the active region 532c may be etched to expose a portion of the n-type semiconductor 532b. A transparent (or non-transparent) contact 534b may be formed on the exposed portion of the n-type semiconductor 532b. Thus, the display backplane may be substantially transparent, including a main emission region and a majority of conductive traces connected to the emission region. Examples of candidate materials include glass, PET, polyamide-imide, polyetherimide, or transparent polyimide for substrates, and ITO or ZnO for conductive traces. The transparent contact may be, for example, a very thin metal, such as Ni at a thickness of 50-80 angstroms. Other thin metals may also be used, such as, for example, Al, Ti, Au, Ag, Mo. An interconnect or bonding system for the LED to the backplane may also be used that is substantially transparent and has well-controlled transmission.
[0071] Note that it may be desirable to have approximately the same % transmission between the top and bottom of the LED, regardless of die type (vertical or lateral / flip chip as described). In the case of a flip chip LED, a wide contact (e.g., ITO / Ag) may be used on the mesa for the p-contact, and since the opposite side of the device may typically have no contacts, and thus no metal on that surface, a layer (transparent protective coating 536 or pattern) may be used to make the transmission equivalent to the surface of the contacts. The transparent protective coating 536 or pattern may be similar to the metal of the actual contacts, but may also be different (e.g., a metal or oxide or a combination of both may be used).
[0072] Figure 5D A cross-sectional view of another sparse array of LEDs is shown according to some examples. Figure 5D The vertical LED 500d includes a p-type semiconductor 542a and an n-type semiconductor 542b on opposite sides of an active region 542c which may include a multi-quantum well structure. Transparent contacts 544a, 544b may be disposed on the p-type semiconductor 542a and the n-type semiconductor 542b, respectively. Figure 5C and Figure 5D The active regions 532c, 542c emit in all directions, so light can be Figure 5C and Figure 5D Both the transparent contacts and the coating (if any) in the structure emit.
[0073] although Figure 5C and Figure 5D Not shown, but there may be other layers, such as reflective material deposited or otherwise formed on the sidewalls of the semiconductor structure to limit light emitted from the active area from being emitted by the edge of the semiconductor structure. That is, light emitted from the active area is substantially all emitted from the surface of the semiconductor structure in the growth direction of the semiconductor structure (i.e., in the direction between the transparent contacts). The reflective material may be formed of one or more metal layers (e.g., Cu) or a multilayer Bragg reflector structure including, for example, oxide layers of different refractive indices.
[0074] Figure 6A top view of an example panel 600 is shown. The panel 600 includes a plurality of adjacent (contacting) tiles 602a, 602b. Each tile 602a, 602b includes an LED array 610. Each LED array 610 includes a plurality of LEDs 612 arranged in a sparse distribution, similar to the LEDs described above. Each LED 612 can emit light of the same color, or can emit different lights of different colors. For convenience, electrical connections between the LEDs 612 and from the LEDs 612 to other (external) components (such as drivers) are not shown. Multiple LEDs 612 of different colors can be arranged at each individual (pixel) position of the LED 612.
[0075] As shown, the panel 600 can be formed of adjacent LED arrays 610 (tiles 602a, 602b). In some embodiments, each LED array 610 can have the same size and can have the same number of LEDs 612. The LEDs 612 within each LED array 610 can be separated by a uniform or substantially uniform distance D in two orthogonal (xy) directions. Each LED 612 closest to the edge in each LED array 610 is arranged to be arranged at a uniform distance D / 2 halfway from the edge of the LED array 610.
[0076] Although LED 612 Figure 6 602a, 602b. The LED arrays 610 are shown as being arranged in a square LED array 610 (i.e., the number of LEDs 612 is the same in each orthogonal direction), but any shape of LED array (e.g., rectangular, triangular) can be used in the panel 600, as long as the LED arrays can be assembled together so as to contact another LED array on all sides and the spacing between the LEDs 612 remains constant. Drivers and other control circuits can be arranged at one electronic device edge 620 of each tile 602a, 602b or at the opposite edge. The electronic device edge 620 can be orthogonal to the common edge between the tiles 602a, 602b. The electronic device edge 620 can include multiple drivers, each of which is configured to drive one or more micro LEDs in each pixel.
[0077] Thus, the display formed by the panel 600 may be substantially edgeless. That is, at most three sides may be free of any visible power conductors or signal buses. Such a display may be formed by a plurality of tiles 602a, 602b having substantially the same characteristics and substantially uniform distances between pixels (LEDs) to form a larger display.
[0078] Although not shown, in some embodiments, each panel or tile may include one or more control components. The control component may include one or more sensors to detect users near the panel and / or tile and provide feedback to the processor. In addition, the panel or tile may include other sensors (such as touch sensors) to allow the panel or tile to be used as a user input device in addition to simply displaying information. In this case, the panel or tile may, for example, use a panel or tile on a side window containing a sparse LED array to display an alphanumeric board (the display may be activated based on a proximity sensor in the panel that detects the presence of a user). The panel or tile may also include one or more connectors to an external digital signal, conductors and interfaces for powering the panel or tile, and other control circuits. For each nth pixel, an integrated circuit may be included that provides current to the LED of one or more pixels. In addition, in addition to conductors for power and digital signals, each pixel may include multiple LEDs of different colors (e.g., red, green, and blue LEDs) to enable a predetermined current to be transmitted to the LED.
[0079] Figure 7 An example of a panel with a single tile is shown. Panel 700 may include a single tile with a sparse LED array 702, an electronics edge 704, and a connector 706 electrically coupled to the electronics edge 704. The various components are described above. In the off mode, panel 700 is transparent. As described herein, panel 700 may provide a display on a single side or on opposite sides.
[0080] Figure 8A-B An example of a panel with multiple display tiles is shown. Figure 7 , Fig. 8A and Figure 8B Each tile of the panels 800a, 800b in FIG. 8 may include a sparse LED array 802, an electronics edge 804, and a connector 806 electrically coupled to the electronics edge 804. Figure 8A-B The rectangular tiles shown in Fig. 8A In , the electronic device edge 804 of the panel 800a can be arranged along a single continuous edge of the long edge of each tile forming the panel 800a (where the short edges are common between the rectangular tiles); Figure 8B In the closed mode, the electronic device edge 804 of the panel 800b can be arranged along the opposite edge of the short edge of each tile forming the panel 800b (where the long edge is common between the rectangular tiles). In the closed mode, the panel 800b is transparent. The panel 800b can provide a display on a single side or on opposite sides. Fig. 8A and Figure 8BIn one embodiment, the tiles are the same size; in other embodiments, the tiles can be different sizes as long as the distance between pixels (which contain multiple LEDs of different colors) is the same.
[0081] Fig. 9A and Fig. 9B An example of a sparse LED array arrangement is shown. As described herein, a double-sided panel 900a, 900b (e.g., a double-sided display) can include a panel 914 that includes a plurality of sparse LED arrays 912a, 912b arranged back to back. Individual (or sets of pixels) in the sparse LED arrays 912a, 912b. Each of the sparse LED arrays 912a, 912b can be disposed on an opaque substrate, thereby limiting viewing of information projected to only one hemisphere. A connection 918, such as a cable or wiring, can provide power and enable control by a processor of the panel 914 via traces 916, which are connected to the electronics of the panel 914 that control the sparse LED arrays 912a, 912b. As Fig. 9A As shown in , panel 914 can be disposed within a cavity formed by transparent material 910. One end of power connection 918 can be retained within transparent material 910 to provide a secure electrical connection to trace 916. Fig. 9B As shown in , the panel 914 may instead be disposed on the transparent material 910 and protected by a protective layer 920 (such as PET). Fig. 9A and Fig. 9B The use of a double-sided sparse LED array arrangement as described in can allow different information to be displayed to an observer on opposite sides of the transparent material 910 without restricting viewing through the transparent material 910 in either direction.
[0082] Fig.10 An example display is shown. Display 1000 may include a display stack 1002 including, for example, Figure 6 The sparse array in the panel shown in Figure 5C or Figure 5D The display stack 1002 may thus include LEDs (such as micro-LEDs) that emit substantially equivalently from both sides of the display 1000, as shown by Figure 5C or Figure 5D The transparent contacts and regions on both the n-side and p-side of the structure are provided. In addition, the backplane ( Fig.10The substrate (not shown) can be substantially transparent, including the primary area of emission (the area of the LED array) and most of the conductive traces that provide power and control to the LEDs of the array (and other components of the panel). Thus, the substrate can be formed of one or more materials (such as glass, PET, polyamideimide, polyetherimide, or transparent polyimide), and the conductive traces can be formed of one or more TCO materials (such as ITO). The interconnect or bonding system for the LEDs to the backplane can also be substantially transparent.
[0083] Darkening layers 1004a, 1004b may be disposed on the outermost sides of each side of the display stack 1002. Darkening layers 1004a, 1004b may be disposed on substantially transparent contacts, or may be separate from the panel as an independent layer on the display 1000. Darkening layers 1004a, 1004b may be selectively darkened (thereby providing selectable darkening) such that light is emitted from only one side of the display 1000. Darkening layers 1004a, 1004b may be formed of, or may include, an electrochromic material (thereby providing an electrochromic structure in the disclosed subject matter) that changes opacity in response to an electrical signal, thereby being able to provide, for example, electrochromic darkening. Electrochromic materials may also include a liquid crystal display (LCD) in which the polarization of the liquid crystal in the cell changes by 90° to block light from the display stack 1002 (which light may be polarized by a polarizing film on the LED and / or on the side of the darkening layers 1004a, 1004b opposite the display stack 1002). Activation of the darkening layers 1004a, 1004b on one side of the display 1000 may provide improved contrast for viewing light from the display stack 1002 on the opposite side of the display 1000. In some embodiments, the darkening layers 1004a, 1004b may be provided using an iris or other mechanically activated layer rather than using an electrochromic material.
[0084] The darkening layers 1004a, 1004b may be controlled by a processor. The processor may be part of the panel or display 1000, or may be within a system of which the display 1000 is a part. In some embodiments, the entire area of the darkening layers 1004a, 1004b may be controlled by the processor as a single element, i.e., the entire darkening layer 1004a, 1004b may have the same state (transparent, opaque, or an intermediate state). In other embodiments, the darkening layers 1004a, 1004b may be divided into multiple areas, and these areas are individually controlled by the processor.
[0085] In some embodiments, the darkening layers 1004a, 1004b may be controlled in response to sensor information. One or more sensors may provide sensor information to the processor. Like the darkening layers 1004a, 1004b, the sensors may be integrated into the panel or display 1000, or may be within a system of which the display 1000 is a part.
[0086] The sensor may include a proximity sensor and / or a (capacitive) touch sensor. The proximity sensor and the touch sensor may implement presence detection and use detection, respectively, to provide a user experience. The proximity sensor may sense which side of the display 1000 the user is on, and orient the displayed image correctly. The proximity sensor may use infrared light to determine the presence of the user on one side of the display 1000. The processor may determine that the user is present for a predetermined amount of time (e.g., greater than about 5 seconds), and activate the darkening layers 1004a, 1004b on the other side of the display 1000 from the user. Alternatively, the proximity sensor may include a camera, and the processor may determine that the user is present based on facial recognition of an image captured by the camera.
[0087] In general, each pixel in the display 1000 can emit light in directions symmetrical about a normal direction that is orthogonal to the underlying portion on which the pixel is disposed. For example, in some embodiments, light from each pixel can be radiated in a Lambertian pattern. However, the propagation of light in the normal direction may result in reduced viewing ability for individuals not within the main lobe of the Lambertian pattern because a significant portion of the light is directed toward an unviewable direction. To this end, in some embodiments, one or more optical elements in a sparse array can be used to adjust the emission angle to an optimized direction in which the (Lambertian) pattern of the emitted light is centered at a main non-perpendicular viewing angle based on a viewing position of a detected user position. Similar to augmented reality / virtual reality systems, eye tracking information can also be used to adjust the light emission angle.
[0088] Alternatively, in other embodiments, Fig. 9A or Fig. 9B The double-sided array shown in Figure 5C or Figure 5D The LEDs shown in the figure can be used Fig.10 In this case, since the arrays can be independently controlled and thus can show the same information or different information, the darkened layers 1004a, 1004b may or may not be present.
[0089] Fig.11An example system is shown. System 1100 may include one or more light sources 1110a, 1110b. The first light source 1110a may include one or more of a sparse LED array 1112, as described herein. The first light source 1110a may include a local driver 1114, also as described herein. The first light source 1110a may be disposed in various locations on or within a device, as described in more detail herein. A second light source 1110b may be present and may include one or more non-sparse LED arrays 1116 (e.g., micro-LED arrays, mini-LED arrays, etc.). The second light source 1110b may be disposed in various other locations on or within a device containing system 1100.
[0090] The LEDs in the first light source 1110a and / or the second light source 1110b may include micro-LEDs. The micro-LED array contains thousands to millions of tiny micro-LEDs that emit light and can be controlled individually or in groups of pixels (e.g., 5×5 pixel groups). The micro-LEDs are small (e.g., side length <0.07 mm) and can use inorganic semiconductor materials (such as those described above) to provide monochromatic or multi-color light, typically red, green, blue, or yellow. Other LEDs may have, for example, approximately 4 mm 2 , 250 microns by 250 microns or larger in size. Similar to thin film LEDs, for example, microLEDs can be used because they are about 5 μm thick, and because they have no inherent substrate, they can be placed directly on a backplane. This results in the overall thickness of the light source being significantly less than when other LEDs are used. The individual control provided by the microLEDs allows the drive electronics for the display to use an active matrix array of drive transistors or a full driver micro IC for individual intensity control. The use of micro ICs can be used to exercise a considerable amount of fine control over the operation of each LED.
[0091] The controller 1130 may include a processor 1132, which may be used to control various functions of the system 1100. As also shown, the controller 1130 may include additional components, such as a driver 1134, which is configured to, among other things, drive the second light source 1110b controlled by the processor 1132. In some embodiments, the driver 1134 may also be configured to provide non-local driving of the sparse LED array 1112 of the first light source 1110a.
[0092] As described above, the LEDs in the sparse LED array 1112 and the non-sparse LED array 1116 can be formed from one or more inorganic materials (e.g., binary compounds such as gallium arsenide (GaAs), ternary compounds such as aluminum gallium arsenide (AlGaAs), quaternary compounds such as indium gallium phosphide (InGaAsP), gallium nitride (GaN), or other suitable materials), typically group III-V materials (defined by the columns of the periodic table) or group II-VI materials. The LEDs in different arrays can emit light in the visible spectrum (about 400nm to about 800nm) and / or can emit light in the infrared spectrum (above about 800nm). At least some of the LEDs can be formed by combining n-type and p-type semiconductors on a rigid substrate (which can be textured), the rigid substrate being, for example, sapphire aluminum oxide (Al2O3) or silicon carbide (SiC), among others. In particular, during the manufacture of the LEDs, various layers are deposited and processed on the substrate. Prior to depositing the various layers, the surface of the substrate may be pre-treated to anneal, etch, polish, etc. The original substrate may be removed and replaced by a thin transparent rigid substrate such as glass or a flexible substrate such as plastic.
[0093] In general, epitaxial semiconductor deposition (e.g., by metal organic chemical vapor deposition) can be used to deposit one or more semiconductor layers, metal deposition (e.g., by sputtering), oxide growth, and other operations such as etching, stripping and cleaning to manufacture various LED layers. After manufacturing and after connecting to contacts on the backplane via metal bonding (such as via wires or ball bonding), the substrate can be removed from the LED structure. The backplane can be a printed circuit board or a wafer containing an integrated circuit (IC), such as a CMOS IC wafer. Semiconductor deposition operations can be used to create LEDs with active regions in which electron-hole recombination occurs and light from the LED is generated. The active region can be, for example, one or more quantum wells. Metal contacts can be used to provide drive current from the IC (such as a driver) of the backplane to n-type and p-type semiconductors, and the LED is disposed on the backplane. Methods for depositing materials, layers and films can include, for example, sputtering deposition, atomic layer deposition (ALD), chemical vapor deposition (CVD), physical vapor deposition (PVD), plasma enhanced atomic layer deposition (PEALD), plasma enhanced chemical vapor deposition (PECVD), and combinations thereof, among others.
[0094] In some embodiments, one or more other layers (such as a phosphor conversion layer containing phosphor particles) can be disposed on some or all of the LEDs or some or all of the LED arrays 1112, 1116 to convert at least a portion of the light from the LEDs to light of a different wavelength. For example, blue light from a GaN LED can be converted by a phosphor conversion layer into near infrared light or white light.
[0095] The light sources 1110a, 1110b may include at least one lens and / or other optical elements, such as a reflector. In different embodiments, a single lens may be disposed over one or more of the LED arrays 1112, 1116, multiple lenses may be disposed over one or more of the LED arrays 1112, 1116, wherein a single lens is disposed over one or more of the LED arrays 1112, 1116, or multiple lenses may be disposed over one or more of the LED arrays 1112, 1116, wherein a single lens is disposed over one or more LEDs in each of the LED arrays 1112, 1116. The at least one lens and / or other optical element may direct light emitted by one or more of the LED arrays 1112, 1116 toward a target.
[0096] The processor 1132 may also control a sensor 1120 including a multi-pixel detector 1122. The sensor 1120 may sense light at one or more wavelengths emitted by the second LED array 1116 and reflected by the target and / or radiation emitted by the target. The sensor 1120 may be, for example, a radar or lidar sensor, or the processor 1132 may be used to determine the presence of a specific object nearby (e.g., other vehicles, people, road signs). The sensor 1120 may include an optical element (e.g., at least one sensor lens) to capture the radiation. The multi-pixel detector 1122 may include, for example, a photodiode or one or more other detectors capable of detecting light within the wavelength range(s) of interest.
[0097] The multi-pixel detector 1122 may include multiple different arrays to sense visible light and / or infrared light. Similar to the LED array 1116, the multi-pixel detector 1122 may have one or more segments (which can sense the same wavelength / wavelength range or different wavelengths / wavelength ranges).
[0098] In some embodiments, instead of or in addition to providing a multi-pixel detector in the sensor 1120, a multi-pixel detector may be provided in the second light source 1110b. In some embodiments, the second light source 1110b and the sensor 1120 may be integrated into a single module, while in other embodiments, the second light source 1110b and the sensor 1120 may be separate modules disposed on a printed circuit board (PCB) or other base. In other embodiments, the second light source 1110b and the sensor 1120 may be attached to different PCBs or bases.
[0099] The LEDs in each of the LED arrays 1112, 1116 can be driven in an analog or digital manner, i.e., using a direct current (DC) driver or pulse width modulation (PWM). As shown, drivers 1114, 1134 can be used to drive the LEDs in the LED arrays 1112, 1116, respectively, as well as other components (such as actuators).
[0100] A power source 1140 (such as a battery) may be used to Fig.10 The components of the system 1100 shown in FIG. 1 are powered.
[0101] The first light source 1110a can be arranged to emit light in a sparse distribution so that the LEDs occupy a small surface density to enable visual observation of the information provided by the first light source 1110a while allowing viewing through the underlying transparent (flexible) substrate of the area between the LEDs along a line of sight through the area between the LEDs. This can allow an observer on the emission side of the first light source 1110a to view the information projected by the first light source 1110a as well as the underlying scene. In other embodiments where the underlying substrate fully reflects visible light or specularly reflects, the area between the LEDs may not be viewable.
[0102] The information projected by the first light source 1110a can be static or moving, similar to the information that can be formed by a non-sparse light source. The LEDs of the first light source 1110a can be electrically connected using conductive traces on the substrate, which are configured to provide a drive current to the LEDs from the driver 1114. As described above, the conductive traces can be transparent and include one or more layers of TCO. The conductive traces can be relatively narrow even if formed of opaque metal and spaced far enough apart to allow visual observation through the substrate without substantial interference. The conductive traces can be, for example, less than about 110 μm wide. The LEDs can be connected in series or in parallel to one or more edges containing a control circuit (and a power supply) via conductive traces along each row and column, and can be addressed individually or in groups of LEDs. The driver 1114 and other control devices in the first light source 1110a for each pixel can also be referred to as a micro IC.
[0103] Fig.12 An example of a common device according to some embodiments is shown. Device 1200 may be, for example, a vehicle embedded display. Various elements may be provided on the backplane described above, while other elements may be local or remote. As described herein, an example may include or may operate on a logic or a number of components, modules, or mechanisms.
[0104] Modules and components are tangible entities (e.g., hardware) that can perform specified operations and can be configured or arranged in a certain manner. In one example, circuits can be arranged as modules in a specified manner (e.g., internally or relative to external entities such as other circuits). In one example, all or part of one or more computer systems (e.g., independent, client or server computer systems) or one or more hardware processors can be configured by firmware or software (e.g., instructions, application parts, or applications) as modules for performing specified operations. In one example, the software can reside on a machine-readable medium. In one example, the software, when executed by the underlying hardware of the module, causes the hardware to perform the specified operation.
[0105] Thus, the term "module" (and "component") should be understood to encompass a tangible entity, i.e., a physically constructed, specially configured (e.g., hardwired), or temporarily (e.g., temporarily) configured (e.g., programmed) entity that operates in a specified manner or performs part or all of any of the operations described herein. Considering an example where a module is temporarily configured, each module need not be instantiated at any one time. For example, where a module includes a general-purpose hardware processor configured using software, the general-purpose hardware processor can be configured into corresponding different modules at different times. The software can configure the hardware processor accordingly, for example, to constitute a particular module at one time and to constitute different modules at different times.
[0106] The electronic device 1200 may include a hardware processor (or equivalent processing circuit) 1202 (e.g., a central processing unit (CPU), a GPU, a hardware processor core, or any combination thereof), a memory 1204 (which may include main memory and static memory), some or all of which may communicate with each other via an interconnect (e.g., a bus) 1208. The memory 1204 may include any or all of removable storage and non-removable storage, volatile memory, or non-volatile memory. The electronic device 1200 may further include a display / light source 1210 (such as the above-mentioned LED or video display), an alphanumeric input device 1212 (e.g., a keyboard), and a user interface (UI) navigation device 1214 (e.g., a mouse). In one example, the display / light source 1210, the input device 1212, and the UI navigation device 1214 may be a touch screen display. The electronic device 1200 may additionally include a storage device (e.g., a drive unit) 1216, a signal generating device 1218 (e.g., a speaker), a network interface device 1220, one or more cameras 1228, and one or more sensors 1230 (such as a global positioning system (GPS) sensor, a compass, an accelerometer, or other sensors such as those described herein). The electronic device 1200 may further include an output controller, such as a serial connection (e.g., a universal serial bus (USB)), a parallel connection, or other wired or wireless connection (e.g., infrared (IR), near field communication (NFC), etc.) to communicate or control one or more peripheral devices (e.g., a printer, a card reader, etc.). Some elements (such as one or more sparse arrays providing a display / light source 1210) may be remote from other elements and may be controlled by the hardware processor 1202.
[0107] The storage device 1216 may include a non-transitory machine-readable medium 1222 (hereinafter referred to as a machine-readable medium) on which one or more sets of data structures or instructions 1224 (e.g., software) are stored, which embody or are used by any one or more of the techniques or functions described herein. The instructions 1224 may also reside completely or at least partially within the memory 1204 and / or within the hardware processor 1202 during execution of its instructions 1224 by the electronic device 1200. Although the machine-readable medium 1222 is shown as a single medium, the term "machine-readable medium" may include a single medium or multiple media (e.g., a centralized or distributed database, and / or associated caches and servers) configured to store one or more instructions 1224.
[0108] The term "machine-readable medium" may include any medium capable of storing, encoding, or carrying instructions for execution by the electronic device 1200 and causing the electronic device 1200 to perform any one or more of the techniques of the present disclosure; or any medium capable of storing, encoding, or carrying data structures used by or associated with such instructions. Non-limiting examples of machine-readable media may include solid-state memory and optical and magnetic media. Specific examples of machine-readable media may include: non-volatile memory, such as semiconductor memory devices (e.g., electrically programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM)) and flash memory devices; magnetic disks, such as built-in hard disks and removable disks; magneto-optical disks; random access memory (RAM); and CD-ROM and DVD-ROM disks.
[0109] Instructions 1224 can further be transmitted or received via a communication network using a transmission medium 1226 via a network interface device 1220 using any of several wireless local area network (WLAN) transmission protocols or SPI or CAN bus. Example communication networks may include local area networks (LANs), wide area networks (WANs), packet data networks (e.g., the Internet), mobile phone networks (e.g., cellular networks), plain old telephone (POTS) networks, and wireless data networks. The communication over the network may include one or more different protocols, such as the Institute of Electrical and Electronics Engineers (IEEE) 802.11 family of standards known as Wi-Fi, the IEEE 802.14 family of standards known as WiMax, the IEEE 802.14.4 family of standards, the long-term evolution (LTE) family of standards, the universal mobile telecommunications system (UMTS) family of standards, peer-to-peer (P2P) networks, next generation (NG) / sixth generation (6G) standards, and the like. In one example, the network interface device 1220 may include one or more physical jacks (e.g., Ethernet jacks, coaxial jacks, or telephone jacks) or one or more antennas to connect to the transmission medium 1226.
[0110] Note that the term "circuit" as used herein refers to, is part of, or includes a hardware component, such as an electronic circuit, a logic circuit, a processor (shared, dedicated, or group) and / or a memory (shared, dedicated, or group), an application specific integrated circuit (ASIC), a field programmable device (FPD) (e.g., a field programmable gate array (FPGA), a programmable logic device (PLD), a complex PLD (CPLD), a high capacity PLD (HCPLD), a structured ASIC, or a programmable SoC), a digital signal processor (DSP), etc., which is configured to provide the described functions. In some embodiments, the circuit can execute one or more software or firmware programs to provide at least some of the described functions. The term "circuit" may also refer to a combination of one or more hardware elements and a program code for performing the functions of the program code (or a combination of a circuit used in an electrical or electronic system and a program code for performing the functions of the program code). In these embodiments, the combination of hardware elements and program code may be referred to as a specific type of circuit.
[0111] As used herein, the term "processor circuit" or "processor" therefore refers to, is part of, or includes a circuit that is capable of sequentially and automatically performing a series of arithmetic or logical operations or recording, storing, and / or transmitting digital data. The term "processor circuit" or "processor" may refer to one or more application processors, one or more baseband processors, a physical central processing unit (CPU), a single-core or multi-core processor, and / or any other device capable of executing or otherwise operating computer-executable instructions (such as program code, software modules, and / or functional processes).
[0112] The camera 1228 can sense at least one or more wavelengths of light emitted by the LED. The camera 1228 can include an optical element (e.g., at least one camera lens) that can collect reflected light from the illumination area and / or the illumination emitted by the illumination area. The camera lens can direct the reflected light onto a multi-pixel sensor (also referred to as a light sensor) to form an image on the multi-pixel sensor.
[0113] The processor 1202 can control and drive the LEDs via one or more drivers. For example, the processor 1202 can optionally control one or more LEDs in the LED array independently of one or more LEDs in the LED array to illuminate an area in a specified manner.
[0114] Additionally, sensor 1230 may be incorporated into camera 1228 and / or light source 1210. Sensor 1230 may sense visible light and / or infrared light, and in addition to receiving reflected light from the LEDs, may further sense ambient light and / or changes / flickering in ambient light. Similar to an LED array, a sensor may have one or more segments (which may be capable of sensing the same wavelength / range of wavelengths or different wavelengths / ranges of wavelengths).
[0115] Figure 13A-13G An example of a process 1300 for fabricating a sparse array is shown in accordance with some embodiments. Fig.14 Shown according to Figure 13A-13G The process operations shown in FIG. 1400 are examples of methods for manufacturing sparse arrays. Figure 13A-13G and Fig.14 , the process Fig.13A Start with the transparent flexible sheet 1302. Fig.14 In operation 1402, the transparent flexible sheet 1302 can be attached to a carrier wafer 1304 (or other type of carrier substrate), such as Fig. 13B At operation 1404, metal traces 1306 may be deposited on transparent flexible sheet 1302, such as Fig. 13C At operation 1406, LED array 1308 may be assembled on metal trace 1306, as shown in FIG. Fig.13D At operation 1408, the transparent flexible sheet 1302 including the metal traces 1306 and the LED array 1308 can be released from the carrier wafer 1304, as shown in FIG. Fig.13E At operation 1410, adhesive layer 1310 may be laminated on transparent flexible sheet 1302 to cover metal traces 1306 and LED array 1308, as shown in FIG. Fig.13F At operation 1412, the transparent flexible sheet 1302 may be flipped over and laminated onto the printed circuit board 1312, as shown in FIG. Figure 13G as shown in .
[0116] In other embodiments, a backplane with traces can be formed on a transparent substrate. A sparse LED array (which may include microLEDs) can be transferred to a transparent substrate with a backplane. For example, a mass transfer process can be used to perform the transfer to provide a sparse LED array. For example, mass transfer can be used to deposit microLED (and microIC) masses on a transparent substrate by selecting a location with a stamp and tying or fixing the transferred material with an adhesive layer. In another example, the transfer can be performed using one or more printing nozzles arranged in parallel to provide a sparse LED array in a vacuum nozzle transfer process. The printing nozzle can be an ENJET tool suitable for the process. A laminated structure can then be formed in either case. In other embodiments, after the transfer, the ENJET tool can be used to repair or replace a specific microLED.
[0117] Alternatively, the traces may be formed on a transparent substrate.The LEDs may then be formed on the transparent substrate and a laminate structure formed as described above.
[0118] Fig.15 An example of a process for operating a VR head mounted viewer according to various embodiments of the disclosed subject matter is shown. During process 1500, at operation 1502, a VR head mounted viewer is provided. At operation 1504, the opacity of a darkened layer in the VR head mounted viewer can be changed based on VR interaction or potential collision. This will be described below with respect to Fig.17 Describe in more detail.
[0119] Although sparse arrays are discussed in detail herein, in other embodiments, a sparse array having Figure 5C or Figure 5D The use of micro-LEDs of the structure described in can be used in a non-sparse array to provide a display similar to the above-mentioned display, such as Fig.10 as shown in .
[0120] Fig.16A block diagram of an example of a system according to various embodiments of the disclosed subject matter is shown. System 1600 can use micro-LEDs to provide AR / VR functionality. System 1600 may include a wearable housing 1612, such as a head-mounted viewer or goggles. Wearable housing 1612 can mechanically support and accommodate the elements detailed below. In some examples, one or more of the elements detailed below may be included in one or more additional wearable housings, which may be separated from the wearable housing 1612 and may be coupled to the wearable housing 1612 wirelessly and / or via a wired connection. For example, a separate wearable housing can reduce the weight of wearable goggles, such as by including batteries, radios, and other elements. Wearable housing 1612 may include one or more batteries 1614 that can power any or all of the elements detailed below. Wearable housing 1612 may include a circuit that can be electrically coupled to an external power source (such as a wall outlet) to charge battery 1614. The wearable housing 1612 may include one or more radios 1616 for wirelessly communicating with a server or network via a suitable protocol (eg, WiFi).
[0121] System 1600 may include one or more sensors 1618, such as optical sensors, audio sensors, tactile sensors, thermal sensors, gyroscope sensors, time-of-flight sensors, triangulation-based sensors, proximity sensors, eye tracking sensors, and the like. In some examples, one or more sensors may sense the location, position, and / or orientation of the user. In some examples, one or more sensors 1618 may generate sensor signals in response to the sensed location, position, and / or orientation of the wearer. The sensor signal may include sensor data corresponding to the sensed location, position, and / or orientation. For example, the sensor data may include a depth map of the surrounding environment. In some examples, such as for an AR system, one or more of sensors 1618 may capture real-time video images of the surrounding environment near the user.
[0122] System 1600 may include one or more video generation processors 1620. One or more video generation processors 1620 may receive scene data representing a three-dimensional scene, such as a set of position coordinates of an object in the scene or a depth map of the scene. The data may be received from a server and / or a storage medium. One or more video generation processors 1620 may receive one or more sensor signals from one or more sensors 1618. In response to scene data representing the surrounding environment and at least one sensor signal representing the location and / or orientation of the user relative to the surrounding environment, one or more video generation processors 1620 may generate at least one video signal corresponding to a view of the scene. In some examples, one or more video generation processors 1620 may generate two video signals, one for each eye of the user, the two video signals representing views of the scene from the perspective of the left eye and right eye of the user, respectively. In some examples, one or more video generation processors 1620 may generate more than two video signals, and combine these video signals to provide one video signal for both eyes, two video signals for both eyes, or other combinations.
[0123] The system 1600 may include one or more light sources 1622 that provide light for a display of the system 1600. For example, suitable light sources 1622 may include the micro-LEDs described above. The one or more light sources 1622 may include light generating elements having different colors or wavelengths. For example, the light sources may include a red light emitting diode that emits red light, a green light emitting diode that emits green light, and a blue light emitting diode that emits blue light. The red light, green light, and blue light are combined in a specific ratio to produce any suitable color that is visually perceptible in the visible portion of the electromagnetic spectrum. Each pixel of the system may include 3 or more micro-LEDs (such as white emitting micro-LEDs, wherein a wavelength conversion layer containing phosphor particles converts light from the micro-LEDs into white light).
[0124] System 1600 may include one or more modulators 1624. Modulator 1624 may be implemented in one of at least two configurations. In the first configuration, modulator 1624 may include a circuit that directly modulates light source 1622. For example, light source 1622 may include an array of LEDs (such as micro-LEDs), and modulator 1624 may directly modulate the electrical power, voltage, and / or current directed to each light emitting diode in the array to form modulated light. Modulation may be performed in an analog manner (current) and / or in a digital manner (PWM). In some examples, light source 1622 may include an array of red light emitting diodes, an array of green light emitting diodes, and an array of blue light emitting diodes, and modulator 1624 may directly modulate the red light emitting diodes, the green light emitting diodes, and the blue light emitting diodes to form modulated light to produce a specified image.
[0125] In a second configuration, the modulator 1624 may include a modulation panel, such as a liquid crystal panel. The light source 1622 may generate uniform illumination or nearly uniform illumination to illuminate the modulation panel. The modulation panel may include pixels. Each pixel may selectively attenuate a corresponding portion of the modulation panel area in response to an electrical modulation signal to form modulated light. In some examples, the modulator 1624 may include a plurality of modulation panels that modulate light of different colors. For example, the modulator 1624 may include a red modulation panel that attenuates red light from a red light source (such as a red light emitting diode), a green modulation panel that attenuates green light from a green light source (such as a green light emitting diode), and a blue modulation panel that attenuates blue light from a blue light source (such as a blue light emitting diode).
[0126] In some examples of the second configuration, the modulator 1624 can receive uniform white light or nearly uniform white light from a white light source (such as a white light emitting diode). The modulation panel can include a wavelength selective filter on each pixel of the modulation panel. The panel pixels can be arranged in groups (such as three or four groups), where each group forms a pixel of a color image. For example, each group can include a panel pixel with a red filter, a panel pixel with a green filter, and a panel pixel with a blue filter. Other suitable configurations can also be used.
[0127] The system 1600 may include one or more modulation processors 1626 that receive a video signal (such as from one or more video generation processors 1620) and generate an electrical modulation signal in response. For configurations in which the modulator 1624 directly modulates the light source 1622, the electrical modulation signal may drive the light source 1622. For configurations in which the modulator 1624 includes a modulation panel, the electrical modulation signal may drive the modulation panel.
[0128] System 1600 may include one or more beam splitters 1628 (also referred to as beam combiners) that combine light beams of different colors to form a single polychromatic light beam. For configurations in which light source 1622 may include multiple light emitting diodes of different colors, system 1600 may include one or more wavelength-sensitive (e.g., dichroic) beam splitters 1628 that combine light of different colors to form a single polychromatic light beam.
[0129] The system 1600 can direct the modulated light toward the eyes of the viewer in one of at least two configurations. In the first configuration, the system 1600 can be used as a projector and can include suitable projection optics 1630 that project the modulated light onto one or more screens 1632. The screen 1632 can be positioned at a suitable distance from the user's eyes. The system 1600 can optionally include one or more lenses 1634 that can position a virtual image of the screen 1632 at a suitable distance from the eyes, such as a close focus distance, such as 500mm, 750mm, or another suitable distance. In some examples, the system 1600 can include a single screen 1632 so that the modulated light can be directed toward both eyes of the user. In some examples, the system 1600 can include two screens 1632 so that the modulated light from each screen 1632 can be directed toward the corresponding eye of the user. In some examples, the system 1600 can include more than two screens 1632. In the second configuration, the system 1600 can direct the modulated light directly into one or both eyes of the viewer. For example, projection optics 1630 may form an image on the retina of one eye of a user, or may form an image on each retina of both eyes of a user.
[0130] For some configurations of the AR system, system 1600 may include a display that is at least partially transparent so that the user can view the user's surroundings through the display. For such configurations, the AR system can generate modulated light corresponding to an enhancement of the surroundings, rather than the surroundings themselves. For example, in an example where a retailer displays chairs, the AR system can direct modulated light corresponding to the chairs, rather than the rest of the room, toward the screen or toward the user's eyes.
[0131] Fig.17 An example VR head-mounted viewer according to various embodiments of the disclosed subject matter is shown. VR head-mounted viewer 1700 may include several components as described above. VR head-mounted viewer 1700 can isolate the user from the real world and stimulate the user's visual perception using a virtual world generated in front of the user's eyes. One aspect of maintaining the illusion of the virtual world is to completely block light signals from the real world by using a completely opaque screen to allow the user to enjoy an immersive VR experience. For example, VR head-mounted viewer 1700 can be provided in any of several form factors (such as goggles or a helmet).
[0132] The VR head mounted viewer 1700 may include a frame 1710, on which a plurality of components may be provided. For example, the frame 1710 may be formed of a highly impact resistant opaque material such as acrylonitrile butadiene styrene (ABS), high density polyethylene (HDPE), or polycarbonate.
[0133] The components may include one or more sensors, such as a proximity sensor 1712, a darkening layer 1714, a display 1716, and a component 1718 that provides additional functionality. In some embodiments, the darkening layer 1714, the display 1716, and the component 1718 may form a layer stack. Additional functionality may additionally or alternatively be introduced via one or more other transparent micro-LED arrays located in front of or behind the display 1716. The display 1716 may be formed of micro-LEDs transferred to a backplane and use narrow traces to maintain a high degree of transparency due to the small size and relative spacing of the micro-LEDs as described above. For example, the display 1716 may include a sparse array or a non-sparse array, such as Figure 5C or Figure 5D Those arrays described in .
[0134] Darkening layer 1714 may be similar to Fig.10 1710 . The darkening layer 1714 may be, for example, an LCD layer controlled by a processor 1718a in component 1718. The display 1716 may be closer to the user (center position 1720) and therefore further away from the frame 1710 than the darkening layer 1714. For example, the darkening layer 1714 may be disposed between the display 1716 and the frame 1710. Alternatively, the darkening layer 1714 is incorporated into the frame 1710 itself or the frame 1710 may be disposed between the display 1716 and the darkening layer 1714 (i.e., the darkening layer 1714 may be disposed outside the frame 1710 and protected by a protective cover layer).
[0135] The darkening layer 1714 can be controlled to adjust the opacity. For example, when the darkening layer 1714 is completely opaque, the VR head-mounted viewer 1700 can act as a standard VR head-mounted viewer, allowing the user to enjoy an immersive VR experience. However, the darkening layer 1714 can be adjusted to become transparent and the VR image is turned off, thereby immediately teleporting the user from the virtual world back to the real world (allowing the user to see the real world through the transparent darkening layer 1714 through the transparent display 1716) without removing the VR head-mounted viewer 1700. The opacity of the darkening layer 1714 can be adjusted in a predetermined number of drops between opaque and transparent. That is, the darkening layer 1714 can have multiple modes, including an opaque mode and a transparent mode, in which the external light is blocked from being seen by the user and the VR image is provided to the user by the display 1716, and in a transparent mode, the user can see the outside through the display 1716, and the VR image is not provided by the display 1716.
[0136] The opacity adjustment of the darkening layer 1714 can be a safety feature (for example, in combination with collision detection). One or more proximity sensors 1712 can be used for collision detection. The proximity sensor 1712 can be set on one or more sides of the frame 1710. To this end, the proximity sensor 1712 can emit / detect infrared light, or can capture images periodically. The period for determining a potential collision can be predetermined (for example, every few seconds) or can depend on whether the user is moving (and the speed, and whether the object was detected in the previous image capture), as determined by the motion and orientation sensor in component 1718. Therefore, if the user is not moving, the period can be extended or indefinite to save the battery life of the battery that powers the VR head-mounted viewer 1700. The detected infrared light or image can be processed by the processor 1718a to determine whether there is a potential collision with a real-world object. As described above, the determination of the possibility of a collision can be based on the speed and direction of the user's movement, as well as the distance (and speed) to the detected object.
[0137] Once a potential collision is detected as being possible (e.g., greater than a predetermined percentage, such as 60%), the processor 1718a may automatically adjust the darkened layer 1714 to be transparent and simultaneously deactivate the VR image provided by the display 1716. Alternatively, the processor 1718a may control the display 1716 to replace a portion of the VR image projected by the display 1716, or overlay an alert on the VR image that a collision is unavoidable.
[0138] In this alternative case (displaying an alert), the processor 1718a can control the darkening layer 1714 to become transparent after the alert is provided, or can wait until user input is provided. The user input can be a manual input on the frame 1710. Alternatively, the processor 1718a can control the display 1716 to insert the user input on the screen (e.g., a corner of the display). Note that the use of independently controllable micro-LEDs can enable other areas of the VR display to be used to provide alphanumeric information (such as time / date, temperature, and notifications, etc.). This alphanumeric information and placement can be controllable by the user through VR user input or remotely (e.g., using, for example, a smartphone app).
[0139] Component 1718 may include eye tracking for VR response (i.e., eye tracker 1718b) and infrared emitters and detectors for controlling the opacity of darkening layer 1714 via on-screen user input (eye gesture-based control). That is, processor 1718a may control display 1716 to provide virtual user input, determine whether eye movement meets predetermined criteria, and change the opacity of the darkening layer and disable display of VR images by display 1716 in response to determining that eye movement meets predetermined criteria. Eye tracker and processor 1718a may determine whether the eye is open or closed, and if the eye is open, determine the gaze direction of the eye. For example, eye tracker and processor 1718a may detect that the user is focusing on the user input to change the opacity for a predetermined amount of time (2-3 seconds), and act in response to change the opacity. Alternatively, the predetermined criteria may include a predetermined eye gesture, such as double or triple blink or extended blink, rather than on-screen user input.
[0140] In another use case, in a modern office, the VR headset 1700 can display a virtual image of a user's work screen (instead of a computer monitor) on which the user performs work. If the user moves their eyes away from the virtual screen provided by the display 1716, for example, to interact with a colleague (e.g., by moving their eyes or turning their head to face the colleague), the opacity of the VR headset 1700 can be adjusted to be transparent. Thus, the above-mentioned predetermined criteria can be dependent on the movement of the VR image provided by the display 1716.
[0141] Fig.18 Another example VR head-mounted viewer according to various embodiments of the disclosed subject matter is shown. The VR head-mounted viewer 1800 may include a layer stack 1802 that covers the frame 1810 described above or is integrated with the frame 1810. Although the VR head-mounted viewer 1800 is shown as having a goggle shape, the VR head-mounted viewer 1800 can be any suitable shape. The micro-LEDs 1820 can be arranged in a central (rectangular) array 1822 and in a peripheral group 1824, and the peripheral group 1824 can be formed into a circular or elliptical shape (e.g., mimicking the shape of an eye). In some embodiments, at least some of the micro-LEDs 1820 can emit infrared light to track eye movement and gaze direction, while other micro-LEDs 1820 can emit visible light. The infrared emitting micro-LEDs may include a first group of micro-LEDs that provide constant illumination of the eye, and another group of micro-LEDs may provide modulated illumination of the eye for eye tracking.
[0142] In some embodiments, the backplane to which the micro LEDs 1820 are connected may have conductive traces to provide power to the micro LEDs 1820. For example, the micro LEDs 1820 may be arranged in pairs, where the paired micro LEDs 1820 are electrically connected in parallel to provide redundancy in the event that one of the micro LEDs is defective or fails. The pairs of micro LEDs 1820 may be arranged in multiple (e.g., two) strings, where each string has multiple (e.g., four) pairs of micro LEDs 1820 connected in parallel, which are connected in series via conductive traces.
[0143] The laminated structure can be used to manufacture micro LEDs 1820. In some embodiments, each group of micro LEDs 1820 can be disposed on a flexible transparent sheet (e.g., a polymer). A conductive path configured to power the micro LEDs 1820, the transparent substrate, and the transparent adhesive sheet can be positioned between and bonded to the flexible transparent sheet and the transparent substrate. The micro LEDs 1820 and the conductive paths can be arranged to form a plurality of transparent micro LED light sources for a VR head-mounted viewer 1800, which can be separated from the laminated structure into individual components for the VR head-mounted viewer 1800.
[0144] In some embodiments, microLEDs 1820 may be disposed on a flexible transparent sheet having conductive traces. MicroLEDs 1820 may be formed directly on a transparent sheet, typically where the transparent sheet is supported by an underlying rigid support. Alternatively, microLEDs 1820 may be transferred and attached to a transparent sheet. An adhesive layer may be applied to one or both of the flexible transparent sheet and the rigid layer. An adhesive (such as, for example, silicone or polyimide) may be applied to the transparent sheet and the microLEDs 1820 thereon. The rigid substrate may be flat or curved, or otherwise non-planar (e.g., faceted). The transparent sheet and the rigid layer may be put together to form a laminated structure that is transparent to visible light, with the microLEDs 1820 and the adhesive between the layers. In some embodiments, the adhesive may be cured or cross-linked to achieve bonding of the layers.
[0145] If the rigid layer is curved (e.g., if the rigid layer forms a curved lens or a curved visor or panel of a helmet or head mounted viewer), the flexible transparent sheet can deform to conform to the curved shape of the rigid layer. This enables the micro LEDs 1820 to be attached to a rigid layer of any desired shape while enabling the micro LEDs 1820 to be manufactured on a planar wafer or substrate.
[0146] The adhesive can bond the layers together and at least partially encapsulate the micro LEDs 1820 between the layers. When the flexible transparent sheet is conformed to the shape of the rigid layer (whether flat, curved, or otherwise non-planar), attaching the layers together can include taking steps to prevent, avoid, or eliminate air bubbles or voids between the rigid layer and the transparent sheet.
[0147] After being attached to the rigid layer, the flexible transparent sheet can remain in its flexible or deformable state. The transparent sheet can be solidified or crosslinked after being placed on a rigid substrate and conforming to the rigid substrate. For example, the solidified or crosslinked transparent sheet can be rigid after solidification or crosslinking, or can remain flexible, pliable or compressible. The transparent sheet can also be self-adhesive to the rigid layer, i.e., serve as its own adhesive. As mentioned above, the transparent sheet can include one or more materials, including PI, PEN, PET or other flexible or curable transparent polymers. The rigid layer can be included in one or more materials among silicon dioxide, optical glass, polycarbonate, PMMA, other rigid transparent polymers or other rigid transparent materials.
[0148] Fig.19 An example VR head mounted viewer according to various embodiments of the disclosed subject matter is shown. The VR head mounted viewer 1900 may be similar to Fig.17 The VR head-mounted view device 1700 shown in FIG. That is, the VR head-mounted view device 1900 may include a frame 1910, and a plurality of components may be provided on the frame 1910. These components may include one or more sensors (such as a proximity sensor 1912), a darkening layer 1914, a display 1916, and components providing additional functions (such as a lens 1918a).
[0149] Display 1916 (like display 1716) can include several layers. In some embodiments, darkening layer 1914 can be the outermost layer of display 1916. Darkening layer 1914 can include electrochromic material, LCD or electronic ink, among others. The thickness of darkening layer 1914 can range from about 15 μm to about 500 μm, typically about 50 μm. Darkening layer 1914 can be attached to a transparent substrate using a transparent adhesive. The transparent adhesive can include silicone, siloxane, epoxy-silicone mixture, epoxy, or acrylic resin, among others. The thickness of the transparent adhesive can range from about 2 μm to about 100 μm, typically about 10 μm. The transparent substrate can include glass, PET or transparent PI, among others. The thickness of the transparent substrate can range from about 50 μm to about 1000 μm, typically about 100 μm. One of the transparent substrates can be a dummy backplane for mechanical support.
[0150] The micro-LED array may be embedded in a conformal transparent adhesive. The conformal transparent adhesive may include, among others, silicone, siloxane, epoxy-silicone mixture, epoxy, or acrylic. The thickness of the conformal transparent adhesive may range from about 10 μm to about 100 μm, typically about 25 μm. Each micro-LED may include GaN, InGaN, AlInGaP, GaAs, or InGaAs (i.e., a light emitting semiconductor). The thickness of the micro-LED may range from about 3 μm to about 15 μm, typically about 5 μm.
[0151] The micro-LEDs may be attached to the transparent oxide conductor via an interconnect metal. The interconnect metal may include Au, Sn, AuSn, In, ACF / ACInk, or SAC, among others. The thickness of the interconnect metal may range from about 0.02 μm to about 5 μm, typically about 0.1 μm. The transparent oxide conductor may include ITO, ZnO, or SnO, among others. The thickness of the transparent oxide conductor may range from about 0.5 μm to about 10 μm, typically about 1 μm.
[0152] The display 1916 may be closer to the user (center position 1920) and therefore further away from the frame 1910 than the darkening layer 1914. The darkening layer 1914 may be controlled to adjust the opacity between transparent and opaque. When the darkening layer 1914 is completely opaque, the VR head-mounted view device 1900 may act as a standard VR head-mounted view device, allowing the user to enjoy an immersive VR experience. However, the darkening layer 1914 may be adjusted to become transparent and the VR image may be turned off, thereby immediately teleporting the user from the virtual world back to the real world (allowing the user to see the real world through the transparent darkening layer 1914 through the transparent display 1916) without removing the VR head-mounted view device 1900. The opacity of the darkening layer 1914 may be adjusted in a predetermined number of drops between opaque and transparent.
[0153] One or more proximity sensors 1912 may be used for collision detection. The proximity sensors 1912 may be disposed on one or more sides of the frame 1910. The detected infrared light or image obtained by the proximity sensor 1912 may be processed by a processor to determine whether there may be a potential collision with a real-world object.
[0154] In this alternative case (displaying an alert), the processor may control the darkened layer 1914 to become transparent after providing the alert, or may wait until user input is provided. The user input may be a manual input on the frame 1910. Alternatively, the processor may control the display 1916 to insert the user input on the screen (e.g., a corner of the display), as described above.
[0155] In some embodiments, an artificial intelligence (AI) system can be used to determine the likelihood of a collision. For example, the AI system can look at the rate of change of the proximity of an object to determine the probability of a collision. The likelihood threshold can be predetermined (e.g., within 0.5 meters of the VR head-mounted viewer 1900), or the threshold can be set by the user. Once a potential collision is detected as possible, the processor can automatically adjust the darkening layer 1914 to be transparent and simultaneously deactivate the VR image provided by the display 1916. Alternatively, the processor can control the display 1916 to replace a portion of the VR image projected by the display 1916, or overlay an alert on the VR image that a collision is inevitable.
[0156] Infrared emitters and detectors may be used for eye tracking of VR responses, and for controlling the opacity of the darkening layer 1914 via on-screen user input (eye gesture-based control). The processor may control the display 1916 to provide virtual user input, determine whether eye movement meets predetermined criteria, and in response to determining that eye movement meets predetermined criteria, change the opacity of the darkening layer and disable display of VR images by the display 1916. The eye tracker and processor may determine whether the eye is open or closed, and if the eye is open, determine the gaze direction of the eye.
[0157] In another use case, in a modern office, the VR headset 1900 can display a virtual image of a user's work screen (instead of a computer monitor) on which the user performs work. If the user moves their eyes away from the virtual screen provided by the display 1916, for example, to interact with a colleague (e.g., by moving their eyes or turning their head to face the colleague), the opacity of the VR headset 1900 can be adjusted to be transparent. Thus, the above-mentioned predetermined criteria can be dependent on the movement of the VR image provided by the display 1916.
[0158] For example, lens 1918a may be a Fresnel lens. The lens may position the image of display 1916 at a suitable distance from the eye, such as at infinity, or at a suitable viewing distance from the eye (such as 0.5m, 1m), etc. In this case, another lens 1918b may be disposed behind display 1916 (i.e., on the side of display 1916 opposite to lens 1918a) to effectively eliminate the focusing effect of lens 1918a so that the real world appears as it would normally be seen. For example, if lens 1918a is a positive lens, another lens 1918b on the opposite side of display 1916 may be a negative lens, optionally with an equal but opposite amount of focal length. Similarly, if lens 1918a is a negative lens, another lens 1918b on the opposite side of display 1916 may be a positive lens, optionally with an equal but opposite amount of focal length. As shown, another lens 1918b may be disposed between display 1916 and darkening layer 1914. In other embodiments, the darkening layer 1914 can be disposed between the display 1916 and the further lens 1918b. In some embodiments, the lens 1918a and the further lens 1918b can be part of a display stack. In other embodiments, the further lens 1918b can be disposed on the frame 1910.
[0159] In some embodiments, the darkening layer 1914 may be divided into segments. The segments of the darkening layer 1914 may, for example, conform to the viewing area of the VR head-mounted viewer 1900. That is, if the viewing area of the VR head-mounted viewer 1900 is substantially circular, the segments of the darkening layer 1914 may be concentric rings. The processor may be able to change the opacity of the segments individually, which may be particularly useful for object avoidance. More specifically, when a considerable amount of information is obtained using peripheral vision, when an object enters the frame of the proximity sensor 1912, the processor may change the opacity of the outermost concentric rings to transparent, and adjust the VR display to avoid using the transparent portion of the darkening layer 1914. This allows the user's real-world field of view to gradually expand as the object gets closer and closer. The number and position of the segments may be predetermined or user-set, allowing greater flexibility. Turning on the darkening layer 1914 by the processor may act as an automatic collision warning to the user without the VR head-mounted viewer 1900 providing an explicit warning to the user.
[0160] Fig. 20 An example VR head mounted viewer according to various embodiments of the disclosed subject matter is shown. The VR head mounted viewer 2000 may be similar to Fig.191900. For the sake of brevity, most of the individual components are not repeated, wherein the VR head mounted viewer 2000 includes a frame 2010, a proximity sensor 2012, darkening layers 2014a, 2014b, a display 2016, and lenses 2018a, 2018b arranged in a similar manner relative to the user (center position 2020).
[0161] The lens 2018a and the other lens 2018b can be configured to provide optical adjustment and in a manner similar to that described with respect to Fig.19 The darkening layers 2014a and 2014b may also be divided into segments. The segments of the darkening layers 2014a and 2014b may, for example, conform to the viewing area of the VR head-mounted viewer 2000. That is, if the viewing area of the VR head-mounted viewer 2000 is substantially circular, the segments of the darkening layers 2014a and 2014b may be concentric rings. As described above, the processor may be able to change the opacity of the segments individually based on information from the proximity sensor 2012. However, unlike the VR head-mounted viewer 1900, the darkening layers 2014a and 2014b of the VR head-mounted viewer 2000 may be coatings on another lens 2018b. The darkening layers 2014a and 2014b may be disposed on one or both surfaces of the other lens 2018b (e.g., the inner surface is closer to the display 2016 than the front of the frame 2010, and / or the outer surface is farther away from the display 2016 than the front of the frame 2010). exist Fig. 20 In the example shown in , based on information from the proximity sensor 2012, the processor has controlled the darkening layers 2014a, 2014b provided on the outer surface of the other lens 2018b so that the interior of the darkening layer 2014a remains opaque while the exterior of the darkening layer 2014b is transparent.
[0162] In various embodiments of the VR head-mounted viewer described above, multiple lenses with different focal lengths may be used. The processor may be able to select the desired focal length depending on the particular mode (e.g., VR, real world), as well as correct the user's vision problems (e.g., myopia, hyperopia, astigmatism). Other optical elements may be used to partially compensate for the viewable area of the VR image and / or the real world. In some embodiments, the processor may mechanically move the lens in the VR head-mounted viewer, for example, by automatically focusing the lens along the visual axis or along an axis perpendicular to the visual axis. For example, this may allow a specific lens to be selected, or to adjust from compensating optics to not using optics.
[0163] In other embodiments, the VR head mounted viewer described above may use image recognition of specific objects within the user's field of view to adjust the opacity of only the darkened layer fragments corresponding to the specific objects. For example, the AI system may determine that the user is trying to view an electronic device (e.g., a smart phone, a watch, a laptop), and make the corresponding fragments of the darkened layer transparent to allow the user to actually view the object in the real world. This can avoid using excessive processing after detecting a specific object, creating a virtual variant of the specific object, and creating an overlay of the specific object (rather than just making (one or more) specific fragments transparent). The remaining fragments can continue to provide VR images.
[0164] Example
[0165] Example 1 is a virtual reality (VR) head-mounted view device, comprising: a frame configured to accommodate a user's head; a substantially transparent display comprising a sparse array of micro light emitting diodes (micro LEDs) configured to display VR images; and a darkening layer with controllable opacity disposed between a front side of the frame and the substantially transparent display.
[0166] In Example 2, the subject matter of Example 1 includes where the micro-LEDs are configured to provide light to be viewed on an opposite side of a substantially transparent display, and the distance between the micro-LEDs is configured to provide visibility through the array.
[0167] In Example 3, the subject matter of Examples 1-2 includes a proximity sensor configured to detect a potential collision of the VR head mounted viewer with an object; and a processor configured to change the opacity of the darkened layer from substantially opaque to substantially transparent in response to detecting the potential collision.
[0168] In Example 4, the subject matter of Example 3 includes, wherein the period of determining the potential collision depends on the speed and direction of movement of the VR headset.
[0169] In Example 5, the subject matter of Examples 3-4 includes, wherein the processor is configured to automatically change the opacity of the darkened layer and disable display of the VR image by the display in response to detecting the potential collision.
[0170] In Example 6, the subject matter of Examples 3-5 includes, wherein the processor is configured to: control the display to provide virtual user input in response to detecting a potential collision; and in response to user activation of the virtual user input, change the opacity of the darkened layer and deactivate display of the VR image by the display.
[0171] In Example 7, the subject matter of Examples 1-6 includes, wherein the darkening layer comprises a plurality of segments, each segment having an individually controllable opacity, and the processor is configured to change the opacity of the segments of the darkening layer from substantially opaque to substantially transparent.
[0172] In Example 8, the subject matter of Example 7 includes a proximity sensor configured to detect a potential collision of the VR head mounted view device with the object, wherein the processor is configured to change the opacity of the fragment of the darkened layer from substantially opaque to substantially transparent in response to detecting the potential collision.
[0173] In Example 9, the subject matter of Example 8 includes, wherein the processor is configured to control segments of the darkened layer from outermost segments inward to increase the field of view of the real world as the VR headset increases in proximity to the object.
[0174] In Example 10, the subject matter of Examples 7-9 includes a lens that is disposed closer to a viewpoint of a VR image than a display of the VR image; and another lens that is disposed farther from the viewpoint of the VR image than the display of the VR image, the other lens being configured to compensate for the lens in response to the darkening layer being substantially transparent.
[0175] In Example 11, the subject matter of Example 10 includes, wherein the darkening layer is a layer on another lens.
[0176] In Example 12, the subject matter of Examples 7-11 includes, wherein the processor is configured to determine the presence of a specific object within the field of view through image recognition, and to adjust the opacity of only the darkened layer fragments corresponding to the specific object.
[0177] In Example 13, the subject matter of Examples 1-12 includes a lens that is disposed closer to a viewpoint of a VR image than a display of the VR image; and another lens that is disposed farther from the viewpoint of the VR image than the display of the VR image, the other lens being configured to compensate for the lens in response to the darkening layer being substantially transparent.
[0178] In Example 14, the subject matter of Examples 1-13 includes a plurality of lenses disposed closer to a viewpoint of a VR image than a display of the VR image, each of the lenses having a different focal length; and a processor configured to perform at least one of mechanically switching between use of different lenses, adjusting a particular lens along a visual axis, and adjusting a particular lens along an axis perpendicular to the visual axis.
[0179] In Example 15, the subject matter of Examples 1-14 includes a processor configured to: control a display to provide a virtual user input; and in response to user activation of the virtual user input, change the opacity of the dimming layer and deactivate display of the VR image by the display.
[0180] In Example 16, the subject matter of Examples 1-15 includes an eye tracker configured to track eye movements of a user's eyes; and a processor configured to: control a display to provide virtual user input; determine whether the eye movement tracked by the eye tracker satisfies a predetermined criterion; and change the opacity of the darkening layer and disable display of the VR image by the display in response to determining that the eye movement satisfies the predetermined criterion.
[0181] In Example 17, the subject matter of Example 16 includes, wherein the predetermined criterion is dependent on movement of the VR image.
[0182] Example 18 is a layer stack comprising: a substantially transparent display comprising an array of micro light emitting diodes (microLEDs) configured to provide virtual reality (VR) images; and a darkening layer adjacent to the substantially transparent display and having a controllable opacity.
[0183] In Example 19, the subject matter of Example 18 includes, wherein the micro-LEDs are configured to provide light to be viewed on opposite sides of the substantially transparent display, and the distance between the micro-LEDs is configured to provide visibility through the array.
[0184] In Example 20, the subject matter of Examples 18-19 includes where the darkened layer comprises a plurality of fragments, each fragment having an individually controllable opacity.
[0185] In Example 21, the subject matter of Example 20 includes, wherein in response to detecting a potential collision with the object, opacity of segments of the darkened layer are individually controlled.
[0186] In Example 22, the subject matter of Example 21 includes wherein fragments of the darkened layer are controlled from outermost fragments inwardly as object proximity increases.
[0187] In Example 23, the subject matter of Examples 20-22 includes a lens disposed on a first side of the display and closer to the display than the darkening layer; and another lens disposed on a second side of the display opposite to the first side, the other lens being configured to compensate for the lens in response to the darkening layer being substantially transparent.
[0188] In Example 24, the subject matter of Example 23 includes, wherein the darkening layer is a layer on another lens.
[0189] In Example 25, the subject matter of Examples 20-24 includes, wherein in response to the presence of the specific object being determined, only the opacity of the fragments of the darkened layer corresponding to the specific object is adjusted.
[0190] In Example 26, the subject matter of Examples 18-25 includes a lens disposed on a first side of the display and closer to the display than the darkening layer; and another lens disposed on a second side of the display opposite to the first side, the other lens being configured to compensate for the lens in response to the darkening layer being substantially transparent.
[0191] In Example 27, the subject matter of Examples 18-26 includes a plurality of lenses disposed on a first side of a display, a darkening layer disposed on a second side of the display, each of the lenses having a different focal length, the lenses being configured to perform at least one of: individually select and mechanically switch between use of different lenses, adjust along a visual axis, and adjust along an axis perpendicular to the visual axis.
[0192] In Example 28, the subject matter of Examples 18-27 includes, wherein in response to user activation of the virtual user input, the opacity of the dimming layer is changed and display of the VR image is deactivated.
[0193] In Example 29, the subject matter of Examples 18-28 includes, wherein in response to determining that the eye movement satisfies a predetermined criterion, the opacity of the darkened layer is changed and display of the VR image is deactivated.
[0194] In Example 30, the subject matter of Examples 18-29 includes, wherein the distance between the micro-LEDs in the array is uniform.
[0195] Example 31 is a virtual reality (VR) system comprising: a frame configured to accommodate a user's head; a substantially transparent display comprising an array of individually controllable micro light emitting diodes (microLEDs) configured to provide VR images; a darkening layer having a controllable opacity, the darkening layer disposed between a front of the frame and the substantially transparent display; a processor configured to control the opacity of the darkening layer between an opaque mode and a substantially transparent mode, in which the opaque mode external light is substantially blocked from passing therethrough and the VR image is provided by the substantially transparent display, and in which the substantially transparent mode external light is substantially transmitted therethrough and the VR image is not provided by the substantially transparent display; and a battery configured to power the display, the darkening layer, and the processor.
[0196] In Example 32, the subject matter of Example 31 includes a proximity sensor configured to detect a potential collision of the VR head mounted view device with the object, wherein the processor is configured to change the opacity of the darkened layer from substantially opaque to substantially transparent in response to detecting the potential collision.
[0197] In Example 33, the subject matter of Example 32 includes, wherein a period for determining a potential collision depends on a speed and a direction in which the VR headset is moving.
[0198] In Example 34, the subject matter of Examples 32-33 includes, wherein the processor is configured to automatically change the opacity of the darkened layer and disable display of the VR image by the display in response to detecting the potential collision.
[0199] In Example 35, the subject matter of Examples 32-34 includes, wherein the processor is configured to: in response to detecting a potential collision, control the display to provide a virtual user input; and in response to user activation of the virtual user input, change the opacity of the darkened layer and deactivate display of the VR image by the display.
[0200] In Example 36, the subject matter of Examples 31-35 includes, wherein the darkening layer comprises a plurality of segments, each segment having an individually controllable opacity, and the processor is configured to change the opacity of the segments of the darkening layer from substantially opaque to substantially transparent.
[0201] In Example 37, the subject matter of Example 36 includes a proximity sensor configured to detect a potential collision of the VR head mounted view device with the object, wherein the processor is configured to change the opacity of the fragments of the darkened layer from substantially opaque to substantially transparent in response to detecting the potential collision.
[0202] In Example 38, the subject matter of Example 37 includes, wherein the processor is configured to control segments of the darkened layer from outermost segments inward to increase the field of view of the real world as the VR headset increases in proximity to the object.
[0203] In Example 39, the subject matter of Example 38 includes a lens that is disposed closer to a viewpoint of the VR image than a display of the VR image; and another lens that is disposed farther from the viewpoint of the VR image than the display of the VR image, the other lens being configured to compensate for the lens in response to the darkening layer being substantially transparent.
[0204] In Example 40, the subject matter of Examples 10-39 includes, wherein the darkening layer is a layer on another lens.
[0205] In Example 41, the subject matter of Examples 38-40 includes, wherein the processor is configured to determine the presence of a specific object within the field of view through image recognition and to adjust the opacity of only the darkened layer fragments corresponding to the specific object.
[0206] In Example 42, the subject matter of Examples 31-41 includes a lens that is disposed closer to a viewpoint of a VR image than a display of the VR image; and another lens that is disposed farther from the viewpoint of the VR image than the display of the VR image, the other lens being configured to compensate for the lens in response to the darkening layer being substantially transparent and the VR head-mounted viewer providing a real-world view.
[0207] In Example 43, the subject matter of Examples 31-42 includes multiple lenses that are arranged closer to the viewpoint of the VR image than the display of the VR image, each of the lenses having a different focal length, wherein the processor is configured to perform at least one of: mechanically switching between the use of different lenses, adjusting particular lenses along the visual axis, and adjusting particular lenses along an axis perpendicular to the visual axis.
[0208] In Example 44, the subject matter of Examples 31-43 includes a processor configured to: control a display to provide a virtual user input; and in response to user activation of the virtual user input, change the opacity of the dimming layer and deactivate display of the VR image by the display.
[0209] In Example 45, the subject matter of Examples 31-44 includes an eye tracker configured to track eye movements of a user's eyes; and a processor configured to: control a display to provide virtual user input; determine whether the eye movement tracked by the eye tracker satisfies a predetermined criterion; and in response to determining that the eye movement satisfies the predetermined criterion, change the opacity of the darkening layer and disable display of the VR image by the display.
[0210] In Example 46, the subject matter of Example 45 includes, wherein the predetermined criterion is dependent on movement of the VR image.
[0211] Example 47 is at least one machine-readable medium comprising instructions that, when executed by a processing circuit, cause the processing circuit to perform operations to implement any of Examples 1-46.
[0212] Example 48 is a device including components implementing any of Examples 1-46.
[0213] Example 49 is a system implementing any of Examples 1-46.
[0214] Example 50 is a method of implementing any of Examples 1-46.
[0215] In some embodiments, other components may exist, while in other embodiments, not all components may exist. As indicated herein, although the term "one" is used herein, one or more associated elements may be used in different embodiments. For example, the term "processor" configured to perform a specific operation includes both a single processor configured to perform all operations and a plurality of processors individually configured to perform some or all operations (which may overlap) so that the combination of processors performs all operations. In addition, the term "comprising" may be considered to be interpreted as "at least comprising" the following elements.
[0216] Although only certain features of the system and method have been illustrated and described herein, many modifications and changes will be made by those skilled in the art. Therefore, it should be understood that the appended claims are intended to cover all such modifications and changes. The method operations may be performed substantially simultaneously or in different orders.
Claims
1. A virtual reality (VR) head mounted viewer, comprising: a frame configured to accommodate a user's head; A substantially transparent display comprising a sparse array of micro light emitting diodes (micro-LEDs) configured to display a VR image; and A darkening layer having a controllable opacity is disposed between the front face of the frame and the substantially transparent display.
2. The VR head mounted viewer of claim 1 , wherein the micro LEDs are configured to provide light to be viewed on an opposite side of the substantially transparent display, and the distance between the micro LEDs is configured to provide visibility through the array.
3. The VR head mounted viewer according to claim 1, further comprising: a proximity sensor configured to detect a potential collision of the VR headset with an object; and A processor is configured to, in response to detecting the potential collision, change an opacity of the darkened layer from substantially opaque to substantially transparent.
4. The VR head mounted view device of claim 3, wherein a period for determining a potential collision depends on a speed and a direction of movement of the VR head mounted view device.
5. The VR head mounted viewer of claim 3, wherein the processor is configured to automatically change the opacity of the darkened layer and disable display of the VR image by the display in response to detecting the potential collision.
6. The VR head mounted viewer according to claim 3, wherein the processor is configured to: In response to detecting the potential collision, controlling the display to provide a virtual user input; and In response to user activation of the virtual user input, the opacity of the dimming layer is changed and display of VR images by the display is disabled.
7. A VR head mounted view device according to claim 1, wherein the darkening layer comprises a plurality of fragments, each fragment having an individually controllable opacity, and the processor is configured to change the opacity of the fragments of the darkening layer from substantially opaque to substantially transparent.
8. The VR head-mounted view device of claim 7, further comprising a proximity sensor configured to detect a potential collision of the VR head-mounted view device with an object, wherein the processor is configured to change the opacity of the fragment of the darkened layer from substantially opaque to substantially transparent in response to detecting the potential collision.
9. The VR head mounted view device of claim 8, wherein the processor is configured to control segments of the darkened layer from outermost segments inwardly to increase the field of view of the real world as the proximity of the VR head mounted view device to the object increases.
10. The VR head mounted viewer according to claim 7, further comprising: a lens disposed closer to a viewpoint of the VR image than a display of the VR image; and Another lens is disposed farther from a viewpoint of the VR image than a display of the VR image, the other lens being configured to compensate for the lens in response to the darkening layer being substantially transparent.
11. The VR head mounted viewer of claim 10, wherein the darkening layer is a layer on the other lens.
12. The VR head mounted viewer according to claim 7, wherein the processor is configured to determine the presence of a specific object within the field of view through image recognition, and adjust the opacity of only the fragments of the darkened layer corresponding to the specific object.
13. The VR head mounted viewer according to claim 1, further comprising: a lens disposed closer to a viewpoint of the VR image than a display of the VR image; and Another lens is disposed farther from a viewpoint of the VR image than a display of the VR image, the other lens being configured to compensate for the lens in response to the darkening layer being substantially transparent.
14. The VR head mounted viewer according to claim 1, further comprising: a plurality of lenses disposed closer to a viewpoint of the VR image than a display of the VR image, each of the lenses having a different focal length; and A processor is configured to at least one of mechanically switch between use of different lenses, adjust a particular lens along a visual axis, and adjust a particular lens along an axis perpendicular to the visual axis.
15. The VR head mounted viewer according to claim 1, further comprising a processor configured to: controlling the display to provide virtual user input; and In response to user activation of the virtual user input, the opacity of the dimming layer is changed and display of VR images by the display is disabled.
16. The VR head mounted viewer according to claim 1, further comprising: an eye tracker configured to track eye movements of a user's eyes; and A processor configured to: controlling the display to provide virtual user input; determining whether eye movement tracked by the eye tracker satisfies a predetermined criterion; and In response to a determination that the eye movement satisfies a predetermined criterion, the opacity of the darkened layer is changed and display of a VR image by the display is disabled.
17. A VR head mounted viewer according to claim 16, wherein the predetermined criterion is dependent on the movement of the VR image.
18. A layer stack comprising: A substantially transparent display comprising an array of micro light emitting diodes (micro-LEDs) configured to provide virtual reality (VR) images; and A darkening layer having a controllable opacity is adjacent to the substantially transparent display.
19. A layer stack according to claim 18, wherein the darkening layer comprises a plurality of fragments, each fragment having an individually controllable opacity, and the individually controllable opacity is individually controlled in response to detecting at least one of a potential collision with an object and the presence of a specific object.
20. The layer stack according to claim 19, further comprising: a lens disposed on a first side of the display and closer to the display than the darkening layer; and Another lens is disposed on a second side of the display opposite the first side, the other lens being configured to compensate for the lens in response to the darkening layer being substantially transparent.
21. The layer stack of claim 18, wherein the opacity of the darkened layer is changed and display of the VR image is deactivated in response to at least one of user activation of a virtual user input and detection of eye movement that meets predetermined criteria.
22. A virtual reality (VR) system, comprising: a frame configured to accommodate a user's head; A substantially transparent display comprising an array of individually controllable micro light emitting diodes (micro-LEDs) configured to provide a VR image; a darkening layer having a controllable opacity, the darkening layer disposed between the front face of the frame and the substantially transparent display; a processor configured to control an opacity of the darkening layer between an opaque mode in which external light is substantially blocked from passing therethrough and a VR image is provided by the substantially transparent display, and a substantially transparent mode in which external light is substantially transmitted therethrough and a VR image is not provided by the substantially transparent display; and A battery is configured to power the display, the dimming layer, and the processor.
23. The VR system of claim 22, further comprising a proximity sensor configured to detect a potential collision with an object, wherein the processor is configured to change the opacity of the darkened layer from substantially completely opaque to substantially transparent in response to detecting the potential collision, and a period for detecting the potential collision depends on the power of the battery and the speed and direction of movement of the VR system.
24. The VR system of claim 23, wherein the darkened layer comprises a plurality of segments, each segment having an individually controllable opacity, and the processor is configured to change the opacity of the segments of the darkened layer from substantially opaque to substantially transparent in response to detecting at least one of the potential collision and the presence of a specific object, the period of detecting at least one of the potential collision and the presence of a specific object depending on the power of the battery and the speed and direction of movement of the VR system.
25. The VR system according to claim 22, further comprising: a lens disposed closer to a viewpoint of the VR image than a display of the VR image; and Another lens is disposed farther from a viewpoint of the VR image than a display of the VR image, the other lens being configured to compensate for the lens in response to the darkening layer being substantially transparent.