Improved optical waveguide arrangement.
Optical waveguides with distinct spectral characteristics at different focal planes address the challenge of generating multiple focal planes and large depth of focus, enabling efficient full-color image production and switching in HMDs and HUDs.
Patent Information
- Application Number
- JP2024517453
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2021-10-08
- Filing Date
- 2022-10-06
- Publication Date
- 2024-11-06
- Estimated Expiration
- 2042-10-06
AI Technical Summary
Existing optical waveguide technologies struggle to efficiently generate multiple focal planes and large depth of focus in applications like HMDs and HUDs, limiting the capability to switch between focal planes and produce full-color images at different depths.
The use of optical waveguides with distinct spectral characteristics at different focal planes, where optical signals with different sets of spectral characteristics are transmitted to generate full-color images at specific focal planes, allowing for switching between focal planes and achieving a large depth of focus.
Enables the generation of full-color images at different focal planes without changing perceived color, providing a large depth of focus and efficient switching between focal planes using optical signals with varying spectral characteristics.
Smart Images

Figure 2024540806000001_ABST
Abstract
Description
[Technical field]
[0001] FIELD OF THE DISCLOSURE Embodiments of the present invention relate generally to optical waveguide arrangements, and more particularly, to optical waveguide arrangements for generating multiple focal planes. [Background technology]
[0002] Optical waveguides can transmit optical frequency light. Optical, or visible, frequencies refer to light having wavelengths between about 400 and 700 nanometers. Optical waveguides can be used at least in displays, where light from a light field can be transmitted using one or more waveguides to an appropriate location for emission to one or more eyes of a user.
[0003] Head-Mounted Displays, HMDs, and Head-Up Displays, HUDs, may be implemented using optical waveguide technology, e.g., for Augmented or Virtual Reality type applications. In Augmented Reality, the user sees a view of the real world on which supplementary instructions are superimposed. In Virtual Reality, the user is deprived of his view into the real world and instead is provided with a view into a software-defined scene. In general, there is a need to provide improvements related to optical waveguide technology. Summary of the Invention
[0004] According to some aspects, the subject matter of the independent claims is provided. Some embodiments are defined in the dependent claims.
[0005] According to a first aspect of the present invention, there is provided a light guide arrangement comprising at least one light source and at least one light guide arranged to transmit light signals to at least one light guide of the light guide arrangement, wherein the at least one light guide is arranged to receive light signals from the at least one light source and to transmit light signals to generate a waveguide-based display, and the at least one light guide is further arranged to generate a first image at a first focal plane of the light guide arrangement when at least some of the received light signals have a set of first spectral characteristics and to generate a second image at a second focal plane of the light guide arrangement when at least some of the received light signals have a set of second spectral characteristics, wherein at least one spectral characteristic of the first set of spectral characteristics is different compared to the second set of spectral characteristics.
[0006] Implementations of the first aspect may comprise at least one feature, or any combination of features, from the bulleted list below: wherein the first set of spectral characteristics includes a first set of at least three distinct spectral characteristics and the second set of spectral characteristics includes a second set of at least three distinct spectral characteristics; where a spectral feature of the first set of distinct spectral features is the same as a spectral feature of the second set of distinct spectral features; where all spectral characteristics of the first set of distinct spectral characteristics are different compared to the second set of distinct spectral characteristics; wherein a first set of distinct spectral characteristics is interleaved with a second set of distinct spectral characteristics; where each spectral feature in the first set of spectral features and each spectral feature in the second set of spectral features is a distinct spectral peak within the visible spectrum; where the entire range corresponding to the first and second sets of spectral characteristics together with the waveguide arrangement includes a region of interest (ROI) that represents a full color image; where the first and second sets of distinct spectral characteristics contain the same white point of the object, Therein, the optical waveguide arrangement is arranged to provide a waveguide-based display as a head mounted display.
[0007] According to a second aspect of the present invention there is provided a head mounted or head up display comprising the optical waveguide arrangement of the first aspect.
[0008] According to a third aspect of the present invention, there is provided a method for an optical waveguide arrangement comprising: transmitting, by at least one light source, optical signals to at least one optical waveguide of an optical waveguide arrangement; receiving, by at least one optical waveguide, the optical signals from the light source and transmitting the optical signals to a human eye to generate a waveguide-based display; and generating, by the at least one optical waveguide, a first image at a first focal plane of the optical waveguide arrangement when at least some of the received optical signals have a set of first spectral characteristics and a second image at a second focal plane of the optical waveguide arrangement when at least some of the received optical signals have a set of second spectral characteristics, wherein at least one spectral characteristic of the first set of spectral characteristics is different compared to the second set of spectral characteristics.
[0009] According to a fourth aspect of the present invention, there is provided an apparatus comprising at least one processing core and at least one memory containing computer program code, the at least one memory and the computer program code configured to cause the at least one processing core and the apparatus to at least transmit optical signals to at least one optical waveguide of an optical waveguide arrangement to generate a waveguide-based display and a first image at a first focal plane of the optical waveguide arrangement when at least some of the transmitted optical signals have a first set of first spectral characteristics and a second image at a second focal plane of the optical waveguide arrangement when at least some of the transmitted optical signals have a second set of second spectral characteristics, wherein at least one spectral characteristic of the first set of spectral characteristics is different compared to the second set of spectral characteristics.
[0010] According to a fifth aspect of the present invention, there is provided a waveguide-based display and a non-transitory computer readable medium having stored thereon a set of computer readable instructions which, when executed by at least one processor, cause an apparatus to at least transmit optical signals to at least one optical waveguide of an optical waveguide arrangement to generate a first image at a first focal plane of the optical waveguide arrangement when at least some of the transmitted optical signals have a first set of first spectral characteristics and a second image at a second focal plane of the optical waveguide arrangement when at least some of the transmitted optical signals have a second set of second spectral characteristics, wherein at least one spectral characteristic of the first set of spectral characteristics is different compared to the second set of spectral characteristics.
[0011] According to a sixth aspect of the present invention there is provided a waveguide based display and a computer program comprising instructions which, when executed by the apparatus, cause the apparatus to at least transmit optical signals into at least one optical waveguide of the optical waveguide arrangement to generate a first image in a first focal plane of the optical waveguide arrangement when at least some of the transmitted optical signals have a first set of first spectral characteristics and a second image in a second focal plane of the optical waveguide arrangement when at least some of the transmitted optical signals have a second set of second spectral characteristics, wherein at least one spectral characteristic of the first set of spectral characteristics is different compared to the second set of spectral characteristics. [Brief description of the drawings]
[0012] [Figure 1] 1 illustrates an example system in accordance with at least some embodiments of the present invention. [Diagram 2] 1 illustrates an example of one focal plane in accordance with at least some embodiments of this invention. [Diagram 3] 1 illustrates an example device capable of supporting at least some embodiments of the present invention. [Figure 4] 1 shows a first example of multiple focal planes in accordance with at least some embodiments of this invention. [Diagram 5] 1 shows a second example of multiple focal planes in accordance with at least some embodiments of this invention. [Figure 6] 1 illustrates a flow diagram of a method in accordance with at least some embodiments of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0013] The term "color space" may refer to a (two-dimensional) chromaticity diagram that corresponds to the perceived colors resulting from the spectral response of the average human eye. The gamut of a device may be the region of color space that is reproducible by that device. In particular, the gamut may correspond to the region in color space that can be reproduced by a combination of a light source and a waveguide, such as light source 140 and waveguide 110 in FIG. 1, in a system for a light field that an observer may perceive as originating from a focal plane. The region of interest, ROI, may then refer to the region of color space sufficient to reproduce what is perceived as a full-color image, but may also correspond to smaller or larger regions of color space.
[0014] Since a particular point in the color space can be reached by different combinations of wavelengths, a particular ROI can be reached using distinct spectral characteristics, e.g., different combinations of peaks in the visible spectrum. A color image can be generated, for example, by assuming that the user's color vision perception corresponds to a standard eye, and by reproducing (a part of) the corresponding color space. As is clear from the definition of the color space, the user can perceive the same color as a result of several different optical signal spectra. This provides a degree of freedom in how the waveguide operates. In addition, distinct spectral characteristics, e.g., different combinations of wavelengths, can be used to generate the same color. How the light is coupled out of the waveguide can be a function of the exit position. That is, a light ray corresponding to a particular position (a particular propagation angle) in the input image can leave the waveguide at different angles depending on the exit position. In general, the user can perceive the same color from multiple spectra of optical signals. This gives rise to a degree of freedom in manufacturing the waveguide 110.
[0015] An embodiment of the present invention relates to a light guide arrangement, and more particularly to generating different focal planes using a light guide arrangement, where a particular region, ROI of a color space is reproduced in all the different focal planes. In particular, different sets of spectral characteristics may be used in the different focal planes, such that all corresponding gamuts are included in the ROI. That is, a particular set of spectral characteristics may be used, for example, to generate a full color image in a particular focal plane, and an at least partially different set of spectral characteristics may be used to generate another full color image in a different focal plane. Thus, the same color sensation or ROI may be realized in the different focal planes by using at least partially different wavelengths in these planes. For example, an optical signal having a first set of distinct spectral characteristics may be transmitted to at least one light guide to generate a first full color image in a first focal plane, and an optical signal having a second set of distinct spectral characteristics may be transmitted to at least one light guide to generate a second full color image in a second focal plane. In some embodiments of the present invention, a set of distinct spectral characteristics may refer to a set of peaks in the visible spectrum, such as a triplet of distinct wavelengths, e.g., a set of light components including red, green, and blue light. The number of focal planes may in practice be greater than two. In some embodiments, a partial region of the color space, or even a single color, may be sufficient.
[0016] 1 shows an example system in accordance with at least some embodiments of the present invention. The system may include a set of light sources 140. The light sources 140 may include, for example, laser or light-emitting diode, LED (Light-Emitting Diode), light sources, where laser sources have the advantage that they are more strictly monochromatic than LEDs. The light sources 140 together with other optical components, for example a MEMS (Microelectromechanical System) mirror 130, may form an optical system that may be configured to generate a light field in angular space.
[0017] An image may be encoded in the light field. The light field is shown diagrammatically in FIG. 1 as field 100. In some embodiments, a physical primary display may display the image of the light field 100, while in other embodiments, the system may not include a physical primary display and the image may simply be encoded in the light field distributed in angular space. The light signal 104 from the light field 100 may be conveyed to a light guide 110 directly or by using a light guide 102, including, for example, mirrors and / or lenses, to generate a waveguide-based display. The light guides 102 are optional in the sense that depending on the details of the particular embodiment, they may not be present. In other words, the light guides 102 are not present in all embodiments.
[0018] The optical signal 104 from the light source 140 may be directed to the in-coupling structure 103, e.g., a partially reflective mirror, a surface relief grating, or other diffractive structure. The in-coupling structure 103 may include, e.g., one or more in-coupling gratings and / or prisms. The in-coupling structure 103 may be positioned to direct the light beam 104 into the light guide 110. That is, the in-coupling structure 103 may diffractively couple the image into the light guide 110. As shown in FIG. 1, in some embodiments, the in-coupling structure 103 may be, for example, on or near a surface of the light guide 110. However, in some embodiments, the light guide 110 may comprise the in-coupling structure 103. In some embodiments, the light 104 may be in-coupled from an end of the waveguide.
[0019] In some embodiments, the inter-coupling structure 103 may not be present, in which case it may be possible to enter the optical signal 104 into the optical waveguide 110, for example, by shining directly onto the side of the optical waveguide 110.
[0020] In the waveguide 110, the optical signal 104 may travel by interacting with element 112a and being repeatedly reflected inside the waveguide until it interacts with element 112, which may deflect the optical signal 104 out of the waveguide 110 and into air, toward the eye 120 as an image producing optical signal 114. Elements 112a and 112 may be located on either or both sides of the optical waveguide 110, where the side of the optical waveguide 110 points toward the side toward the eye 120 or the "outside world" side.
[0021] Elements 112 and 112a may include, for example, partially reflective mirrors, surface relief gratings, or other diffractive structures. Element 112a may be positioned, for example, to spread out light field 100 inside waveguide 110 so that the image of the waveguide display is accurately generated. Light from different angular aspects of light field 100 may interact with element 112 in a manner that causes light signal 114 to result in an image encoded in light field 100 on the retina of eye 120.
[0022] Element 112 may cause light signal 104 to leave waveguide 110 at multiple exit locations. As a result, the user will perceive an image encoded in light field 100 in front of his eye 120. Since waveguide 110 may be at least partially transparent, the user can also advantageously see his real environment through waveguide 110, for example, when the waveguide-based display is head-mounted. Light is emitted from waveguide 110 as a result of the action of element 112, i.e. element 112 may be referred to as an outcoupling element or structure.
[0023] The example system shown in Figure 1 includes three light sources 140, and at least one processor 150 may be configured to control the light sources 140. This is an example to which the disclosure is not limited, but rather there may be fewer than three or more than three light sources 140. The light sources 140 may be considered monochromatic in the sense that the light sources 140 may produce a narrow spectral band of light with a single peak wavelength, as with a laser, or the spectral band may be broader, as with an LED. Light sources with more complex spectral distributions are also possible.
[0024] The light source 140 may be controlled, for example, programmatically, to produce a color image encoded in the light field 100 in the angle space. In examples where a mirror 130 is present, the light source 140 and the mirror 130 may be synchronized with each other such that light from the light source 140 illuminates certain angular regions of the angle space 100 in a controlled manner to produce therein a representation of a color image that reproduces a still or moving input image received from an external source, such as a virtual reality or augmented reality computer. The still or moving image received from the external source may include, for example, a digital image or a digital video feed. Thus, the image encoded in the light field 100 is configurable by providing an appropriately selected input image.
[0025] To produce a particular color at a given aspect in the angle space of light field 100, the given aspect in the angle space may be illuminated, for example, by a set of at least three light sources 140. This particular color may then be reproduced by light signal 114 as light from the given aspect in the angle space of light field 100 travels in waveguide 110 to element 112, via element 112a, if it is at an angle corresponding to the given aspect in angle space 100.
[0026] Figure 2 shows an example of a focal plane in accordance with at least some embodiments of the present invention. In Figure 2, eye 120 is shown similar to Figure 1. One focal plane from eye 120 is shown at 160. Said focal plane 160 is generated beyond an optical waveguide, e.g., optical waveguide 110 of Figure 1, when viewed from the perspective of eye 120.
[0027] Light rays corresponding to a particular pixel or source point may exit light pipe 110 at particular angles at different locations on the surface of light pipe 110 in order for the light to be perceived as originating from a particular focal plane, e.g., a full color image at a particular focal length. That is, the exit angle of light ray 104 may be a function of the exit position, not just the incident ray angle, as in an infinite focal length near-eye display. Such behavior may be achieved by elements 112 and 112a shown in FIG. 1.
[0028] With respect to the use of optical waveguides, one challenge relates to different focal planes. For example, in some applications it may be desirable to switch from one focal plane to another, or to generate, for example, full color images at different focal planes on top of each other. Alternatively, it may be desirable to have a large depth of focus, DOF. DOF is shown at 165 in FIG. 2 and refers to the area where focus is acceptable. Thus, embodiments of the present invention allow for switching between focal planes and a large DOF to generate different focal planes using optical signals with different sets of spectral characteristics.
[0029] For example, an optical signal 104 having a first set of well-defined spectral characteristics may be used to generate a first image in a first focal plane. Alternatively, or in addition, an optical signal 104 having a second set of well-defined spectral characteristics may be used to generate a second image in a second focal plane. The first and second images may be full color images; i.e., full color images may be produced for different focal planes. In some embodiments, the first and second images may include only one color, or a portion of a color space, instead of a full color image. In some embodiments, the first and second images may be the same, i.e., include the same colors, and the image may be moved from the first focal plane to the second focal plane by switching from using the first set of well-defined spectral characteristics to using the second set of well-defined spectral characteristics.
[0030] In some embodiments of the present invention, the light source 140 transmitting the optical signal 104 having a first set of well-defined spectral characteristics may be shut down and the light source 140 transmitting the optical signal 104 having a second set of well-defined spectral characteristics may be activated, thereby, for example, moving the full-color image from a first focal plane to a second focal plane. If the light source 140 transmitting the optical signal 104 having the second set of well-defined spectral characteristics is shut down at some point thereafter and the light source 140 transmitting the optical signal 104 having the first set of well-defined spectral characteristics is reactivated, the full-color image may be moved from the second focal plane back to the first focal plane. Thus, the full-color image may jump between the first focal plane and the second focal plane depending on whether the optical signal 104 having the first set of well-defined spectral characteristics or the optical signal 104 having the second set of well-defined spectral characteristics is transmitted.
[0031] Thus, a full color image may be moved from one focal plane to another without changing the perceived color between the images at the different focal planes, as long as the ROI is at the intersection of the focal plane gamut. The focal plane to be displayed may be selected for the full color image by selecting a particular set of distinct spectral characteristics. For example, in some embodiments, first and second sets of distinct spectral characteristics represent full color images within the same ROI, e.g., including the same white point, such that all colors near this white point are thereby reproduced in the corresponding first and second focal planes.
[0032] Furthermore, in some embodiments, a light source 140 transmitting an optical signal 104 having a first set of distinct spectral characteristics and a light source 140 transmitting an optical signal 104 having a second set of distinct spectral characteristics may be active simultaneously, thereby generating first and second full-color images on top of each other. Also, the optical signals 104 having the first and second sets of distinct spectral characteristics may be interleaved to generate a large DOF. In practice, there may be more than two sets, for example ten sets of distinct spectral characteristics. Similarly, there may be more than two focal planes.
[0033] FIG. 3 illustrates an example device capable of supporting at least some embodiments of the present invention. Illustrated is device 300, which may include, for example, a control mechanism for operating an optical waveguide arrangement, such as the optical waveguide arrangement shown in FIG. 1. Included in device 300 is processor 310, which may include, for example, a single or multi-core processor or microcontroller, where a single-core processor includes one processing core and a multi-core processor includes multiple processing cores. Processor 310 may generally include a control device. Processor 310 may include multiple processors. Processor 310 may also be a control device. The processing core may include, for example, a Cortex-A8 processing core manufactured by ARM Holdings or a Steamroller processing core designed by Advanced Micro Devices Corporation. Processor 310 may include at least one Qualcomm Snapdragon and / or Intel Atom processor. Processor 310 may include at least one Application-Specific Integrated Circuit, ASIC. The processor 310 may include at least one field-programmable gate array, FPGA. The processor 310 may be a means for performing steps of the method in the device 300, such as sending and shifting. The processor 310 may be configured, at least in part, by computer instructions to perform actions. The processor 310 may be the processor 150 of FIG. 1.
[0034] The device 300 may include a memory 320. The memory 320 may include a permanent memory, such as a random access memory and / or a non-volatile memory. The memory 320 may include at least one RAM chip. The memory 320 may include, for example, a solid-state, magnetic, optical, and / or holographic memory. The memory 320 may be at least partially accessible to the processor 310. The memory 320 may be at least partially included in the processor 310. The memory 320 may be a means for storing information. The memory 320 may include computer instructions that the processor 310 is configured to execute. When computer instructions configured to cause the processor 310 to perform a certain action are stored in the memory 320 and the entire device 300 is configured to operate under the direction of the processor 310 using the computer instructions from the memory 320, the processor 310 and / or at least one processing core thereof may be considered to be configured to perform said certain action. The memory 320 may be at least partially included in the processor 310. The memory 320 may be at least partially external to the device 300, but accessible to the device 300. The memory 320 may store, for example, information defining the segments of the primary display 100.
[0035] The device 300 may comprise a transmitter 330. The device 300 may comprise a receiver 340. The transmitter 330 and the receiver 340 may be configured to transmit and receive information, respectively, according to at least one cellular or non-cellular standard. The transmitter 330 may comprise multiple transmitters. The receiver 340 may comprise multiple receivers. The receiver 340 may be configured to receive an input image, and the transmitter 330 may be configured to output control commands, for example, for directing the mirror 130, if any, and the light source 140, according to the input image. The transmitter 430 and / or the receiver 440 may be configured to operate, for example, according to a Wireless Local Area Network, WLAN (Wireless Local Area Network) standard.
[0036] The device 300 may comprise a user interface, UI 350. The UI 350 may comprise at least one of a display, a keyboard, a touch screen, a vibrator arranged to send signals to a user by vibrating the device 300, a speaker, and a microphone. A user may be able to operate the device 300 via the UI 350, for example to configure display parameters.
[0037] The processor 310 may be equipped with a transmitter arranged to output information from the processor 310 via conductors internal to the apparatus 300 to other devices included in the apparatus 300. Such a transmitter may comprise, for example, a serial bus transmitter arranged to output information via at least one conductor to the memory 320 for storage therein. As an alternative to a serial bus, the transmitter may comprise a parallel bus transmitter. Similarly, the processor 310 may comprise a receiver arranged to receive information at the processor 310 from other devices included in the apparatus 300 via conductors internal to the apparatus 300. Such a receiver may comprise, for example, a serial bus receiver arranged to receive information via at least one conductor from the receiver 340 for processing in the processor 310. As an alternative to a serial bus, the receiver may comprise a parallel bus receiver.
[0038] The device 300 may include additional devices not shown in FIG. 3. For example, the device 300 may include a Near-Field Communication (NFC) transceiver. The NFC transceiver may support at least one NFC technology, such as NFC, Bluetooth, Wi-Fi, or a similar technology. In some embodiments, the device 300 may lack at least one of the aforementioned devices. For example, some devices 300 may lack a UI 350.
[0039] The processor 310, memory 320, transmitter 330, receiver 340, and / or UI 350 may be interconnected by conductors internal to the device 300 in a number of different ways. For example, each of the aforementioned devices may be individually connected to a master bus internal to the device 300 to enable the devices to exchange information. However, one skilled in the art will appreciate that this is merely one example and that, depending on the embodiment, various ways of interconnecting at least two of the aforementioned devices may be selected without departing from the scope of the present invention.
[0040] Figure 4 shows a first example of multiple focal planes in accordance with at least some embodiments of the present invention. In Figure 4, eye 120 is shown similarly as in Figure 2. Multiple focal planes are similarly shown. A first focal plane is shown at 162, a second focal plane is shown at 164, and a third focal plane is shown at 166. As in Figure 2, the multiple focal planes 162, 164, and 166 may be generated beyond an optical waveguide, e.g., optical waveguide 110 of Figure 1, when viewed from the perspective of eye 120.
[0041] As shown in Fig. 4, different sets of spectral characteristics (λ1, λ2, λ3), (λ4, λ5, λ6), (λ7, λ8, λ9), i.e., spectral peaks, may be used to generate, for example, full-color images at different focal planes. For example, a first full-color image may be generated at a first focal plane 162 using a first spectral characteristic, e.g., distinct wavelengths λ1, λ2, and λ3. That is, the first spectral characteristic may include a first set of at least three distinct spectral characteristics (λ1, λ2, λ3).
[0042] Similarly, a second full-color image can be generated at the second focal plane 164 using a second spectral characteristic, e.g., distinct wavelengths λ4, λ5, and λ6. The second spectral characteristic can similarly include a second set of at least three distinct spectral characteristics, where each distinct special characteristic in the second set is different compared to the first set of distinct special characteristics, i.e., none of the distinct special characteristics in the first set can be found in the second set of distinct special characteristics. For example, λ1 is not in the second set of distinct special characteristics.
[0043] In some embodiments, each of the first and second spectral characteristics may be distinct spectral peaks. Additionally, in some embodiments of the present invention, a third full-color image may be generated at a third focal plane 166 using three spectral characteristics, e.g., distinct wavelengths λ7, λ8, and λ9. In some embodiments, λ1, λ4, and λ7 may be close to each other in the spectrum (but the difference may be greater than or equal to, e.g., 5 nm or 10 nm within the desired ROI), thereby allowing for short rotations. As shown in FIG. 4, each spectral characteristic may have its own focal plane, i.e., each spectral characteristic may be used to generate a full-color image at only one particular focal plane.
[0044] 1, at least one optical waveguide 110 may be arranged to generate a first full-color image at a first focal plane 162 when an optical signal 104 having at least one first spectral characteristic (λ1, λ2, and / or λ3, etc.) is received from at least one light source 140. Similarly, at least one optical waveguide 110 may be arranged to generate a second full-color image at a second focal plane 164 when an optical signal 104 having at least one second spectral characteristic (λ4, λ5, and / or λ6, etc.) is received from at least one light source 140. The at least one first spectral characteristic may form a first set of distinct spectral characteristics, and the at least one second spectral characteristic may form a second set of distinct spectral characteristics.
[0045] In some embodiments, fuzzy focal planes may be present in addition to or instead of specific focal planes. Fuzzy focal planes may refer to focal planes where the image is not actually located at exactly one focal depth, but in a (small) area around it. It is therefore possible to obtain a reasonable approximation of a continuous range of focal planes by a distinct number of "real" focal planes. It may also be possible to use two (or more) such focal planes in a program to simulate any real focal plane in between (i.e., a precise focal depth, rather than a large depth of field).
[0046] In some embodiments, the processor 150 may be configured to control the at least one light source 140 to transmit an optical signal having a first set of distinct spectral characteristics by using the three light sources, thereby generating a first full-color image in a first focal plane 162, for example. At some point thereafter, the processor 150 may control the at least one light source 140 to transmit an optical signal having a second set of distinct spectral characteristics by using the same three light sources or an additional light source, thereby generating a second full-color image in a second focal plane 164. In some embodiments, the processor 150 may control the at least one light source 140 to cease transmitting an optical signal having the first set of distinct spectral characteristics. As a result, the full-color image may be shifted from the first focal plane to the second focal plane if the first and second full-color images are the same. However, in some embodiments, the first and second signals may not be the same, i.e., different full-color images may be displayed at different focal planes.
[0047] Further, in some embodiments, the processor 150 may then control the at least one light source 140 to stop transmitting the optical signal having the second set of distinct spectral characteristics and to start transmitting the optical signal having the first set of distinct spectral characteristics. Hence, the full-color image may jump between the first focal plane 162 and the second focal plane 164 depending on whether the optical signal having the first set of distinct spectral characteristics (λ1, λ2, λ3) or the optical signal having the second set of distinct spectral characteristics (λ4, λ5, λ6) is transmitted by the at least one light source 140 and conveyed to the user's eye 120 via the at least one optical waveguide 110.
[0048] Distinct spectral characteristics of the first set (λ1, λ2, λ3) and the second set (λ4, λ5, λ6) can be selected such that the corresponding gamuts contain the same ROI even though the first and second full-color images are in different focal planes, i.e., the same appearance can be provided and all colors can be presented in different focal planes.
[0049] That is, the focal plane of the optical waveguide arrangement may be shifted from the first focal plane 162 to the second focal plane 164 by shutting down the transmission of optical signals having a first set of spectral characteristics (λ1, λ2, λ3) and activating the transmission of optical signals having a second set of spectral characteristics (λ4, λ5, λ6). Thus, the focal plane of the optical waveguide arrangement may be shifted from the first focal plane 162 to the second focal plane 164 when the spectral characteristics of the optical signals received by the at least one optical waveguide 110 are shifted from the at least one first spectral characteristic to the at least one second spectral characteristic and vice versa.
[0050] As an example, three light sources 140 may be used to generate three optical signals having three distinct spectral characteristics. The same three light sources 140 may be used to generate three optical signals having three distinct spectral characteristics, for example, by reconfiguring the light sources 140.
[0051] If additional light sources 140 (e.g., six in total) are used, the processor 150 may control at least one of the light sources 140 to continue transmitting optical signals having the first set of distinct spectral characteristics along with transmitting optical signals having a second set of distinct spectral characteristics, thereby, for example, simultaneously generating a first full-color image in the first focal plane 162 and a second full-color image in the second focal plane 164, i.e., generating first and second full-color images on top of each other. In other words, by activating all light sources, i.e., simultaneously transmitting optical signals having the first and second sets of distinct spectral characteristics, a first full-color image may be generated in the first focal plane 162 and a second full-color image may be generated in the second focal plane 164.
[0052] In some embodiments, optical signals having a first set of well-defined spectral characteristics may be interleaved with optical signals having a second set of well-defined spectral characteristics, and thus a large DOF may be created.
[0053] 5 shows a second example of multiple focal planes in accordance with at least some embodiments of the present invention. In FIG. 5, eye 120 is shown similarly as in FIGS. 2 and 4. Multiple focal planes are similarly shown. A first focal plane is shown at 172, a second focal plane is shown at 174, and a third focal plane is shown at 176. Similar to FIG. 4, the multiple focal planes 172, 174, and 176 may be generated beyond an optical waveguide, e.g., optical waveguide 110 of FIG. 1, when viewed from the perspective of eye 120.
[0054] As shown in FIG. 5, in some embodiments of the present invention, for example, a first full-color image may be generated at a first focal plane 172 using an optical signal having a first spectral characteristic (e.g., distinct wavelengths λ1, λ2, and λ3), a second full-color image may be generated at a second focal plane 174 using an optical signal having a second spectral characteristic (e.g., distinct wavelengths λ1, λ5, and λ6), and a third full-color image may be generated at a third focal plane 176 using an optical signal having a third spectral characteristic (e.g., distinct wavelengths λ1, λ8, and λ9).
[0055] Thus, at least one spectral characteristic may be the same in all sets of spectral characteristics, e.g., λ1 as shown in FIG. 5, thereby requiring fewer light sources when different light sources are used to generate optical signals having the first, second and third spectral characteristics. Alternatively, when the same light source 140 is used to generate multiple sets of spectral characteristics, faster reconfiguration is possible since it is not necessary to reconfigure at least one light source to generate full-color images at different focal planes. Thus, the use of a common spectral characteristic allows for more efficient operation for generating multiple focal planes. In some embodiments, exactly one spectral characteristic may be the same in all sets of spectral characteristics.
[0056] 6 is a flow graph of a method according to at least some embodiments of the invention. The illustrated method phases may be performed by the optical waveguide arrangement or device 300 of FIG. 3 or in a control mechanism configured to control its function when installed therein.
[0057] The method may include, in step 610, transmitting, by at least one light source, a light signal to at least one light guide of a light guide arrangement. Further, the method may include, in step 620, receiving, by at least one light guide, the light signal from the light source and transmitting the light signal to a human eye to generate a waveguide-based display. Finally, the method may include, in step 630, generating, by at least one light guide, a first image at a first focal plane of the light guide arrangement when at least some of the received light signals have a set of first spectral characteristics, and a second image at a second focal plane of the light guide arrangement when at least some of the received light signals have a set of second spectral characteristics, wherein at least one spectral characteristic of the first set of spectral characteristics is different compared to the set of second spectral characteristics. In some embodiments, the first and second images may include sufficient colors to create the perception of a full color image, while in some embodiments, a partial region of a color space, or even a single color, may be included.
[0058] It will be understood that the disclosed embodiments of the invention are not limited to the particular structures, process steps, or materials disclosed herein, but extend to equivalents thereof as recognized by those skilled in the art. It will also be understood that the terminology used herein is used solely for the purpose of describing particular embodiments, and is not intended to be limiting.
[0059] Reference to an embodiment or an example throughout this specification means that a particular feature, structure, or characteristic described with respect to that embodiment is included in at least one embodiment of the invention. Thus, the appearances of the phrases "in one embodiment" or "in one example" in various places throughout this specification are not necessarily all referring to the same embodiment. For example, when a numerical value is referred to using a term such as about or substantially, the exact numerical value is also disclosed.
[0060] In this specification, a plurality of items, structural elements, composite elements, and / or materials may be presented in a common list for convenience. However, these lists should be construed as if each member of the list were individually identified as a separate and unique member. Thus, the individual members of such lists should not be construed as de facto equivalents of any other members of the same list solely based on their presentation in a common grouping, absent indications to the contrary. In addition, various embodiments and examples of the present invention may be referenced herein, along with alternative forms of the various components thereof. It is understood that such embodiments, examples, and alternative forms should not be construed as de facto equivalents of each other, but should be considered as separate and independent representations of the present invention.
[0061] Furthermore, the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the foregoing description, numerous specific details, such as lengths, widths, shapes, and the like, are provided to provide a thorough understanding of embodiments of the present invention. However, one of ordinary skill in the art will recognize that the present invention may be practiced without one or more of those specific details, or with other methods, components, materials, and the like. In other instances, well-known structures, materials, or operations have not been shown or described in detail to avoid obscuring aspects of the present invention.
[0062] While the foregoing examples illustrate the principles of the present invention in one or more specific applications, it will be apparent to those skilled in the art that numerous modifications in the form, use and details of the implementations may be made without the exercise of inventive faculty and without departing from the principles and concepts of the present invention. Accordingly, the present invention is not intended to be limited, except as by the scope of the following claims.
[0063] The verbs "comprise" and "include" are used in this document as open limitations that do not exclude or require the presence of unrecited features. Features recited in dependent claims are mutually freely combinable, unless expressly stated otherwise. Furthermore, it is to be understood that the use of "a" or "an", i.e. the singular, does not exclude the plural throughout this specification. [Industrial Applicability]
[0064] At least some embodiments of the present invention find industrial application in HMDs and HUDs.
[0065] Acronym List ASIC Application Specific Integrated Circuit DOF depth of focus FPGA Field Programmable Gate Array HMD Head Mounted Display HUD Head Up Display LCOS Liquid Crystal on Silicon LED Light Emitting Diode NFC Near Field Communication MEMS Microelectromechanical Systems ROI Region of Interest UI User Interface WLAN Wireless Local Area Network [Explanation of symbols]
[0066] 100 Light Field 102 Light Guide 103 Coupling internal structure 104 light 110 Waveguide 112 elements 114 Directed light 120 eyes 130 Mirror 140 light source 150 processors 160~166, 170~176 focal plane 300~350 Structure of the device in Figure 3 610-630 Phases of the method in Fig. 6
Claims
1. 1. An optical waveguide arrangement comprising: at least one light source arranged to transmit an optical signal into one optical waveguide of said optical waveguide arrangement; said one optical waveguide arranged to receive said optical signals from said at least one light source and to transmit said optical signals to generate a waveguide-based display; said one optical waveguide is further arranged to generate a first image in a first focal plane of said optical waveguide arrangement when at least some of said received optical signals have a set of first spectral characteristics and to generate a second image in a second focal plane of said optical waveguide arrangement when at least some of said received optical signals have a set of second spectral characteristics, at least one spectral characteristic of said set of first spectral characteristics being different compared to said set of second spectral characteristics; Optical waveguide arrangement.
2. 2. The optical waveguide arrangement of claim 1, wherein the optical waveguide arrangement is such that when the spectral characteristics of the transmitted optical signal are shifted from the first set of spectral characteristics to the second set of spectral characteristics, a perceived focal plane of an image produced by the optical waveguide arrangement is shifted from the first focal plane to the second focal plane.
3. 3. An optical waveguide arrangement according to claim 1 or claim 2, wherein the set of first spectral characteristics comprises a first set of at least three distinct spectral characteristics and the set of second spectral characteristics comprises a second set of at least three distinct spectral characteristics.
4. 4. The optical waveguide arrangement of claim 3, wherein one spectral characteristic of said first set of distinct spectral characteristics is the same as one spectral characteristic of said second set of distinct spectral characteristics.
5. 4. The optical waveguide arrangement of claim 3, wherein all spectral characteristics of said first set of distinct spectral characteristics are different as compared to said second set of distinct spectral characteristics.
6. 6. An optical waveguide arrangement according to claim 3, wherein the first set of distinct spectral characteristics are interleaved with the second set of distinct spectral characteristics.
7. 7. The optical waveguide arrangement of claim 1, wherein each spectral characteristic in the first set of spectral characteristics and each spectral characteristic in the second set of spectral characteristics is a distinct spectral peak in the visible spectrum.
8. 8. An optical waveguide arrangement according to claim 1, wherein the total range corresponding to said first and second sets of spectral characteristics together with said waveguide arrangement comprises a region of interest, ROI, that represents a full colour image.
9. 9. The light guide arrangement of claim 1, wherein the first and second sets of distinct spectral characteristics comprise the same white point of interest.
10. 10. The optical waveguide arrangement of claim 1 , arranged to provide the waveguide-based display as a head mounted display.
11. A head mounted or head up display comprising an optical waveguide arrangement according to any one of claims 1 to 10.
12. transmitting, by means of at least one optical source, an optical signal into one optical waveguide of the optical waveguide arrangement; receiving, by said one optical waveguide, said optical signal from said at least one light source and conveying said optical signal to a human eye to generate a waveguide-based display; generating, by said one optical waveguide, a first image in a first focal plane of said optical waveguide arrangement when at least some of said received optical signals have a set of first spectral characteristics, and a second image in a second focal plane of said optical waveguide arrangement when at least some of said received optical signals have a set of second spectral characteristics, wherein at least one spectral characteristic of said set of first spectral characteristics is different compared to said set of second spectral characteristics; A method for optical waveguide arrangement comprising:
13. An apparatus comprising at least one processing core and at least one memory containing computer program code, the at least one memory and the computer program code being adapted to communicate with the at least one processing core and at least transmitting the optical signals into one optical waveguide of the optical waveguide arrangement to generate a waveguide-based display and a first image in a first focal plane of the optical waveguide arrangement when at least some of the transmitted optical signals have a first set of first spectral characteristics and a second image in a second focal plane of the optical waveguide arrangement when at least some of the transmitted optical signals have a second set of second spectral characteristics, wherein at least one spectral characteristic of the first set of spectral characteristics is different compared to the second set of spectral characteristics; An apparatus configured to cause the apparatus to perform the steps of:
14. A computer program, the program being executed by an apparatus, the apparatus being configured to: transmitting the optical signals into one optical waveguide of the optical waveguide arrangement to generate a waveguide-based display and a first image in a first focal plane of the optical waveguide arrangement when at least some of the transmitted optical signals have a first set of first spectral characteristics and a second image in a second focal plane of the optical waveguide arrangement when at least some of the transmitted optical signals have a second set of second spectral characteristics, wherein at least one spectral characteristic of the first set of spectral characteristics is different compared to the second set of spectral characteristics; A computer program comprising instructions to cause a computer to:
Citation Information
Patent Citations
Virtual reality, augmented reality, and mixed reality systems involving thick media and related methods
JP2019530146A
Apparatuses, methods and systems for multiple focal distance display
US10088685B1
Head-Mounted Display System
US20200310121A1
