Projection lens, image generation device, display device, and transport means
The projection lens with an optical adjustment device improves stereoscopic display by splitting imaging light into spatially dispersed sublights, addressing issues of image distortion and crosstalk in head-up display devices, thereby enhancing the stereoscopic effect.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- YINWANG INTELLIGENT TECHNOLOGIES CO LTD
- Filing Date
- 2024-02-22
- Publication Date
- 2026-05-26
AI Technical Summary
Existing head-up display devices suffer from suboptimal stereoscopic display effects due to issues like image resolution loss, distortion, and crosstalk between left and right eye images, particularly in stereoscopic display technology based on the binocular parallax principle.
A projection lens design incorporating a first imaging lens and an optical adjustment device, such as a slit diffraction grating or microlens array, to split imaging light into spatially dispersed sublights for stereoscopic display, minimizing image distortion and crosstalk while maintaining a simple structure and low cost.
The solution enhances stereoscopic display quality by avoiding image resolution loss and crosstalk, achieving a better stereoscopic effect with minimal impact on cost and device size.
Smart Images

Figure 2026516838000001_ABST
Abstract
Description
Technical Field
[0001] This application claims the priority of Chinese Patent Application No. 202310488160.4, filed with the China National Intellectual Property Administration on April 28, 2023, and titled "PROJECTION LENS, IMAGE GENERATION APPARATUS, DISPLAY DEVICE, AND TRANSPORTATION MEANS", and the entire content of that application is incorporated herein by reference.
[0002] This application relates to the field of optical display technology, and particularly to projection lenses, image generation devices, display devices, and transportation means.
Background Art
[0003] A head-up display (HUD) device can be used in vehicles and is configured to project driving-related information such as instrument information and navigation information onto the driver's forward field of view. In this way, the driver can obtain driving-related information without having to lower their line of sight to look at the dashboard or navigation device during the driving process, which improves driving safety.
[0004] In order to better integrate the information projected by the head-up display device into the driving scenario, stereoscopic display technology based on the binocular parallax principle, particularly naked-eye stereoscopic display technology, has begun to be applied to the head-up display device. However, there is still room for improvement in the stereoscopic display effect of related-art head-up display devices.
Summary of the Invention
Means for Solving the Problems
[0005] Embodiments of this application provide a projection lens, an image generation device, a display device, and a transportation means to improve the stereoscopic display effect of the image generation device.
[0006] To achieve the aforementioned objectives, the following technical solutions are used in the embodiments of this application.
[0007] According to a first aspect, one embodiment of the present application provides a projection lens. The projection lens includes a first imaging lens, a light adjustment device, and a second imaging lens. The light adjustment device is positioned between the first imaging lens and the second imaging lens.
[0008] The first imaging lens is configured to receive imaging light to form a relay image plane and to perform imaging with respect to the imaging light on the side of the light adjustment device that is closer to the first imaging lens. The imaging light includes a first imaging sublight and a second imaging sublight, which are used to form the left eye image and the right eye image, respectively, for performing stereoscopic display.
[0009] The light adjustment device is configured to split the imaging light on the relay image plane. After splitting, the first and second imaging sublights of the imaging light are projected onto the second imaging lens in different directions. The second imaging lens is configured to project the first and second imaging sublights.
[0010] When a projection lens of the aforementioned structure is used, and as a result, imaging light used to perform stereoscopic display based on the binocular parallax principle is received, beam splitting can be performed on the imaging light to form spatially dispersed first and second imaging sublights in order to perform the stereoscopic display function. Furthermore, the first imaging lens can form a relay image plane in front of the light tuner, and one-to-one mapping of pixels in the image source module may be performed on the relay image plane. The light tuner performs beam splitting on the imaging light on the relay image plane. In this design, the distance between the light tuner and the position from which the imaging light is emitted can be shortened, so the light tuner has a good beam splitting effect on the imaging light, facilitating the achievement of a good stereoscopic display effect.
[0011] In addition, since beam splitting of imaging light on the relay image plane is performed by using an optical adjustment device within the projection lens, problems such as image resolution loss, image distortion, and crosstalk between the left and right eye images caused by the diffuse screen can be avoided, which helps to improve the stereoscopic display effect.
[0012] Furthermore, the projection lens can achieve the aforementioned technical effects by adding only a first imaging lens and an optical adjustment device. The structure is simple, the cost is low, and when the projection lens works with the image source module to form the image generating device, the impact on the cost and volume of the image generating device is small.
[0013] In some embodiments, the imaging light is unpolarized, and the light tuning device includes at least one of a slit diffraction grating, a microlens array, and a cylindrical lens array. The projection lens provided in this embodiment of the application is applicable to application scenarios in which the imaging light is unpolarized and multiple different optical devices can be selected for the light tuning device, which provides good adaptability and facilitates improvement of the projection lens.
[0014] In some embodiments, the imaging light is polarized, and the optical adjustment device includes at least one of a slit diffraction grating, a microlens array, a cylindrical lens array, and a polarization adjustment element. The projection lens provided in this embodiment of the application is applicable to application scenarios in which the imaging light is polarized and multiple different optical devices can be selected for the optical adjustment device, which provides good adaptability and facilitates improvement of the projection lens.
[0015] In some embodiments, the polarization adjustment element includes at least one of a polarization diffraction grating and a polarization lens. Polarization diffraction gratings and polarization lenses have advantages such as good beam splitting effect, simple structure, low cost, and small occupied volume. Assuming that the projection lens can achieve the aforementioned technical effects, polarization diffraction gratings and polarization lenses have little impact on cost and volume.
[0016] In some embodiments, the projection lens includes two second imaging lenses, each configured to project a first imaging sublight and a second imaging sublight. In the projection lens provided in this embodiment of the application, separate second imaging lenses are arranged corresponding to the first imaging sublight and the second imaging sublight. This design helps to improve the projection quality of the projection lens, further avoids crosstalk between the first and second imaging sublights, and ensures a stereoscopic display effect.
[0017] In some embodiments, the first imaging lens is configured to receive imaging light and form an enlarged real image on the relay image plane. This design helps improve the beam splitting effect of the optical tuner on imaging light and thus improve the stereoscopic display effect.
[0018] In some embodiments, the imaging light includes at least two pairs of imaging sublights, each of which includes a first imaging sublight and a second imaging sublight, and each pair of imaging sublights is used separately to form a stereoscopic viewing viewpoint. The light adjustment device is configured to split the imaging light on the relay image plane and project different pairs of imaging sublights onto the projection lens in different directions, and project the first and second imaging sublights of the same pair onto the projection lens in different directions.
[0019] The projection lens provided in this embodiment of the present application is applicable when there are multiple stereoscopic viewing viewpoints, and at least two of the stereoscopic viewing viewpoints can be formed at different positions, thereby expanding the stereoscopic viewing angle.
[0020] According to a second aspect, one embodiment of the present application provides an image generating apparatus including an image source module and a projection lens according to any one of the embodiments of the first aspect.
[0021] The image source module is configured to form imaging light containing image information based on image data, and to project the imaging light onto a projection lens.
[0022] In some embodiments, the image source module includes a light source, liquid crystal on silicon, and a polarizing beam splitter. The light source is configured to provide illumination rays that are projected onto the polarizing beam splitter. The polarizing beam splitter is configured to perform polarization splitting on the illumination rays to form a first ray, project the first ray onto the liquid crystal on silicon, and the polarization direction of the first ray is a first polarization direction.
[0023] The liquid crystal on silicon is configured to form an imaging light, project the imaging light onto a projection lens via a polarizing beam splitter, and have a polarization direction of the imaging light that is a second polarization direction, with the first and second polarization directions being perpendicular to each other.
[0024] In some embodiments, the image source module includes a light source, a digital micromirror device, and an internal total internal reflection prism. The light source is configured to provide illumination rays projected onto the internal total internal reflection prism. The internal total internal reflection prism is configured to reflect the illumination rays to form a first ray projected onto the digital micromirror device and to transmit the imaging light formed by the digital micromirror device.
[0025] The digital micromirror device is configured to modulate a first ray based on image data to form an imaging light, and to project the imaging light onto a projection lens via an internal total internal reflection prism.
[0026] In some embodiments, the image source module includes a light source and a liquid crystal display. The light source is configured to provide illumination rays that are projected onto the liquid crystal display.
[0027] A liquid crystal display is configured to modulate illumination rays based on image data to form image light, and to project the image light onto a projection lens.
[0028] According to a third aspect, an embodiment of the present application provides a display device. The display device includes a processor and an image generation device according to any one of the embodiments of the second aspect, and the processor is configured to control the image generation device to form imaging light.
[0029] In some embodiments, the display device further includes a diffusion screen and a first reflection element. The diffusion screen is disposed on the light output side of the image generation device, configured to receive the imaging light and perform imaging. The first reflection element is configured to reflect the imaging information on the diffusion screen to a preset position.
[0030] According to a fourth aspect, an embodiment of the present application provides a transport means. The transport means includes a display device according to the embodiment of the second aspect, and the display device is mounted on the transport means.
[0031] In some embodiments, the transport means further includes a second reflection element, the display device is configured to project the imaging light onto the second reflection element, and the second reflection element is configured to reflect the imaging light.
[0032] The technical effects that can be achieved by the image generation device, display device, and transport means provided in the embodiments of the present application are the same as the technical effects that can be achieved by the image generation device of any one of the foregoing embodiments. Details are not described again here.
Brief Description of the Drawings
[0033] [Figure 1] It is a diagram of the structure of a stereoscopic display device according to the related art. [Figure 2] It is a diagram of the structure of another stereoscopic display device according to the related art. [Figure 3] It is a diagram of the structure of a projection lens according to an embodiment of the present application. [Figure 4] It is a diagram of the structure of another projection lens according to an embodiment of the present application. [Figure 5] This is a diagram showing the structure of an image generation device according to one embodiment of this application. [Figure 6] This is a diagram showing the structure of an image generation device using liquid crystal on silicon according to one embodiment of this application. [Figure 7] Figure 6 shows the structure of the polarizing beam splitter. [Figure 8] This is a diagram showing the structure of an image generation device using a digital micromirror device according to one embodiment of this application. [Figure 9] This is a diagram showing the structure of an image generation device using a liquid crystal display according to one embodiment of this application. [Figure 10A] This is a diagram illustrating different application scenarios for the image generation device described in this application. [Figure 10B] This is a diagram illustrating different application scenarios for the image generation device described in this application. [Figure 10C] This is a diagram illustrating different application scenarios for the image generation device described in this application. [Figure 10D] This is a diagram illustrating different application scenarios for the image generation device described in this application. [Figure 11] This is a diagram showing the structure of a display device according to one embodiment of this application. [Figure 12] This is a circuit diagram of a display device according to one embodiment of this application. [Figure 13] This is a diagram showing the structure of a transport means according to one embodiment of the present application. [Figure 14] This is a functional diagram of a transport means according to one embodiment of the present application. [Modes for carrying out the invention]
[0034] The following describes the technical solutions in the embodiments of this application with reference to the accompanying drawings. It is clear that the embodiments described are only a part of, and not all, of, the embodiments of this application.
[0035] In the embodiments of this application, the terms “first” and “second” are used solely for the purpose of facilitating explanation and are not intended to be understood as indicating or suggesting relative importance, or implicitly indicating the number of technical features being described. Thus, features limited by “first,” “second,” etc., may explicitly or implicitly indicate that one or more such features are included. In the description of this application, unless otherwise specified, “multiple” means two or three or more.
[0036] In the embodiments of this application, “up,” “down,” “left,” and “right” are not limited to definitions of the direction in which the components are schematically positioned in the accompanying drawings. It should be understood that these directional terms are relative concepts used for relative description and clarification and may change as appropriate based on changes in the orientation of the components in the accompanying drawings.
[0037] In embodiments of this application, unless otherwise specified in the context, the term “includes” is to be interpreted “open and inclusive,” that is, “includes but not limited to,” throughout this specification and the claims. In this description, terms such as “one embodiment,” “several embodiments,” “an exemplary embodiment,” “example,” or “several examples” are intended to indicate that certain features, structures, materials, or characteristics relating to an embodiment or example are included in at least one embodiment or example of this disclosure. The aforementioned general expressions of the terms do not necessarily refer to the same embodiment or example. Furthermore, certain features, structures, materials, or characteristics may be included in any one or more embodiments or examples in any suitable manner.
[0038] Where used herein, “about,” “generally,” or “approximately” includes the stated value and the mean value within the permissible deviation range of a particular value, where the permissible deviation range is determined by those skilled in the art by taking into account the measurement being discussed and the errors associated with the measurement of a particular quantity (i.e., the limits of the measuring system).
[0039] As used herein, “parallel,” “perpendicular to,” and “equal to” include the cases described and similar cases. The range of similar cases is within the tolerance range. The tolerance range is determined by those skilled in the art by taking into account the measurement in question and the errors associated with the measurement of a particular quantity (i.e., the limits of the measuring system). For example, “parallel” includes “absolutely parallel” and “approximately parallel,” and the tolerance range for “approximately parallel” may be, for example, a deviation of 5° or less. “Perpendicular to” includes “absolutely perpendicular to” and “approximately perpendicular to,” and the tolerance range for “approximately perpendicular to” may also be, for example, a deviation of 5° or less. “Equal to” includes “absolutely equal to” and “approximately equal to.” The tolerance range for “approximately equal to” may be, for example, that the difference between two identical objects is 5% or less of one of the two objects.
[0040] When a layer or element is referred to as being on another layer or substrate, it should be understood that the layer or element may be directly on that other layer or substrate, or there may be an intermediate layer between the layer or element and the other layer or substrate.
[0041] In embodiments of this application, exemplary mounting configurations are described with reference to cross-sectional and / or plan views and / or equivalent circuit schematics used as ideal examples accompanying the drawings. In the accompanying drawings, the thicknesses of layers and regions are enlarged for clarity. Herein, variations in the shape of the accompanying drawings may be assumed, for example, due to manufacturing techniques and / or tolerances. Thus, exemplary mounting configurations should not be construed as being limited to the shapes of the regions shown herein, but rather include, for example, manufacturing-induced shape deviations. For example, an etching region shown as a rectangle typically has bending characteristics. Thus, the regions shown in the accompanying drawings are essentially examples, and their shapes are not intended to represent the actual shapes of the regions of the device, nor are they intended to limit the scope of exemplary mounting configurations.
[0042] To improve display effects, some display devices have stereoscopic (3D) display capabilities. Currently, the stereoscopic display function of display devices can be implemented using beam-splitting stereoscopic display technology based on the binocular parallax principle. That is, based on the visual difference between the observer's two eyes (left and right), the left-eye image that can be seen by the observer's left eye and the right-eye image that can be seen by the observer's right eye are presented separately. The left-eye image and the right-eye image are mixed in the observer's brain to achieve a visual stereoscopic display effect.
[0043] Figure 1 is a diagram of the structure of a stereoscopic display device 1000 based on related technology. As shown in Figure 1, the stereoscopic display device 1000 includes an image generation unit (PGU) 1, a diffusion screen 110, and a light adjustment element 130. The image generation unit 1 is configured to generate a binocular interleaved image for stereoscopic display and project the binocular interleaved image onto the diffusion screen 110. The light adjustment element 130 is located on the side of the diffusion screen 110 that is farther from the image generation unit 1, i.e., on the light output side of the diffusion screen 110, and performs beam splitting on the binocular interleaved image on the diffusion screen 110 to form spatially dispersed left-eye and right-eye images. When the observer's left eye observes the left-eye image and the observer's right eye observes the right-eye image, a stereoscopic display visual effect can be achieved.
[0044] Figure 2 is a diagram of the structure of another stereoscopic display device 1000 according to related technology. As shown in Figure 2, the stereoscopic display device 1000 includes an image generating device 1 and a diffuse screen 110. The image generating device 1 includes a display chip 12, two groups of directional backlights 11 having different light output directions, and a projection lens 5. In the image generating device 1 of the stereoscopic display device 1000, the left-eye image and the right-eye image used to perform stereoscopic display are formed via time-division modulation by controlling the switches of the two groups of directional backlights 11 and by using the time-division high refresh rate feature of the display chip 12. Since the image generating device 1 projects the left-eye image and the right-eye image separately onto the diffuse screen 110 via the projection lens 5, the diffuse screen 110 can quickly alternate between displaying the left-eye image and the right-eye image. When the observer's left eye views the left-eye image and the observer's right eye views the right-eye image, a stereoscopic display visual effect can be achieved.
[0045] While the aforementioned related technology stereoscopic display device 1000 can implement stereoscopic display functionality, it still suffers from several drawbacks. For example, in the stereoscopic display device 1000 shown in Figure 1, the scattering effect of the diffuse screen 110 and its structural characteristics can lead to problems such as loss of resolution and image distortion of the displayed image, and may further lead to the generation of crosstalk between the left-eye and right-eye images used for stereoscopic display, affecting the stereoscopic display effect. In the stereoscopic display device 1000 shown in Figure 2, the diffuse screen 110 can also affect the stereoscopic display effect. In addition, the stereoscopic display device 1000 in Figure 2 suffers from the problems of being large and expensive due to the increased number of backlights and the higher refresh rate requirements for the display chip 12.
[0046] Based on this, embodiments of the present application provide a projection lens, an image generating apparatus, a display device, and a transport means to improve the stereoscopic display effect of an image generating apparatus.
[0047] As shown in Figure 3, the projection lens 5 provided in one embodiment of the present application includes a first imaging lens 51, an optical adjustment device 53, and a second imaging lens 52. The optical adjustment device 53 is positioned between the first imaging lens 51 and the second imaging lens 52.
[0048] In the projection lens 5, the first imaging lens 51 is configured to receive imaging light P1. The imaging light P1 may be emitted by an image source module 2 (see Figure 5) in the image generation device 1 and used to perform stereoscopic display based on the binocular parallax principle. The imaging light P1 includes a first imaging sublight P11 and a second imaging sublight P12, which are used to form the left-eye image and the right-eye image, respectively, for performing stereoscopic display.
[0049] After receiving the imaging light P1, the first imaging lens 51 images the imaging light P1 on the side of the optical adjustment device 53, closer to the first imaging lens 51, in order to form a relay image plane 50. A one-to-one mapping of pixels in the image source module 2 may be performed on the relay image plane 50. Here, the imaging performed by the first imaging lens 51 on the imaging light P1 satisfies the imaging equation. The distance between the first imaging lens 51 and the position from which the imaging light P1 is emitted (image source module 2), the distance between the first imaging lens 51 and the optical adjustment device 53, and the lens parameters of the first imaging lens 51 are controlled so that the image plane for imaging of the imaging light P1 after it has passed through the first imaging lens 51 is located on the side of the optical adjustment device 53, closer to the first imaging lens 51. In other words, the first imaging lens 51 may be controlled to form an image with respect to the imaging light P1 on the side of the light adjustment device 53 that is closer to the first imaging lens 51, in order to form a relay image plane 50. A one-to-one mapping of pixels in the image source module 2 may be performed on the relay image plane 50. Forming the relay image plane 50 is equivalent to shortening the distance between the position from which the imaging light P1 is emitted and the light adjustment device 53, which is beneficial to the processing of the imaging light P1 by the light adjustment device 53.
[0050] The light adjustment device 53 is configured to split the imaging light P1 on the relay image plane 50. After splitting, the first imaging sublight P11 and the second imaging sublight P12 of the imaging light P1 are projected onto the second imaging lens 52 in different directions, forming spatially dispersed first and second imaging sublights P11 and P12. The spatially dispersed first and second imaging sublights P11 and P12 are irradiated at different positions via the second imaging lens 52, forming spatially dispersed left-eye and right-eye images. A stereoscopic display effect can be achieved when the observer's left eye observes the left-eye image and the observer's right eye observes the right-eye image.
[0051] From this, it can be seen that the projection lens 5 provided in this embodiment of the present application, upon receiving imaging light P1 used to perform stereoscopic display based on the binocular parallax principle, can divide the imaging light P1 to form spatially dispersed first imaging sublights P11 and second imaging sublights P12 in order to perform the stereoscopic display function. Furthermore, the first imaging lens 51 can form a relay image plane 50 in front of the light adjustment device 53, and one-to-one mapping of pixels in the image source module 2 may be performed on the relay image plane 50. The light adjustment device 53 performs beam splitting on the imaging light P1 on the relay image plane 50. In this design, the distance between the light adjustment device 53 and the position from which the imaging light P1 is emitted can be shortened, so that the light adjustment device 53 has a good beam splitting effect on the imaging light P1 and facilitates the achievement of a good stereoscopic display effect.
[0052] In addition, since the beam splitting of the imaging light P1 on the relay image plane 50 is performed by using the light adjustment device 53 in the projection lens 5, problems such as image resolution loss, image distortion, and crosstalk between the left-eye and right-eye images caused by the diffusion screen 110 can be avoided, which helps to improve the stereoscopic display effect.
[0053] In addition, the projection lens 5 can achieve the aforementioned technical effects by adding only the first imaging lens 51 and the light adjustment device 53. The structure is simple, the cost is low, and when the projection lens 5 cooperates with the image source module 2 to form the image generating device 1, the impact on the cost and volume of the image generating device 1 is small.
[0054] From the above description, it can be seen that the shorter the distance between the relay image plane 50 and the optical adjustment device 53, the better the beam splitting effect of the optical adjustment device 53 on the imaging light P1 on the relay image plane 50. Therefore, the size and optical parameters of the first imaging lens 51, the distance between the first imaging lens 51 and the position from which the imaging light P1 is emitted, and the distance between the first imaging lens 51 and the optical adjustment device 53 can be controlled so that the relay image plane 50 formed by imaging the imaging light P1 with the first imaging lens 51 is as close as possible to the optical adjustment device 53. In the projection lens 5 provided in this embodiment of the application, the optical adjustment device 53 may be an optical device that performs beam splitting on the imaging light P1 based on characteristics such as refraction, diffraction, cutoff, polarization state, or wavelength. For example, the optical adjustment device 53 may include at least one of a slit diffraction grating, a microlens array, a cylindrical lens array, a polarizing lens, and a polarizing diffraction grating.
[0055] In different application scenarios, the imaging light P1 may be polarized or unpolarized (natural light). When the imaging light P1 is unpolarized, the optical adjustment device 53 may be a depolarization adjustment element. A depolarization adjustment element is an optical device applicable to beam splitting for both unpolarized and polarized light, and has no requirement for the polarization state. For example, a depolarization adjustment element includes at least one of a slit diffraction grating, a microlens array, and a cylindrical lens array.
[0056] When the imaging light P1 is polarized, the optical adjustment device 53 may be a non-polarizing adjustment element or a polarization adjustment element. A polarization adjustment element is an optical device applicable to beam splitting for a specific polarization. When the optical adjustment device 53 is a polarization adjustment element, the polarization adjustment element must be configured to split the imaging light P1. For example, if the imaging light P1 is polarized in a first polarization direction, the polarization adjustment element must be configured to split the polarization in the first polarization direction.
[0057] For example, the polarization adjustment element may be a liquid crystal diffraction grating or a liquid crystal lens. In other words, when the imaging light P1 is polarized in a first polarization direction, the light adjustment device 53 includes at least one of a slit diffraction grating, a microlens array, a cylindrical lens array, a polarizing lens, and a polarizing diffraction grating, and both the polarizing diffraction grating and the polarizing lens may be configured to split the polarization in the first polarization direction.
[0058] In some embodiments, as shown in Figure 4, the projection lens 5 may include two second imaging lenses (52a and 52b), each configured to project a first imaging sublight P11 and a second imaging sublight P12, respectively. In the projection lens 5 provided in this embodiment of the application, separate second imaging lenses are arranged corresponding to the first imaging sublight P11 and the second imaging sublight P12. This helps to improve the projection quality of the projection lens 5, further avoiding crosstalk between the first imaging sublight P11 and the second imaging sublight P12, and ensuring a stereoscopic display effect.
[0059] In some embodiments, the first imaging lens 51 is configured to receive imaging light P1 and form an enlarged real image on the side of the optical adjustment device 53 that is closer to the first imaging lens 51. That is, the enlarged real image exists on the relay image plane 50. This design further facilitates beam splitting of the imaging light P1 by the optical adjustment device 53, and as a result, a better stereoscopic display effect can be obtained.
[0060] In some embodiments, the imaging light P1 includes at least two pairs of imaging sublights, each of which includes a first imaging sublight P11 and a second imaging sublight P12, and the first imaging sublight P11 and the second imaging sublight P12 of each imaging sublight pair can form a binocular disparity image for performing stereoscopic display. Each of the imaging sublight pairs is used separately to form a single stereoscopic viewing viewpoint.
[0061] The first imaging lens 51 receives imaging light P1 and is configured to form a relay image plane 50 on the side of the light adjustment device 53 that is closer to the first imaging lens 51. The light adjustment device 53 is configured to split the imaging light P1 on the relay image plane 50. After splitting, different pairs of imaging sublights are projected onto the second imaging lens 52 in different directions, and the first imaging sublight P11 and the second imaging sublight P12 of the same pair are projected onto the second imaging lens 52 in different directions. In this design, multiple spatially dispersed viewpoints can be formed. In this way, multiple observers in different positions can view the left-eye image and the right-eye image simultaneously, enabling stereoscopic display functionality and widening the stereoscopic viewing angle. Thus, the projection lens 5 provided in this embodiment of the present application is applicable to application scenarios with multiple viewpoints and a wide viewing angle.
[0062] In addition, in Figures 3 and 4, the first imaging lens 51 and the second imaging lens 52 each contain three optical lenses, but this is merely an example for illustrative purposes. More or fewer optical lenses may be placed in each of the first imaging lens 51 and the second imaging lens 52, as needed.
[0063] In addition, one embodiment of this application provides an image generating apparatus. As shown in Figure 5, the image generating apparatus 1 further includes an image source module 2 that uses the projection lens 5 in the above embodiment and emits imaging light P1. The image source module 2 includes a light source 3 and an optical modulator 4.
[0064] The light source 3 is configured to generate an illumination ray P3, which may be projected directly onto the optical modulator 4, or it may form a first ray P2 by using an intermediate structure (not shown in Figure 5), such as a beam splitting device. The first ray P2 is projected onto the optical modulator 4. The optical modulator 4 is configured to modulate the ray projected onto the optical modulator 4 (the first ray P2 or illumination ray P3) based on image data to form an imaging light P1 containing image information. The image data is image data for performing stereoscopic display based on the binocular parallax principle, and the image data includes left-eye image data for forming the left-eye image and right-eye image data for forming the right-eye image. Therefore, the imaging light P1 formed by the image source module 2 includes a first imaging sublight P11 corresponding to the left-eye image data and a second imaging sublight P12 corresponding to the right-eye image data. The first imaging sublight P11 and the second imaging sublight P12 are mixed together and collectively called the imaging light P1.
[0065] The optical modulator 4 may be at least one of the following: liquid crystal on silicon (LCoS), digital micromirror display (DMD), and liquid crystal display (LCD).
[0066] In the following, the image generating apparatus 1 provided in this embodiment of the application will be described using examples in which the optical modulator 4 is liquid crystal on silicon, a digital micromirror device, and a liquid crystal display.
[0067] In some embodiments, as shown in Figure 6, the image generation apparatus 1 includes a light source 3, a polarizing beam splitter (PBS) 6, a liquid crystal on silicon 41, and a projection lens 5.
[0068] The light source 3 is configured to generate illumination rays P3 that are irradiated onto the polarizing beam splitter 6. The illumination rays P3 may be natural light (unpolarized), a mixed ray of P (parallel) polarization and S (perpendicular) polarization (polarized), or a polarization (either P-polarized or S-polarized) applicable to the liquid crystal on silicon 41.
[0069] For example, the light source 3 may include a light-emitting element 31 and an optical element 32, and the light-emitting element 31 may be a light-emitting diode (LED) or a laser diode (LD). The optical element 32 may be configured to focus and parallelize the light beam generated by the light-emitting element 31, or it may be further configured to perform polarization treatment on the light beam generated by the light-emitting element 31 to form an illumination beam P3 that is projected onto the polarized beam splitter 6.
[0070] In this embodiment, an example in which the illumination ray P3 generated by the light source 3 is natural light is used to explain the image generation device 1 in this embodiment.
[0071] The polarizing beam splitter 6 is a prism capable of splitting a polarized beam, and may split the incident light ray into S-polarized and P-polarized beams, or it may emit the S-polarized and P-polarized beams in different directions to irradiate different positions.
[0072] For example, as shown in Figure 7, the polarizing beam splitter 6 has four outer surfaces, namely a first surface S1, a second surface S2, a third surface S3, and a fourth surface S4. The polarizing beam splitter 6 further has a beam splitting surface S0, which may reflect S-polarized light or transmit P-polarized light.
[0073] When incident light containing P-polarized and S-polarized light is irradiated onto the beam splitting surface S0 via the first side surface S1, the S-polarized light (represented by dots in Figure 7) reflected by the beam splitting surface S0 is emitted from the second side surface S2, and the P-polarized light (represented by vertical short lines in Figure 7) transmitted by the beam splitting surface S0 is emitted from the third side surface S3, thereby performing a polarization beam splitting function.
[0074] In this embodiment, the light source 3 is positioned opposite the first side surface S1 of the polarizing beam splitter 6, and the illumination ray P3 generated by the light source 3 is irradiated onto the beam splitting surface S0 via the first side surface S1, and the beam splitting surface S0 splits the illumination ray P3 into a first ray P2 and a second ray. The first ray P2 is either S-polarized or P-polarized, and the second ray is the other of S-polarized or P-polarized. After splitting the illumination ray P3 into the first ray P2 and the second ray, the polarizing beam splitter 6 emits the first ray P2 and the second ray in different directions to irradiate different locations.
[0075] For example, in this embodiment, the first ray P2 is S-polarized, that is, a portion of the illumination ray P3 that has been reflected by the beam splitting surface S0, and the first ray P2 is emitted through the second side surface S2. The second ray is P-polarized, that is, a portion of the illumination ray P3 that has been transmitted by the beam splitting surface S0, and the second ray is emitted through the third side surface S3.
[0076] The liquid crystal on silicon 41 is positioned opposite the second side surface S2 of the polarizing beam splitter 6, and the first ray P2 emitted through the second side surface S2 irradiates the liquid crystal on silicon 41.
[0077] The liquid crystal on silicon 41 is a reflective display chip comprising a complementary metal oxide semiconductor (CMOS) substrate, a liquid crystal layer, and a glass substrate. The CMOS substrate includes a CMOS driver circuit and a metal reflector. The CMOS driver circuit is manufactured on the silicon wafer using a CMOS process. After the manufacturing of the CMOS driver circuit is complete, the silicon wafer is smoothed using a grinding technique and plated with a metal layer to be used as a metal reflector. The glass substrate has transparent electrodes, and the CMOS substrate and the glass substrate are positioned facing each other, with the liquid crystal layer positioned between the CMOS substrate and the glass substrate.
[0078] The liquid crystal on silicon 41 has multiple pixels arranged in an array, with multiple pixel electrodes arranged on the CMOS substrate corresponding to each pixel, and a common electrode arranged on the CMOS substrate or a glass substrate. By applying a voltage to the pixel electrodes, the liquid crystal corresponding to each pixel in the liquid crystal layer can be controlled, modulating the light passing through the pixels.
[0079] In this embodiment, after the first ray P2 is incident on the liquid crystal on silicon 41, the liquid crystal on silicon 41 modulates the first ray P2 based on image data to form an imaging light P1 containing image information. The image data may be image data for performing stereoscopic display based on the binocular parallax principle, and the image data may include left-eye image data for forming a left-eye image and right-eye image data for forming a right-eye image.
[0080] Some pixels of the liquid crystal on silicon 41 modulate a first ray P2 based on left-eye image data to form a first imaging sublight P11 containing left-eye image information, and some pixels of the liquid crystal on silicon 41 modulate the first ray P2 based on right-eye image data to form a second imaging sublight P12 containing right-eye image information. The first imaging sublight P11 and the second imaging sublight P12 are mixed together and collectively called imaging light P1.
[0081] For example, a plurality of pixels arranged in an array of liquid crystal on silicon 41 include a plurality of left-eye pixels used to form a first imaging sublight P11 and a plurality of right-eye pixels used to form a second imaging sublight P12. The right-eye pixels and left-eye pixels are arranged adjacent to each other.
[0082] The imaging light P1 formed by the liquid crystal on silicon 41 has a polarization direction perpendicular to the polarization direction of the first ray P2. In this specification, the polarization direction of the first ray P2 is defined as the first polarization direction, the polarization direction of the imaging light P1 is defined as the second polarization direction, and the first and second polarization directions are perpendicular to each other. In other words, the imaging light P1 may be either P-polarized or S-polarized, and the first ray P2 may be the other of P-polarized or S-polarized.
[0083] In this embodiment, an example in which the first ray P2 is S-polarized and the imaging light P1 is P-polarized is used to describe the image generation apparatus 1 in which liquid crystal on silicon 41 is used. Those skilled in the art can adapt and adjust the description herein for the case in which the first ray P2 is P-polarized and the imaging light P1 is S-polarized.
[0084] From the above explanation, it can be seen that the imaging light P1 is P-polarized, and that the imaging light P1 is irradiated onto the second side surface S2 of the polarizing beam splitter 6, and then irradiated onto the beam splitting surface S0 of the polarizing beam splitter 6 via the second side surface S2. From the above explanation, it can be seen that the beam splitting surface S0 of the polarizing beam splitter 6 can transmit P-polarized light. Therefore, the imaging light P1 can pass through the beam splitting surface S0 of the polarizing beam splitter 6, is emitted from the third side surface S3 of the polarizing beam splitter 6, and irradiates the projection lens 5.
[0085] When imaging light P1 is shone onto the projection lens 5, the first imaging lens 51 within the projection lens 5 receives the imaging light P1 and is configured to perform imaging on the side of the light adjustment device 53 that is closer to the first imaging lens 51, thereby forming a relay image plane 50. One-to-one mapping of pixels in the liquid crystal on silicon 41 may be performed on the relay image plane 50. The light adjustment device 53 performs beam splitting on the imaging light P1 on the relay image plane 50, and after splitting, the first imaging sublight P11 and the second imaging sublight P12 of the imaging light P1 are projected onto the second imaging lens 52 in different directions, forming spatially dispersed first and second imaging sublight P11 and second imaging sublight P12. The spatially dispersed first and second imaging sublight P11 and second imaging sublight P12 are shone at different positions via the second imaging lens 52, forming spatially dispersed left-eye and right-eye images. A stereoscopic effect can be achieved when the observer's left eye observes the left-eye image and the observer's right eye observes the right-eye image.
[0086] It can be seen that the image generation device 1 having the projection lens 5 can perform a stereoscopic display function. Furthermore, the first imaging lens 51 within the projection lens 5 can form a relay image plane 50 in front of the light adjustment device 53. In this design, the distance between the light adjustment device 53 and the position from which the imaging light P1 is emitted (liquid crystal on silicon 41) can be shortened, so the light adjustment device 53 has a good beam splitting effect on the imaging light P1, and a good stereoscopic display effect can be achieved.
[0087] In addition, since the beam splitting of the imaging light P1 on the relay image plane 50 is performed by using the light adjustment device 53 in the projection lens 5, problems such as image resolution loss, image distortion, and crosstalk between the left-eye image and the right-eye image caused by the diffusion screen can be avoided, thereby improving the stereoscopic display effect of the image generation device 1.
[0088] The imaging light P1 formed by the liquid crystal on silicon 41 is polarized. Therefore, in the projection lens 5 used in the image generation device 1, the light adjustment device 53 may be a polarization adjustment element or a depolarization adjustment element.
[0089] For example, the light adjustment device 53 within the projection lens 5 may be a polarizing lens. The polarizing lens may be a microlens array, a cylindrical lens array, or a lens array formed by a plurality of sublenses. One sublens is positioned corresponding to at least two adjacent pixels. When light is emitted from the pixels corresponding to the sublens, the sublens may refract light emitted from different positions in different ways, or emit light emitted in different directions by different pixels, in order to perform a beam splitting function. The pixels corresponding to the sublenses include adjacent left-eye pixels and right-eye pixels. Thus, beam splitting of the imaging light P1 can be performed through the arrangement of the lens array formed by the aforementioned sublenses. After splitting, the first imaging sublight P11 and the second imaging sublight P12 of the imaging light P1 are emitted in different directions.
[0090] A polarizing lens is a polarization-dependent lens array, where sub-lenses within the lens array refract only specific polarizations and do not affect other polarizations. In this embodiment, the polarizing lens can be applied to beam splitting for P-polarized light by refraction, i.e., it can be configured to split the imaging light P1. The aforementioned features of the polarizing lens may be achieved by using materials such as liquid crystal.
[0091] As another example, the light adjustment device 53 within the projection lens 5 may be a polarizing diffraction grating. The polarizing diffraction grating is a barrier diffraction grating and includes a diffraction grating array formed by a plurality of sub-diffraction gratings. One sub-diffraction grating is positioned corresponding to at least two adjacent pixels. When light is emitted by the pixels corresponding to the sub-diffraction gratings, the sub-diffraction gratings can block light emitted from different positions in different ways, so that light emitted by different pixels is emitted in different directions, thus performing a beam splitting function. The pixels corresponding to the sub-diffraction gratings include the left eye pixel and the right eye pixel, which are adjacent to each other. Therefore, beam splitting of the imaging light P1 can be performed through the arrangement of the diffraction grating array formed by the aforementioned sub-diffraction gratings. After splitting, the imaging light P1 is emitted in different directions from the first imaging sublight P11 and the second imaging sublight P12.
[0092] A polarization diffraction grating is a polarization-dependent diffraction grating array, where sub-diffraction gratings within the array refract only specific polarizations and do not affect other polarizations. In this embodiment, the polarization diffraction grating can be applied to beam splitting for P-polarized light by blocking, that is, it can be configured to split imaging light P1. For example, the polarization diffraction grating may be a diffraction grating structure formed by using a P-polarizer, or it may perform the above function by using a material such as liquid crystal.
[0093] In some embodiments, as shown in Figure 8, the image generation apparatus 1 includes an image source module 2 and a projection lens 5. The image source module 2 includes a light source 3, an internal total internal reflection prism (TIR prism) 7, and a digital micromirror device 42. The light source 3 is configured to generate illumination rays P3 that irradiate the internal total internal reflection prism 7. For details of the light source 3, please refer to the relevant content described above. Details will not be described again here.
[0094] The internal total internal reflection prism 7 plays a role in redirecting and removing stray light in the image source module 2. The internal total internal reflection prism 7 is positioned between the digital micromirror device 42 and the light source 3 and is configured to reflect some or all of the illumination ray P3 emitted by the light source 3, forming a first ray P2 that illuminates the digital micromirror device 42. The internal total internal reflection prism 7 also allows the imaging light P1 formed by the digital micromirror device 42 to pass through and illuminate the projection lens 5.
[0095] Because an internal total internal reflection prism 7 is positioned, the quality of light incident on the digital micromirror device 42 can be improved, and the positioning of the light source 3, digital micromirror device 42, and projection lens 5 within the image generation device 1 can be optimized. In this way, the structure of the image generation device 1 becomes more compact, facilitating miniaturization design.
[0096] The digital micromirror device 42 receives a first ray P2, modulates the first ray P2 based on image data, and forms an imaging light P1 containing image information. Similar to the liquid crystal on silicon 41, the digital micromirror device 42 is a reflective display chip based on a CMOS process. The difference is that the digital micromirror device 42 is a micro-electrical-mechanical system (MEMS) for electronic input and optical output, and includes a CMOS substrate and multiple micromirrors arranged in an array on the CMOS substrate. One micromirror corresponds to one pixel. The number of micromirrors in the digital micromirror device 42 is related to the resolution of the digital micromirror device 42.
[0097] In the digital micromirror device 42, the micromirrors are reflective mirrors that can be flipped, and the flipping of the micromirrors is controlled by a digital drive signal from a CMOS substrate. By controlling the flip angle of the micromirrors, the micromirrors can be oriented in different directions, and micromirrors oriented in different directions can reflect incident light in different directions. When the reflected light from the micromirrors is projected onto the projection lens 5, one pixel in the picture can be illuminated. When the reflected light from the micromirrors is not projected onto the projection lens 5, one pixel in the picture can be turned off. Thus, the flipping of the micromirrors in the micromirror array can be controlled, and the first ray P2 can be modulated.
[0098] In this embodiment, after the first ray P2 is incident on the digital micromirror device 42, the digital micromirror device 42 modulates the first ray P2 based on image data to form an imaging light P1 containing image information. The image data may be image data for performing stereoscopic display based on the binocular parallax principle, and the image data may include left-eye image data for forming a left-eye image and right-eye image data for forming a right-eye image.
[0099] Some pixels (micromirrors) within the digital micromirror device 42 modulate a first ray P2 based on left-eye image data to form a first imaging sublight P11 containing left-eye image information, and some pixels (micromirrors) within the digital micromirror device 42 modulate the first ray P2 based on right-eye image data to form a second imaging sublight P12 containing right-eye image information. The first imaging sublight P11 and the second imaging sublight P12 are mixed together and collectively called imaging light P1.
[0100] For example, the array of pixels (micromirrors) arranged within the digital micromirror device 42 includes a plurality of left-eye pixels (micromirrors) used to form a first imaging sublight P11 and a plurality of right-eye pixels (micromirrors) used to form a second imaging sublight P12. The right-eye pixels (micromirrors) and left-eye pixels (micromirrors) are arranged adjacent to each other.
[0101] The imaging light P1 formed by the digital micromirror device 42 is projected onto the projection lens 5 via the internal total internal reflection prism 7. The first imaging lens 51 within the projection lens 5 receives the imaging light P1 and is configured to perform imaging on the side of the light adjustment device 53 that is closer to the first imaging lens 51, thereby forming a relay image plane 50. One-to-one mapping of pixels in the digital micromirror device 42 may be performed on the relay image plane 50. The light adjustment device 53 performs beam splitting on the imaging light P1 on the relay image plane 50, and after splitting, the first imaging sublight P11 and the second imaging sublight P12 of the imaging light P1 are projected onto the second imaging lens 52 in different directions, forming the spatially dispersed first imaging sublight P11 and second imaging sublight P12. The spatially dispersed first imaging sublight P11 and second imaging sublight P12 illuminate different positions via the second imaging lens 52, forming spatially dispersed left-eye and right-eye images. A stereoscopic display effect can be achieved when the observer's left eye observes the left-eye image and the observer's right eye observes the right-eye image.
[0102] It can be seen that the image generation device 1 having the projection lens 5 can perform a stereoscopic display function. Furthermore, the first imaging lens 51 within the projection lens 5 can form a relay image plane 50 in front of the light adjustment device 53. In this design, the distance between the light adjustment device 53 and the position from which the imaging light P1 is emitted (digital micromirror device 42) can be shortened, so the light adjustment device 53 has a good beam splitting effect on the imaging light P1, and a good stereoscopic display effect can be achieved.
[0103] In addition, since the beam splitting of the imaging light P1 on the relay image plane 50 is performed by using the light adjustment device 53 in the projection lens 5, problems such as image resolution loss, image distortion, and crosstalk between the left-eye image and the right-eye image caused by the diffusion screen can be avoided, thereby improving the stereoscopic display effect of the image generation device 1.
[0104] In some embodiments, as shown in Figure 9, the image generating apparatus 1 includes an image source module 2 and a projection lens 5. The image source module 2 includes a light source 3 and a liquid crystal display 43. The liquid crystal display 43 is a transmissive liquid crystal structure. The light source 3 is located on one side of the liquid crystal display 43. The light adjustment device 53 and the projection lens 5 are located on the other side of the liquid crystal display 43.
[0105] Light source 3 is configured to generate illumination rays P3, which are irradiated onto the liquid crystal display 43. Illumination rays P3 may be natural light (unpolarized), a mixed ray of P-polarized and S-polarized light (polarized), or a polarization (either P-polarized or S-polarized) applicable to the liquid crystal on silicon 41. For a description of light source 3, please refer to the relevant content above. Further details will not be explained again here.
[0106] In this embodiment, an example in which the illumination ray P3 generated by the light source 3 is natural light is used to explain the image generation device 1 in this embodiment.
[0107] The illumination ray P3 generated by the light source 3 is irradiated onto the liquid crystal display 43. The liquid crystal display 43 includes a first substrate and a second substrate arranged opposite each other, as well as a liquid crystal layer disposed between an array substrate and an alignment substrate. The liquid crystal display 43 includes a plurality of pixels arranged in an array, with a plurality of pixel electrodes arranged on the array substrate corresponding to each pixel, and a common electrode arranged on either the array substrate or the alignment substrate. By applying a voltage to the pixel electrodes, the liquid crystal corresponding to the pixels in the liquid crystal layer can be controlled, modulating the light passing through the pixels.
[0108] In this embodiment, after illumination light P3 is incident on the liquid crystal display 43, the liquid crystal display 43 modulates the illumination light P3 based on image data to form imaging light P1 containing image information. The image data may be image data for performing stereoscopic display based on the binocular parallax principle, and the image data may include left-eye image data for forming a left-eye image and right-eye image data for forming a right-eye image.
[0109] Some pixels in the liquid crystal display 43 modulate illumination rays P3 based on left-eye image data to form a first imaging sublight P11 containing left-eye image information, and some pixels in the liquid crystal display 43 modulate illumination rays P3 based on right-eye image data to form a second imaging sublight P12 containing right-eye image information. The first imaging sublight P11 and the second imaging sublight P12 are mixed together and collectively called imaging light P1.
[0110] For example, a plurality of pixels arranged in an array within the liquid crystal display 43 include a plurality of left-eye pixels used to form a first imaging sublight P11 and a plurality of right-eye pixels used to form a second imaging sublight P12. The right-eye pixels and left-eye pixels are arranged adjacent to each other.
[0111] The imaging light P1 formed by the liquid crystal display 43 is projected onto the projection lens 5. The first imaging lens 51 within the projection lens 5 receives the imaging light P1 and is configured to perform imaging on the side of the light adjustment device 53 that is closer to the first imaging lens 51, thereby forming a relay image plane 50. One-to-one mapping of pixels in the liquid crystal display 43 may be performed on the relay image plane 50. The light adjustment device 53 performs beam splitting on the imaging light P1 on the relay image plane 50, and after splitting, the first imaging sublight P11 and the second imaging sublight P12 of the imaging light P1 are projected onto the second imaging lens 52 in different directions, forming the spatially dispersed first imaging sublight P11 and second imaging sublight P12. The spatially dispersed first imaging sublight P11 and second imaging sublight P12 illuminate different positions via the second imaging lens 52, forming spatially dispersed left-eye and right-eye images. A stereoscopic display effect can be achieved when the observer's left eye observes the left-eye image and the observer's right eye observes the right-eye image.
[0112] It can be seen that the image generation device 1 having a projection lens 5 can perform a stereoscopic display function. Furthermore, the first imaging lens 51 within the projection lens 5 can form a relay image plane 50 in front of the light adjustment device 53. In this design, the distance between the light adjustment device 53 and the position from which the imaging light P1 is emitted (liquid crystal display 43) can be shortened, so the light adjustment device 53 has a good beam splitting effect on the imaging light P1, and a good stereoscopic display effect can be achieved.
[0113] In addition, since the beam splitting of the imaging light P1 on the relay image plane 50 is performed by using the light adjustment device 53 in the projection lens 5, problems such as image resolution loss, image distortion, and crosstalk between the left-eye image and the right-eye image caused by the diffusion screen can be avoided, thereby improving the stereoscopic display effect of the image generation device 1.
[0114] The image light P1 formed by the liquid crystal display 43 is polarized. Therefore, in the projection lens 5 used in the image generation device 1, the light adjustment device 53 may be a polarization adjustment element or a depolarization adjustment element.
[0115] In the embodiments described above, an example in which the imaging light P1 includes a first imaging sublight P11 and a second imaging sublight P12 is used to describe the image generating apparatus 1 provided in this embodiment of the application. However, the embodiments of this application are not limited thereto.
[0116] In some embodiments, the imaging light P1 includes at least two pairs of imaging sublights, each of which includes a first imaging sublight P11 and a second imaging sublight P12, and the first imaging sublight P11 and the second imaging sublight P12 of each imaging sublight pair can form a binocular disparity image for performing stereoscopic display. Each of the imaging sublight pairs is used separately to form a single stereoscopic viewing viewpoint.
[0117] The light adjustment device 53 may project different pairs of imaging sublights onto the projection lens 5 in different directions, or it may project the first imaging sublight P11 and the second imaging sublight P12 of the same pair onto the projection lens 5 in different directions. In this design, multiple spatially dispersed viewpoints can be formed. In this way, multiple observers in different positions can view the left eye image and the right eye image simultaneously, enabling stereoscopic display functionality and widening the stereoscopic display field of view of the image generation device 1.
[0118] The image generation device 1 provided in this embodiment of the application may be used in audio and video entertainment scenarios and driving assistance scenarios. In certain applications, the image generation device 1 may be used independently or integrated as a component into another device.
[0119] For example, in a possible application scenario, the image generation device in this embodiment of the present application is integrated into a head-up display (HUD) device. See Figure 10A, which illustrates this using an example in which the head-up display device is mounted on a means of transport. The head-up display device may project navigation information, instrument information, etc., into the driver's forward field of view, thereby preventing the driver from lowering their gaze to view the information and thus ensuring that driving safety is not affected. After the image projected by the head-up display device is reflected by the windshield, a virtual image is formed outside the means of transport. Types of head-up display devices include, but are not limited to, windshield (W)-HUDs and augmented reality head-up displays (AR-HUDs).
[0120] In another possible implementation, the image generation device in this embodiment of the application is integrated into an in-vehicle display. See Figure 10B. The in-vehicle display may be mounted behind the seats, such as the passenger seat, of the transport vehicle. The location in which the in-vehicle display is mounted is not limited in this application.
[0121] In yet another possible application scenario, the image generating device in this embodiment of the present application is integrated into a Near Eye Display (NED) device. The NED device may be, for example, an AR device or a VR device. An AR device may include, but is not limited to, AR glasses or an AR helmet, and a VR device may include, but is not limited to, VR glasses or a VR helmet. See Figure 10C, where AR glasses are used as an example. A user may wear the AR glasses device to play games, watch videos, participate in virtual meetings, or engage in video shopping.
[0122] In yet another possible application scenario, the image generation device in this embodiment of the present application is integrated into a projector. See Figure 10D. The projector may project images onto a wall or projection screen.
[0123] The application scenarios described above are merely examples. The image generating apparatus 1 provided in this application may be used in other possible scenarios, such as in medical devices. This is not limited to this application.
[0124] One embodiment of this application further provides a display device. As shown in Figure 11, the display device 100 includes a processor 1001 and the image generation device 1 in the above-described embodiment. The processor 1001 is configured to control the image generation device 1 to form imaging light.
[0125] The display device 100 provided in this embodiment of the present application may be a head-up display device, an in-vehicle display, a near-eye display device, a projector, a medical device, etc., as mentioned in the application scenarios described above, or it may be a display incorporated into a smart home appliance device, or it may be a web TV, a smart TV, or an Internet Protocol TV (IPTV), or it may be integrated into a web TV, a smart TV, or an Internet Protocol TV.
[0126] In some embodiments, the display device 100 further includes a diffuse screen 110. The diffuse screen 110 is positioned on the light output side of the image generating device 1 and is configured to receive imaging light emitted by the image generating device 1 and perform imaging. A first imaging sublight and a second imaging sublight can form a stereoscopic viewing viewpoint on the diffuse screen 110 that matches the interpupillary distance of the human eye.
[0127] Furthermore, the diffusion screen 110 can improve the uniformity of the image through its scattering effect and structure. In addition, the diffusion screen 110 may be configured to perform angular diffusion at the stereoscopic viewing viewpoint in order to widen the stereoscopic viewing angle.
[0128] In this embodiment, the diffusion screen 110 may be a reflective diffusion screen or a transmissive diffusion screen.
[0129] In some embodiments, the display device 100 further includes a first reflecting element 120. The first reflecting element 120 may be positioned behind the diffusion screen 110, or it may be configured to reflect the image pattern on the diffusion screen 110 to a preset position.
[0130] Figure 12 is a diagram of a display device 100 according to one embodiment of the present application.
[0131] As shown in Figure 12, the circuitry within the display device 100 mainly includes a processor 1001, internal memory 1002, external memory interface 1003, audio module 1004, video module 1005, power module 1006, wireless communication module 1007, I / O interface 1008, video interface 1009, Controller Area Network (CAN) transceiver 1010, display circuit 1011, and one of the aforementioned image generation devices 1. The processor 1001 may be connected via a bus to peripheral elements of the processor 1001, such as the internal memory 1002, external memory interface 1003, audio module 1004, video module 1005, power module 1006, wireless communication module 1007, I / O interface 1008, video interface 1009, CAN transceiver 1010, and display circuit 1011.
[0132] Processor 1001 may be called a front-end processor. Processor 1001 may include one or more processing units. For example, processor 1001 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processing unit (NPU). Different processing units may be independent components or may be integrated into one or more processors.
[0133] Memory may be located further within the processor 1001 and configured to store instructions and data, for example, the operating system and AR Creator software package of the display device 100. In some embodiments, the storage within the processor 1001 is a cache. The storage may store instructions or data that have just been used by the processor 1001 or that are used periodically. If the processor 1001 needs to use an instruction or data again, the processor 1001 may retrieve that instruction or data directly from the storage. This avoids repeated access, reduces latency for the processor 1001, and improves system efficiency.
[0134] In addition, if the display device 100 in this embodiment is mounted on a transport means, the functions of the processor 1001 may be performed by a domain controller on the transport means.
[0135] In some embodiments, the display device 100 may further include a plurality of input / output (I / O) interfaces 1008 connected to the processor 1001. The interfaces 1008 may include, but are not limited to, an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, a universal serial bus (USB) interface, and the like. The I / O interfaces 1008 may be connected to devices such as a mouse, touchscreen, keyboard, camera, speaker / horn, microphone, or to physical buttons on the display device 100 (e.g., volume buttons, brightness adjustment buttons, power on / off buttons, etc.).
[0136] The internal memory 1002 may be configured to store computer executable program code, which includes instructions. The internal memory 1002 may also include a program storage area and a data storage area. The program storage area may store the operating system, applications required by at least one function (such as a call function, a time setting function, or an AR function), etc. The data storage area may store data created by processes using the display device (such as a phone book and world time), etc. In addition, the internal memory 1002 may include high-speed random access memory, or non-volatile memory, such as at least one magnetic disk storage device, flash memory, or universal flash storage (UFS). The processor 1001 performs various functional applications and data processing of the display device 100 by executing instructions stored in the internal memory 1002 and / or instructions stored in memory located in the processor 1001.
[0137] The external memory interface 1003 may be configured to connect to external memory (for example, a Micro SD card). The external memory may store data or program instructions as needed. The processor 1001 may perform operations such as reading and writing data and programs via the external memory interface 1003.
[0138] The audio module 1004 is configured to convert digital audio information into analog audio signals for output, and is also configured to convert analog audio input into digital audio signals. The audio module 1004 may be further configured to encode and decode audio signals, for example, to perform audio playback or audio recording. In some embodiments, the audio module 1004 may be located within the processor 1001, or some functional modules within the audio module 1004 may be located within the processor 1001. The display device may perform audio functions via the audio module 1004, an application processor, etc.
[0139] The video interface 1009 may receive audio and video inputs from external sources, specifically, high-definition multimedia interface (HDMI®), digital visual interface (DVI), video graphics array (VGA), display port (DP), low-voltage differential signaling (LVDS) interface, etc. The video interface 1009 may further output video externally. For example, the display device 100 may receive video data transmitted by the navigation system or by the domain controller via the video interface.
[0140] The video module 1005 may decode the video input by the video interface 1009, for example, by performing H.264 decoding. The video module may further encode the video collected by the display device 100, for example, by performing H.264 encoding on the video collected by an external camera. In addition, the processor 1001 may decode the video input by the video interface 1009 and then output the decoded image signal to the display circuit 1011.
[0141] Furthermore, if the display device 100 in this embodiment is mounted on a means of transport, the display device 100 may further include a CAN transceiver 1010, which may be connected to the vehicle's CAN bus. Via the CAN bus, the display device 100 may communicate with an in-vehicle entertainment system (music, radio, and video modules), a vehicle status system, and the like. For example, a user may activate the in-vehicle music playback function by operating the display device 100. The vehicle status system may transmit vehicle status information (vehicle doors, seat belts, etc.) to the display device 100 for display.
[0142] The display circuit 1011 and the image generation device 1 work together to perform the function of displaying an image. The display circuit 1011 receives the image signal output by the processor 1001, processes the image signal, and inputs the processed image signal to the image generation device 1 for imaging. The display circuit 1011 may further control the image displayed by the image generation device 1, for example, by controlling parameters such as display brightness and contrast. The display circuit 1011 may also include a drive circuit, an image control circuit, etc.
[0143] In this embodiment, the video interface 1009 may receive input video data (or referred to as a video source), the video module 1005 may perform decoding and / or digitization processing and output the image signal to the display circuit 1011, and the display circuit 1011 may drive the image generation device 1 to generate a visual image (emit imaging light) and perform imaging based on the input image signal.
[0144] The power module 1006 is configured to supply power to components such as the processor 1001 and the image generation device 1 based on input power (e.g., DC). The power module 1006 may include a rechargeable battery. Furthermore, the power module 1006 may be connected to the vehicle's power supply module (e.g., a power battery), and the vehicle's power supply module may supply power to the power module 1006 of the display device 100.
[0145] The wireless communication module 1007 may enable the display device 100 to communicate wirelessly with the outside world, or it may provide wireless communication solutions such as wireless local area networks (WLAN), wireless fidelity (Wi-Fi) networks, Bluetooth® (BT), global navigation satellite systems (GNSS), frequency modulation (FM), near-field communication (NFC) technology, and infrared (IR) technology. The wireless communication module 1007 may be one or more components incorporating at least one communication processing module. The wireless communication module 1007 receives electromagnetic waves via an antenna, performs frequency modulation and filtering on the electromagnetic wave signal, and transmits the processed signal to the processor 1001. The wireless communication module 1007 may further receive a signal intended for transmission from the processor 1001, perform frequency modulation and amplification on that signal, or convert the signal into electromagnetic waves for radiation via an antenna.
[0146] In addition, the video data decoded by the video module 1005 may be received wirelessly via the wireless communication module 1007, or read from the internal memory 1002 or external memory, in addition to being input via the video interface 1009. For example, the display device 100 may receive video data from a terminal device or in-vehicle entertainment system via a wireless local area network within the vehicle, and the display device 100 may further read audio and video data stored in the internal memory 1002 or external memory.
[0147] In addition, the schematic circuit diagram in this embodiment of the application does not constitute a specific limitation on the display device 100. In some other embodiments of the application, the display device 100 may include more or fewer components than those shown in the figure, or combinations of some components, or divisions of some components, or different component layouts. The components shown in the figure may be implemented by hardware, software, or a combination of software and hardware.
[0148] In addition to the functions described above, the display device 100 may further provide the ability to receive television broadcasts. For example, the display device 100 may be integrated with a web TV, a smart TV, or an Internet Protocol TV (IPTV).
[0149] In addition, one embodiment of the present application provides a transport means, the display device 100 of the above embodiment being mounted on the transport means. The transport means further includes a second reflective element, which is configured to reflect the image light formed by the display device 100 to a preset position.
[0150] For example, as shown in Figure 13, when the display device 100 is a head-up display device mounted on a means of transport, the second reflective element may be the windshield 201 of the means of transport. The windshield 201 is configured to receive imaging light emitted by the head-up display device. The imaging light includes driving-related image information. The windshield 201 reflects the imaging light into the eyes of the driver of the means of transport, thereby allowing the driver of the means of transport 200 to see a virtual image of the driving-related image information.
[0151] Figure 14 is a functional diagram of a transport means 200 according to one embodiment of the present application. The transport means may include various subsystems, for example, a sensor system 210, a control system 220, one or more peripheral devices 230 (one peripheral device is used as an example in the figure), a power supply 240, a computer system 250, and a display system 260. The subsystems may communicate with each other. The display system 260 may include a display device 100 provided in one embodiment of the present application. The transport means may further include other functional systems, for example, an engine system that powers the transport means, and a cockpit. This is not limited herein.
[0152] Specifically, the sensor system 210 may include a plurality of detection devices. These detection devices can detect measured information and convert the detected information into electrical signals or other information in the required format based on specific rules for output. The detection devices may include, but are not limited to, a Global Positioning System (GPS), a vehicle speed sensor, an Inertial Measurement Unit (IMU), a radar unit, a laser rangefinder, a camera device, a wheel speed sensor, a steering sensor, a gear sensor, or other elements used for automatic detection.
[0153] The control system 220 may include multiple elements, such as the steering unit, brake unit, lighting system, autonomous driving system, map navigation system, network time system, and obstacle avoidance system shown in the figure. The control system 220 may receive information transmitted by the sensor system 210 (e.g., vehicle speed, distance between vehicles) and perform functions such as autonomous driving and map navigation.
[0154] In some embodiments, the control system 220 may further include elements such as a throttle controller and an engine controller configured to control the vehicle's speed. This is not limited to the present application.
[0155] The peripheral device 230 may include multiple elements, such as a communication system, a touchscreen, a user interface, a microphone, and a speaker. The communication system is configured to perform network communication between the transport and other devices. In actual use, the communication system may perform network communication between the transport and other devices by using wireless communication technology or wired communication technology. Wired communication technology may mean that the vehicle communicates with other devices via network cables or optical fibers, etc.
[0156] Power supply 240 represents a system used to supply power or energy to a vehicle and may include, but is not limited to, rechargeable lithium batteries and lead-acid batteries. In actual use, one or more battery components within the power supply are configured to provide electrical or energy to start the vehicle. The type and materials of the power supply are not limited in this application.
[0157] Some functions of the transport means may be controlled and performed by a computer system 250. The computer system 250 may include one or more processors 2501 (one processor is shown in the figure as an example) and storage 2502 (which may also be called a memory device). In actual use, the storage 2502 may be located inside or outside the computer system 250, and may be used, for example, as a cache within the transport means. This is not limited to the present application.
[0158] The processor 2501 may include one or more general-purpose processors, such as a graphics processing unit (GPU). The processor 2501 may be configured to execute associated programs stored in the storage 2502, or instructions corresponding to those programs, in order to implement the functions of the corresponding vehicle. The processor 2501 may also be referred to as a domain controller.
[0159] The storage 2502 may include volatile memory, such as RAM. Alternatively, the memory may include non-volatile memory, such as ROM, flash memory, HDD, or solid-state drive (SSD). Alternatively, the storage 2502 may include a combination of the aforementioned types of memory. The storage 2502 may be configured to store program code or a set of instructions corresponding to program code, and as a result, the processor 2501 invokes the program code or instructions stored in the storage 2502 to perform the corresponding functions of the vehicle. In this application, the storage 2502 may store a set of program code used for vehicle control. The processor 2501 may control the safe driving of the vehicle by invoking the program code. Methods for performing the safe driving of the vehicle are described in detail below in this application.
[0160] In some embodiments, in addition to storing program code or instructions, storage 2502 may further store information such as road maps, driving routes, and sensor data. The computer system 250 may perform vehicle-related functions in combination with other elements in the diagram of the vehicle's functional framework, such as sensors in the sensor system and GPS. For example, the computer system 250 may control the direction of travel or speed of the means of transport based on data input from the sensor system 210, etc. This is not limited to the present application.
[0161] The display system 260 may interact with other systems within the means of transport. For example, the display system 260 may display navigation information transmitted by the control system 220, or it may play multimedia content transmitted by the computer system 250 and peripheral devices 230. For a specific structure of the display system 260, please refer to the previously described embodiments of the display device. Further details will not be described here.
[0162] The four subsystems shown in this embodiment, specifically the sensor system 210, the control system 220, the computer system 250, and the display system 260, are merely examples and do not constitute a limitation. In actual use, a means of transport may combine several elements within the vehicle based on different functions to obtain subsystems with corresponding different functions. In actual use, a means of transport may include more or fewer subsystems or elements. This is not limited to the present application.
[0163] The means of transport in the embodiments of this application may be known means of transport such as vehicles, airplanes, ships, or rockets, or they may be new means of transport that may emerge in the future. The vehicles may be electric vehicles, fuel cell vehicles, or hybrid vehicles, for example, pure electric vehicles, range-extended electric vehicles, hybrid electric vehicles, fuel cell vehicles, or new energy vehicles. This is not particularly limited in this application.
[0164] The technical effects that can be achieved by the display device and transport means provided in the embodiments of this application are the same as the technical effects that can be achieved by any one of the image generating apparatus 1 of the embodiments described above. Further details are not described here.
[0165] The foregoing description is merely a specific embodiment of the present application and is not intended to limit the scope of protection of this application. Any modifications or substitutions readily conceivable by a person skilled in the art within the scope of the art disclosed herein shall fall within the scope of protection of this application. Accordingly, the scope of protection of this application shall be subject to the scope of protection of the claims. [Explanation of Symbols]
[0166] 1. Image generation device 2 Image source module 3 light source 4. Optical modulator 5. Projection lens 6. Polarizing Beam Splitter 7. Internal total internal reflection prism 11. Directional backlight 12 display chips 31 Light-emitting element 32 Optical Circumference 41 Liquid Crystal on Silicon 42 Digital Micromirror Devices 43 LCD display 50 Relay image plane 51 First imaging lens 52 Second imaging lens 53 Light adjustment device 100 display devices 110 Diffusion Screen 120 First reflecting element 130 Light Adjusting Elements 200 Means of transportation 201 Windshield 210 Sensor System 220 Control Systems 230 Peripheral Devices 240 Power supply 250 Computer Systems 260 Display Systems 1000 3D display devices 1001 Processor 1002 Internal Memory 1003 External memory interface 1004 Audio Module 1005 Video Module 1006 Power Module 1007 Wireless communication module 1008 I / O Interface 1009 Video Interface 1010 Controller Area Network (CAN) Transmitter / Receiver 1011 Display circuit 2501 Processor 2502 Storage P1 imaging light P11 First imaging sublight P12 Second imaging sublight P2 First Ray P3 Illumination Ray S0 beam splitting surface S1 First Aspect S2 Second Aspect S3 Third Aspect S4 Fourth Aspect
Claims
1. A projection lens comprising a first imaging lens, a light adjustment device, and a second imaging lens, The first imaging lens receives imaging light to form a relay image plane, and images the imaging light on the side of the light adjustment device that is closer to the first imaging lens, and the imaging light includes a first imaging sublight and a second imaging sublight, and the first imaging sublight and the second imaging sublight are used, respectively, to form a left-eye image and a right-eye image for performing stereoscopic display. The light adjustment device is configured to split the imaging light on the relay image plane, and after splitting, the first imaging sublight and the second imaging sublight of the imaging light are projected onto the second imaging lens in different directions. The second imaging lens is a projection lens configured to project the first imaging sublight and the second imaging sublight.
2. The projection lens according to claim 1, wherein the imaging light is unpolarized, and the light adjustment device comprises at least one of a slit diffraction grating, a microlens array, and a cylindrical lens array.
3. The projection lens according to claim 1, wherein the imaging light is polarized, and the light adjustment device comprises at least one of a slit diffraction grating, a microlens array, a cylindrical lens array, and a polarization adjustment element.
4. The projection lens according to claim 3, wherein the polarization adjustment element comprises at least one of a polarization diffraction grating and a polarization lens.
5. The projection lens according to any one of claims 1 to 4, wherein the projection lens includes two second imaging lenses, the two second imaging lenses each configured to project the first imaging sublight and the second imaging sublight.
6. The projection lens according to any one of claims 1 to 5, wherein the image of the imaging light formed by the first imaging lens on the relay image plane is an enlarged real image.
7. The imaging light comprises at least two pairs of imaging sublights, each of which comprises a first imaging sublight and a second imaging sublight, and each of which is used separately to form a stereoscopic viewing viewpoint. The projection lens according to any one of claims 1 to 6, wherein the light adjustment device is configured to project different pairs of imaging sublights onto the second imaging lens in different directions, and to project the first and second imaging sublights of the same pair of imaging sublights onto the second imaging lens in different directions.
8. An image generating apparatus comprising an image source module and a projection lens according to any one of claims 1 to 7, The image source module is configured to form imaging light containing image information and project the imaging light onto the projection lens, thereby forming an image generating device.
9. The image source module comprises a light source, liquid crystal on silicon, and a polarizing beam splitter. The light source is configured to provide illumination rays projected onto the polarizing beam splitter. The polarization beam splitter is configured to perform polarization splitting on the illumination beam to form a first ray, project the first ray onto the liquid crystal on silicon, and the polarization direction of the first ray is a first polarization direction. The image generating apparatus according to claim 8, wherein the liquid crystal on silicon is configured to form the imaging light, project the imaging light onto the projection lens via the polarizing beam splitter, the polarization direction of the imaging light is a second polarization direction, and the first polarization direction and the second polarization direction are perpendicular to each other.
10. The image source module comprises a light source, a digital micromirror device, and an internal total internal reflection prism. The light source is configured to provide illumination rays projected onto the internal total internal reflection prism, The internal total internal reflection prism is configured to reflect the illumination ray to form a first ray projected onto the digital micromirror device and to transmit the imaging light formed by the digital micromirror device. The image generating apparatus according to claim 8, wherein the digital micromirror device is configured to modulate the first ray based on image data to form the imaging light, and to project the imaging light onto the projection lens via the internal total internal reflection prism.
11. The image source module comprises a light source and a liquid crystal display, The light source is configured to provide illumination rays projected onto the liquid crystal display. The image generating apparatus according to claim 8, wherein the liquid crystal display is configured to modulate the illumination ray based on image data to form the imaging light, and to project the imaging light onto the projection lens.
12. A display device comprising a processor and an image generating apparatus according to any one of claims 8 to 11, wherein the processor is configured to control the image generating apparatus to form imaging light.
13. The display device further comprises a diffusion screen and a first reflective element. The diffusion screen is positioned on the optical output side of the image generation device and is configured to receive the imaging light emitted by the image generation device and perform imaging. The display device according to claim 12, wherein the first reflective element is configured to reflect the image information on the diffusion screen to a preset position.
14. A transport means comprising a display device according to claim 12 or 13, wherein the display device is attached to the transport means.
15. The transport means according to claim 14, further comprising a second reflective element, wherein the display device is configured to project imaging light onto the second reflective element, and the second reflective element is configured to reflect the imaging light.