Display module, optical display system, terminal device, and image display method

Abstract

The present disclosure discloses a display module, an optical display system, a terminal device, and an image display method, which may be applied to fields such as head-up display (HUD), near-eye display (NED), display, or in-vehicle display. The display module includes a scattering layer and a reflective layer. The scattering layer is configured to receive different image lights from a picture generation unit and scatter the different image lights to corresponding positions on the reflective layer, where the image lights carry image information. The reflective layer is configured to reflect the image lights from the corresponding positions on the scattering layer to corresponding viewing points and transmit ambient light. The different image lights can be reflected to corresponding viewing points through cooperation between the scattering layer and the reflective layer to form a 3D image. In addition, since the reflective layer can also transmit ambient light, a 3D transparent display can also be realized by using the display module.

Description

[Technical Field]

[0001] The present application relates to the field of display technology, in particular to a display module, an optical display system, a terminal device, and an image display method. [Background technology]

[0002] With the development of display technology, transparent displays are becoming more and more widely applied. Transparent displays can display image information without affecting the user's observation of ambient light. Transparent displays are mainly classified into active emissive and projection types. For active emissive displays, organic light emitting diode (OLED) technology is used as an example. For projection displays, for example, scattering particles or phosphors are added to the windshield or window glass of a vehicle, and the windshield to which the scattering particles or phosphors are added emits light under the illumination of a light source to generate an image. The concentration of the scattering particles can be controlled, or the scattering particles can have wavelength selectivity, so that the transparency of the windshield to ambient light is still good. In this way, transparent displays are implemented.

[0003] Currently, three-dimensional (3D) displays can give viewers a stronger sense of three-dimensional fidelity, increase the display's depth of field, and improve the richness of display content. A display device emits left-eye image light and right-eye image light, which have different polarization states. When a user wears polarized glasses, the left and right glasses only allow image light with corresponding polarization states to enter. Therefore, different images are observed by the left and right eyes, and 3D vision is formed by visual fusion in the brain.

[0004] However, existing 3D displays need to be realized based on external tools (such as polarized glasses), and 3D transparent displays cannot be realized. Summary of the Invention

[0005] The present application provides a display module, an optical display system, a terminal device, and an image display method to realize a 3D transparent display.

[0006] According to a first aspect, the present application provides a display module. The display module includes a scattering layer and a reflective layer. The scattering layer is configured to receive different image lights from a picture generation unit (PGU) and scatter the different image lights to corresponding positions on the reflective layer, where the image lights carry image information. The reflective layer is configured to reflect the image lights from the corresponding positions on the scattering layer to corresponding viewing points and transmit ambient light.

[0007] Based on the above solution, different image lights can be reflected to corresponding viewing points through the cooperation between the scattering layer and the reflective layer to form a 3D image. And the reflective layer can also transmit ambient light, so that a 3D transparent display can be realized by using the display module.

[0008] Different image lights carry different image information. Furthermore, the reflectance states of the different image lights may be the same or different.

[0009] In a possible implementation, the reflective layer includes a concave cylindrical reflector array, a surface of the concave cylindrical reflectors of the concave cylindrical reflector array that is closer to the scattering layer is concave, and the concave surface is covered with a reflective film.

[0010] The surface of the concave cylindrical reflector of the concave cylindrical reflector array, which is the surface closest to the scattering layer, is concave, so that the image formed based on the image light from the scattering layer has parallax and three-dimensional effects.

[0011] It can be understood that there may be non-concave cylindrical reflectors in the concave cylindrical reflector array if the 3D transparent display is not affected.

[0012] In a possible implementation, the projection of the concave surface close to the scattering layer onto at least a first plane is in the shape of a circular arc, the first plane being, for example, a horizontal plane.

[0013] The projection of the concave surface near the scattering layer onto at least the first plane is set to be in an arc shape, so that the image formed by the image light has parallax and stereoscopic effect in a first direction parallel to the first plane.

[0014] In a possible implementation, the reflectance of the reflective film is greater than a first reflectance threshold and less than a second reflectance threshold.

[0015] The reflectivity of the reflective film is greater than a first reflectivity threshold and less than a second reflectivity threshold, so that the reflective film can reflect image light from the scattering layer and transmit ambient light, thereby realizing a 3D transparent display.

[0016] In a possible implementation, the reflectivity of the reflective film is related to the transmittance requirements of the reflective film.

[0017] The reflectance of the reflective film is set to be related to the transmittance requirement of the reflective film, so that the application scenario requirements of the display module can be met. For example, if the display module is to be placed on a windshield, the transmittance of the windshield must be greater than 70%. Therefore, the transmittance of the reflective film must be greater than 70%. Correspondingly, the reflectance of the reflective film is less than 30% and greater than 0.

[0018] In a possible implementation, the reflective film comprises a nano-metal film or a dielectric film.

[0019] In a possible implementation, the concave surface is filled with a filler material, the refractive index of the filler material and the refractive index of the concave cylindrical reflector meeting a preset tolerance requirement.

[0020] In a possible implementation, the refractive index of the filler is the same as the refractive index of the concave cylindrical reflector.

[0021] For example, the material of the filler is the same as the material of the concave cylindrical reflector.

[0022] The concave surface of the concave cylindrical reflector is filled with a filler material, and the refractive index of the filler material and the refractive index of the concave cylindrical reflector satisfy a preset tolerance requirement so that the display module does not affect the propagation direction of ambient light and a good transparent display is realized.

[0023] In a possible implementation, the concave cylindrical reflector array is a one-dimensional array, and one concave cylindrical reflector of the concave cylindrical reflector array corresponds to N columns of areas of the scattering layer, and the N columns of areas are used to receive different image light, where N is an integer greater than 1.

[0024] One concave cylindrical reflector is set to correspond to more than two rows of the area of ​​the scattering layer, so that the display module can generate a 3D transparent display with stronger stereoscopic effect.

[0025] In a possible implementation, the concave cylindrical reflector array is a two-dimensional array, and one concave cylindrical reflector of the concave cylindrical reflector array corresponds to one area of ​​the scattering layer.

[0026] Based on the two-dimensional concave cylindrical reflector array, the image formed by the image light has parallax and stereoscopic effect in a first direction, and also has parallax and stereoscopic effect in a second direction.

[0027] In a possible implementation, the reflective layer comprises a holographic reflective dielectric layer, which is further produced by a holographic exposure method.

[0028] The holographic reflective dielectric layer is used as a reflective layer, which allows the thickness of the display module to be reduced so as to achieve brightness and thinness of the display module.

[0029] In a possible implementation, the angle of incidence at which the image light scattered to the corresponding position of the reflective layer is emitted into the scattering layer is within a preset angle range.

[0030] The scattering layer is set to have angular selectivity, so that it can only scatter light within a preset angular range and is transparent to ambient light emitted from other directions, thus the display module can realize a 3D transparent display.

[0031] In a possible implementation, the scattering layer is obtained by holographic exposure.

[0032] The scattering layer is fabricated by a holographic exposure method, and the reference laser light during exposure and the image light emitted by the picture generating unit have the same viewing angle and incident angle, so that only the image light with the same viewing angle and incident angle can stimulate the scattering layer, and the ambient light is directly transmitted because it does not meet the angle selection conditions of the scattering layer. The display module based on the scattering layer has high transparency.

[0033] According to a second aspect, the present application provides an optical display system, the optical display system including a picture generation unit and a display module according to the first aspect or any one of the possible implementations of the first aspect, the picture generation unit being configured to emit different image lights.

[0034] In a possible implementation, the different image lights emitted by the picture generation units have the same polarization state.

[0035] For example, the picture generation unit includes, but is not limited to, a projector.

[0036] According to a third aspect, the present application provides a terminal device, the terminal device including an optical display system according to the second aspect or any one of the possible implementations of the second aspect, the optical display system being mounted on the terminal device.

[0037] For technical effects that can be achieved by implementing either the second or third aspect, please refer to the description of the advantageous effects of the first aspect, and the details will not be described again here.

[0038] According to a fourth aspect, the present application provides an image display method, the method including: obtaining coordinates of a first viewpoint and / or a second viewpoint; determining K eye relief distances based on the coordinates of the first viewpoint and / or the second viewpoint and coordinates of K target positions in a display area of ​​the windshield, the K target positions being in one-to-one correspondence with the K rows of an image projected onto the display area, and the parallax, eye relief distance, and virtual image distance between the first viewpoint and the second viewpoint satisfying the correspondence relationship; and controlling display of the image by adjusting the parallax of the K rows of the image.

[0039] Based on the above solution, the parallax, eye relief distance, and virtual image distance satisfy the corresponding relationship, and the parallax is corrected for each row, so that the virtual image distance of every row of the displayed image is the same, and the non-tilted (or called vertical) display of the image can be controlled.

[0040] In a possible implementation, the correspondence is ΔP i ={(VID-ER i ) / VID}·T is satisfied, ΔP iis the parallax between the first and second viewpoints in the ith row, T is the distance between the first and second viewpoints, V is the virtual image distance, and ER i is the eye relief distance of the ith row.

[0041] According to a fifth aspect, the present application provides a chip. The chip includes at least one processor and an interface circuit. Optionally, the chip may further include a memory. The processor is configured to execute computer programs or instructions stored in the memory, thereby enabling the chip to perform a method according to the fourth aspect or any one of the possible implementations of the fourth aspect.

[0042] According to a sixth aspect, the present application provides a computer-readable storage medium having stored thereon a computer program or instructions which, when executed by a control device, can cause the control device to perform a method according to the fourth aspect or any one of the possible implementations of the fourth aspect.

[0043] According to a seventh aspect, the present application provides a computer program product, comprising a computer program or instructions, which, when executed by a control device, enable the control device to perform a method according to the fourth aspect or any one of the possible implementations of the fourth aspect. [Brief explanation of the drawings]

[0044] [Figure 1a] 1 is a diagram showing a display module applied to a vehicle windshield in accordance with the present disclosure; [Figure 1b] 1 is a diagram showing a display module applied to a vehicle window according to the present application; [Figure 1c] 1 is a diagram showing a display module applied to a sunroof according to the present application; [Figure 1d]1 is a diagram showing the application of a display module to a NED device according to the present application. [Figure 1e] 1 is a diagram showing a display module applied to an in-vehicle display according to the present application; [Figure 1f] 1 is a diagram showing the application of a display module to a display according to the present application; [Figure 2] 1 is a diagram of the structure of a display module according to the present application; [Figure 3a] FIG. 2 is a diagram of the relationship between ambient light and image light according to the present application. [Figure 3b] FIG. 10 is another diagram of the relationship between ambient light and image light according to the present application. [Figure 4a] 1 is a diagram of the principle of manufacturing a scattering layer based on holographic exposure technology according to the present application; [Figure 4b] 1 is a diagram illustrating the principle of scattering layer reproduction according to the present application; [Figure 5a] 1 is a diagram of the structure of a scattering layer according to the present application; [Figure 5b] 1 is a diagram of another scattering layer structure according to the present application. [Figure 6] 1 is a diagram of the structure of a concave cylindrical reflector array according to the present application. [Figure 7a] 1 is a diagram of a projection of a concave cylindrical reflector array onto a first plane, in accordance with the present application. [Figure 7b] 1 is a diagram of a projection of a concave surface onto a first plane according to the present application. [Figure 8] 1 is a diagram of a projection of a concave cylindrical reflector array onto a second plane, in accordance with the present application. [Figure 9] 1 illustrates the correspondence between the area of ​​the concave cylindrical reflector array and the scattering layer according to the present application. [Figure 10] 10 illustrates another correspondence between the concave cylindrical reflector array and the area of ​​the scattering layer according to the present application. [Figure 11] 1 is a diagram of another concave cylindrical reflector array structure according to the present application. [Figure 12a] 1 is a diagram of the principle of obtaining a holographic reflective dielectric layer based on a lens array according to the present application; [Figure 12b]1 is a diagram of the principle of obtaining a holographic reflective dielectric layer based on a reflector array according to the present application; [Figure 13] 1 is a diagram of the optical path of a display module according to the present application; [Figure 14] 1 is a diagram of the architecture of an optical display system according to the present application; [Figure 15] 1 is a schematic method flowchart of an image display method according to the present application. [Figure 16a] FIG. 1 is a diagram illustrating the relationship between eye relief distance, virtual image distance, and parallax according to the present application. [Figure 16b] 1 is a diagram illustrating the positional relationship between the parallax and the display module according to the present application. FIG. [Figure 17] 1 is a circuit diagram of an optical display system according to the present application. [Figure 18] 1 is an example of a functional block diagram of a vehicle according to the present application. DETAILED DESCRIPTION OF THE INVENTION

[0045] Hereinafter, embodiments of the present application will be described in detail with reference to the accompanying drawings.

[0046] The following is an explanation of some terms used in the present application, which are provided to facilitate understanding by those skilled in the art and are not intended to limit the scope of protection claimed by the present application.

[0047] 1. Scattering Scattering refers to the phenomenon whereby some of the light deviates from its original direction as it passes through a medium. The light that deviates from its original direction is called scattered light.

[0048] 2. Holographic technology The first step in holographic technology is to record the object's light wave information based on the interference principle, which is the imaging process. The object being imaged is irradiated with a laser to form a diffuse object beam. Another part of the laser is emitted as a reference beam onto the holographic substrate, which overlaps with the object beam and generates interference. Interference refers to the phenomenon in which two or more wave trains meet in space, causing them to overlap or cancel each other out, forming a new waveform. The phase and amplitude of each point on the object's light wave are converted into spatial intensity, thereby recording all the information about the object's light wave based on the contrast and spacing between the interference fringes. The film recording the interference fringes is then developed and fixed, resulting in a holographic layer (also known as a holographic photograph). The second step is to reconstruct the object's light wave information based on the diffraction principle, which is the image formation process.

[0049] 3. Viewpoint A viewpoint is a position from which an image is observed. Specifically, the viewpoint may be two or more positions within the eyebox. The eyebox is generally the range within which the driver's eyes can see all of the displayed image. For details, see Figure 1a. To accommodate differences in driver height, the size of the eyebox is generally 130mm x 50mm. If the driver's eyes are within the eyebox, the driver can see a complete and clear image. If the driver's eyes are outside the eyebox, the driver may see image distortion, color rendering errors, or even be unable to see the image.

[0050] 4. Virtual Image Distance (VID) The virtual image distance refers to the distance between the viewpoint and the center of the image.

[0051] 5. Parallax Parallax refers to the difference in distance of the same target observed from two viewpoints within a certain distance (T).

[0052] The above explains some terms used in this application, and the following explains possible application scenarios of this application.

[0053] In a possible application scenario, the display module provided herein can be placed on the windshield of a vehicle (with an incidence angle of approximately 30° to 60°) and used in conjunction with a head-up display (HUD) device. See FIG. 1a. The HUD projects the generated image (referred to as a HUD virtual image) into the driver's forward field of view and fuses the image with actual road surface information to enhance the driver's perception of the actual driving environment. For example, the HUD can superimpose a HUD virtual image conveying navigation information (e.g., direction arrows, distance, and / or driving time) and / or vehicle status information (e.g., driving speed, cruising speed, temperature, fuel capacity, and / or vehicle light status) onto the actual environment outside the vehicle (e.g., a certain distance ahead, surrounding obstacles, and / or a vehicle reversing image), thereby providing the driver with an augmented reality visual effect. Based on this, the vehicle can implement functions such as augmented reality (AR) navigation, adaptive cruise, and lane departure prevention. Alternatively, vehicle assisted driving, intelligent driving, etc. may be implemented with reference to the functions of an advanced driving assistance system (ADAS). Generally, the virtual image distance of the HUD virtual image formed based on vehicle status information is approximately 2-3 meters so as not to interfere with road conditions. The virtual image distance of the HUD virtual image formed based on navigation information is approximately 7-15 meters so as to better blend the HUD virtual image formed based on navigation information with the actual road surface. Examples of HUDs include, but are not limited to, windshield head-up display devices (W-HUDs), AR-HUDs, etc.

[0054] In yet another possible application scenario, the display module provided herein may alternatively be disposed on a vehicle window (e.g., a side window or a rear window) and used together with a picture generation unit. The picture generation unit may project image light onto the display module on the vehicle window. See FIG. 1b. In this application scenario, the picture generation unit may include, for example, but is not limited to, a projector.

[0055] In yet another possible application scenario, the display module provided herein may alternatively be disposed on a sunroof and used together with a picture generation unit. The picture generation unit may project image light onto the display module on the sunroof. See FIG. 1c. In this application scenario, the picture generation unit may include, but is not limited to, a projector, for example.

[0056] In yet another possible application scenario, the display module provided herein may alternatively be incorporated into a near-eye display (NED) device. The NED device may be, for example, an augmented reality (AR) device or a virtual reality (VR) device. The AR device may include, but is not limited to, AR glasses or an AR helmet. The VR device may include, but is not limited to, VR glasses or a VR helmet. See FIG. 1d. AR glasses are used as an example. A user may wear AR glasses to play games, watch videos, participate in virtual meetings, or perform video shopping.

[0057] In yet another possible application scenario, the display module provided herein may alternatively be incorporated into an in-vehicle display. See FIG. 1e. The in-vehicle display may be mounted on the rear side of a seat in a vehicle, at a front passenger position, etc. The location where the in-vehicle display is mounted is not limited by the present application. FIG. 1e uses an example in which the in-vehicle display is mounted on the rear side of a seat.

[0058] In yet another possible application scenario, the display module provided herein can alternatively be integrated into a display and used as a desktop display, see Fig. 1f.

[0059] It should be understood that the above possible application scenarios are merely examples, and the display module provided herein may alternatively be applied to other possible application scenarios and is not limited to the scenarios shown in the above examples.

[0060] Based on the above, the present application provides a display module, which can realize a 3D transparent display.

[0061] The display module provided in the present application will be described in detail below with reference to FIGS.

[0062] FIG. 2 is a diagram of the structure of a display module according to the present application. The display module includes a scattering layer and a reflective layer. The scattering layer is configured to receive different image lights from a picture generating unit and scatter the different image lights to corresponding positions on the reflective layer. The image lights carry image information. The image information carried by the different image lights may be the same or different, and the polarization states of the different image lights may be the same or different. The reflective layer is configured to reflect the image lights from corresponding positions on the scattering layer to corresponding viewing points and transmit ambient light. For example, the reflective layer is configured to reflect first image light from the scattering layer to a first viewing point and reflect second image light to a second viewing point. Alternatively, it can be understood that the first image light is focused on the first viewing point and the second image light is focused on the second viewing point. It can be understood that Figure 2 is an example in which a picture generating unit emits first image light and second image light, the first image light being focused at a first viewpoint after passing through a scattering layer and a reflective layer, and the second image light being focused at a second viewpoint after passing through a scattering layer and a reflective layer.

[0063] Ambient light is light different from image light. In a possible implementation, the propagation direction of the ambient light is opposite to the propagation direction of the image light. See FIG. 3a. In another possible implementation, the propagation direction of the ambient light is the same as the propagation direction of the image light. See FIG. 3b. It should be understood that the ambient light shown in FIGS. 3a and 3b is merely an example. The propagation direction of the ambient light in this application may alternatively be another possible direction. This is not limited here.

[0064] Based on the above display module, different image lights can be reflected to corresponding viewing points through the cooperation between the scattering layer and the reflective layer to form a 3D image. In addition, the reflective layer can also transmit ambient light, so that a 3D transparent display can be realized by using the display module.

[0065] In a possible implementation, the picture generation unit may include, but is not limited to, a projector. To facilitate the description of the solution, the following uses an example in which the picture generation unit is a projector for illustration.

[0066] The following describes each functional structure shown in FIG. 2 individually to provide an example of a specific implementation solution.

[0067] 1.Scattering layer In a possible implementation, the scattering layer has angle selectivity. Scattering can be achieved only for light emitted at a specific incident angle, and the scattering layer is transparent to ambient light emitted from other directions. Specifically, the scattering layer is configured to scatter image light having an incident angle within a preset angular range. In other words, the incident angle at which the image light scattered to the corresponding position of the reflective layer is emitted to the scattering layer is within the preset angular range.

[0068] The scattering layer can be fabricated using a holographic exposure method. See FIG. 4a. A first laser beam is used as the object beam after passing through a conventional scatterer (e.g., frosted glass), and a reference laser beam interferes with the object beam in the holographic recording layer via a semi-transmissive, semi-reflective mirror. The field of view (or optical cone angle) of the reference laser beam is the same as the field of view of the image light emitted from the projector, and the incident angle of the reference laser beam onto the scattering layer is equal to the incident angle of the image light emitted from the projector onto the scattering layer. Based on this, the resulting holographic recording layer can be used as the scattering layer of a display module.

[0069] For example, see FIG. 4b. The viewing angle formed by the image light emitted by the projector is ω, and the incident angle at which the central image light is radiated onto the scattering layer is θ. The incident angle at which each image light is radiated onto the scattering layer can be determined based on the incident angle θ at which the central image light is radiated onto the scattering layer, the viewing angle ω of the image light, and the angle interval between adjacent image lights. Based on this, referring to FIG. 4a, when the scattering layer is manufactured based on holographic exposure technology, the viewing angle formed by the reference laser beam is controlled to be ω, and the semi-transparent semi-reflective mirror is adjusted so that the incident angle at which the central image light of the reference laser beam is radiated onto the holographic recording layer is θ.

[0070] The scattering layer is fabricated by a holographic exposure method. During exposure, the reference laser beam has the same optical cone angle and incident angle as the projector, so that only the image light with the same optical cone angle and incident angle can stimulate the scattering layer, while ambient light is directly transmitted because it does not satisfy the angle selection condition. Compared with traditional scatterers, the scattering layer has higher transparency.

[0071] It should be noted that the above holographic exposure method is only one example of fabricating a scattering layer. Alternatively, the scattering layer of the present application may be fabricated by other possible methods. For example, the scattering layer can be obtained by doping scattering particles, combining micro-nanostructures with a phase compensation layer, or by other methods. This is not a limitation of the present application.

[0072] FIG. 5a is a diagram of the structure of a scattering layer according to the present application. In this example, the image light from the projector includes a first image light and a second image light. The scattering layer includes a first area and a second area. The first area and the second area are divided based on the received image light and are represented by different fillings in FIG. 5a. The first area is used to scatter the first image light, and the second area is used to scatter the second image light. Specifically, one first image light corresponds to one first area, and one second image light corresponds to one second area.

[0073] FIG. 5b is a diagram of another scattering layer structure according to the present disclosure. In this example, the image light from the projector includes first, second, third, and fourth image lights. For example, the scattering layer includes a first area, a second area, a third area, and a fourth area. The first, second, third, and fourth areas are divided based on the received image light and are represented by different fillings in FIG. 5b. One first image light corresponds to one first area, one second image light corresponds to one second area, one third image light corresponds to one third area, and one fourth image light corresponds to one fourth area. The first area is used to scatter the first image light, the second area is used to scatter the second image light, the third area is used to scatter the third image light, and the fourth area is used to scatter the fourth image light.

[0074] The scattering layer shown in Figures 5a and 5b may be fabricated by the holographic exposure method shown in Figure 4a, or by doping scattering particles or micro-nanostructures, which is not limited in this application. Generally, the size of the areas included in the scattering layer may be the same.

[0075] 2.Reflective layer In a possible implementation, the reflective layer is configured to reflect image light from corresponding locations on the scattering layer to corresponding viewpoints and transmit ambient light.

[0076] In a possible implementation, the concave cylindrical reflector array can be manufactured by injection molding, nanoimprinting, etc. The following shows, as an example, two possible structures of the reflective layer.

[0077] In the first configuration, the reflective layer includes an array of concave cylindrical reflectors.

[0078] The concave cylindrical reflector array can be a one-dimensional array or a two-dimensional array, and two cases can be described:

[0079] Case 1: The concave cylindrical reflector array is a one-dimensional concave cylindrical reflector array.

[0080] FIG. 6 is a diagram of the structure of the concave cylindrical reflector array according to the present application. The concave cylindrical reflector array is a one-dimensional concave cylindrical reflector array. The surface of the concave cylindrical reflector in the concave cylindrical reflector array, which is close to the scattering layer, is concave. In addition, when the 3D transparent display is not affected, a non-concave reflector may exist in the concave cylindrical reflector array. See FIG. 7a. The projection of the concave surface onto the first plane (xoy plane) is in an arc shape. The vector height or coordinates (x, y) of the arc shape can be expressed by using the following Equation 1:

Number

[0081] Here, c is the curvature, and k is the shape coefficient (when the arc shape is a hyperbola when k < -1, the arc shape is a parabola when k = -1, the arc shape is an ellipse when -1 < k < 0, the arc shape is a circle when k = 0, or the arc shape is a flat ellipse when k > 0).

[0082] Alternatively, the vector height or x coordinate of the arc shape can be expressed by the following Equation 2, that is, polynomial terms can be added based on Equation 1:

Number

[0083] Here, Σ i=1 N A i y i are polynomial terms, A is the coefficient of the polynomial, and N is the degree of the polynomial (that is, the maximum power series).

[0084] Based on this, the arc shape may include, but is not limited to, a parabolic shape, a circular arc shape, an elliptical arc shape, a hyperbolic arc shape, or other possible arc shapes. For example, the edge of the arc shape may include a sawtooth shape (see FIG. 7b). It may also be understood that the projection of the concave surface onto the first plane may be a regular arc shape or an irregular arc shape. This is not limited in the present application. For example, the diameter of the arc shape is typically between 100 micrometers (μm) and 10 millimeters (mm).

[0085] Furthermore, the concave cylindrical reflectors in the one-dimensional concave cylindrical reflector array have a cylindrical structure on a second plane (x-axis plane) (e.g., a vertical plane). See FIG. 8. The second plane is perpendicular to the first plane. The first plane may be a horizontal plane, and the second plane may be a vertical plane. The direction parallel to the first plane is called the first direction, and the direction parallel to the second plane is called the second direction. Based on the one-dimensional concave cylindrical reflector array, the image formed by the image light has parallax and stereoscopic effect in the first direction, but does not have stereoscopic effect in the second direction.

[0086] Specifically, one concave cylindrical reflector in the one-dimensional concave cylindrical reflector array corresponds to at least two rows of areas of the scattering layer. Several rows of areas of the scattering layer corresponding to one concave cylindrical reflector are related to the image light emitted by the projector. See FIG. 9. The projector emits first image light and second image light. One concave cylindrical reflector corresponds to one row of first areas and one row of second areas of the scattering layer. For the scattering layer in this example, see the description of FIG. 4a. The first area and the second area of ​​the scattering layer are located at different positions with respect to the concave surface of the concave cylindrical reflector. The first image light passing through the first area of ​​the scattering layer and the second image light passing through the second area of ​​the scattering layer are scattered to corresponding positions on the concave surface of the concave cylindrical reflector, from which the first image light is reflected to a first viewpoint and the second image light is reflected to a second viewpoint.

[0087] See FIG. 10. The projector emits first, second, third, and fourth image lights. One concave cylindrical reflector corresponds to one row of first areas, one row of second areas, one row of third areas, and one row of fourth areas of the scattering layer. The first, second, third, and fourth areas of the scattering layer are located at different positions on the concave surface of the concave cylindrical reflector. The first image light passing through the first area of ​​the scattering layer, the second image light passing through the second area of ​​the scattering layer, the third image light passing through the third area of ​​the scattering layer, and the fourth image light passing through the fourth area of ​​the scattering layer are scattered to corresponding positions on the concave surface of the concave cylindrical reflector. For the scattering layer in this example, please refer to the description of Figure 4b, where the first image light is reflected to the first viewpoint, the second image light is reflected to the second viewpoint, the third image light is reflected to the third viewpoint, and the fourth image light is reflected to the fourth viewpoint from the corresponding positions on the concave surface of the concave cylindrical reflector. One concave cylindrical reflector is set to correspond to four rows of the scattering layer area, so that the display module can generate a 3D transparent display with a stronger stereoscopic effect.

[0088] In a possible implementation, the concave cylindrical reflector array, scattering layer, and viewpoint must satisfy the following Equations 3 and 4:

number

number

[0089] where f represents the focal length of the concave cylindrical reflector, which is equal to the distance from the scattering layer to the concave cylindrical reflector array, and W prepresents the length of the first area or the second area of the scattering layer on the first plane (i.e., the xoy plane), p represents the diameter of the concave cylindrical reflector, L represents the distance from the first viewing point and the second viewing point to the display module, and T represents the distance between the first viewing point and the second viewing point. The first viewing point and the second viewing point may be the positions of the left and right eyes of an observer.

[0090] Case 2: The concave cylindrical reflector array is a two-dimensional concave cylindrical reflector array.

[0091] FIG. 11 is a diagram of the structure of another concave cylindrical reflector array according to the present application. The concave cylindrical reflector array is a two-dimensional concave cylindrical reflector array. The concave surface of the concave cylindrical reflector in the two-dimensional concave cylindrical reflector array with respect to the first plane, and the projection of the concave surface close to the scattering layer is in an arc shape, and the projection of the concave surface with respect to the second plane is also in an arc shape. The concave surface may be a paraboloid, a spherical surface, an ellipsoidal surface, a hyperboloidal surface, etc. The vector height or x coordinate of the concave surface can be represented by using the following formula 5:

Number

[0092] Here, c is the curvature, k is the shape coefficient. When k < -1, the arc shape is a hyperboloid; when k = -1, the arc shape is a parabolic line; when -1 < k < 0, the arc shape is an ellipsoidal surface; when k = 0, the arc shape is a spherical surface; or when k > 0, the arc shape is a flat ellipsoidal surface.

[0093] Alternatively, the vector height or coordinates (x, y, z) of the concave surface can be expressed by using the following formula 6. In other words, polynomial terms can be added based on formula 5:

Number

[0094] Here, Σ i=1 N Σj=0 i A ij y j z i-j is a polynomial, A is the coefficients of the polynomial, and N is the degree of the polynomial (i.e., the maximal power series).

[0095] On this basis, the concave surface may be, for example, a spherical surface, an ellipsoidal surface, a hyperbolic surface, or any other possible surface type, which is not limited in this application.

[0096] Based on a two-dimensional concave cylindrical reflector array, the image formed by the image light has parallax and stereoscopic effect in a first direction, and also has parallax and stereoscopic effect in a second direction.

[0097] In a possible implementation, the concave surface of the concave cylindrical reflector in the concave cylindrical reflector array is covered with a reflective film, and the reflectivity of the reflective film is greater than a first reflectivity threshold and less than a second reflectivity threshold, so that the reflective film can reflect image light from the scattering layer and transmit ambient light, thereby realizing a 3D transparent display. The reflective film can also be understood as a partially reflective and partially transmissive reflective film. For example, the reflective film can include, but is not limited to, a nanometal film or a dielectric film, which can achieve partial reflection and partial transmission. For example, the reflectivity of the reflective film is greater than 0 and less than 100%.

[0098] Furthermore, optionally, the reflectance of the reflective film is related to the requirements for the transmittance of the reflective film. When the display module is applied in different scenarios, there are specific requirements for the transmittance of the reflective film. For example, when the display module is disposed on a windshield, the transmittance of the windshield must be greater than 70%. Therefore, the transmittance of the reflective film must be greater than 70%. In addition, since the sum of the reflectance and transmittance of the reflective film is equal to 100%, the reflectance of the reflective film is less than 30% and greater than 0. It can also be understood that the reflective film must satisfy the following requirements: the reflective film can transmit ambient light and reflect the received image light. In other words, the first reflectance threshold of the reflective film must allow the reflected image light to display a 3D image, and the second reflectance threshold of the reflective film must allow the transmitted ambient light to be used in the application scenario of the display module. For example, the reflectance of the reflective film can be set to be between 10% and 30%. In other words, the first reflectance threshold is equal to 10%, and the second reflectance threshold is equal to 30%. Based on the reflective film, the display module can realize a 3D transparent display.

[0099] The concave surface of the concave cylindrical reflector is filled with a filler material so as not to affect the propagation direction of the ambient light, and the refractive index of the filler material and the refractive index of the concave cylindrical reflector meet a preset tolerance requirement. Furthermore, the refractive index of the filler material is the same as the refractive index of the concave cylindrical reflector. The material of the filler material may be the same as or different from the material of the concave cylindrical reflector, but this is not limited in the present application. It can be understood that the influence of the reflective film on the propagation direction of the ambient light is negligible because the thickness of the reflective film is thin.

[0100] The concave cylindrical reflector array of Structure 1 above is used as the reflective layer, eliminating the need for a conventional transmissive cylindrical lens. The concave cylindrical reflector, covered with a reflective surface and filled with a filler layer on the concave surface, can be directly used, making the display module transparent to ambient light and realizing a 3D transparent display.

[0101] In the second configuration, the reflective layer comprises a holographic reflective dielectric layer.

[0102] In a possible implementation, the holographic reflective dielectric layer has angle selectivity. The holographic reflective dielectric layer can be stimulated only when the image light scattered by the scattering layer is radiated onto the holographic reflective dielectric layer from the entire surface. In other words, only the image light radiated onto the holographic reflective dielectric layer from the entire surface can be reflected (or diffracted) by the holographic reflective dielectric layer to the corresponding viewpoint. Most of the ambient light passes directly through the holographic reflective dielectric layer.

[0103] The holographic reflective dielectric layer can be fabricated by a holographic exposure method. The following provides two examples of fabricating a holographic reflective dielectric layer by a holographic exposure method.

[0104] Example 1: A holographic reflective dielectric layer is fabricated with a lens array by holographic exposure.

[0105] See Figure 12a. A second laser beam is emitted perpendicularly from one side onto the holographic reflective dielectric layer. A third laser beam is emitted from the other side onto the lens array, diffracted by the lens array, and then incident on the holographic reflective dielectric layer. The size of the lenses in the lens array is the same as the size of the concave cylindrical reflectors in the concave cylindrical reflector array of the display module, and the focal length of the lenses in the lens array is the same as the focal length of the concave cylindrical reflectors in the concave cylindrical reflector array of the display module. Based on this, a holographic reflective dielectric layer is obtained, and the image light scattered by the scattering layer can stimulate the holographic reflective dielectric layer, while most of the ambient light is directly transmitted.

[0106] In a possible implementation, the lens array may be a cylindrical lens array. The cylindrical lens array may be arranged in one dimension, and a non-one-dimensionally arranged cylindrical lens array may generate parallax and stereoscopic vision in a first direction. Alternatively, the cylindrical lens array may be arranged in two dimensions, and a two-dimensionally arranged cylindrical lens array may generate parallax and stereoscopic vision in both the first and second directions.

[0107] Example 2: A holographic reflective dielectric layer is fabricated with a reflector array by holographic exposure.

[0108] See Figure 12b. A fourth laser beam is incident perpendicularly on the holographic reflective dielectric layer from one side, transmitted to the concave reflector array, reflected by the concave reflector array, and then re-entered on the holographic reflective dielectric layer. The size of the concave reflectors in the concave reflector array is the same as the size of the concave cylindrical reflectors in the concave cylindrical reflector array of the display module, and the focal length of the concave reflectors in the concave reflector array is the same as the focal length of the concave cylindrical reflectors in the concave cylindrical reflector array of the display module. Based on this, the holographic reflective dielectric layer is obtained, and the image light scattered by the scattering layer can stimulate the holographic reflective dielectric layer, while most of the ambient light is directly transmitted.

[0109] The concave reflector array can be a cylindrical concave reflector array. For the arrangement method of the cylindrical concave reflector array, please refer to the above arrangement method of the cylindrical lens, and the details will not be described again here.

[0110] Based on the above Example 2, the holographic reflective dielectric layer is manufactured based on the third laser beam, which has low requirements for environmental vibration and low exposure cost. In addition, the thickness of the holographic reflective dielectric layer manufactured by the holographic exposure method is thin (e.g., <100 μm), which makes the display module lighter and thinner.

[0111] The holographic reflective dielectric layer manufactured according to the above Example 1 or Example 2 has a volume grating structure and strong angular selectivity. The holographic reflective dielectric layer is used as a reflective layer, and the optical path of the display module is shown in Figure 13. The image light emitted from the projector passes through the scattering layer and is scattered by the holographic reflective dielectric layer, stimulating the holographic reflective dielectric layer. The first image light is reflected by the holographic reflective dielectric layer to a first viewpoint, and the second image light is reflected by the holographic reflective dielectric layer to a second viewpoint. Most of the ambient light passes directly through the holographic reflective dielectric layer.

[0112] Based on the above-described structural and functional principles of the display module, the present application further provides an optical display system. Referring to FIG. 14, the optical display system includes a picture generation unit and a display module according to the above-described embodiment. The picture generation unit is configured to emit different image lights. In this example, the picture generation unit emits first image light and second image light, and the scattering layer included in the display module is shown in FIG. 5a, and the reflective layer included in the display module is shown in FIG. 6. For details, please refer to the relevant descriptions above. Details will not be described again here. The first image light emitted by the picture generation unit passes through the display module and converges to a first viewing point, and the second image light emitted by the picture generation unit passes through the display module and converges to a second viewing point, allowing ambient light to pass through the display module, thereby realizing a 3D transparent display.

[0113] In a possible implementation, the picture generation unit includes a light source component and a light modulation component. The light source component is configured to emit a first light beam and a second light beam. The light modulation component is configured to modulate the first light beam to obtain a first image light carrying first image information and modulate the second light beam to obtain a second image light carrying second image information. Specifically, the light modulation component may load (or modulate) the first image information onto the first light beam to obtain the first image light carrying image information and load the second image information onto the second light beam to obtain the second image light carrying image information. The first light beam and the second light beam are also referred to as light carriers.

[0114] For example, the light source component may be, for example, a laser diode (LD), a light-emitting diode (LED), a vertical cavity surface emitting laser (VCSEL), an edge emitting laser (EEL), a diode pumped solid state laser (DPSS), or an optical fiber laser. It can be understood that the above light source components are merely examples, and this is not limiting in the present application. The light modulation component may be, for example, a reflective liquid crystal on silicon (LCOS) display, a liquid crystal display (LCD), a digital light processing (DLP) display, a laser beam scanning (LBS) display, an organic light emitting diode (OLED), a micro light emitting diode (micro-LED), an active-matrix organic light emitting diode (AMOLED), a flexible light emitting diode (FLED), a quantum dot light emitting diode (QLED), a reflective display based on a digital micro-mirror device (DMD), etc. Note that the above light modulation components are merely examples and are not limiting in this application. Other components capable of performing image information modulation on the first light beam and the second light beam also fall within the scope of protection of this application.

[0115] For example, the picture generation unit may be, for example, a projector.

[0116] Based on the above content and the same concept, the present application provides an image display method. Please refer to the description of Fig. 15. The image display method may be applied to the display module shown in any one of the embodiments of Fig. 2 to Fig. 13, or to the optical display system shown in Fig. 14. It can also be understood that the image display method may be implemented by using the display module shown in any one of the embodiments of Fig. 2 to Fig. 13, or the image display method may be implemented based on the optical display system shown in Fig. 14.

[0117] 15 shows an image display method according to the present application. The method includes the following steps:

[0118] Step 1501: The coordinates of the first viewpoint and / or the second viewpoint are obtained.

[0119] For example, the coordinates of the first viewpoint are (x1, y1) and the coordinates of the second viewpoint are (x2, y2). For example, the left and right eyes of an observer may be located at the first viewpoint and the second viewpoint.

[0120] In a possible implementation, the coordinates of the first viewpoint and the coordinates of the second viewpoint may be eye coordinates by default.

[0121] In another possible implementation, the first viewpoint and the second viewpoint may be the positions of the observer's eyes, and the coordinates of the eye positions may be obtained by an eye tracker. Eye tracking refers to tracking eye movements by measuring the position of the eye gaze point or the movement of the eye relative to the head. The eye tracker is a device capable of tracking and measuring eye position and eye movement information. The eye tracker can track and output the position coordinates of both eyes of the observer in real time. For example, the eye tracker may include, but is not limited to, a camera (e.g., a driver monitor system (DMS) camera), an infrared transmitter, or an infrared detector.

[0122] Step 1502: Determine K eye relief distances based on the coordinates of the first viewpoint and / or the second viewpoint and the coordinates of K target positions within the display area on the windshield.

[0123] The K target positions are in one-to-one correspondence with the K rows of the image projected onto the display area. In other words, one row of the image projected onto the display area may correspond to one target position on the windshield. See FIG. 16a. Three target positions (target position 1, target position 2, and target position 3) on the windshield are used as an example. The coordinates of the three target positions are (X1, Y1, Z1) for target position 1, (X2, Y2, Z2) for target position 2, and (X3, Y3, Z3) for target position 3, respectively. The coordinates of the three target positions correspond to three different rows of the image. It may be understood that the coordinates of the target positions in the display area on the windshield may be stored in advance.

[0124] The eye relief distance is the distance between the first viewpoint (or second viewpoint) and the target position within the viewing area on the windshield. isatisfies the following equation 7. It can be seen that the ER on the same plane is the same, see Figure 16b. Therefore, the ER is the same for the left and right eyes of an observer.

number

[0125] It can be understood that if the coordinates of the first viewpoint are obtained in step 1501, the coordinates of the first viewpoint may be used in Equation 7, if the coordinates of the second viewpoint are obtained in step 1501, the coordinates of the second viewpoint may be used in Equation 7, and if the coordinates of the first viewpoint and the second viewpoint are obtained in step 1501, the average value of the coordinates of the first viewpoint and the second viewpoint may be used in Equation 7.

[0126] Based on the above equation 7, the eye relief distance ER1, the eye relief distance ER2, and the eye relief distance ER3 can be determined.

[0127] In a possible implementation, the parallax between the first and second viewpoints, the eye relief distance, and the virtual image distance satisfy the following equation 8:

number

[0128] where ΔP i is the parallax between the first and second viewpoints in the ith row, VID is the virtual image distance, and ER i is the eye relief distance of the i-th row, and T is the distance between the first and second viewpoints. If the coordinates of the first and second viewpoints are for the left and right eyes of an observer, T is the distance between the observer's eyes, which is typically 65 millimeters (mm).

[0129] Step 1503: Control the display of the image by adjusting the parallax of K rows of the image.

[0130] Since the windshield is tilted, the image seen by the observer is also tilted. To observe an untilted image, the virtual image distance VID corresponding to each row must be the same. Based on Equation 8 above, the parallax ΔP1 between the first and second viewpoints in the first row, the parallax ΔP2 between the first and second viewpoints in the second row, and the parallax ΔP3 between the first and second viewpoints in the third row can be determined. See Figure 16a. Therefore, to observe an untilted image, the parallax ΔP i can be observed by adjusting

[0131] Based on the above steps 1501 to 1503, the display of a non-tilted image can be controlled by adjusting the parallax of each row. In other words, based on the above method, the display of a tilted 3D image caused by a tilted windshield can be corrected.

[0132] In a possible implementation, if the user needs to adjust the image formation position, the user first inputs the target VID, and then calculates the parallax ΔP based on the target VID according to the above Equation 8, in order to display the image at the image formation position required by the user. i The parallax ΔP can be adjusted. i If increases, the image formation distance increases (i.e., the virtual image distance increases), or the parallax ΔP i If is reduced, the image formation distance is reduced (i.e., the virtual image distance is reduced).

[0133] The image display method may be performed by a control module, which may belong to the optical display system or may be independent of the optical display system. For example, the control module may include a processor. The processor may be a circuit having a signal (or data) processing function. In one implementation, the processor may be a circuit having a function of reading and executing instructions, such as a central processing unit (CPU), a microprocessor, a graphics processing unit (GPU) (which may also be understood as a microprocessor), or a digital signal processor (DSP). In another implementation, the processor may implement a specific function based on the logical relationships of a hardware circuit. The logical relationships of the hardware circuit may be fixed or reconfigurable. For example, the processor may be a hardware circuit implemented by an application-specific integrated circuit (ASIC) or a programmable logic device (PLD), such as a field programmable gate array (FPGA). In a reconfigurable hardware circuit, the process of a processor loading a configuration document to implement the hardware circuit configuration can be understood as the processor loading instructions to implement some or all of the functions of the above units. Alternatively, the processor may be a hardware circuit designed for artificial intelligence, and can be understood as an ASIC, such as a neural network processing unit (NPU), a tensor processing unit (TPU), or a deep learning processing unit (DPU).For example, the processor may be an application processor (AP), an image signal processor (ISP), another programmable logic device, a transistor logic device, a hardware component, or any combination thereof.

[0134] If the optical display system resides in a vehicle, the control module may be an in-vehicle domain processor, an in-vehicle electronic control unit (ECU), and so on.

[0135] Based on the above, Figure 17 is a circuit diagram of an optical display system according to the present application. The circuit of the optical display system mainly includes a processor 1701, an external memory interface 1702, an internal memory 1703, an audio module 1704, a video module 1705, a power module 1706, a wireless communication module 1707, an input / output (I / O) interface 1708, a video interface 1709, a display circuit 1710, a modulator 1711, a light source 1712, etc. The processor 1701 may be connected to its peripheral components, such as the external memory interface 1702, the internal memory 1703, the audio module 1704, the video module 1705, the power module 1706, the wireless communication module 1707, the I / O interface 1708, the video interface 1709, and the display circuit 1710, via a bus.

[0136] It should be noted that the circuit diagrams herein do not constitute specific limitations on the optical display system. In some alternative embodiments herein, the optical display system may include fewer or more components than those shown, or may include a combination of some components, or may be separated into some components, or may have a different component layout. The components shown may be implemented using hardware, software, or a combination of software and hardware.

[0137] The processor 1701 includes one or more processing units. A processing unit may be a circuit with signal (or data) processing capabilities. For details, please refer to the relevant descriptions above. Details will not be described again here. Different processing units may be independent components or may be integrated into one or more processors.

[0138] A memory may also be disposed in the processor 1701 and configured to store instructions and data. In some embodiments, the memory in the processor 1701 is a cache. The memory may store instructions or data used or cyclically used by the processor 1701. When the processor 1701 needs to use the instructions or data again, the processor 1701 may retrieve the instructions or data directly from the memory. This avoids repeated accesses and reduces the latency of the processor 1701, thereby improving the efficiency of the optical display system. The processor 1701 may execute the stored instructions to perform the image formation method described above.

[0139] In some embodiments, the optical display system may further include a plurality of input / output (I / O) interfaces 1708 coupled to the processor 1701. The I / O interfaces 1708 may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, a universal serial bus (USB) interface, and / or the like. The I / O interface 1708 may be connected to devices such as a mouse, touchpad, keyboard, camera, speaker / loudspeaker, or microphone, or may be connected to physical buttons of the optical display system (e.g., volume buttons, brightness adjustment buttons, or power on / off button).

[0140] The external memory interface 1702 may be configured to connect to an external memory card, such as a microSD card, to expand the storage capabilities of the optical display system. The external memory card communicates with the processor 1701 through the external memory interface 1702 to implement data storage functions.

[0141] The internal memory 1703 may be configured to store computer-executable program code, where the executable program code includes instructions. The internal memory 1703 may include a program storage area and a data storage area. The program storage area may store an operating system, applications required by at least one function, etc. The data storage area may store data generated during use of the optical display system. The internal memory 1703 may also include random access memory (RAM), flash memory, universal flash storage (UFS), read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), registers, a hard disk, a removable hard disk, a CD-ROM, or any other form of storage medium well known in the art. The processor 1701 performs various functional applications and data processing for the optical display system by executing instructions stored in the internal memory 1703 and / or instructions stored in memory located in the processor 1701. For example, a storage medium may be coupled to the processor, thereby enabling the processor to read information from and write information to the storage medium. In another example, the storage medium may alternatively be a component of the processor. The processor and the storage medium may be located in an ASIC. Alternatively, the ASIC may be located in the optical display system. Indeed, the processor and the storage medium may exist as separate components in the optical display system.

[0142] The optical display system may implement audio functionality such as music playback or recording via an audio module 1704, an application processor, or the like.

[0143] The audio module 1704 is configured to convert digital audio information into analog audio signals for output, and to convert analog audio signals into digital audio signals. The audio module 1704 may be further configured to encode and decode audio signals, for example, to perform audio playback or recording. In some embodiments, the audio module 1704 may be located in the processor 1701, or some functional modules of the audio module 1704 may be located in the processor 1701.

[0144] The video interface 1709 can receive externally input audio and video signals, and may be, for example, a high-definition multimedia interface (HDMI), a digital visual interface (DVI), a video graphics array (VGA), a display port (DP), etc. Alternatively, the video interface 1709 can output video. When the optical display system is used as a head-up display, the video interface 1709 can receive speed and power signals input by surrounding devices, and can also receive externally input AR video signals. When the optical display system includes a projector, the video interface 1709 can receive video signals input by an external computer or terminal device.

[0145] The video module 1705 may decode video input via the video interface 1709, for example, performing H.264 decoding. The video module may also encode video collected by the optical display system, for example, performing H.264 encoding on video collected by an external camera. The processor 1701 may also decode video input via the video interface 1709 and then output the decoded image signal to the display circuit 1710.

[0146] The power module 1706 is configured to supply power to the processor 1701 and the light source 1712 based on input electricity (e.g., direct current). The power module 1706 includes a rechargeable battery, which may supply power to the processor 1701 and the light source 1712. The light emitted by the light source 1712 may be transmitted to the modulator 1711 for image formation to form an image light signal.

[0147] The wireless communication module 1707 enables the optical display system to communicate wirelessly with the outside world and may provide wireless local area networks (WLANs) (e.g., wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite systems (GNSS), frequency modulation (FM), near-field communication (NFC) technology, infrared (IR) technology, etc. The wireless communication module 1707 may be one or more components incorporating at least one communication processor module. The wireless communication module 1707 receives electromagnetic waves through an antenna, performs frequency modulation and filtering on the electromagnetic wave signals, and transmits the processed signals to the processor. The wireless communication module 1707 may also receive signals to be transmitted from the processor 1701, frequency modulate and amplify the signals, and convert the signals into electromagnetic waves for emission by the antenna.

[0148] In addition to inputting the video data decoded by the video module 1705 through the video interface 1709, the video data decoded by the video module 1705 may alternatively be received wirelessly through the wireless communication module 1707 or read from an external memory. For example, the optical display system may receive video data from a terminal device or an in-car entertainment system through an in-car wireless local area network, and the optical display system may also receive audio and video data stored in an external memory.

[0149] The display circuit 1710 and the modulator 1711 are configured to display a corresponding image. In this embodiment, the video interface 1709 receives an externally input video source signal. The video module 1705 outputs one or more image signals to the display circuit 1710 after decoding and / or digitizing the signal. The display circuit 1710 drives the modulator 1711 based on the input image signal to form an image on the input modified signal and output at least two paths of image light. The main processor 1701 may also output one or more image signals to the display circuit 1710.

[0150] For example, the optical display system may include, but is not limited to, a system formed by a HUD, a windshield, a display, an in-vehicle display, an AR device, a VR device, etc. The AR device may include, but is not limited to, AR glasses, an AR helmet, etc. The VR device may include, but is not limited to, VR glasses, a VR helmet, etc.

[0151] Based on the above-described structural and functional principles of the optical display system, the present application further provides a terminal device. The terminal device may include any one of the optical display systems described above. For example, the terminal device may be a vehicle (e.g., an unmanned vehicle, a smart vehicle, an electric vehicle, or a digital vehicle), a robot, a surveying and mapping device, an unmanned aerial vehicle, a smart home device (e.g., a television, a robot vacuum cleaner, a smart desk lamp, a sound system, a smart lighting system, a home appliance control system, home background music, a home theater system, an intercom system, or a video surveillance device), a smart manufacturing device (e.g., an industrial device), a smart transportation system (e.g., an AGV, an unmanned guided vehicle, or a truck), or a smart terminal (e.g., a mobile phone, a computer, a tablet computer, a palmtop computer, a desktop computer, a headset, an audio device, a wearable device, an in-vehicle device, a virtual reality device, or an augmented reality device).

[0152] For example, the terminal device is a vehicle. FIG. 18 is an example of a functional block diagram of a vehicle according to the present application. Components coupled to or included in the terminal device 1800 may include a propulsion system 1801, a sensing system 1802, a control system 1803, a computer system 1804, a user interface 1805, and an optical display system 1806. The components of the terminal device 1800 may be configured to operate in interconnection with each other and / or with other components coupled to each system. For example, the computer system 1804 may be configured to receive and control data from the propulsion system 1801, the sensing system 1802, the control system 1803, etc. The computer system 1804 may be further configured to generate a display of an image on the user interface 1805 and receive input from the user interface 1805.

[0153] The propulsion system 1801 may supply power to the terminal device 1800 for movement. The propulsion system 1801 may include an engine / drive engine, an energy source, a transmission, wheels / tires, etc. Additionally, or alternatively, the propulsion system 1801 may include other components in addition to the components shown in Fig. 18 , which is not particularly limited in this application.

[0154] The sensing system 1802 may include several sensors configured to detect information about the environment in which the terminal device 1800 is located. For example, the sensors of the sensing system 1802 may include, but are not limited to, a global positioning system (GPS), an inertial measurement unit (IMU), a millimeter-wave radar, a lidar, a camera, and a brake configured to change the position and / or orientation of the sensor. The millimeter-wave radar may detect targets in the environment surrounding the terminal device 1800 through radio signals. In some embodiments, in addition to detecting targets, the millimeter-wave radar may be further configured to detect the speed and / or direction of movement of the targets. The lidar may detect targets in the environment in which the terminal device 1800 is located based on a laser. In some embodiments, the lidar may include one or more laser sources and one or more detectors, as well as other system components. The camera may be configured to capture multiple images of the environment surrounding the terminal device 1800. The camera may be a still camera or a video camera. In some embodiments, the GPS may be any sensor configured to estimate the geographic position of the terminal device 1800. Thus, the GPS may include a transceiver configured to estimate the position of the terminal device 1800 relative to the Earth based on satellite positioning data. In some possible examples, the computer system 1804 may be configured to use the GPS to reference map data to estimate the path the terminal device 1800 is traveling. The IMU may be configured to detect changes in the position and orientation of the terminal device 1800 based on inertial acceleration and any combination thereof. In some examples, the combination of sensors in the IMU may include, for example, an accelerometer and a gyroscope. Other combinations of sensors in the IMU are also possible.

[0155] It may be understood that the sensing system 1802 may further include sensors of the internal systems of the terminal device 1800 being monitored (e.g., an on-board air quality monitor, a fuel gauge, or an engine oil temperature gauge). Sensor data from one or more of these sensors may be used to detect objects and corresponding characteristics of the objects (position, shape, orientation, speed, etc.). Such detection and recognition is an important function for the safe operation of the terminal device 1800. The sensing system 1802 may further include other sensors, which are not particularly limited in this application.

[0156] The control system 1803 controls the operation of the terminal device 1800 and its components. The control system 1803 may include various elements, including a steering unit, a throttle, a braking unit, a sensor fusion algorithm, a computer vision system, a route control system, and an obstacle avoidance system. The steering system may be operated to adjust the direction of movement of the terminal device 1800. For example, in an embodiment, the steering unit may be a steering wheel system. The throttle is configured to control the operating speed of the engine and thus the speed of the terminal device 1800. The control system 1803 may additionally or alternatively include other components other than those shown in FIG. 18 . This is not particularly limited in this application. The braking unit is configured to control the deceleration of the terminal device 1800. The braking unit may decelerate the wheels by using friction. In another embodiment, the braking unit may convert the kinetic energy of the wheels into electric current. Alternatively, the braking unit may reduce the rotational speed of the wheels in other ways to control the speed of the terminal device 1800. The computer vision system may be operated to process and analyze images captured by the camera to recognize targets and / or features in the environment surrounding the terminal device 1800. Targets and / or features may include traffic signals, road boundaries, and obstacles. The computer vision system may use target recognition algorithms, structure from motion (SFM) algorithms, video tracking, and other computer vision techniques. In some embodiments, the computer vision system may be configured to map the environment, track targets, estimate target speeds, etc. The route control system is configured to determine a driving route for the terminal device 1800. In some embodiments, the route control system may combine the sensing system 1802, GPS, and one or more predetermined map data to determine a driving route for the terminal device 1800.The obstacle avoidance system is otherwise configured to identify, evaluate, and avoid or circumvent potential obstacles in the environment of the terminal device 1800. Indeed, in examples, the control system 1803 may include additional or alternative components in addition to those shown and described. Alternatively, the control system 1803 may exclude some of the components described above.

[0157] Some or all of the functionality of terminal device 1800 is controlled by computer system 1804. Computer system 1804 may include at least one processor 18041, and may further include interface circuitry 18042. Processor 18041 executes instructions stored on a non-transitory computer-readable medium, such as memory 18043. Computer system 1804 may alternatively be multiple computing devices controlling individual components or subsystems of terminal device 1800 in a distributed manner.

[0158] The processor 18041 may be a circuit with signal (or data) processing capabilities. For details, please refer to the related descriptions above. The details will not be described again here.

[0159] 18 functionally represents the processor, memory, and other elements of computer system 1804 in the same block, those skilled in the art will understand that a processor or memory may actually include multiple processors or memories that are not maintained in the same physical enclosure. For example, memory may be a hard disk drive or other storage medium located in a different enclosure than that of computer system 1804. Unlike using a single processor to perform the steps described herein, some components, such as the steering component and the deceleration component, may each include a respective processor that performs only calculations related to the component's specific function. As another example, a processor may alternatively be remote from the vehicle but in wireless communication with the vehicle.

[0160] In some embodiments, memory 18043 includes instructions (e.g., program logic) that can be read by processor 18041 to perform various functions of terminal device 1800, including those described above. Memory 18043 may also include additional instructions, including instructions for transmitting data to, receiving data from, interacting with, and / or controlling one or more of propulsion system 1801, sensing system 1802, and control system 1803. In addition to instructions, memory 18043 may also store data, such as road maps, route information, data detected by sensors, location, direction, vehicle speed, other vehicle data, and other information. Such information can be used by terminal device 1800 and computer system 1804 when terminal device 1800 operates in autonomous mode, semi-autonomous mode, and / or manual mode.

[0161] For details about the memory, please refer to the description of the internal memory 1703 in Figure 17. The details will not be described again here.

[0162] User interface 1805 is used to provide information to or receive information from a user of terminal device 1800. Optionally, user interface 1805 may include one or more input / output devices from a set of peripherals, which may include, for example, a wireless communication system, a touchscreen, a microphone, and / or a speaker.

[0163] Computer system 1804 may control the functions of terminal device 1800 based on inputs received from various subsystems (e.g., propulsion system 1801, sensing system 1802, and control system 1803) and from user interface 1805. For example, computer system 1804 may use inputs from control system 1803 to control a steering unit to avoid obstacles detected by sensing system 1802 and the obstacle avoidance system. In some embodiments, computer system 1804 may be operated to provide control over many aspects of terminal device 1800 and its subsystems.

[0164] For the optical display system 1806, please refer to the description of any one of the above embodiments. Details will not be described again here. Note that the functions of some elements of the optical display system may alternatively be implemented by other subsystems of the vehicle. For example, the controller may alternatively be an element of the control system.

[0165] Optionally, one or more of the above components may be separately installed in or associated with terminal device 1800. For example, memory 18043 may exist partially or completely separate from terminal device 1800. The above components may be communicatively coupled in a wired and / or wireless manner.

[0166] It should be noted that the functional framework of the terminal device provided in Figure 18 is merely an example. In other examples, the terminal device 1800 may include more, fewer, or different systems, and each system may include more, fewer, or different components. Also, the systems and components shown may be combined or divided in any manner, and this is not a limitation of the present application.

[0167] The method steps of the embodiments of the present application may be implemented in a hardware manner, or may be implemented in a manner in which software instructions are executed by a processor. The software instructions may include corresponding software modules, which may be stored in a storage module. For the storage medium, please refer to the above description of the memory 18043. Details will not be described again here. For example, the storage medium may be coupled to the processor, thereby allowing the processor to read information from and write information to the storage medium. Indeed, the storage medium may be a component of the processor.

[0168] All or part of the above embodiments may be implemented using software, hardware, firmware, or any combination thereof. When software is used to implement the embodiments, all or part of the embodiments may be implemented in the form of a computer program product. The computer program product includes one or more computer programs and instructions. When the computer programs or instructions are loaded and executed on a computer, all or part of the processes or functions of the embodiments of the present application are executed. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer program or instructions may be stored in a computer-readable storage medium or transmitted from a computer-readable storage medium to another computer-readable storage medium. For example, the computer program or instructions may be transmitted from a website, computer, server, or data center to another website, computer, server, or data center via a wired or wireless manner. The computer-readable storage medium may be any available medium accessible by a computer or a data storage device, such as a server or data center, incorporating one or more available media. The usable medium may be a magnetic medium, such as a floppy disk, hard disk, or magnetic tape, an optical medium, such as a digital video disc (DVD), or a semiconductor medium, such as a solid-state drive (SSD).

[0169] In various embodiments of the present application, unless otherwise stated or there is no logical contradiction, the terms and / or descriptions in different embodiments are consistent and can be cross-referenced, and the technical features in different embodiments may be combined based on their internal logical relationships to form new embodiments.

[0170] As used herein, "uniformity" does not mean absolute uniformity and may be subject to certain engineering tolerances. "Perpendicular" does not mean absolute perpendicularity and may be subject to certain engineering tolerances. "At least one" means one or more, and "plurality" means two or more. The term "and / or" refers to an association relationship describing related objects and indicates that three relationships may exist. For example, A and / or B can refer to the following three cases: only A is present, both A and B are present, and only B is present, where A and B alone may be singular or plural. "At least one of the following items (moieties)" or similar expressions refers to any combination of these items, including only one item (moiety) or any combination of multiple items (moieties). For example, "at least one of a, b, or c" can refer to a, b, c, a and b, a and c, b and c, or a, b, and c, where a, b, and c may be singular or plural. In the text of this application, the character " / " generally represents an "or" relationship between related objects. In formulas herein, the character " / " indicates a "division by" relationship between related objects. The term "for example" is also used herein to indicate providing an example, illustration, or explanation. Any embodiment or design scheme described herein as an "example" should not be described as preferred or having more advantages than other embodiments or design schemes. Alternatively, the term "example" is used to specifically present concepts and should not be construed as limiting the present invention.

[0171] It should be understood that various numbers herein are used merely for distinction purposes to facilitate description and are not intended to limit the scope of the embodiments of the present application. The sequence numbers of the above processes do not imply an execution order, and the execution order of the processes should be determined based on the functions and internal logic of the processes. Terms such as "first," "second," etc. are used to distinguish between similar objects, but do not necessarily indicate a particular order or sequence. Furthermore, the terms "comprise," "have," and any variations thereof are intended to cover non-exclusive inclusions, for example, to include a series of steps or units. A method, system, product, or device is not necessarily illustrated or limited to the explicitly listed steps or units, and may include other steps or units that are inherent to such a process, method, product, or device or that are not explicitly listed.

[0172] The above description is merely a specific example of the present application and is not intended to limit the scope of protection of the present application. Any modifications or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in the present application should fall within the scope of protection of the present application. Therefore, the scope of protection of the present application should be governed by the claims.

Claims

1. a scattering layer and a reflective layer; the scattering layer is configured to receive different image lights from a picture generating unit and scatter the different image lights to corresponding positions on the reflective layer, the image lights carrying image information; the reflective layer is configured to reflect the image light from a corresponding position on the scattering layer to a corresponding viewpoint and transmit ambient light. Display module.

2. the reflective layer comprises an array of concave cylindrical reflectors; a surface of a concave cylindrical reflector of the concave cylindrical reflector array, the surface being close to the scattering layer, and the concave surface being covered with a reflective film; The module of claim 1 .

3. a projection of the concave surface near the scattering layer onto at least a first plane in the shape of a circular arc; The module of claim 2 .

4. The reflectance of the reflective film is greater than a first reflectance threshold and less than a second reflectance threshold.

4. A module according to claim 2 or 3.

5. The reflectivity of the reflective film is related to the transmittance requirements of the reflective film. The module of claim 4.

6. The reflective film has a nano-metal film or a dielectric film. A module according to any one of claims 2 to 5.

7. the concave surface is filled with a filler material, and the refractive index of the filler material and the refractive index of the concave cylindrical reflector meet a preset tolerance requirement; A module according to any one of claims 2 to 6.

8. The refractive index of the filler is the same as the refractive index of the concave cylindrical reflector. The module of claim 7.

9. the concave cylindrical reflector array is a one-dimensional array, and one concave cylindrical reflector of the concave cylindrical reflector array corresponds to N columns of areas of the scattering layer, the N columns of areas being used to receive different image light, and N is an integer greater than 1; A module according to any one of claims 2 to 8.

10. the concave cylindrical reflector array is a two-dimensional array, and one concave cylindrical reflector of the concave cylindrical reflector array corresponds to one area of ​​the scattering layer; A module according to any one of claims 2 to 8.

11. The reflective layer comprises a holographic reflective dielectric layer. The module of claim 1 .

12. the incident angle at which the image light scattered at the corresponding position of the reflective layer is emitted into the scattering layer is within a preset angle range; A module according to any one of claims 1 to 11.

13. The scattering layer is obtained by holographic exposure. A module according to any one of claims 1 to 12.

14. a picture generation unit; and a display module according to any one of claims 1 to 13, the picture generation unit is configured to emit different image lights; Optical display system.

15. the polarization states of the different image lights are the same; The system of claim 14.

16. the picture generation unit comprises a projector; 16. A system according to claim 14 or 15.

17. A terminal device comprising an optical display system according to any one of claims 14 to 16, the optical display system is mounted on the terminal device; Terminal device.

18. obtaining coordinates of a first viewpoint and / or a second viewpoint; determining K eye relief distances based on the coordinates of the first viewpoint and / or the second viewpoint and coordinates of K target positions within a display area of ​​the windshield, wherein the K target positions are in one-to-one correspondence with the K rows of the image projected onto the display area, and the parallax, eye relief distance, and virtual image distance between the first viewpoint and the second viewpoint satisfy a correspondence relationship; controlling the display of the image by adjusting the parallax of the K rows of the image; An image display method comprising:

19. The correspondence is ΔP ｉ = {(VID-ER ｉ ) / VID}·T is satisfied, ΔP ｉ is the parallax between the first and second viewpoints in the i-th row, T is the distance between the first and second viewpoints, V is the virtual image distance, and ER ｉ is the eye relief distance of the i-th row, 20. The method of claim 18.

20. storing a computer program or instructions, which, when executed by a control device, enable said control device to carry out the method according to any one of claims 18 to 19; A computer-readable storage medium.

Images