Three-dimensional display module based on orthogonal characteristic pointing control unit array

Abstract

The present invention discloses a three-dimensional display module based on an array of orthogonal characteristic pointing control units, including a pointing control unit array, a controllable light valve array, a control device, and a backlight assembly. The pointing control unit array is composed of pointing control units, which are divided into at least one pointing control unit group; the controllable light valve array is composed of controllable light valves, which are divided into at least one controllable light valve group; each controllable light valve group corresponds to at least one pointing control unit group. A controllable light valve group and a pointing control unit group corresponding to each other are constructed into a viewing area projection structure, and each pointing control unit thereof projects the viewing area to the pupil of the observer by regulating the incident light or the outgoing light of the corresponding controllable light valve to implement three-dimensional display. In the same viewing area projection structure, the pointing control unit and the controllable light valve are configured to have orthogonal characteristics to suppress the light information crosstalk between the pointing control units and the controllable light valves that do not correspond to each other.

Description

Technical Field

[0001] The present invention relates to the field of three-dimensional display technology, and more specifically to a three-dimensional display module based on an orthogonal characteristic pointing control unit array. Background Art

[0002] Compared with traditional two-dimensional display, three-dimensional display can provide more dimensional information and is receiving more and more attention. A three-dimensional display system that sets a micro-modulation device for each pixel or sub-pixel and generates multiple viewing zones by directional traction of the light beam projected by each pixel (sub-pixel) has attracted attention due to its light and thin optical structure and flexible viewing zone control capabilities. However, the diffraction light caused by the small size structure of pixels (sub-pixels) and micro-modulation devices, including the divergent light corresponding to the divergence angle of the pixel (sub-pixel) output light, introduces crosstalk between non-corresponding pixels (sub-pixels) and micro-modulation devices, affecting the display quality. Summary of the invention

[0003] The present invention proposes a three-dimensional display module based on an array of orthogonal characteristic pointing control units, with controllable light valves as equivalent display pixels (sub-pixels), and each controllable light valve is correspondingly provided with a pointing control unit to control the direction of the incident light or the outgoing light of each controllable light valve, so as to realize the projection of multiple visual zones. Among them, several adjacent pointing control units activated at the same time are configured to allow only the light of different orthogonal characteristics corresponding to each other to pass through, and at the same time, each controllable light valve is configured to allow only the light of corresponding orthogonal characteristics to pass through. Thus, based on the orthogonal characteristic design, the crosstalk between non-corresponding controllable light valves and pointing control units is suppressed. The three-dimensional display module based on the array of orthogonal characteristic pointing control units can directly project views to the two pupils of the observer respectively, and can also be used as an eyepiece to build a binocular display system based on two display modules corresponding to the two eyes of the observer respectively. The distance between the viewing zones projected to each pupil of the observer can be greater than or equal to the pupil diameter of the observer, so as to perform three-dimensional display based on stereoscopic technology or Maxwellian View; the distance between the viewing zones projected to each pupil of the observer can also be less than the pupil diameter of the observer in at least one direction, so as to perform three-dimensional display based on super-multi-view technology. Among them, stereoscopic technology and Maxwellian View are three-dimensional display technologies that project a view to each pupil of the observer, that is, a single-eye single-image display technology. In stereoscopic technology, the size of the viewing zone corresponding to each view is greater than the pupil size of the observer, but in Maxwellian View, the size of the viewing zone corresponding to each view is less than the pupil size of the observer. The light distribution area of ​​the one viewing zone is often set to: the union of the areas covered by the light whose intensity of any light beam contained in the corresponding view of the viewing zone is not less than 50% of the maximum value of the light intensity on the viewing zone surface. Super-multi-view is a monocular multi-image display technology that projects more than one image to any pupil of the observer. Stereoscopic technology has a focus-convergence conflict problem, and Maxwellian View and super-multi-view are developed to solve this focus-convergence conflict problem. Among them, Maxwellian View is also often referred to as retinal projection technology. It uses the small divergence angle of the projected light beam to reduce the constraints of the light beam exit point (pixel, or sub-pixel, or their image) on the observer's eye focus point, and achieves the consistency of each eye's focus point with the binocular convergence point through the coupling traction of binocular convergence to the monocular focus; in super-multiple views, through each display object point, more than one light beam passes through different viewing areas and enters any pupil of the observer. The superimposed light intensity of the more than one light beam at the display object point, combined with the coupling traction of binocular convergence to the monocular focus, drives the consistency of the monocular focus distance and the binocular convergence distance.

[0004] The present invention provides the following solutions:

[0005] A three-dimensional display module based on an orthogonal characteristic pointing control unit array, comprising:

[0006] A pointing control unit array, the pointing control unit array is composed of pointing control units capable of modulating the exit direction of an incident light beam, all pointing control units of the pointing control unit array are divided into M pointing control unit groups, and in the same pointing control unit group, adjacent O pointing control units correspond to each other and only allow O types of orthogonal characteristic light to exit, and each pointing control unit blocks the exit of non-corresponding (O-1) types of orthogonal characteristic light, wherein M≧1, O≧2;

[0007] A controllable light valve array, the controllable light valve array is composed of controllable light valves that can controllably change the output rate of incident light, and all controllable light valves in the controllable light valve array are divided into N controllable light valve groups, where N≧1;

[0008] Any one of the pointing control unit groups of the pointing control unit array is arranged to correspond to at least one controllable light valve group of the controllable light valve array, and a pointing control unit group and a controllable light valve group corresponding to each other form a viewing zone projection structure, with a total of K viewing zone projection structures, where K≧1;

[0009] Wherein, in the same viewing zone projection structure, each controllable light valve only allows the light of the orthogonal characteristic corresponding to the corresponding direction control unit to be emitted, and each direction control unit controls the direction of the incident light or the emitted light of the corresponding controllable light valve to guide the generation of Z viewing zones, and an image can be observed through each of the Z viewing zones, where Z≧1;

[0010] A control device, which can be connected to the directional control unit array and the controllable light valve array respectively and control the incident light emission rate of each controllable light valve to correspond to the projection light information intensity of the scene to be displayed along the corresponding sagittal direction at any time point,

[0011] The corresponding vector direction of any controllable light valve of the controllable light valve array is the transmission vector direction when the light beam projected by the controllable light valve enters the area where the pupil of the observer is located;

[0012] A backlight assembly, which, under the control of the control device, can project backlight along T directions to the orthogonal characteristic pointing control unit array or the controllable light valve array, wherein T≧1;

[0013] When K>1, the control device sequentially activates the K visual zone projection structures for visual zone projection, or the three-dimensional display module based on the orthogonal characteristic pointing control unit array further includes a pupil tracking device connected to the control device, and according to the pupil position of the observer determined by the pupil tracking device, the control device only activates one visual zone projection structure or the control device sequentially activates K1 visual zone projection structures for visual zone projection, wherein 1 <K1<K;

[0014] The activation of a visual zone projection structure refers to the visual zone projection of the visual zone projection structure based on a backlight in one direction, or the visual zone projection based on backlights in different directions at multiple time points and time sequences;

[0015] The three-dimensional display module based on the orthogonal characteristic pointing control unit array is configured to project at least two viewing areas.

[0016] In one embodiment, the viewing zones corresponding to the same pupil of the observer are spaced apart in at least one direction less than the diameter of the observer's pupil.

[0017] In one embodiment, the viewing zones corresponding to the same pupil of the observer are arranged with a gradient viewing zone spacing along at least one direction.

[0018] In one embodiment, the orthogonal characteristics are timing characteristics activated at different time points in a time period, or two linear polarization characteristics with mutually perpendicular polarization directions, or two rotational polarization characteristics for left-handed light and right-handed light, or color characteristics corresponding to different wavelengths, or a combination of any two or more of the timing characteristics activated at different time points in a time period, two linear polarization characteristics with mutually perpendicular polarization directions, or two rotational polarization characteristics for left-handed light and right-handed light, or color characteristics corresponding to different wavelengths.

[0019] In one embodiment, the backlight along T directions is parallel backlight along T directions.

[0020] In one embodiment, the pointing control unit is a micro-nano grating structure, or a super surface structure, or a holographic grating structure.

[0021] In one embodiment, the backlight assembly is a waveguide structure.

[0022] In one embodiment, when the backlight assembly projects backlight directly into the controllable light valve array, each controllable light valve of the controllable light valve array is a light emitting aperture of each pixel or sub-pixel of the active light-emitting display screen, and each light-emitting pixel or sub-pixel of the selected display screen is constructed as the backlight assembly;

[0023] The control of the output rate of the incident light by each controllable light valve is implemented by the control device controlling the output rate of the light-emitting pixel or sub-pixel corresponding to the controllable light valve.

[0024] The functions of the backlight assembly and the controllable light valve array are implemented by an active light-emitting display screen.

[0025] In one embodiment, when the backlight assembly projects backlight directly into the controllable light valve array, each controllable light valve of the controllable light valve array is a light intensity coverage area corresponding to 50% of the maximum light intensity value of each light beam projected by the selected light scanning device at a certain position, and is named as an equivalent controllable light valve, and the selected light scanning device is used as the backlight assembly;

[0026] The control of the output rate of the incident light by each equivalent controllable light valve is implemented by the control device controlling the output rate of the corresponding scanning output light of the selected backlight assembly.

[0027] The functions of the backlight assembly and the controllable light valve array are implemented by a light scanning device.

[0028] In one embodiment, the optical scanning device comprises a scanning device and a light source;

[0029] The three-dimensional display module based on the orthogonal characteristic pointing control unit array is configured so that the control device can drive the light source to project a light beam to the scanning device to be scanned and emitted to the pointing control unit array, and each scanned output light beam is incident on each pointing control unit of the pointing control unit array one by one.

[0030] In one embodiment, the optical scanning device further comprises a collimation unit;

[0031] The three-dimensional display module based on the orthogonal characteristic pointing control unit array is configured so that the control device can drive the light source to project a light beam to the scanning device to be scanned and emitted to the collimation unit, and each scanned output light beam from the same scanning device is converted into mutually parallel light beams by the collimation unit.

[0032] In one embodiment, a corresponding orthogonal characteristic modulation structure is placed on the propagation path of each light beam emitted by the scanning device, so as to give the emitted light beams corresponding orthogonal characteristics.

[0033] In one embodiment, the three-dimensional display module based on the orthogonal characteristic pointing control unit array also includes an auxiliary projection device, which together with the pointing control unit array projects a viewing area to the area where the observer's pupil is located.

[0034] In one embodiment, the auxiliary projection device has an optical structure in the form of a windshield.

[0035] In one embodiment, the light source projects more than one light beam in different directions toward the scanning device;

[0036] In one embodiment, at least one optical scanning device projects a light beam through a waveguide structure toward an array of pointing control units.

[0037] In one embodiment, each controllable light valve is a liquid crystal unit whose gray scale can be adjusted under the control of a control device.

[0038] In one embodiment, the three-dimensional display module based on the orthogonal characteristic pointing control unit array further includes a projection device to form an enlarged virtual image of the composite structure composed of the pointing control unit array and the controllable light valve array.

[0039] In one embodiment, the three-dimensional display module based on the orthogonal characteristic pointing control unit array further includes a deflection device for guiding the light beam from the composite structure to be transmitted toward the pupil of the observer by deflecting the exit direction of the incident light.

[0040] In one embodiment, the viewing area generated by the three-dimensional display module based on the orthogonal characteristic pointing control unit array covers two pupils of the same observer.

[0041] The present application also provides the following another technical solution.

[0042] A binocular display structure, comprising the three-dimensional display module based on the orthogonal characteristic pointing control unit array as described above;

[0043] Wherein, the viewing area generated by each three-dimensional display module based on the orthogonal characteristic pointing control unit array of the binocular display structure can only cover one pupil of the same observer.

[0044] It should be understood that the binocular display structure in this solution requires two three-dimensional display modules based on orthogonal characteristic pointing control unit arrays, and the two three-dimensional display modules based on orthogonal characteristic pointing control unit arrays correspond to the two pupils respectively. It should be noted that, unlike this solution, in the aforementioned three-dimensional display module based on orthogonal characteristic pointing control unit array, when the projection field of view covers two pupils, the three-dimensional display module based on orthogonal characteristic pointing control unit array itself can be used as a binocular system.

[0045] The present invention has the following technical effects: the present invention utilizes the different orthogonal characteristics design between adjacent controllable light valves and their corresponding direction control units to suppress the crosstalk between non-corresponding controllable light valves and direction control units, and based on a thin and light direction control unit array-controllable light valve array combined structure, performs projection of multiple viewing zones to achieve high-quality three-dimensional display effects.

[0046] The details of the embodiments of the present invention are shown in the drawings or the following description. Other features, objectives and advantages of the present invention will become more apparent through the following description and the drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] The accompanying drawings are used to help better understand the present invention and are also a part of this specification. These drawings, which illustrate the embodiments, and together with the description, serve to explain the principle of the present invention.

[0048] Figure 1It is a structural diagram of a display module system including only one viewing area projection structure according to Embodiment 1 of the present invention.

[0049] Figure 2 Schematic diagram of the structure of a binocular display system built based on two display modules.

[0050] Figure 3 is a schematic diagram of the structure of an example of a waveguide type backlight assembly.

[0051] Figure 4 FIG. 4 is a schematic diagram of the structure of another example of a waveguide type backlight assembly.

[0052] Figure 5 for Figure 4 A structural diagram of an equivalent structure of the example shown.

[0053] Figure 6 The structure diagram of a backlight component example for emitting parallel backlight is shown.

[0054] Figure 7 FIG. 4 is a schematic diagram of the structure of another example of a backlight assembly emitting parallel backlight.

[0055] Figure 8 The invention is a schematic structural diagram of an example of a backlight assembly for projecting non-parallel backlight.

[0056] Fig. 9 The schematic diagram is a structural diagram of an example of a waveguide-type backlight component etched with a directional control unit.

[0057] Fig.10 It is a schematic diagram of the view area projection structure based on color characteristics and line deflection characteristics.

[0058] Fig.11 It is a schematic diagram of a two-dimensional arrangement of viewing areas.

[0059] Fig.12 This is another schematic diagram of the distribution of two-dimensional viewing areas.

[0060] Fig.13 This is another schematic diagram of a two-dimensional arrangement of viewing area distribution.

[0061] Fig.14 Schematic diagram of generating a strip-shaped viewing area by modulating light through a controllable light valve by a directional control unit.

[0062] Fig.15 It is a one-dimensional view area distribution diagram.

[0063] Fig.16 It is another schematic diagram of one-dimensional arrangement of view area distribution.

[0064] Fig.17 This is another schematic diagram of one-dimensional arrangement of viewing area distribution.

[0065] Fig.18 It is a schematic diagram of a two-dimensional arrangement of controllable light valves based on two linear polarization characteristics.

[0066] Fig.19 It is a schematic diagram of a controllable light valve arrangement based on a mixture of linear polarization characteristics and timing characteristics.

[0067] Fig. 20 The diagram is a schematic diagram of a viewing area projection structure in which a pointing control unit corresponds to more than one light valve.

[0068] Fig.21 It is the display module optical structure corresponding to M=1 and N=2.

[0069] Fig. 22 It is the display module optical structure corresponding to M=2 and N=1.

[0070] Fig.23 It is a schematic diagram of the optical structure of a display module including only one viewing area projection structure according to Embodiment 2 of the present invention.

[0071] Fig.24 Schematic diagram of a viewing area projection structure corresponding to T=2 in Example 2 of the present invention.

[0072] Fig.25 Schematic diagram of a strip-shaped viewing area generated by the output light of the controllable light valve through the pointing control unit.

[0073] Fig.26 Schematic diagram of the optical structure of the display module corresponding to M=2 and N=1 in Example 2 of the present invention.

[0074] Fig. 27 Schematic diagram of the optical structure of the display module corresponding to M=1 and N=2 in Embodiment 2 of the present invention.

[0075] Fig.28 A schematic diagram of the structure of an optical scanning device example I1 that implements the functions of a backlight assembly and a controllable light valve array.

[0076] Fig.29 Schematic diagram of the structure of an optical scanning device example I2 using an auxiliary projection device.

[0077] Fig.30 It is a schematic diagram of the structure of an optical scanning device example I3 using another auxiliary projection device.

[0078] Fig.31 A schematic diagram of an example of a light scanning device-waveguide composite structure that implements the functions of a backlight assembly and a controllable light valve array.

[0079] Fig.32 A schematic diagram of another structure of a scanning device.

[0080] Fig.33 A schematic diagram of the structure of an optical scanning device example II1 that implements the functions of a backlight assembly and a controllable light valve array.

[0081] Fig.34 It is a structural schematic diagram of example II2 of the optical scanning device with different incident light beams incident on the scanning device at a small angle.

[0082] Fig.35 A schematic diagram of the structure of Example III of the optical scanning device implementing the functions of the backlight assembly and the controllable light valve array.

[0083] Fig.36 Example IV of a light scanning device-waveguide composite structure for implementing the functions of a backlight assembly and a controllable light valve array.

[0084] Fig.37 Schematic diagram of the optical structure of the display module that introduces the projection device.

[0085] Fig.38 Schematic diagram of the optical structure of the display module that introduces projection devices and deflection devices.

[0086] Fig.39 A schematic diagram of a composite structure of a projection device and a deflection device. DETAILED DESCRIPTION

[0087] The present invention is based on a three-dimensional display module of an array of orthogonal characteristic pointing control units, and uses each pointing control unit to modulate the direction of the incident light or the outgoing light of the corresponding controllable light valve, and guides the modulated light of each controllable light valve to be projected to the corresponding viewing area, so as to generate multiple viewing areas for three-dimensional display. Among them, adjacent pointing control units are configured to be endowed with different orthogonal characteristics to suppress the crosstalk between non-corresponding controllable light valves and pointing control units, thereby improving the display quality. Through the design of the shape and arrangement of the viewing area, three-dimensional display based on stereoscopic technology, Maxwellian View, and super-multiple views can be implemented.

[0088] Example 1

[0089] Figure 1The invention is a three-dimensional display module based on an array of orthogonal characteristic pointing control units, which includes a pointing control unit array 100, a controllable light valve array 200, a backlight assembly 30, a control device 40 and a pupil tracking device 50. The backlight projected by the backlight assembly 30 is incident on the pointing control unit array 100 and the controllable light valve array 200 in sequence. The pointing control unit array 100 is composed of pointing control units that can modulate the direction of the incident light beam and the outgoing light, and all the pointing control units are divided into M≧1 pointing control unit groups 10; the controllable light valve array 200 is composed of controllable light valves that can controllably change the incident light output rate, and all the controllable light valves are divided into N≧1 controllable light valve groups 20. Any pointing control unit group corresponds to at least one controllable light valve group, and a pointing control unit group and a controllable light valve group corresponding to each other constitute a viewing area projection structure. Figure 1 Taking a simple M=1 and N=1 as an example, the pointing control unit array 100 is used as M=1 pointing control unit group 10, and the controllable light valve array 200 is used as N=1 controllable light valve group 20, and the two correspondingly construct K=1 viewing area projection structure. Figure 1 In the viewing zone projection structure shown, the directional control units and the controllable light valves are arranged in one-to-one correspondence. In the directional control unit group 10, adjacent O≧2 directional control units in one-to-one correspondence only allow O types of orthogonal characteristic light to be emitted. Figure 1Taking the linear polarization characteristics with mutually perpendicular polarization directions as O=2 orthogonal characteristics, an example is given for explanation, and the O=2 linear polarization characteristics are represented by “•” and “-” respectively. Specifically, the directional control units m1, m3, m5, m7, ... only control the incident “-” light and allow it to be emitted, and do not allow the non-corresponding “•” light to be emitted, or although the “•” light is also allowed to be emitted, the emitted “•” light does not enter the observer’s eyes, or the emitted “•” light as noise has an influence on the display quality that can be ignored; and the controllable light valves V1, V3, V5, V7, ... corresponding to the directional control units m1, m3, m5, m7, ... respectively in turn also use the “-” light as the corresponding orthogonal characteristic light, and only allow the corresponding “-” light to pass through, while blocking the non-corresponding “•” light, or although the “•” light is also allowed to be emitted, the emitted “•” light does not enter the observer’s eyes, or the emitted “•” light as noise has an influence on the display quality that can be ignored. Differently, the directional control units m2, m4, m6, m8, ... only control the incident "•" light and allow it to be emitted, and do not allow the non-corresponding "-" light to be emitted, or although the "-" light is allowed to be emitted, the emitted "-" light does not enter the observer's eyes, or the emitted "-" light has a negligible effect on the display quality as noise; and the controllable light valves V2, V4, V6, V8, ... corresponding to the directional control units m2, m4, m6, m8, ... respectively in turn also use the "•" light as the corresponding orthogonal characteristic light, and only allow the corresponding "•" light to pass through, while blocking the non-corresponding "-" light, or although the "-" light is allowed to be emitted, the emitted "-" light does not enter the observer's eyes, or the emitted "-" light has a negligible effect on the display quality as noise. The backlight assembly 30 projects parallel backlight along direction 1 to the directional control unit array 100. The directional control units separated by Z-1 directional control units are respectively divided into subgroups, Figure 1 Take Z=5 as an example. x Direction, m1, m6, m 11 , ... into subgroups, m2, m7, m 12 , ... into subgroups, m3, m8, m 13 , ... into subgroups, m4, m9, m 14 , ... into subgroups, m5, m 10 、m 15 , ... into subgroups, with a total of Z = 5 directional control unit subgroups. Each directional control unit of any directional control unit subgroup controls the incident backlight respectively, and guides each regulated light to the corresponding viewing area through the corresponding controllable light valve, such as Figure 1, which correspond to Z=5 viewing zones of the Z=5 directional control unit subgroups: VZ1, VZ2, VZ3, VZ4, VZ5. Each controllable light valve also uses the viewing zone corresponding to the corresponding directional control unit as the corresponding viewing zone of the controllable light valve. Under the control of the control device 40, each controllable light valve transmits light information that is the projection light information of the scene to be displayed along the transmission direction of its outgoing light. For example, a liquid crystal unit with adjustable grayscale under the control of the control device 40 is used as each controllable light valve. In each viewing zone, a two-dimensional image displayed by the controllable light valve corresponding to the viewing zone can be seen, and the two-dimensional image is a two-dimensional view of the scene to be displayed about the viewing zone. Figure 1 In the case where the controllable light valves are arranged equidistantly, each controllable light valve and its corresponding viewing area and the corresponding directional control unit are optimally arranged in a straight line, so that the spatial position of each directional control unit depends on the spatial position of the corresponding controllable light valve and the corresponding viewing area. Figure 1 Only Z=5 is used as an example for explanation, and Z can also take other values. The projected visual area can correspond to the two pupils of the observer, or it can correspond to one pupil of the observer. For the latter, two three-dimensional display modules based on the orthogonal characteristic pointing control unit array are required, corresponding to the two pupils of the observer respectively, to construct a binocular display system. Figure 2 In the example, the pointing control unit array 100, the controllable light valve array 200, and the backlight assembly 30 correspond to the right pupil of the observer, and the pointing control unit array 100', the controllable light valve array 200', and the backlight assembly 30' correspond to the left pupil of the observer. Figure 2 In the following figures, for clarity of illustration, some components, such as the control device 40 and the pupil tracking device 50, are no longer shown.

[0090] The diffracted light generated by the modulation of the incident light by the size of each directional control unit and the internal diffraction structure will be emitted through other non-corresponding controllable light valves, which will cause crosstalk. The design of orthogonal characteristics can suppress this type of crosstalk. Figure 1 Taking the pointing control unit m5 as an example, its emitted “-” light is controlled by the corresponding controllable light valve V5 and emitted to the corresponding viewing zone VZ5, but cannot be emitted through the non-corresponding controllable light valves V4 and V6 (most adjacent to the corresponding controllable light valve V5) with different orthogonal characteristics, thereby avoiding the crosstalk caused by the modulated emitted light of the pointing control unit m5 being emitted through the non-corresponding controllable light valves V4 and V6. Figure 1 In the figure, "×" is used to indicate the cutoff suppression of the corresponding crosstalk. The cutoff suppression may not be 100% blocked, as long as the influence of the transmitted light on the display quality can be ignored. Limited by the number of orthogonal characteristics that can be selected, crosstalk will also be generated when the outgoing light modulated by the pointing control unit m5 is emitted through a non-corresponding controllable light valve with the same orthogonal characteristics that is farther away from the corresponding controllable light valve V5. This type of crosstalk is designed not to be incident on other viewing areas, or it is incident on other viewing areas, but the light intensity is small and has no obvious effect on the display quality. Obviously, a larger O value can better suppress the crosstalk.

[0091] The visual zone spacing corresponding to one pupil of the observer can be set to be greater than or equal to the pupil diameter of the observer to perform three-dimensional display based on stereoscopic technology or Maxwellian View; it can also be set to be smaller than the pupil diameter of the observer in at least one direction to perform three-dimensional display based on super multi-view technology. The light intensities of the “•” and “-” components of the backlight projected by the backlight unit 30 are optimally set to be equal. Figure 1 In the figure, for the sake of clarity, the spaces between adjacent directional control units and adjacent controllable light valves are shown as blank spaces. In fact, the areas between adjacent directional control units and adjacent controllable light valves are optimally designed to be light-proof, or adjacent directional control units and adjacent controllable light valves are arranged without gaps to avoid noise caused by light leakage.

[0092] The directional control unit can be various microstructures that have the ability to modulate the incident light, such as micro-nano grating structures, metasurface structures, holographic grating structures, etc. In fact, each directional control unit can control the exit direction of the incident light, and can also control the parameters such as the amplitude and divergence angle of the exit light. The orthogonal characteristics of each directional control unit can be achieved through various feasible optical design methods. For example, each directional control unit corresponds to an attached polarizer (each attached polarizer is regarded as a component of the corresponding directional control unit in this patent), or the metasurface structure type directional control unit itself has the ability to control the polarization direction of the exit light, which can achieve the purpose of each directional control unit emitting corresponding linear polarization characteristic light. Similarly, the orthogonal characteristics of each controllable light valve can be achieved through various feasible optical design methods, such as realizing its linear polarization characteristic setting through an attached polarizer (each attached polarizer is regarded as a component of the corresponding controllable light valve in this patent).

[0093] Under the control of the control device 40, the backlight assembly 30 can also project backlight in more than one direction (corresponding to T>1). When backlight is projected in different directions, the viewing area generated by the same viewing area projection structure will be offset. Figure 1 In the case of T=2, when the backlight assembly 30 projects backlight along direction 1, the above-mentioned viewing zones VZ1, VZ2, VZ3, VZ4, and VZ5 are generated; when the backlight assembly 30 projects backlight along direction 1', other viewing zones VZ'1, VZ'2, VZ'3, VZ'4, and VZ'5 are generated. The same applies when T takes a larger value. Figure 1 The offset distance between viewports VZ1, VZ2, VZ3, VZ4, VZ5 and viewports VZ'1, VZ'2, VZ'3, VZ'4, VZ'5 Δδ is only for illustration, and it can take any possible value. The backlight along different directions can be projected in time sequence, and each controllable light valve synchronously corresponds to the loading information, so as to realize the projection of more visual areas based on time sequence multiplexing; a pupil tracking device 50 can also be introduced, and according to the position of the observer's pupil determined by the pupil tracking device 50, the control device only activates one or some directions of the backlight in time sequence for display, and the generated visual area corresponding to the activated one or some directions of the backlight in time sequence should cover the observer's pupil in real time. That is, at each time point, for the observer's pupil whose position is determined by the pupil tracking device 50, the corresponding light information does not enter the visual area of ​​the observer's pupil, does not contribute to the display, and can be not activated. The backlight along different directions that is turned on in time sequence can also be backlight of different colors, such as R (red), G (green), and B (blue) backlight, to realize color display. The corresponding directions of the backlight of different colors can be specially designed to be along the same direction or along different directions. In the latter case, the optimal design requires that each pupil of the observer can receive different color light beams passing through any display object point through different viewing zones. The case where the backlight assembly 30 provides optional backlight in multiple directions is also applicable to the following viewing zone projection structure. The following description of the embodiment of the viewing zone projection structure will not repeat the discussion of the display under the condition of backlight in multiple directions, but will only be described by taking T=1 as an example.

[0094] The backlight assembly 30 may adopt various optical structures for projecting backlight. Figure 3 The waveguide structure shown includes a light source 301. The light emitted from the light source 301 is converted into parallel light by the collimator 302 and enters the optical waveguide 304 through the entrance pupil 303; after being modulated in its emission direction by the coupling-in device 305, it propagates in the optical waveguide 304 through total reflection by the reflection surfaces 306a and 306b; then it is modulated by the coupling-out device 307 and emitted in parallel through the exit pupil 308. Figure 3 The collimating device 302 is shown as a lens. Figure 3 The waveguide structure shown in the figure may also adopt various other possible optical structures as its specific structure, such as various geometric optical waveguides or diffraction optical waveguides with one-dimensional pupil expansion capability or two-dimensional pupil expansion capability, such as the various waveguide structures described in the Chinese invention patent “Three-dimensional display module with optical waveguide vector backlight” (publication number CN113126315A, publication date 2021-07-16). Figure 4 The waveguide structure shown can project parallel backlight along T=3 directions through the timed activation of T=3 light sources 301a, 301a, 301a under the control of the control device 40. Figure 4 The T light sources shown correspond to the function of projecting backlight in different directions, and can also be used Figure 5The controllable deflection device 309 shown in the figure is implemented. Under the control of the control device 40, the controllable deflection device 309 can deflect the parallel light beam projected by the light source 301 through the collimating device 302 and enter the pupil 303 along different directions. The controllable deflection device 309 can also be a transmission type device, such as an electrically controlled liquid crystal deflection device, which modulates the exit direction of the incident light by phase. The transmission type controllable deflection device 309 can be placed Figure 3 The deflection device 309 can also be further placed on the transmission path of the outgoing light of the waveguide structure, such as Figure 3 The position Po2 or Po3 shown replaces the function of T light sources. Obviously, multiple light sources can also be combined with the deflection device 309 to work simultaneously. Multiple of the above-mentioned waveguide structures can also be stacked together to provide backlight. For example, different stacked waveguide structures each project backlight of different colors to reduce the impact of dispersion on display quality, or project backlight in more directions, or project different backlights with larger angle intervals.

[0095] like Figure 6 Another backlight assembly 30 is shown, including light sources 301a, 301b, 301c and a collimator 302', and the light projected by each light source is converted into parallel backlight by the collimator 302'. T=3 light sources 301a, 301b, 301c can project backlight in T=3 directions. Figure 6 Take T=3 as an example. Figure 7 It is also an optional backlight structure, which includes multiple collimating devices and multiple light sources. Parallel backlight is projected through the combination of multiple collimating devices 302-1, 302-2, 302-3, 302-4 and their corresponding light sources, such as the light sources 301-1a and 301-1b corresponding to the collimating device 302-1. Figure 4 In the backlight assembly 30 shown, the combination structure of multiple light sources and collimating devices 302 is also seen in other patents, such as the combination of a sequential switching light source array and a relay device in the Chinese invention patent "Three-dimensional display module with optical waveguide vector backlight" (publication number CN113126315A, publication date 2021-07-16). This type of combination structure can also be replaced by numerous other optical structures that can project light beams in different directions, such as Figure 7 The structure shown, for example Figure 5 The combination of the light source 301, the collimating device 302 and the deflecting device 309. Note that Figure 4 Take T=3 as an example. Figure 7 Take T=2 as an example. Figure 7 The structure shown replaces Figure 4 The combination structure of the multiple light sources and the collimating device 302 should be replaced with equal T values. In fact, the backlight projected by the backlight assembly 30 is not necessarily required to be parallel light. For example, Figures 3 to 7 The light sources shown can be point light sources or linear light sources. When each light source is a linear light source, the backlight corresponding to each light source is parallel light only in one direction and non-parallel light in another direction, which is conducive to the generation of the strip viewing area described below. Figure 8 In the backlight assembly 30 composed of multiple light sources shown, each directional control unit is provided with a light source, and the light source provides non-parallel backlight for its corresponding directional control unit. Specifically, the light source 30-1 projects non-parallel backlight to the corresponding directional control unit m1, and the light source 30-2 projects non-parallel backlight to the corresponding directional control unit m2, and so on. In fact, various other backlights, such as backlights that converge at a certain point, or divergent backlights that emit from a certain point, may all be used as backlights provided by the backlight assembly 30 described in this patent. Furthermore, the backlight projected along "one direction" by the backlight assembly 30 described in this patent is not limited to the same incident backlight direction corresponding to each directional control unit, but can also refer to the following situation: each directional control unit has backlight incident along the corresponding direction (the backlight can be parallel light, or divergent light, or convergent light), but the incident directions of the backlights corresponding to different directional control units are not necessarily the same, and the backlights corresponding to all directional control units are combined into the backlight projected by the light assembly 30 along "one direction".

[0096] Each directional control unit can also be directly arranged on the backlight assembly 30, such as Fig. 9 As shown, each microstructure-type pointing control unit m1, m2, m3, m4, m5, ... is directly etched on the total reflection surface 306a of the waveguide structure, and diffracts part of the incident light to be emitted (the rest continues to be transmitted based on total reflection to provide backlight for other microstructure-type pointing control units), serving as the backlight of the controllable light valve corresponding to the pointing control unit.

[0097] The above embodiments are illustrated along one-dimensional direction, and can be extended to two dimensions by the same logic, such as two-dimensionally arranged viewing areas, two-dimensionally arranged light sources in the backlight assembly 30, and two-dimensional pupil expansion waveguide structures. In the above embodiments, the controllable light valves are shown as being arranged in a plane, but they can also be arranged in a curved surface, and the corresponding directional control units can also be arranged in a curved surface.

[0098] The orthogonal characteristics can also be set as color characteristics of different wavelengths to display color images. Fig.10 In the example, O=6 adjacent directional control units are respectively assigned O=6 mixing characteristics: “R•”, “G•”, “B•”, “R-”, “G-”, “B-”. Correspondingly, the controllable light valve corresponding to any directional control unit is assigned the same mixing characteristic. Fig.10In the case where K=5 viewing zones VZ1, VZ2, VZ3, VZ4 and VZ5 are generated as shown, if at least three adjacent viewing zones simultaneously enter a pupil, the corresponding eye receives color information. The color characteristics of each directional control unit and the controllable light valve can be implemented through various possible designs, for example, by attaching corresponding color filters. Fig.10 When K is 3 or a multiple of 3, the light beams passing through any viewing area can be designed to have the same color. Fig.10 In the embodiment of the present invention, the backlight projected by the backlight assembly needs to have R, G, and B color components. Fig.10 Three adjacent directional control units corresponding to the same linear deflection characteristics and different color characteristics can also overlap into a directional control unit without color characteristics and only with corresponding linear deflection characteristics. For example, m1, m2, and m3 are replaced by a directional control unit with "-" but allowing R, G, and B light to pass through at the same time, and in a backlight corresponding to the directional control unit, the R, G, and B components can be incident along the direction pointing to the controllable light valves V1, V2, and V3, or the directional control unit projects backlight covering the controllable light valves V1, V2, and V3. As mentioned above, Fig.10 The backlight component can also be K backlights that can be incident in sequence to project more viewing areas, or combined with the pupil tracking device 50 to only activate the backlight that generates a viewing area that corresponds to the observer's pupil in real time.

[0099] By designing the spatial position of each directional control unit relative to the corresponding controllable light valve, and the direction and light distribution of the output light beam, various shapes and arrangement distributions of viewing areas can be designed. Fig.11 The two-dimensional uniformly arranged view zones shown are: ... VZ nm , VZ nm+1 , VZ nm+2 , VZ nm+3 , VZ nm+4 ,…,…,VZ n+1m , VZ n+1m+1 , VZ n+1m+2 , VZ n+1m+3 , VZ n+1m+4 ,…,…. The first subscript of each viewport indicates the row, and the second subscript indicates the column, for example, viewport VZ n+1m+2 Represents the viewport at row n+1 and column m+2. Fig.11In the figure, each viewing area is represented by a circle, and gaps are shown between adjacent viewing areas. In fact, the circles shown indicate the positions of corresponding viewing areas; at the same time, the gaps between adjacent circles are only for clearly showing the relative positional relationship between adjacent viewing areas, and do not mean that there is a gap between the light distribution area corresponding to one viewing area and the light distribution area corresponding to the adjacent viewing area. This description also applies to subsequent illustrations of viewing areas of other shapes. In this patent document, the distribution area of ​​any viewing area on the viewing area surface is set to: the union of the areas covered by light whose intensity on the viewing area surface is not less than 50% of the maximum light intensity of any light beam contained in the view corresponding to the viewing area. In this patent document, the shape of a viewing area refers to the shape of its distribution area on the viewing area surface. Figure 1 and Fig.10 In the figure, the light beams emitted by the controllable light valves corresponding to each viewing zone are shown to converge to a point in the viewing zone. In fact, all the light beams emitted by the controllable light valves corresponding to any viewing zone are not required to converge to a point. Often, if the area covered by the light intensity of any light beam included in the view corresponding to a viewing zone is not less than 50% of the maximum light intensity on the viewing zone surface, and all of them intersect with the same pupil, the viewing zone can be considered to be effectively generated. The spacing between viewing zones corresponding to a pupil can be greater than the pupil diameter D of the observer. p , where the size of each viewing area is smaller than D p When displaying based on Maxwellian View, the size of each viewing area is not less than D p When displaying based on stereo technology; the viewing area corresponding to a pupil, the spacing can also be less than D in at least one direction p , for display based on super multi-view technology.

[0100] Fig.12 Another two-dimensional arrangement of the viewing zones is shown. When the number of generated viewing zones is not large enough, the limited number of viewing zones are divided into two sets, corresponding to the observer's pupils. Specifically, the viewing zone VZ nm , VZ nm+1 , VZ nm+2 , VZ n+1m , VZ n+1m+1 , VZ n+1m+2 , VZ n+2m , VZ n+2m+1 , VZ n+2m+2 Corresponding to the observer's left pupil, visual area VZ' nm , VZ' nm+1 , VZ' nm+2 , VZ' n+1m , VZ' n+1m+1 , VZ' n+1m+2 , VZ' n+2m , VZ' n+2m+1 , VZ' n+2m+2 Corresponding to the observer's right pupil. Fig.12In the figure, the distance between adjacent viewing zones corresponding to the same pupil is shown to be smaller than the pupil diameter of the observer, which can also be designed as other situations.

[0101] Fig.13 In the figure, the shapes of the two-dimensionally arranged viewing zones are shown as asymmetric strips, specifically viewing zones: ... VZ nm , VZ nm+1 , VZ nm+2 ,…,…,VZ n+1m , VZ n+1m+1 , VZ n+1m+2 ,…,…. This design is optimally suitable for ultra-multi-view display. Based on the fact that the interpupillary distance of the observer is much larger than the single pupil diameter D p Biological characteristics, the larger visual area distance along the line connecting the two pupils is greater than>D p It is smaller than the interpupillary distance and smaller than D along the line connecting the pupils. p The viewport spacing is conducive to reducing the excessive number of viewports required for displaying multiple views. Fig.13 In the direction of the line connecting the pupils x To any two adjacent view areas, such as view area VZ n+1m and view zone VZ n+1m+1 The interval period is greater than>D p And it is smaller than the interpupillary distance; vertically along the line connecting the pupils y To any two adjacent view areas, such as view area VZ n+1m+1 and view zone VZ n+2m+1 The interval period is less than D p . In the pointing control unit m i The projected light passes through the corresponding controllable light valve V j In the case of incident viewing area, the controllable light valve V j The outgoing beam is in the viewing zone VZ mj The distribution area on the viewing area (the area covered by the light whose intensity on the viewing area is not less than 50% of the maximum light intensity) is formed into a long strip, which can be controlled by the pointing control unit m i Shape and / or orientation control unit m i Phase modulation is achieved, such as Fig.14 In addition, a corresponding one-way scattering sheet structure is placed behind each controllable light valve, or a strip light source (e.g. Figures 3 to 7 The light source shown is a strip light source), which can also be used to achieve a long strip viewing area.

[0102] Fig.15 VZ is a long strip of viewing area uniformly arranged along one dimension. m , VZ m+1 , VZ m+2 ,…VZ k , VZ k+1, VZ k+2 ,…. The distance between adjacent viewing zones can be greater than, equal to, or less than the observer's pupil diameter D p . Fig.15 The distance between adjacent visual zones is smaller than the pupil diameter D p For example, in this case, since the interpupillary distance of the observer is much larger than the pupil diameter D p , continuously and completely cover the observer's pupils, requiring more small spacing ( <D p ) Number of viewports. Fig.16 In the case shown, the small spacing ( <D p ) Viewing area…VZ m , VZ m+1 , VZ m+2 , VZ m+3 , VZ m+4 , VZ m+5 , VZ m+6 , ..., and the acute angle between the two pupils has a larger value in [0, 90°] (relative to Fig.15 Smaller acute angles are beneficial for covering the observer's pupils with a smaller number of closely spaced viewing zones. Fig.16 In the case shown, care should be taken to avoid the intersection of different pupils of the same observer and the same visual area. Fig.17 The figure shows an example of a non-uniform view zone arrangement, or a view zone arrangement with a gradually changing spacing. In this case, the view zone spacing is set smaller where the pupil often appears, which is beneficial to the improvement of display quality when the number of view zones is insufficient to support all small-pitch view zones to cover the entire observation area. At this time, the pupil tracking device 50 can also be used. When the pupil deviates from the view zone small-pitch arrangement area, the control device 40 reminds the observer to adjust the position, or controls the backlight assembly 30 to change the incident backlight to ensure that the view zone small-pitch arrangement area follows the corresponding pupil. Fig.17 Only the visual zone arrangement corresponding to one pupil is shown, including the visual zone..., VZ m , VZ m+1 , VZ m+2 , VZ m+3 , VZ m+4 , VZ m+5 , VZ m+6 , VZ m+7 , ..., their spacings change gradually. The area sizes of each viewing area can be the same or different along the arrangement direction. Fig.17 The area sizes of each viewing area in the example are also different along the arrangement direction. Similarly, when the generated viewing area needs to correspond to the double pupils of the observer, the viewing area arrangement with a gradually changing spacing corresponding to the other pupil can be designed. The shape of each viewing area is not limited to the above-mentioned figures, and can also be any other shape.

[0103] Only O=2 linear polarization characteristics are used as orthogonal characteristics, and the two-dimensional arrangement of controllable light valve arrays based on them is as follows Fig.18 As shown. Along the x-direction and the y-direction, two adjacent controllable light valves correspond to different orthogonal characteristics respectively; but along the two directions at 45° to the x-direction, adjacent controllable light valves can only correspond to the same orthogonal characteristics. In order to avoid crosstalk between adjacent controllable light valves from the modulated output light of the corresponding directional control unit of the other party, more orthogonal characteristics are required. The orthogonal characteristic light refers to different characteristic lights that can be mutually exclusive and respectively selected. For example, the timing characteristic lights projected at different time points in a time period can be respectively selected by the corresponding liquid crystal switches being synchronously opened only at the corresponding time points; for example, the timing characteristic of a directional control unit can be implemented by closing or opening the liquid crystal switch attached to the directional control unit under the control of the control device 40 (the attached liquid crystal switch is regarded as a component of the corresponding directional control unit in this patent). Another example is two linear polarization characteristic lights with mutually perpendicular polarization directions, for example, the linear polarization characteristic of a directional control unit or a controllable light valve. The corresponding linear polarization characteristic light can be selected by the corresponding attached polarizer to block the non-corresponding linear polarization characteristic light. For example, two kinds of polarization characteristic lights, namely left-handed light and right-handed light, for example, the polarization characteristic of a directional control unit or a controllable light valve can be implemented by the combination of the corresponding attached wave plate and polarizer to implement the gating of the corresponding polarization characteristic light, and block the non-corresponding polarization characteristic light. For another example, color characteristics corresponding to different wavelengths, for example, the color characteristics of a directional control unit or a controllable light valve can be implemented by the corresponding attached color filters to implement the gating of the corresponding color characteristic light, and block the non-corresponding color characteristic light. The combination of these orthogonal characteristics can also form more types of orthogonal characteristics. For example, Fig.19 By adopting a combination of two timing characteristics and two linear deflection characteristics, two adjacent controllable light valves along the x direction, the y direction, and the two directions at 45°, respectively, have different orthogonal characteristics. Among them, t1 means that the controllable light valve is activated at the moment t1 of any time period and is closed at another moment t2; t2 means that the controllable light valve is activated at the moment t2 of any time period and is closed at another moment t1. Each moment mentioned here refers to a time period including the moment. The directional control unit corresponding to each controllable light valve allows the backlight to enter only when the corresponding controllable light valve is activated. The permission and non-permission of the backlight entry can be implemented, for example, by a liquid crystal switch (controlled by the control device 40) attached to the directional control unit.

[0104] Furthermore, each directional control unit can correspond to more than one controllable light valve. At this time, the light beam incident on any directional control unit emits multi-order diffraction light in multiple directions based on the diffraction of the directional control unit. The multi-order diffraction light is respectively used as backlight to incident on different controllable light valves. At the same time, it is necessary to ensure that adjacent controllable light valves correspond to different orthogonal characteristics. At this time, any directional control unit and the corresponding multiple controllable light valves are set to have the same orthogonal characteristics, and adjacent directional control units have different orthogonal characteristics. Specifically, O=4 orthogonal characteristics (a mixture of timing characteristics and linear polarization characteristics) are adopted. Fig. 20 For example, it simply includes K=1 viewing zone projection structure. The pointing control unit m1 with orthogonal characteristics (t1 and •) diffracts three beams of diffracted light of different orders, which are directed to the corresponding controllable light valves V1, V5=V with the same orthogonal characteristics. 1+4 、V9=V 5+4 ; The directional control unit m2 with orthogonal characteristics (t1 and t2) diffracts three beams of diffracted light of different orders, which are directed to the corresponding controllable light valves V2, V6=V2 with the same orthogonal characteristics. 2+4 、V 10 =V 6+4 ; The directional control unit m3 with orthogonal characteristics (t2 and •) diffracts three beams of diffracted light of different orders, which are directed to the corresponding controllable light valves V3, V7=V with the same orthogonal characteristics. 3+4 、V 11 =V 7+4 ; The directional control unit m4 with orthogonal characteristics (t2 and t2-) diffracts three beams of diffracted light of different orders, which are directed to the corresponding controllable light valves V4, V8=V with the same orthogonal characteristics. 4+4 、V 12 =V 8+4 On the basis of the O=4 positions of the pointing control units m1, m2, m3, and m4, the positions of the subsequent O=4 pointing control units m5, m6, m7, and m8 are set to meet the following requirements: the pointing control unit m5 with orthogonal characteristics (t1 and •) diffracts three beams of diffracted light of different orders, which are directed to the corresponding controllable light valves V with the same orthogonal characteristics. 13 、V 17 =V 13+4 、V 21 =V 17+4 ; The directional control unit m6 with orthogonal characteristics (t1 and t2) diffracts three beams of different orders of diffraction light, which are directed to the corresponding controllable light valves V with the same orthogonal characteristics. 14 、V 18 =V 14+4 、V 22 =V 18+4; The directional control unit m7 with orthogonal characteristics (t2 and •) diffracts three beams of diffracted light of different orders, which are directed to the corresponding controllable light valves V with the same orthogonal characteristics. 15 、V 19 =V 15+4 、V 23 =V 19+4 ; The directional control unit m8 with orthogonal characteristics (t2 and ‐) diffracts three beams of diffracted light of different orders, which are directed to the corresponding controllable light valves V with the same orthogonal characteristics. 16 、V 20 =V 16+4 、V 24 =V 20+4 Based on the 2×O=8 position-determined directional control units m1, m2, m3, m4, m5, m6, m7, and m8, the subsequent O=4 directional control units m9, m 10 、m 11 、m 12 The position is repeated. This can realize the generation of 3×O=12 viewing zones. When a pointing control unit provides backlight for multiple controllable light valves at the same time, the output light of each order of diffraction light as the backlight of different controllable light valves is optimally designed to be relatively close or equal; while the other order of diffraction light needs to be as small as possible.

[0105] The above embodiments all take M=1 and N=1 as an example. Fig.21 and Fig. 22 They correspond to M=1, N=2 and M=2, N=1 respectively. Fig.21 In the one-dimensional direction shown, the pointing control unit array 100 with linear deflection characteristics serves as M=1 pointing control unit group 10, and the controllable light valve array 200 is grouped with controllable light valves spaced one apart, including N=2 controllable light valve groups. Specifically, the controllable light valves V1, V2, V3, V4, ... constitute the controllable light valve group 20, and the controllable light valves V'1, V'2, V'3, V'4, ... constitute the controllable light valve group 20'. Then the pointing control unit group 10 and the controllable light valve group 20 are constructed as one viewing area projection structure, and the pointing control unit group 10 and the controllable light valve group 20' are constructed as another viewing area projection structure, for a total of K=2 viewing area projection structures. Different viewing area projection structures correspond to different backlights, such as Fig.21 K=2 backlight beams along directions 2 and 3 are shown. Different visual zone projection structures can be activated at different time sequences; or according to the pupil position determined by the pupil tracking device 50, only one or part of the visual zone projection structures activated in sequence (one in the case of K=2) are activated, and the visual zone generated by the activated visual zone projection structure can cover the pupil of the observer. The activation of a visual zone projection structure refers to the visual zone projection of the visual zone projection structure under the condition of one backlight projection or multiple backlight sequential projection. Fig.21Simply taking the case where each view zone projection structure corresponds to T = 1 backlight as an example. Fig. 22 Taking the one-dimensional direction as an example, the orientation control unit array 100 with linear polarization characteristics is grouped with every other orientation control unit, and contains M = 2 groups of orientation control units. Specifically, the orientation control units m1, m2, m3, m4,... form the orientation control unit group 10, and the controllable light valves m'1, m'2, m'3, m'4,... form the orientation control unit group 10'. The controllable light valve array 200 serves as a group of controllable light valves 20. Then, the orientation control unit group 10 and the controllable light valve group 20 are constructed into one view zone projection structure, and the orientation control unit group 10' and the controllable light valve group 20 are constructed into another view zone projection structure, with a total of K = 2 view zone projection structures. Different from Fig.21 the situation shown, Fig. 22 in which, different view zone projection structures can correspond to the same backlight, such as Fig. 22 the backlight along direction 1 shown. In this case, different view zone projection structures are activated at different time sequences, or according to the pupil position determined by the pupil tracking device 50, only one or a part of K' (1 < K' < K, K' = 1 when K = 2) view zone projection structures are activated in sequence, and it is ensured that the view zones generated by the activated view zone projection structures can cover the observer's pupil in real time. The activation of a view zone projection structure refers to the view zone projection of this view zone projection structure under the backlight in only one direction or the sequential projection of the backlight in multiple directions. Fig. 22 Simply taking the case where each view zone projection structure corresponds to T = 1 backlight as an example. Fig.21 and Fig. 22 both take K = 2 as an example. Similarly, K can be extended to the case where K > 2, such as the case where M > 1 and N > 1. At the same time, it can also be further extended to the case where each view zone projection structure corresponds to T > 2.

[0106] Embodiment 2

[0107] Fig.23 This is a three-dimensional display module based on an orthogonal characteristic orientation control unit array for Embodiment 2. This display module includes an orientation control unit array 100, a controllable light valve array 200, a backlight assembly 30, a controller device 40, and a pupil tracking device 50. The controller device 40 and the pupil tracking device 50 therein are similar to Figure 1 the situation shown, Fig.23Not shown. The backlight projected by the backlight assembly 30 is incident on the controllable light valve array 200 and the direction control unit array 100 in sequence. The controllable light valve array 200 is composed of controllable light valves that controllably change the incident light output rate, and all controllable light valves are divided into N≧1 controllable light valve groups 20; the direction control unit array 100 is composed of direction control units that can modulate the direction of the incident light beam output, and all direction control units are divided into M≧1 direction control unit groups 10. Any direction control unit group corresponds to at least one controllable light valve group, and a corresponding direction control unit group and a controllable light valve group constitute a viewing area projection structure. Fig.23 Taking a simple M=1 and N=1 as an example, the pointing control unit array 100 is used as M=1 pointing control unit group 10, and the controllable light valve array 200 is used as N=1 controllable light valve group 20, and the two are correspondingly constructed into a K=1 viewing area projection structure. Fig.23 In the K=1 viewing zone projection structure shown, the pointing control units and the controllable light valves are arranged one-to-one. In the controllable light valve group 20, adjacent O≧2 controllable light valves correspond one-to-one to each other and only allow O types of orthogonal characteristic light to be emitted. Fig.23Taking the linear polarization characteristic with mutually perpendicular polarization directions as an example, it is explained as O=2 orthogonal characteristics, represented by "•" and "-". Specifically, the controllable light valves V1, V3, V5, V7, ... only allow the corresponding "-" light to be incident and emitted, and do not allow the non-corresponding "•" light to be emitted, or although the "•" light is allowed to be emitted, the emitted "•" light does not enter the observer's eyes, or although the "•" light is allowed to be emitted, the influence of the emitted "•" light on the display quality is within a tolerable range. The directional control units m1, m3, m5, m7, ..., which correspond to the controllable light valves V1, V3, V5, V7, ..., respectively, also use the "-" light as the corresponding orthogonal characteristic light, and only allow the corresponding "-" light to be incident and modulated for emission, while blocking the non-corresponding "•" light, or although the "•" light is allowed to be emitted, the emitted "•" light does not enter the observer's eyes, or although the "•" light is allowed to be emitted, the influence of the emitted "•" light on the display quality is within a tolerable range. Differently, the controllable light valves V2, V4, V6, V8, ... only allow the corresponding "•" light to be incident and emitted, and do not allow the non-corresponding "-" light to be emitted, or although the "-" light is allowed to be emitted, the emitted "-" light does not enter the observer's eyes, or although the "-" light is allowed to be emitted, the influence of the emitted "-" light on the display quality is within a tolerable range. The directional control units m2, m4, m6, m8, ... that correspond to the controllable light valves V2, V4, V6, V8, ... respectively also use the "•" light as the corresponding orthogonal characteristic light, and only allow the corresponding "•" light to be incident and modulated to be emitted, while blocking the non-corresponding "-" light, or although the "-" light is allowed to be emitted, the influence of the emitted "-" light on the display quality is within a tolerable range. In other words, the "blocking" mentioned here is not a 100% cutoff, but a blocking in which the transmittance does not obviously affect the display effect. The backlight assembly 30 projects parallel backlight along direction 1 onto the controllable light valve array 200. The controllable light valves separated by Z-1 controllable light valves are respectively divided into subgroups, Fig.23 With Z=5 and along x direction as an example. Controllable light valves V1, V6, V 11 , ... into subgroups, V2, V7, V 12 , ... into subgroups, V3, V8, V 13 , ... into subgroups, V4, V9, V 14 , ... into subgroups, V5, V 10 、V 15 , ... into subgroups, with a total of Z=5 controllable light valve subgroups. The backlight from the backlight assembly 30 passes through each controllable light valve of any controllable light valve subgroup, enters the corresponding directional modulation unit, and is modulated by the corresponding directional modulation unit and guided to the corresponding viewing area. For example Fig.23There are Z=5 viewing zones corresponding to Z=5 controllable light valve subgroups: VZ1, VZ2, VZ3, VZ4, VZ5. Each directional control unit also uses the viewing zone corresponding to the corresponding controllable light valve as the corresponding viewing zone of the directional control unit. Under the control of the control device 40, each controllable light valve transmits light to carry information, which is the projection light information of the scene to be displayed along the transmission direction when the projection light enters the corresponding viewing zone. For example, using an electrically controlled liquid crystal unit as each controllable light valve, the corresponding information can be loaded under the control of the control device 40. Then, in each viewing zone, a two-dimensional image displayed by the controllable light valve subgroup corresponding to the viewing zone can be seen, and the two-dimensional image is a two-dimensional view of the scene to be displayed about the viewing zone. Fig.23 In the embodiment, when the controllable light valves are arranged at equal intervals, the direction control units may be arranged at non-equal intervals. In actual situations, the controllable light valves may also be arranged at non-equal intervals, while the direction control units may be arranged at equal intervals. Fig.23 Take Z=5 as an example, and Z can also take other values. The projected visual area can correspond to the two pupils of the observer, or it can correspond to one pupil of the observer. For the latter, two three-dimensional display modules based on the orthogonal characteristic pointing control unit array are required, corresponding to the two pupils of the observer respectively, to construct a binocular display system, similar to Figure 2 For the sake of clarity, some components, such as Figure 1 The control device 40 and the pupil tracking device 50 are shown in Fig.23 And not shown in the following related figures.

[0108] The aperture and internal structure of each controllable light valve modulate the incident light to produce diffracted light; the diffracted light is emitted through other non-corresponding controllable light valves, which may cause crosstalk. The design of orthogonal characteristics can suppress this type of crosstalk. Fig.23 Taking the controllable light valve V5 as an example, its emitted “-” light is regulated by the corresponding directional control unit m5 and emitted to the corresponding viewing zone VZ5, but cannot be emitted through the non-corresponding directional control units m4 and m6 (which are most adjacent to the corresponding directional control unit m5) with different orthogonal characteristics, thereby avoiding the crosstalk caused by the emitted light of the controllable light valve V5 passing through the non-corresponding directional control units m4 and m6. Fig.23 In the figure, “×” indicates the cutoff suppression of the corresponding crosstalk. Limited by the number of orthogonal characteristics that can be selected, when the light emitted by the controllable light valve V5 passes through the non-corresponding directional control unit with the same orthogonal characteristics that is farther away from the corresponding directional control unit m5, crosstalk will be generated, for example Fig.23 The crosstalk caused by the light emitted by the middle controllable light valve V5 passing through the non-corresponding directional control unit m3 or m7. The crosstalk noise needs to be designed not to enter each viewing area, or although it enters the viewing area, the light intensity is small and has no obvious impact on the display effect. Obviously, a larger O value can better suppress the crosstalk.

[0109] The viewing zone spacing corresponding to one pupil of the observer can be set to be greater than or equal to the pupil diameter of the observer, so as to perform three-dimensional display based on stereoscopic technology or Maxwellian View. The light intensities of the “•” and “-” components of the backlight projected by the backlight unit 30 are optimally set to be equal. Fig.23 In the figure, for the sake of clarity, the spaces between adjacent directional control units and adjacent controllable light valves are shown as blank spaces. In fact, the areas between adjacent directional control units and adjacent controllable light valves are optimally designed to be light-proof, or adjacent directional control units and adjacent controllable light valves are arranged without gaps to avoid noise caused by light leakage.

[0110] The pointing control unit can be various microstructures that have the ability to modulate the incident light, such as micro-nano grating structures, metasurface structures, holographic grating structures, etc. It can adjust the exit direction of the incident light, and can also adjust the phase distribution, amplitude distribution, divergence angle and other parameters of the exiting light. The orthogonal characteristics of each pointing control unit can be achieved through various possible optical design methods. For example, each pointing control unit corresponds to an attached polarizer, or the ability of the metasurface structure-type pointing control unit itself to control the polarization direction of the exiting light is utilized to achieve the linear polarization characteristics of each pointing control unit line. The orthogonal characteristics of each controllable light valve can be achieved through various feasible optical design methods, such as realizing its linear polarization characteristic setting through an attached polarizer.

[0111] Under the control of the control device 40, the backlight assembly 30 can also project backlight in more than one direction (corresponding to T>1). When backlight is projected in different directions, it enters the corresponding direction control unit in different directions through the same controllable light valve and is controlled by the direction control unit to be emitted, which will cause the visual area generated by the projection structure of each visual area to be offset. Fig.24 In the case of T=2, when the backlight assembly 30 projects backlight along direction 4, the corresponding viewing zones VZ1, VZ2, VZ3, VZ4, and VZ5 are generated; when the backlight assembly 30 projects backlight along direction 4', other viewing zones VZ'1, VZ'2, VZ'3, VZ'4, and VZ'5 are generated. The same applies when T takes more values. Fig.24 The offset distance between viewports VZ1, VZ2, VZ3, VZ4, VZ5 and viewports VZ'1, VZ'2, VZ'3, VZ'4, VZ'5 Δδ is only for illustration, and it can take any possible value. The backlights in different directions can be projected in sequence, and each controllable light valve can load corresponding information synchronously, so as to realize the projection of more visual areas based on time-sequential multiplexing; a pupil tracking device 50 can also be introduced, and according to the pupil position of the observer determined by the pupil tracking device 50, only one backlight is activated, or part of the backlight is activated in sequence for visual area projection, on the premise that the generated visual area can cover the corresponding pupil in real time. The backlights that are turned on in sequence and in different directions can also be backlights of different colors, such as R (red), G (green), and B (blue) backlights, to realize color display. The corresponding directions of the backlights of different colors can be specially designed to be in the same direction or in different directions. In the latter case, it is the optimal design for the observer pupil to receive different color light beams passing through any display object point through different visual areas. The situation where the backlight assembly 30 provides optional backlights in multiple directions is also applicable to the projection structures of each visual area below. The following description of the projection structure of each viewing area will not repeat the discussion of the display under multi-directional backlight conditions, but will only take T=1 as an example for explanation.

[0112] The backlight assembly 30 can adopt various optical structures for projecting backlight. For example, the waveguide structures described in Embodiment 1. Figure 3 The waveguide structure shown includes a light source 301, Figure 4 Another waveguide structure of multiple light sources is shown, Figure 5 The waveguide structure using the controllable deflection device 309 is shown. Similarly, multiple waveguide structures of various types can also be stacked to provide backlight, for example, each projecting backlight of different colors to reduce the impact of dispersion on display quality, or projecting backlight in more directions, or projecting different backlights with larger angle intervals. Figures 6 to 9 The optical structure shown can also be used as the backlight component of this embodiment. In fact, various other backlights, such as backlights that converge on a certain point, or divergent backlights that radiate from a certain point, etc., may all be used as the backlight provided by the backlight component 30 described in this patent. Furthermore, the backlight projected along "one direction" by the backlight component 30 described in this patent is not limited to the same direction of the incident backlight corresponding to each controllable light valve, but also includes the following situation: each controllable light valve has a corresponding backlight incident along one direction (the backlight can be parallel light, or divergent light, or convergent light), but the incident directions of the backlight corresponding to different controllable light valves are not necessarily the same, and the backlight corresponding to all the controllable light valves is combined into the backlight projected along "one direction" by the backlight component 30.

[0113] Each directional control unit can flexibly control the incident light from the corresponding controllable light valve, thereby generating viewing areas of various shapes and arrangement distributions. In this patent document, the distribution area of ​​any viewing area on the viewing area surface is set to: the union of the areas covered by the light whose intensity on the viewing area surface is not less than 50% of the maximum light intensity of any light beam contained in the corresponding view of the viewing area. In this patent document, the shape of a viewing area refers to the shape of its distribution area on the viewing area surface. Similar to Example 1 Figures 11 to 13 , Figure 15-17 Various viewport distributions shown. Fig.23 In the figure, the light beams emitted by the controllable light valves corresponding to each viewing zone are shown to converge to a point in the viewing zone. In fact, the light beams emitted by the controllable light valves corresponding to any viewing zone do not necessarily converge to a point. Often, if the area covered by the light intensity of any light beam included in the view corresponding to a viewing zone on the viewing zone surface is not less than 50% of its maximum light intensity, and all of them intersect with the same pupil, the viewing zone can be considered to be effectively generated. Fig.11 In the case of p , where the size of each viewing area is smaller than D p When displaying based on Maxwellian View, the size of each viewing area is not less than D p It can also be displayed based on stereoscopic technology. p , so as to display based on super-multiple views. When implementing super-multiple view display, the size of each viewing area is optimally designed to be smaller than D p The shapes of the viewing areas are not limited to those shown in the above figures, but may be any other shapes.

[0114] In the controllable light valve V i The projected light is directed to the corresponding control unit m j In the case of incident viewing area, the pointing control unit m j The distribution area of ​​the outgoing light beam on the viewing area (the area covered by the light whose intensity on the viewing area surface is not less than 50% of the maximum light intensity) can be various shapes including long strips. The various shapes can be directly directed to the control unit m j The modulation of the incident light is obtained, such as Fig.25 In addition, it can also be achieved by other means, such as in a controllable light valve V j A corresponding one-way scattering sheet structure is placed at the back to realize a long strip viewing area, or it can be realized by setting each light source to be strip-shaped.

[0115] The above embodiment uses O=2 linear deflection characteristics as orthogonal characteristics, and the characteristic controllable light valve array arranged in two dimensions is as follows: Fig.18As shown. If along the x-direction and the y-direction, two adjacent controllable light valves correspond to different orthogonal characteristics respectively; then, along the two directions at 45° to the x-direction, the adjacent controllable light valves can only correspond to the same orthogonal characteristics. In order to overcome the crosstalk between the adjacent directional control units from the controllable light valves corresponding to each other, more orthogonal characteristics are required. The orthogonal characteristic light refers to different characteristic lights that can be mutually exclusive and respectively selected. For example, the timing characteristic lights projected at different time points in a time period can be respectively selected by the corresponding liquid crystal switches being synchronously opened only at the corresponding time points; for example, the timing characteristic of a directional control unit can be implemented by closing or opening the liquid crystal switch attached to the directional control unit under the control of the control device 40 (the attached liquid crystal switch is regarded as a component of the corresponding directional control unit in this patent). For another example, two linear polarization characteristic lights with mutually perpendicular polarization directions, for example, the linear polarization characteristic of a directional control unit or a controllable light valve can be implemented by the corresponding attached polarizer to select the corresponding linear polarization characteristic light and block the non-corresponding linear polarization characteristic light. For example, two kinds of polarization characteristic lights, namely left-handed light and right-handed light, can be selected by the polarization characteristic of a directional control unit or a controllable light valve through the combination of the corresponding attached wave plate and polarizer to select the corresponding polarization characteristic light, and block the non-corresponding polarization characteristic light. For another example, color characteristics corresponding to different wavelengths, for example, the color characteristics of a directional control unit or a controllable light valve can be selected by the corresponding attached color filters to select the corresponding color characteristic light, and block the non-corresponding color characteristic light. The combination of these orthogonal characteristics can also form more types of orthogonal characteristics. Fig.19 Taking the combination characteristics of two timing characteristics and two linear deflection characteristics as an example, along the x direction, the y direction, and the two directions at 45° to the two, two adjacent controllable light valves have different orthogonal characteristics. Among them, t1 means that the controllable light valve is activated at the moment t1 of any time period and is closed at another moment t2; t2 means that the controllable light valve is activated at the moment t2 of any time period and is closed at another moment t1. The directional control unit corresponding to each controllable light valve allows backlight incident only when the corresponding controllable light valve is activated. The permission or non-permission of backlight incidence can be implemented, for example, by turning on and off the liquid crystal switch (controlled by the control device 40) attached to the directional control unit.

[0116] The above embodiments all take M=1 and N=1 as an example. Fig.26 and Fig. 27 They correspond to M=2, N=1 and M=1, N=2 respectively. Fig.26Taking the one-dimensional direction as an example, the pointing control unit array 100 with linear polarization characteristics is grouped with every other pointing control unit, and includes M = 2 groups of pointing control units. Specifically, the pointing control units m1, m2, m3, m4, … form the pointing control unit group 10, and the pointing control units m'1, m'2, m'3, m'4, … form the pointing control unit group 10'. Two adjacent pointing control units belonging to different pointing control unit groups have the same linear polarization characteristics. The controllable light valve array 200 serves as a controllable light valve group 20. Then, the pointing control unit group 10 and the controllable light valve group 20 are constructed into a view area projection structure, and the pointing control unit group 10' and the controllable light valve group 20 are constructed into another view area projection structure, with a total of K = 2 view area projection structures. Fig.26 Among them, different view area projection structures respectively correspond to different backlights along direction 5 and direction 6. For the view area projection structure corresponding to the backlight along direction 5, when activated, the generated view areas are VZ1, VZ2, VZ3, VZ4, VZ5. If the backlight along direction 6 is incident, the view areas generated by the corresponding view area projection structure are shifted to VZ 1' , VZ 2' , VZ 3' , VZ 4' , VZ 5' . Different view area projection structures are sequentially activated at different time points, or according to the pupil position determined by the pupil tracking device 50, only one or 1 < K' < K view area projection structures are activated sequentially, and the view areas generated by the activated view area projection structures can cover the observer's pupil in real time. The activation of a view area projection structure refers to the view area projection of the view area projection structure when backlight is incident in only one direction or when backlight is incident in multiple directions sequentially. Fig.26 Among them, a view area projection structure is shown as only corresponding to the backlight along T = 1 direction. As described above, each view area projection structure can further correspond to the backlight along multiple directions (T > 1). Fig. 27 Also taking the one-dimensional direction as an example, the pointing control unit array 100 with linear polarization characteristics serves as M = 1 group of pointing control units 10, and the controllable light valves of the controllable light valve array 200 are grouped with every other controllable light valve, including N = 2 groups of controllable light valves. Specifically, the controllable light valves V1, V2, V3, V4, … form the controllable light valve group 20, and the controllable light valves V'1, V'2, V'3, V'4, … form the controllable light valve group 20'. Then, the pointing control unit group 10 and the controllable light valve group 20 are constructed into a view area projection structure, and the pointing control unit group 10 and the controllable light valve group 20' are constructed into another view area projection structure, with a total of K = 2 view area projection structures. Different view area projection structures correspond to different backlights, such as Fig.21The two view zone projection structures shown respectively correspond to K = 2 backlights along directions 7 and 8. Different view zone projection structures are sequentially activated at different time points, or according to the pupil position determined by the pupil tracking device 50, only one or 1 < K' < K view zone projection structures are sequentially activated. At this time, the view zones generated by the activated view zone projection structures can cover the observer's pupil in real time. Fig. 27 In it, one view zone projection structure is shown to only correspond to the backlight along T = 1 direction. As described above, each view zone projection structure can further correspond to the backlights along multiple directions (T > 1). The different backlights corresponding to the same view zone projection structure can be sequentially activated at different times; or according to the pupil position determined by the pupil tracking device 50, only one or some of the backlights in different directions are sequentially activated. The activation of a view zone projection structure means the view zone projection of the view zone projection structure when there is only one-direction backlight or when there are sequentially multiple backlights incident. Fig.21 Simply take T = 1 as an example. Fig.26 and Fig. 27 Both take K = 2 as an example, and K can similarly be extended to the case of > 2, such as the cases of M > 1 and N > 1.

[0117] In this embodiment, after the light projected by the backlight assembly 30 is incident on the controllable light valve array 200, it is then regulated by the pointing regulation unit array 100. In this case, the functions of the backlight assembly 30 and the controllable light valve array 200 can be implemented by a backlight type display screen, such as an LCD display screen. At this time, each controllable light valve is to select each pixel or sub-pixel of the display screen, and the backlight structure of the selected display screen is used as the backlight assembly 30. The functions of the backlight assembly 30 and the controllable light valve array 200 can also be implemented by an active light-emitting display screen, such as an OLED display screen, a mini-LED display screen, an LED display screen, etc. At this time, the light-emitting apertures of each pixel or sub-pixel of the display screen are the controllable light valves of the controllable light valve array 200. The selected light-emitting pixels or sub-pixels of the display screen are constructed as the backlight assembly 30, and the control of the light output rate of the incident light by each controllable light valve is implemented by the controller device 40 controlling the light output rate of the light-emitting pixel or sub-pixel corresponding to the controllable light valve. However, different from a conventional display screen, for the display screen, its adjacent pixels or sub-pixels should satisfy the arrangement manner required by this patent: adjacent pixels or sub-pixels correspond to different orthogonal characteristics.

[0118] The functions of the above-mentioned backlight assembly 30 and controllable light valve array 200 can also be implemented by an optical scanning device, such as Fig.28The light scanning device shown includes a scanning device 2001, a scanning light source 2002, and a collimating unit 2003. In the light scanning device, the scanning device 2001 rotates and scans under the drive of the control device 40. Its scanning light source 2002 includes a red (R) light source 2002R, a green (G) light source 2002G, and a blue (B) light source 2002B. Each light source of the light scanning device described in this patent can be a (quasi) laser light source or a non-laser light source. Their emitted light passes through the blue (B) light reflector 2002MB, the green (G) light reflector 2002MG, and the red (R) light reflector 2002MR respectively, and is combined into a composite light beam to enter the scanning device 2001. Among them, the green (G) light reflector 2002MG allows blue light to pass through, and the red (R) light reflector 2002MR allows blue light and green light to pass through. The control device 40 controls the timing deflection of the scanning device 2001 to scan the incident synthetic light beam along different directions and project it to the collimation unit 2003. The collimation unit 2003 modulates the scanned output light beam incident from different directions into a parallel light beam, and incidents each pointing control unit of the pointing control unit array 100 one by one. Fig.28 The focal length is f The lens is used as the collimating unit 2003, which can also be other optical devices with collimating function. The light scanning device scans each light beam at a certain position, and the light intensity coverage area corresponding to 50% of the maximum light intensity value of the light beam at the position is used as a controllable light valve. The virtual controllable light valve is named as an equivalent controllable light valve. The scanning light source 2002 and the light scanning device 2001 are used as the backlight assembly 30. Fig.28 In the embodiment, the position of each equivalent controllable light valve is set at the collimation unit 2003, such as Fig.28 . Obviously, the position of each equivalent controllable light valve can also be set at other points on the corresponding light beam. The control of the incident light output rate by each equivalent controllable light valve is implemented by the control device 40 controlling the light output rate of the corresponding light beam scanned and output by the scanning device 2001. That is, the control device 40 sets the light information (including light intensity and / or color) of the output light of each equivalent controllable light valve by the output light intensity of each corresponding light source at the corresponding time point. Fig.28 In the embodiment, the scanning device 2001 scans in two-dimensional directions to generate an equivalent controllable light valve with two-dimensional distribution. If the scanning device 2001 deflects the incident light beam in one direction at a time interval of β , when the angular spacing is small, the spacing between adjacent equivalent controllable light valves along this direction is approximately f tan( β) . Fig.28 The synthetic light beam incident on the scanning device 2001 may also be a combination of lights of other colors. Fig.28The characteristic of the structure shown is that when a (quasi) laser characteristic light source is used, the divergence angle of the output light of each equivalent controllable light valve can be smaller, which is beneficial to reducing the crosstalk of the output light of each equivalent controllable light valve to the non-corresponding directional control unit when a limited number of orthogonal characteristics can be selected, and the monochromaticity of the light source is also beneficial to suppressing the dispersion effect during the diffraction control process of each directional control unit. Fig.28 In the optical scanning device shown in FIG. 1 , the collimating unit 2003 used can be removed. In this case, the optical scanning device scans the outgoing light beams in different directions and directly incidents the corresponding pointing control units. The collimating unit 2003 can also be replaced by an auxiliary projection device 80, such as Fig.29 The scanning device 2001 scans the emitted light beam and directs it to the control unit array 100 and the auxiliary projection device 80 to project the viewing area to the area where the pupil of the observer is located. Fig.29 In the embodiment, the auxiliary projection device 80 is exemplified as a reflective optical surface in the form of a windshield, and it may also be an optical structure in other forms, such as Fig.30 The structure constructed by the reflective curved surfaces 801 and 802 shown in the figure is another example of a flat reflective surface. The auxiliary projection device 80 can also allow external ambient light to enter while reflecting the light beam from the light scanning device. For example, the auxiliary projection device 80 has a semi-transmissive and semi-reflective property, or transmits and reflects light of different polarization states respectively, and the light emitted by the light scanning device has the property of being reflected by the auxiliary projection device 80. Fig.29 and Fig.30 The display module of the structure shown can be applied to the vehicle head-up display to project the visual area to the driver's pupils; two or even more such display modules can also be provided to project the visual area to the driver's pupils and the area where the two pupils are located. As described above, the projected visual area can be designed in various shapes (including strips) and arranged and distributed, similar to the relevant embodiment 1. Figures 11 to 13 , Figure 15-17 Various viewport distributions shown.

[0119] Fig.28 The optical scanning device shown in the figure can also be combined with a waveguide structure to implement the functions of the backlight assembly 30 and the controllable light valve array 200, such as Fig.31 Example. Fig.31 In the figure, the scanning device 2001 sequentially scans the outgoing light beam, which is collimated by the collimating unit 2003 and then enters the optical waveguide 304 through the entrance pupil 303; after being modulated in its outgoing direction by the coupling device 305, it is totally reflected by the reflection surfaces 306a and 306b and propagates in the optical waveguide 304; the light beams from each equivalent controllable light valve (such as Fig.28 The light beams (as shown in the figure) are designed to be incident on the corresponding pointing control units on the reflecting surface 306a respectively, and are projected to the corresponding viewing areas respectively after being modulated. Fig.31The outgoing light of the pointing control unit shown in the figure is transmitted along the corresponding directions respectively, and is simply shown as being emitted at a small angle. Here, the pointing control unit can also be designed to be placed at other positions in the waveguide structure, and the outgoing light beams of each pointing control unit can also be reflected and emitted through the optical waveguide 304. Optimally, the light beam from any equivalent controllable light valve will no longer continue to be transmitted in the optical waveguide after passing through the corresponding pointing control unit, or although it continues to be transmitted in the optical waveguide, it will not be incident on the non-corresponding viewing area, or although it is incident on the non-corresponding viewing area, the impact of the corresponding display quality as noise is within a tolerable range. Fig.31 In the figure, the collimating unit 2003 is also the collimating device 302 of the waveguide structure. Fig.28 and Fig.31 The scanning device 2001 shown scans in two dimensions to obtain an equivalent controllable light valve with two-dimensional distribution. Fig.32 The structure shown. Fig.32 In the embodiment, two one-dimensional scanning devices 2001a and 2001b scanning in different directions are placed on the front and rear focal planes of two coaxial lenses 2004 and 2005, respectively, and the distance between the two lenses is equal to the sum of their focal lengths. f 1+ f 2.

[0120] Figure 28 to Figure 31 In the structure shown, the orthogonal characteristic settings corresponding to each equivalent controllable light valve, such as the color characteristics or timing characteristics of RGB, can be implemented by controlling the driving of each scanning light source 2002 by the control device 40. The linear deflection characteristic or rotational deflection characteristic can be implemented by placing a corresponding polarizer or polarizer + wave plate at each equivalent controllable light valve. Here, the size of each polarizer or polarizer + wave plate is optimally larger than the size of the corresponding equivalent controllable light valve without spatial conflict between them. The linear deflection characteristic or rotational deflection characteristic can also be achieved by placing a device that can transform the linear deflection characteristic or rotational deflection characteristic in real time after each light source, so as to synchronously modulate the linear deflection characteristic or rotational deflection characteristic of the synthetic light beam incident to the scanning device 2001 as needed. In addition, more than one synthetic light beam can be projected to the same scanning device 2001, or a combination of more than one scanning device 2001 and a scanning light source 2002 can be used to achieve some orthogonal characteristic settings. For example Figure 33 to Figure 36 An example of an optical structure that can implement linear deflection characteristics is shown. Fig.33 In the embodiment, the composite light beams including "R•", "G•" and "B•" lights from light sources 2002R, 2002G and 2002B, and the composite light beams including "R-", "G-" and "B-" lights from light sources 2002R'', 2002G'' and 2002B'', are respectively directed in two directions at an angle of θ Incident scanning device 2001. In order to obtain a smaller θ Value, can be designed Fig.34 The reflecting mirror 2006a and the transflecting mirror 2006b are shown. The angle between the two composite light beams incident on the scanning device 2001 is designed so that each linearly polarized characteristic light beam scanned by the scanning device 2001 is incident on its corresponding pointing control unit. In fact, Fig.34 The two composite beams shown can also be further separated along the same path ( θ =0) are incident on the scanning device 2001. In this case, the two light beams are projected sequentially, but not simultaneously. Light beams from different light sources of the same scanning light source can also be incident on the scanning device 2001 along their respective corresponding directions. For example, the "R•" light beam, "G•" light beam, and "B•" light beam from the light source 2002R, the light source 2002G, and the light source 2002B are incident on the scanning device 2001 along different directions, respectively. Fig.35 Two scanning devices 2001 and 2001''' are set to correspond to the same collimation unit 2003. The two scanning devices 2001 and 2001''' respectively correspond to the scanning light sources to emit a "•" light beam and a "-" light beam respectively. Their light distribution areas at the exit points on the collimation unit 2003 serve as equivalent controllable light valves corresponding to the "•" characteristic or the "-" characteristic respectively. Fig.36 Two scanning devices 2001 and 2001' are provided, and the outgoing light beams are collimated by the corresponding collimating devices 302 and 302', respectively, and then respectively enter the corresponding coupling devices 305 and 305' through the entrance pupils 303 and 303'. Each light beam is transmitted in the optical waveguide and respectively enters the corresponding pointing control unit.

[0121] Figure 33 to Figure 36 In the embodiment, more than one composite light beam is projected to the same scanning device 2001, or the composite light beams are projected to more than one scanning device 2001 respectively, and can also be designed to have the same characteristics. Fig.33 and Fig.34 There is no difference in the wireless deflection characteristics of the two synthetic beams of the incident scanning device 2001. Fig.35 and Fig.36 At this time, the design of projecting more than one synthetic beam to the same scanning device 2001, or projecting synthetic beams to more than one scanning device 2001, can increase the number of corresponding equivalent controllable light valves. Fig.36 In the embodiment, the two synthetic light beams incident on the scanning device 2001 and the scanning device 2001' respectively have no difference in wireless deflection characteristics. At this time, the pointing control units corresponding to the scanning output light beams of different scanning devices can be arranged alternately or cover pointing control units in different areas respectively to increase the coverage area of ​​the pointing control units. Obviously, in the latter case, Fig.36The pointing control unit in the apparatus may no longer be configured to have different line deflection characteristics.

[0122] Figures 28 to 36 In the optical structure shown, when a (quasi) laser characteristic light source is used, each pointing control unit corresponds to the incident light, has a small divergence angle and good monochromaticity; these characteristics are conducive to reducing the crosstalk of each scanned output light to the non-corresponding pointing control unit, and suppressing the crosstalk of each pointing control unit output light to the non-corresponding viewing area. At this time, when the crosstalk of each scanned output light beam to the non-corresponding pointing control unit is not obvious, the adjacent pointing control units can "no longer be assigned different orthogonal characteristics", and similarly perform projection of multiple viewing areas, and perform the above-mentioned three-dimensional display of this patent based on the multiple viewing areas. At this time, each corresponding equivalent controllable light valve is also no longer assigned corresponding orthogonal characteristics.

[0123] Example 3

[0124] In this embodiment, a projection device 60 is further introduced into the three-dimensional display module based on the orthogonal characteristic pointing control unit array described in Embodiment 1 or Embodiment 2 to enlarge the virtual image of the composite optical structure composed of the pointing control unit array 100 and the controllable light valve array 200. The enlarged pointing control unit array 100 and the controllable light valve array 200 are used as the effective pointing control unit array 100 and the effective controllable light valve array 200, and the display is performed in the same way. Fig.37 A lens is used as the projection device 60. The projection device 60 may be any other device with an imaging function, such as a Fresnel lens, a holographic lens, or a phase plate. The display module including the projection device 60 may be used as a near-eye eyepiece, and two near-eye eyepieces corresponding to the two eyes of the observer may be used to build a head-mounted binocular display system (head-mounted VR). Fig.37 The structure shown can further include a deflection device 70, such as Fig.38 The semi-transparent and semi-reflective surface shown can allow external ambient light to enter (head-mounted AR). The projection device 60 and the deflection device 70 can also be combined into an optical structure, such as Fig.39 The free-form surface combination structure shown in FIG. Among them, the surface of the free-form surface device F 1 is the transmission surface, curved surface F 3 is the reflective surface, curved surface F 2 is a semi-reflective and semi-transparent surface, curved surface F 4 is the transmission surface, curved surface F 5 is the transmission surface. F 1. F 3. F 2 and F 4 Implement the function of the projection device 60, the curved surface F 3 and F 2 implements the function of the deflection device 70. F 5.F 2 and F 4 Allow external ambient light to enter without being affected by the device.

[0125] The above are only preferred embodiments of the present invention, but the design concept of the present invention is not limited to this. Any design of different orthogonal characteristics for adjacent controllable light valves and adjacent directional control units, using directional modulation units to directional modulate the outgoing light or incident light of each corresponding controllable light valve to generate multiple viewing areas, and suppressing the crosstalk between non-corresponding directional control units and controllable light valves based on orthogonal characteristics, all fall within the protection scope of the present invention. For example, in the Chinese invention patent "A display module with quadratic constraint on the aperture of a beam divergence angle deflection" (publication number CN112882248A, publication date 2021-06-01), each microstructure of a microstructure array-type spectroscopic device that corresponds one-to-one to pixels or sub-pixels of a display screen, when its corresponding pixel or sub-pixel (corresponding to the controllable light valve of this patent) is given an orthogonal characteristic, the microstructure can also be set to have a corresponding orthogonal characteristic, so as to suppress the crosstalk between each pixel or sub-pixel and a non-corresponding microstructure based on the idea described in this patent. The embodiments of this patent only list some examples of backlight components. Other types of optical structures that are too numerous to mention can provide the required backlight, such as various waveguide structures that can project backlight, can all be used as backlight components of this patent; various microstructures that can regulate incident light and are inexhaustible can all be used as the direction control unit of this patent. The orthogonal characteristics described in this patent only take linear polarity characteristics, color characteristics, time characteristics, or their mixed characteristics as examples, which can also be other possible characteristics, as long as the characteristics can be mutually exclusive and separately selected. Accordingly, all relevant embodiments fall within the scope of protection of the present invention.

Claims

1. A three-dimensional display module based on an array of orthogonal characteristic pointing control units, characterized in that: include: A pointing control unit array (100), the pointing control unit array (100) comprising pointing control units capable of modulating the exit direction of an incident light beam, all pointing control units of the pointing control unit array (100) being divided into M pointing control unit groups (10), and in the same pointing control unit group, adjacent O pointing control units correspondingly only allow O types of orthogonal characteristic light to exit respectively, and each pointing control unit blocks the exit of non-corresponding (O-1) types of orthogonal characteristic light, wherein M≧1, O≧2; A controllable light valve array (200), the controllable light valve array (200) comprising controllable light valves capable of controllably changing the emission rate of incident light, all controllable light valves of the controllable light valve array (200) being divided into N controllable light valve groups (20), wherein N≧1; Any one of the directional control unit groups of the directional control unit array (100) is arranged to correspond to at least one controllable light valve group of the controllable light valve array (200), and a directional control unit group and a controllable light valve group corresponding to each other form a viewing area projection structure, with a total of K viewing area projection structures, where K≧1; Wherein, in the same viewing zone projection structure, each controllable light valve only allows the light of the orthogonal characteristic corresponding to the corresponding direction control unit to be emitted, and each direction control unit controls the direction of the incident light or the emitted light of the corresponding controllable light valve to guide the generation of Z viewing zones, and at least one image can be observed through each of the Z viewing zones, where Z≧1; A control device (40) capable of being connected to the directional control unit array (100) and the controllable light valve array (200) respectively and controlling the incident light output rate of each controllable light valve to correspond to the intensity of projection light information of the scene to be displayed along the corresponding sagittal direction at any time point, The corresponding vector direction of any controllable light valve of the controllable light valve array (200) is the transmission vector direction when the light beam projected by the controllable light valve enters the area where the pupil of the observer is located; A backlight assembly (30), which, under the control of the control device (40), can project backlight along T directions respectively toward the orthogonal characteristic directivity control unit array (100) or the controllable light valve array (200), wherein T≧1; When K>1, the control device (40) sequentially activates the K visual zone projection structures to perform visual zone projection, or the three-dimensional display module based on the orthogonal characteristic pointing control unit array further includes a pupil tracking device (50) connected to the control device (40), and according to the pupil position of the observer determined by the pupil tracking device (50), the control device (40) only activates one visual zone projection structure or the control device (40) sequentially activates K1 visual zone projection structures to perform visual zone projection, wherein 1 <K1<K; The activation of a visual zone projection structure refers to the visual zone projection of the visual zone projection structure based on a backlight in one direction, or the visual zone projection based on backlights in different directions at multiple time points and time sequences; The three-dimensional display module based on the orthogonal characteristic pointing control unit array is configured to project at least two viewing areas.

2. The three-dimensional display module based on the orthogonal characteristic pointing control unit array according to claim 1, characterized in that: The visual zones corresponding to the same pupil of the observer are spaced apart in at least one direction less than the pupil diameter of the observer.

3. The three-dimensional display module based on the orthogonal characteristic pointing control unit array according to claim 1, characterized in that: The viewing zones corresponding to the same pupil of the observer are arranged with a gradient viewing zone spacing along at least one direction.

4. The three-dimensional display module based on the orthogonal characteristic pointing control unit array according to claim 1, characterized in that: The orthogonal characteristics are timing characteristics activated at different time points in a time period, or two linear polarization characteristics with mutually perpendicular polarization directions, or two rotational polarization characteristics for left-handed light and right-handed light, or color characteristics corresponding to different wavelengths, or a combination of any two or more of the timing characteristics activated at different time points in a time period, two linear polarization characteristics with mutually perpendicular polarization directions, or two rotational polarization characteristics for left-handed light and right-handed light, or color characteristics corresponding to different wavelengths.

5. The three-dimensional display module based on the orthogonal characteristic pointing control unit array according to claim 1, characterized in that The backlight along T directions is parallel backlight along T directions.

6. The three-dimensional display module based on the orthogonal characteristic pointing control unit array according to claim 1, characterized in that The pointing control unit is a micro-nano grating structure, or a super surface structure, or a holographic grating structure.

7. The three-dimensional display module based on the orthogonal characteristic pointing control unit array according to claim 1, characterized in that: The backlight assembly (30) is a waveguide structure.

8. The three-dimensional display module based on the orthogonal characteristic pointing control unit array according to claim 1, characterized in that: In the case where the backlight component (30) projects backlight that directly enters the controllable light valve array (200), each controllable light valve of the controllable light valve array (200) is a light exit aperture of each pixel or sub-pixel of a selected active light-emitting display screen, and each light-emitting pixel or sub-pixel of the selected display screen is constructed as the backlight component (30); The control of the incident light output rate by each controllable light valve is implemented by the control device (40) controlling the light output rate of the light-emitting pixel or sub-pixel corresponding to the controllable light valve.

9. The three-dimensional display module based on the orthogonal characteristic pointing control unit array according to claim 1, characterized in that: In the case where the backlight component (30) projects backlight directly incident on the controllable light valve array (200), each controllable light valve of the controllable light valve array (200) is a light intensity coverage area corresponding to 50% of the maximum light intensity value of each light beam projected by the selected light scanning device at a certain position, and is named as an equivalent controllable light valve, and the selected light scanning device is used as the backlight component (30); The control of the output rate of the incident light by each equivalent controllable light valve is implemented by the control device (40) controlling the output rate of the corresponding scanned output light by the selected light scanning device.

10. The three-dimensional display module based on the orthogonal characteristic pointing control unit array according to claim 9, characterized in that: The optical scanning device comprises a scanning device (2001) and a light source (2002); The three-dimensional display module based on the orthogonal characteristic pointing control unit array is configured so that the control device (40) can drive the light source (2002) to project a light beam to the scanning device (2001) so that the light beam is scanned and emitted to the pointing control unit array (100), and each scanned light beam is incident on each pointing control unit of the pointing control unit array (100) in a one-to-one correspondence.

11. The three-dimensional display module based on the orthogonal characteristic pointing control unit array according to claim 10, characterized in that: The optical scanning device further comprises a collimation unit (2003); The three-dimensional display module based on the array of orthogonal characteristic pointing control units is configured so that the control device (40) can drive the light source (2002) to project a light beam to the scanning device (2001) to be scanned and emitted to the collimation unit (2003), and each scanned light beam from the same scanning device (2001) is converted into mutually parallel light beams by the collimation unit (2003).

12. The three-dimensional display module based on the orthogonal characteristic pointing control unit array according to claim 10 or 11, characterized in that: A corresponding orthogonal characteristic modulation structure is placed on the propagation path of each light beam scanned out by the scanning device (2001), so as to give the outgoing light beam the corresponding orthogonal characteristic.

13. The three-dimensional display module based on the orthogonal characteristic pointing control unit array according to claim 10 or 11, characterized in that: It also includes an auxiliary projection device (80) which, together with a direction control unit array (100), projects a viewing area toward the area where the pupil of the observer is located.

14. The three-dimensional display module based on the orthogonal characteristic pointing control unit array according to claim 13, characterized in that: The auxiliary projection device (80) has an optical structure in the form of a windshield.

15. The three-dimensional display module based on the orthogonal characteristic pointing control unit array according to claim 10 or 11, characterized in that: The light source (2002) projects more than one light beam toward the scanning device (2001) in different directions.

16. The three-dimensional display module based on the orthogonal characteristic pointing control unit array according to claim 10 or 11, characterized in that: At least one optical scanning device projects a light beam through a waveguide structure toward a pointing control unit array (100).

17. The three-dimensional display module based on the orthogonal characteristic pointing control unit array according to claim 1, characterized in that: Each controllable light valve is a liquid crystal unit with adjustable grayscale under the control of a control device (40).

18. The three-dimensional display module based on the orthogonal characteristic pointing control unit array according to claim 1, further comprising a projection device (60) for forming an enlarged virtual image of the composite structure composed of the pointing control unit array (100) and the controllable light valve array (200).

19. The three-dimensional display module based on the orthogonal characteristic pointing control unit array according to claim 18, characterized in that: It also comprises a deflection device (70) for guiding a light beam from the composite structure to be transmitted toward the pupil of an observer by deflecting the exit direction of the incident light.

20. The three-dimensional display module based on the orthogonal characteristic pointing control unit array according to claim 1, characterized in that: The viewing area generated by the three-dimensional display module based on the orthogonal characteristic pointing control unit array covers the two pupils of the same observer.

21. A binocular display structure, characterized in that: The binocular display structure comprises two three-dimensional display modules based on an orthogonal characteristic pointing control unit array according to any one of claims 1 to 19; Wherein, the viewing area generated by each three-dimensional display module based on the orthogonal characteristic pointing control unit array of the binocular display structure can only cover one pupil of the same observer.

Images