Naked-eye 3D air imaging system, device and method, and computer storage medium

Abstract

Disclosed in the present disclosure are a naked-eye 3D air imaging system, device and method, and a computer storage medium. The naked-eye 3D air imaging system comprises a naked-eye 3D display module, an equivalent negative refractive index optical element, an eyeball tracking module and a controller. The naked-eye 3D display module is used for displaying a 3D image, and the 3D image comprises a left-eye image and a right-eye image. The naked-eye 3D display module is on one side of the equivalent negative refractive index optical element, which side is a light source side, and the other side of the equivalent negative refractive index optical element is an imaging side. The equivalent negative refractive index optical element is used for converging light, which includes the left-eye image and the right-eye image and is emitted by the naked-eye 3D display module, at a 3D viewpoint position on the imaging side, and forming a three-dimensional air image on the imaging side. The eyeball tracking module is used for acquiring the coordinates of the eyes of a user in real time. The controller is connected to the eyeball tracking module and the naked-eye 3D display module, and is used for sending an image signal to the naked-eye 3D display module on the basis of the coordinates of the eyes of the user, and adjusting the 3D viewpoint position so as to refresh the three-dimensional air image in real time.

Description

Naked-eye 3D aerial imaging system, device, method and computer storage medium

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office of China on March 29, 2024, with application number 202410382043.4 and entitled “Naked-eye 3D aerial imaging system, device, method and computer storage medium,” the entire contents of which are incorporated by reference into this application. Technical Field

[0003] The present disclosure relates to the field of optical manufacturing technology, and in particular to a naked-eye 3D aerial imaging system, device, method and computer storage medium. Background Art

[0004] Glasses-free 3D uses binocular parallax to create realistic three-dimensional images with space and depth, without the need for any auxiliary equipment (such as 3D glasses). Existing aerial display systems mostly combine flat-panel display devices with aerial imaging elements to achieve aerial displays within a two-dimensional plane.

[0005] In existing technologies, two-dimensional aerial real images are gradually failing to meet user needs, and achieving three-dimensional aerial real images is urgent. However, current true three-dimensional display technology is still immature, and there is no suitable three-dimensional light source in the commercial field.

[0006] Public content

[0007] The present disclosure aims to address at least one of the technical issues in the prior art. To this end, one objective of the present disclosure is to provide a glasses-free 3D aerial imaging system that can adjust the 3D viewpoint position according to the position of the user's eyes, ensuring that the user can always view a three-dimensional image with a greater sense of space and depth, regardless of their location.

[0008] In order to achieve the above-mentioned objectives, the naked-eye 3D aerial imaging system proposed in the first embodiment of the present disclosure includes: a naked-eye 3D display module, wherein the naked-eye 3D display module is used to display a 3D image, wherein the 3D image includes a left-eye image and a right-eye image; an equivalent negative refractive index optical element, wherein the naked-eye 3D display module is located on one side of the equivalent negative refractive index optical element, wherein the one side is a light source side, and the other side of the equivalent negative refractive index optical element is an imaging side, wherein the equivalent negative refractive index optical element is used to converge the light rays emitted by the naked-eye 3D display module, including the left-eye image and the right-eye image, at a 3D viewpoint position on the imaging side, and form an aerial three-dimensional stereoscopic image on the imaging side; an eye tracking module, wherein the eye tracking module is used to obtain the coordinates of the user's two eyes in real time; and a controller, wherein the controller is connected to the eye tracking module and the naked-eye 3D display module, and is used to send an image signal to the naked-eye 3D display module according to the coordinates of the user's two eyes, and adjust the 3D viewpoint position to refresh the aerial three-dimensional stereoscopic image in real time.

[0009] According to the naked-eye 3D aerial imaging system proposed in the embodiment of the present disclosure, the naked-eye 3D display module and the equivalent negative refractive index optical element are arranged in combination to combine the naked-eye 3D technology with the aerial imaging technology to realize a three-dimensional stereoscopic image with a sense of space and depth. In addition, by setting an eye tracking module, the coordinates of the user's eyes can be obtained in real time, and then the controller sends an image signal to the naked-eye 3D display module according to the coordinates of the user's eyes, and the 3D viewpoint position is adjusted in real time to refresh the aerial three-dimensional stereoscopic image. In other words, the naked-eye 3D aerial imaging system of the embodiment of the present disclosure can adjust the 3D viewpoint position in time according to the position changes of the user's eyes to realize the naked-eye three-dimensional stereoscopic display of the image. Since there is a certain difference between the images entering the user's left eye and right eye, based on the display principle of binocular parallax, it will provide the user with a real three-dimensional space experience and sense of depth.

[0010] In some embodiments of the present disclosure, the equivalent negative refractive index optical element includes a first optical waveguide array and a second optical waveguide array formed by stacking a plurality of reflective units. The first optical waveguide array and the second optical waveguide array are closely attached to each other in the same plane and are orthogonally arranged.

[0011] In some embodiments of the present disclosure, the cross-section of at least one of the reflection units along the thickness direction of the equivalent negative refractive index optical element is rectangular, and the angle between the extension direction of the sub-waveguide in the first optical waveguide array and the extension direction of one of the sides of at least one of the reflection units satisfies 30°≤θ≤60°.

[0012] In some embodiments of the present disclosure, θ is equal to 45°.

[0013] In some embodiments of the present disclosure, the naked-eye 3D display module includes at least a light source and a light adjustment unit, and the light adjustment unit is used to adjust the light emitted by the light source to form the left-eye image and the right-eye image.

[0014] In some embodiments of the present disclosure, the controller is connected to the light adjustment unit and is used to send the image signal to the light adjustment unit to adjust the propagation direction of the light containing the left eye image and / or adjust the propagation direction of the light containing the right eye image in real time.

[0015] In some embodiments of the present disclosure, an angle is formed between the equivalent negative refractive index optical element and the naked-eye 3D display module.

[0016] In order to achieve the above-mentioned purpose, the second embodiment of the present disclosure proposes a naked-eye 3D aerial imaging device, comprising: a device body and a naked-eye 3D aerial imaging system of any embodiment of the first aspect above, wherein the naked-eye 3D aerial imaging system is arranged on the device body.

[0017] According to the naked-eye 3D aerial imaging device proposed in the embodiments of the present disclosure, by adopting the naked-eye 3D aerial imaging system of any embodiment of the first aspect above, the naked-eye 3D technology is combined with the aerial imaging technology to realize the naked-eye three-dimensional stereoscopic display of images, and the 3D viewpoint position can be adjusted in time according to the changes in the position of the user's eyes to refresh the three-dimensional stereoscopic image in the air. Since there is a certain difference between the images entering the user's left eye and right eye, based on the display principle of binocular parallax, it is ensured that the user can always view the three-dimensional stereoscopic image with a better sense of space and depth no matter where he is.

[0018] In order to achieve the above-mentioned objectives, the third embodiment of the present disclosure further proposes a naked-eye 3D aerial imaging method, which is used for the naked-eye 3D aerial imaging device described in the second embodiment above, including: S1, displaying a 3D image and projecting the 3D image to a 3D viewpoint position on the imaging side, and forming an aerial three-dimensional stereoscopic image on the imaging side; S2, obtaining the coordinates of the user's two eyes; S3, obtaining an image signal based on the coordinates of the user's two eyes; S4, adjusting the 3D viewpoint position based on the image signal; repeating steps S2-S4 to refresh the aerial three-dimensional stereoscopic image in real time.

[0019] The naked-eye 3D aerial imaging method proposed in the embodiment of the present disclosure is used in the naked-eye 3D aerial imaging device of the second embodiment above. On the basis of being able to realize naked-eye three-dimensional stereoscopic display of images, the 3D viewpoint position can also be adjusted in time according to the position changes of the user's eyes to refresh the aerial three-dimensional stereoscopic image, ensuring that the user can always view the three-dimensional stereoscopic image with a better sense of space and depth regardless of their position.

[0020] In order to achieve the above-mentioned objectives, the fourth aspect embodiment of the present disclosure also proposes a non-temporary computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, it implements the naked-eye 3D aerial imaging method as described in any embodiment of the third aspect above.

[0021] According to the non-temporary computer-readable storage medium proposed in the embodiments of the present disclosure, when the computer program stored thereon is executed by a processor, a naked-eye 3D aerial imaging method as in any embodiment of the third aspect above is implemented, which can not only realize the naked-eye three-dimensional stereoscopic display of the image, but also adjust the 3D viewpoint position in time according to the changes in the position of the user's eyes to refresh the aerial three-dimensional stereoscopic image, ensuring that the user can always view the three-dimensional stereoscopic image with a better sense of space and depth regardless of their position.

[0022] Additional aspects and advantages of the present disclosure will be given in part in the description that follows and, in part, will be obvious from the description that follows, or will be learned through practice of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] The above and / or additional aspects and advantages of the present disclosure will become apparent and readily understood from the description of the embodiments in conjunction with the following drawings, in which:

[0024] FIG1 is a block diagram of a naked-eye 3D aerial imaging system according to one embodiment of the present disclosure;

[0025] FIG2 is a schematic diagram of a naked-eye 3D aerial imaging system according to one embodiment of the present disclosure;

[0026] FIG3 is a schematic diagram of an equivalent negative refractive index optical element according to one embodiment of the present disclosure;

[0027] FIG4 is a schematic diagram of an equivalent negative refractive index optical element according to another embodiment of the present disclosure;

[0028] FIG5 is a schematic diagram of an equivalent negative refractive index optical element according to yet another embodiment of the present disclosure;

[0029] FIG6 is a schematic diagram of imaging of two groups of optical waveguide array slabs according to one embodiment of the present disclosure;

[0030] FIG7 is a schematic diagram illustrating the principle of imaging light convergence of a first optical waveguide array according to an embodiment of the present disclosure;

[0031] FIG8 is a schematic diagram illustrating the principle of imaging light convergence of a first optical waveguide array according to another embodiment of the present disclosure;

[0032] FIG9 is a schematic diagram of an imaging optical path of a single-row, multi-row equivalent negative refractive index optical element according to an embodiment of the present disclosure;

[0033] FIG10 is a schematic diagram of an optical path of a naked-eye 3D aerial imaging system according to an embodiment of the present disclosure;

[0034] FIG11 is a schematic diagram of an optical path of a naked-eye 3D aerial imaging system according to another embodiment of the present disclosure;

[0035] FIG12 is a block diagram of a naked-eye 3D aerial imaging device according to one embodiment of the present disclosure;

[0036] FIG13 is a flowchart of a naked-eye 3D aerial imaging method according to an embodiment of the present disclosure.

[0037] Figure numerals: Naked-eye 3D aerial imaging device 100; Naked-eye 3D aerial imaging system 10, device body 20; Naked-eye 3D display module 1; Equivalent negative refractive index optical element 2; Eye tracking module 3; Controller 4; First transparent substrate A; First optical waveguide array B; Second optical waveguide array C; Second transparent substrate D; Light source 11; Light adjustment unit 12; Left-eye screen pixel 121; Right-eye screen pixel 122; Slit grating 123; Rod lens array 124; User left eye 401; User right eye 402; Display area M. DETAILED DESCRIPTION

[0038] Embodiments of the present disclosure are described in detail below, and the embodiments described with reference to the accompanying drawings are exemplary.

[0039] Glasses-free 3D refers to the use of binocular parallax to produce realistic stereoscopic images with space and depth without the need for any auxiliary equipment such as 3D glasses. In existing technologies, glasses-free 3D can be categorized into three types: light barrier, lenticular, and directed light sources. The light barrier technology uses a slit grating in front of the screen. When the image intended for the left eye is displayed on the LCD screen, an opaque stripe blocks the view of the right eye. Similarly, when the image intended for the right eye is displayed on the LCD screen, an opaque stripe blocks the view of the left eye. By separating the left and right eye's visible images, the viewer perceives a 3D image. The lenticular lens technology uses the principle of lens refraction to project the pixels corresponding to the left and right eyes separately, achieving image separation. Directed light source technology uses two sets of LEDs (Light-Emitting Diodes) at different angles, located on the left and right sides, along with a high-refresh rate LCD (Liquid Crystal Display) panel and a reflective prism module, to reflect the image to the left and right eyes in an interleaved order of odd and even frames. Among them, the biggest advantage of cylindrical lens technology compared to light barrier technology is that the lens will not block light, which greatly improves the brightness.

[0040] However, the naked-eye 3D display devices in the prior art, whether based on light barrier technology, cylindrical lens technology or directional light source technology, are mostly flat display devices. In actual application, the naked-eye 3D display device is combined with an aerial imaging element to form an aerial display system, which can realize aerial display in a two-dimensional plane. However, the two-dimensional aerial real image has gradually failed to meet the needs of users. In order to solve the problem that the aerial image formed by the current aerial display system is a 2D display, the embodiment of the present disclosure proposes a new naked-eye 3D aerial imaging system, which can directly present the real image in the air, and can adjust the 3D viewpoint position in real time according to the position of the user's eyes based on eye tracking technology, so as to achieve the purpose of real-time refresh of three-dimensional aerial stereoscopic images, which can enhance the stereoscopic effect of the naked-eye 3D display. The naked-eye 3D aerial imaging system 10 according to the embodiment of the first aspect of the present disclosure is described below with reference to Figures 1 to 11.

[0041] In some embodiments of the present disclosure, as shown in FIG1 , which is a block diagram of a naked-eye 3D aerial imaging system according to one embodiment of the present disclosure, the naked-eye 3D aerial imaging system 10 includes a naked-eye 3D display module 1 , an equivalent negative refractive index optical element 2 , an eye tracking module 3 , and a controller 4 .

[0042] The naked-eye 3D display module 1 is used to display 3D images, which include left-eye and right-eye images. Specifically, the naked-eye 3D display module 1 can use an existing naked-eye 3D display device. The naked-eye 3D display device is a device based on the principles of light barrier technology or cylindrical lens technology. The optical path principles of the two technologies are similar. Both control the light propagation direction of the pixels on the liquid crystal screen image plane to produce a difference in the images incident on the left and right eyes, namely binocular parallax. Alternatively, the naked-eye 3D display device is a device based on the principle of directional light source technology. The directional light source technology is combined with two sets of LEDs at different angles distributed on the left and right sides, a high refresh rate LCD panel and a reflective prism module, so that the images are reflected to the user's left and right eyes in an odd-even frame interlaced order. Among them, because there are subtle differences between the images received by the left and right eyes of the human body, that is, the left eye image and the right eye image, after the left eye image and the right eye image enter the eye, the brain automatically combines the left eye image and the right eye image into a single image, thereby achieving a three-dimensional perception.

[0043] In some embodiments, the naked-eye 3D display module 1 is located on one side of the equivalent negative refractive index optical element 2, which serves as the light source side, and on the other side of the equivalent negative refractive index optical element 2, which serves as the imaging side. The equivalent negative refractive index optical element 2 can perform point-to-point modulation of the target object image, meaning that light rays from any direction passing through the equivalent negative refractive index optical element 2 can be reconverged into a floating real image at a symmetrical position on the equivalent negative refractive index optical element 2. The imaging distance of the floating real image is the same as the distance to the original image, which is equal-distance imaging. Furthermore, the floating real image is located in mid-air, requiring no media carrier, and can be directly presented in mid-air. The display plane of the 3D image emitted by the naked-eye 3D display module 1 is typically a two-dimensional plane. After the light rays of the 3D image are converged by the equivalent negative refractive index optical element 2, a floating real image is formed at a position opposite the naked-eye 3D display module 1 on the imaging side. This floating real image is a three-dimensional image in mid-air.

[0044] Furthermore, the equivalent negative refractive index optical element 2 is used to converge the light rays emitted by the naked-eye 3D display module 1, including the left-eye image and the right-eye image, to the 3D viewpoint position on the imaging side. Furthermore, the 3D viewpoint position can be a certain spatial range. When the user's left eye and right eye are both located within this spatial range, the light rays of the left-eye image and the right-eye image are converged by the equivalent negative refractive index optical element 2 and can enter the left and right eyes of the human body respectively. The user's eyes can each receive a clear real image formed by the left-eye image and the right-eye image when moving within the range of the 3D viewpoint position. Moreover, since there is a certain difference between the images entering the user's left and right eyes, based on the display principle of binocular parallax, and because the images appear to be floating in the air, it will give people a real sense of three-dimensional space and depth.

[0045] It is understandable that the common principles used to achieve aerial imaging technology are mainly the following: 1. Imaging using components based on the lens imaging principle, such as Fresnel lenses and spherical concave mirrors. The light source can present a real image in the air beyond one focal length of the imaging component. 2. Imaging using a dual microlens array (MLA). Unlike light field display, this method uses two layers of MLA. The focal points and optical axes of the corresponding sub-lenses of the two layers of MLA coincide to form a relay optical element, so that each pair of sub-lenses forms an upright image. 3. Imaging using a dihedral corner reflector array (DCRA). The DCRA consists of several pillars, each of which contains two mutually perpendicular reflecting surfaces. After two reflections, the light from the light source converges to a plane-symmetrical position of the light source relative to the DCRA. 4. Imaging using a retroreflector (RR). RR is used as an imaging element. To achieve aerial imaging, a half-reflective half-mirror is required. The light emitted by the light source is incident on the RR through the half-reflective half-mirror. The light will be transmitted in the opposite direction and re-incident on the half-reflective half-mirror. Part of the light is reflected by the half-reflective half-mirror and converges to the light source, and the other part of the light passes through the half-reflective half-mirror and converges to form an image at a position symmetrical to the plane of the light source with respect to the half-reflective half-mirror. 5. Imaging using a double slit mirror array (SMA). SMA is composed of two layers of orthogonal slit mirror arrays. The light is reflected once in each layer of SMA, and then converges to form an image at a position symmetrical to the plane of the double SMA with respect to the light source. Since the double SMA has obvious advantages in terms of light utilization, cost, processing, imaging quality, volume, etc., the equivalent negative refractive index optical element 2 of the embodiment of the present disclosure can adopt an equivalent negative refractive index flat lens based on the principle of the double SMA. For double SMA imaging, it can copy a three-dimensional image in the air, meeting the user's demand for a three-dimensional real image in the air.

[0046] Based on the above, the embodiment of the present disclosure combines a naked-eye 3D display module 1 with an equivalent negative refractive index optical element 2. Although the display plane of the naked-eye 3D technology is a two-dimensional plane, it is based on the display principle of binocular parallax, combined with aerial imaging technology, which can give people a real sense of three-dimensional space and depth.

[0047] In other embodiments, as shown in FIG2 , an angle is formed between the equivalent negative refractive index optical element 2 and the naked-eye 3D display module 1. For example, the angle between the equivalent negative refractive index optical element 2 and the naked-eye 3D display module 1 can be set to 30°, 45°, or 60°, etc., as needed, and is not specifically limited here. Taking the angle between the equivalent negative refractive index optical element 2 and the naked-eye 3D display module 1 as 45° as an example, a display area M is formed on the imaging side of the equivalent negative refractive index optical element 2, which is symmetrical with the naked-eye 3D display module 1. The light containing the 3D image emitted by the naked-eye 3D display module 1 converges at the display area M to form a three-dimensional stereoscopic image.

[0048] In some embodiments, the eye tracking module 3 is used to obtain the coordinates of the user's eyes in real time; the controller 4 is connected to the eye tracking module 3 and the naked eye 3D display module 1, and is used to send image signals to the naked eye 3D display module 1 according to the coordinates of the user's eyes, adjust the 3D viewpoint position to refresh the three-dimensional stereoscopic image in the air in real time. Among them, when a person's eyes look in different directions, there will be subtle changes in the eyes. These changes will produce extractable features. The computer can extract these features through image capture or scanning, thereby tracking the changes in the eyes in real time, predicting the user's state and needs, and responding to achieve the purpose of controlling the device with the eyes. The eye tracking module 3 of the embodiment of the present disclosure is based on the principle of eye tracking technology, and can be a device or equipment composed of an infrared device and an image acquisition device. For example, the module can track according to the changes in the features of the eye and the surrounding area of ​​the eye, and can also track according to the changes in the angle of the iris. It can also actively project infrared light beams to the iris to extract features.

[0049] It can be understood that first, the eye tracking module 3 obtains the coordinates of the user's eyes in real time and sends the coordinates of the eyes to the controller 4; the controller 4 receives the coordinates of the user's eyes and calculates data containing the new 3D viewpoint position based on the coordinates of the user's eyes, and sends the corresponding image signal to the naked-eye 3D display module 1 based on the data. Then, the naked-eye 3D display module 1 will adjust the light propagation direction of the displayed 3D image in a timely manner according to the image signal to adjust the 3D viewpoint position. Specifically, by adjusting the propagation direction of the light containing the left-eye image and / or adjusting the propagation direction of the light containing the right-eye image, the position of the point where the light converges on the imaging side can be changed, so that the entire naked-eye 3D aerial imaging system 10 can refresh the aerial three-dimensional stereoscopic image in real time according to the coordinates of the user's eyes.

[0050] According to the naked-eye 3D aerial imaging system 10 proposed in the embodiment of the present disclosure, the naked-eye 3D display module 1 and the equivalent negative refractive index optical element 2 are arranged in conjunction to combine the naked-eye 3D technology with the aerial imaging technology to realize a three-dimensional stereoscopic image with a sense of space and depth. In addition, by setting the eye tracking module 3, the coordinates of the user's eyes can be obtained in real time, and then the controller 4 sends the image signal to the naked-eye 3D display module 1 according to the coordinates of the user's eyes, and the 3D viewpoint position is adjusted in real time to refresh the aerial three-dimensional stereoscopic image. In other words, the naked-eye 3D aerial imaging system 10 of the embodiment of the present disclosure can adjust the 3D viewpoint position in time according to the position changes of the user's eyes to realize the naked-eye three-dimensional stereoscopic display of the image. Since there is a certain difference between the images entering the user's left eye and right eye, based on the display principle of binocular parallax, it will provide the user with a real three-dimensional space experience and depth sense.

[0051] In some embodiments of the present disclosure, as shown in FIG3 , it is a schematic diagram of an equivalent negative refractive index optical element 2 according to an embodiment of the present disclosure. The equivalent negative refractive index optical element 2 can be a flat lens. The equivalent negative refractive index optical element 2 includes a first optical waveguide array B and a second optical waveguide array C composed of a plurality of stacked reflective units. The first optical waveguide array B and the second optical waveguide array C are tightly fitted and orthogonally arranged in the same plane. According to the enlarged diagram of the thickness plane of the equivalent negative refractive index optical element 2 shown in FIG3 , it can be seen that the sub-waveguides on the first optical waveguide array B and the second optical waveguide array C can be filled and bonded by glue.

[0052] Furthermore, as shown in Figure 3, the equivalent negative refractive index optical element 2 can also include two glass substrates, i.e., glass windows, for protecting the first optical waveguide array B and the second optical waveguide array C. The first optical waveguide array B and the second optical waveguide array C are located between the two glass windows, and the first transparent substrate A, the first optical waveguide array B, the second optical waveguide array C and the second transparent substrate D are arranged in sequence along the thickness direction of the equivalent negative refractive index optical element 2.

[0053] In other embodiments, the orthogonal arrangement of the first optical waveguide array B and the second optical waveguide array C can be understood in conjunction with Figures 4 and 5. Figure 4 is a schematic diagram of an equivalent negative refractive index optical element according to another embodiment of the present disclosure; Figure 5 is a schematic diagram of an equivalent negative refractive index optical element according to yet another embodiment of the present disclosure.

[0054] As shown in Figure 4 , at least one reflective unit in the equivalent negative refractive index optical element 2 has a rectangular cross-section along the thickness direction of the equivalent negative refractive index optical element 2. Specifically, the first transparent substrate A, first optical waveguide array B, second optical waveguide array C, and second transparent substrate D in the disclosed embodiment all have rectangular cross-sections along the thickness direction of the equivalent negative refractive index optical element 2. The sub-waveguides in the first optical waveguide array B and the second optical waveguide array C are arranged obliquely. More specifically, as shown in Figures 4 and 5 , the X direction is the extension direction of the sub-waveguides in the first optical waveguide array B, the Y direction is the extension direction of the sub-waveguides in the second optical waveguide array C, and the Z direction is the thickness direction of the equivalent negative refractive index optical element 2. The first optical waveguide array B and the second optical waveguide array C are relative concepts. The sub-waveguide structures of the two layers of optical waveguide arrays are identical, except that the sub-waveguides are arranged with their extension directions perpendicular to each other.

[0055] Furthermore, as shown in Figure 4 , the first optical waveguide array B and the second optical waveguide array C have a rectangular outer contour. The angle θ between the extension direction of each sub-waveguide and at least two sides of the outer contour of the optical waveguide array is θ, where θ satisfies 30°≤θ≤60°, preferably θ=45°. At this angle, the floating real image is clearest and the afterimage is least noticeable. By employing the equivalent negative refractive index optical element 2 of the above-described embodiment and arranging the sub-waveguides in the two layers of optical waveguide arrays with their extension directions perpendicular to each other, this flat lens can be used to form a real image of a two-dimensional or three-dimensional light source directly in air, achieving a true holographic image. This meets the requirements of a large field of view, large aperture, high resolution, zero distortion, and zero dispersion, while also achieving naked-eye three-dimensional stereoscopic display characteristics.

[0056] In some embodiments, the imaging principle of the equivalent negative refractive index optical element 2 of the present disclosure can be understood in conjunction with Figures 6-9. Figure 6 is a schematic diagram of imaging of two sets of optical waveguide array plates according to one embodiment of the present disclosure; Figure 7 is a schematic diagram of the principle of convergence of imaging light rays of the first optical waveguide array according to one embodiment of the present disclosure; Figure 8 is a schematic diagram of the principle of convergence of imaging light rays of the first optical waveguide array according to another embodiment of the present disclosure; and Figure 9 is a schematic diagram of the principle of the imaging optical path of a single-row, multi-row equivalent negative refractive index optical element according to one embodiment of the present disclosure.

[0057] As can be seen from the above embodiments, the core imaging element of the equivalent negative refractive index optical element 2 is two mutually orthogonal single-row, multi-column equivalent negative refractive index optical waveguide array plates, namely, the first optical waveguide array B and the second optical waveguide array C. As shown in Figure 6, this can achieve aberration-free point-to-point imaging of the object and image. The specific imaging principle is as follows.

[0058] As shown in Figures 7 and 8, the first optical waveguide array B and the second optical waveguide array C can be separated, and the first optical waveguide array B is used as an example for description. In a single-layer optical waveguide array, after passing through a single-sided equivalent negative refractive index flat lens, a single point of light from the object side is split and mirror-modulated by each row of optical waveguides. The light then converges onto a straight line parallel to the long side of the optical waveguide, forming a point-to-line one-dimensional imaging effect. Furthermore, as shown in Figure 9, to achieve a point intersection in both directions, two sets of optical waveguides are required. Specifically, the first optical waveguide array B and the second optical waveguide array C are arranged in close proximity and orthogonal to each other in the same plane. Because the two optical waveguides are arranged in perpendicular directions, the target object image can be modulated point-to-point. Therefore, light from any direction passing through this mutually orthogonal double-layer waveguide array can be re-converged into a floating real image at a symmetrical position of the optical waveguide array. The imaging distance of the floating real image is the same as the distance to the original image, both L, which is equidistant imaging. The position of the floating real image is in the air, so no medium carrier is required, and the real image can be directly presented in the air.

[0059] In some embodiments of the present disclosure, the naked-eye 3D display module 1 includes at least a light source 11 and a light adjustment unit 12. It is understood that the naked-eye 3D display module 1 can be based on light barrier technology or lenticular lens technology. Both technologies have similar optical principles, both controlling the light propagation direction of pixels on the LCD screen image plane to create a difference in the images incident on the left and right eyes, thereby achieving a three-dimensional effect.

[0060] Specifically, as shown in Figure 10, it is a schematic diagram of the optical path of a naked-eye 3D aerial imaging system according to an embodiment of the present disclosure, in which the eye tracking module 3 and the controller 4 are not shown. Among them, the naked-eye 3D display module 1 in the figure adopts a naked-eye 3D display device based on the principle of light barrier technology. The naked-eye 3D display module 1 is mainly composed of left-eye screen pixels 121, right-eye screen pixels 122, a slit grating 123 and a backlight module. Among them, the backlight module is the light source 11, and the left-eye screen pixels 121, the right-eye screen pixels 122 and the slit grating 123 are combined to serve as the light adjustment unit 12. The left-eye screen pixels 121 and the right-eye screen pixels 122 are arranged at intervals in the row direction of the screen, and are respectively used to adjust the light emitted by the light source 11 to form a left-eye image and a right-eye image.

[0061] As shown in Figure 11, it is a schematic diagram of the optical path of a naked-eye 3D aerial imaging system according to another embodiment of the present disclosure, wherein the naked-eye 3D display module 1 in the figure adopts a naked-eye 3D display device based on the principle of cylindrical lens technology, and the eye tracking module 3 and controller 4 are not shown in the figure.

[0062] The naked eye 3D display module 1 is mainly composed of left eye screen pixels 121, right eye screen pixels 122, a cylindrical lens array 124 and a backlight module. The backlight module is the light source 11, and the left eye screen pixels 121, the right eye screen pixels 122 and the cylindrical lens array 124 are combined to form a light adjustment unit 12. The left eye screen pixels 121 and the right eye screen pixels 122 are arranged at intervals in the row direction of the screen, and are respectively used to adjust the light emitted by the light source 11 to form a left eye image and a right eye image. The light of the left eye image and the right eye image is converged through the equivalent negative refractive index optical element 2, and a real image, that is, a three-dimensional stereoscopic image, is formed at a display area M that is symmetrical to the naked eye 3D display module 1 on the imaging side.

[0063] The light is ultimately focused on the imaging side at positions 401 and 402 in Figures 10 and 11 . More specifically, positions 401 and 402 represent the positions of the user's left and right eyes, respectively. Because the images entering the user's left and right eyes differ somewhat, based on the display principle of binocular parallax and because the images appear to be floating in mid-air, they create a tangible sense of three-dimensional space and depth.

[0064] Furthermore, position 401 and position 402 can also be regarded as 3D viewpoint positions, and the 3D viewpoint position can be a certain spatial range. When the user's eyes move within the spatial range of the 3D viewpoint position, they can respectively receive real images formed by clear left eye images and right eye images.

[0065] The controller 4 is connected to the light adjustment unit 12. When the controller 4 controls the light adjustment unit 12 to adjust the 3D viewpoint position, it sends an image signal to the light adjustment unit 12 and controls the light propagation direction of the pixel points on the plane of the left-eye screen pixel 121 and / or the right-eye screen pixel 122, so as to achieve the purpose of real-time adjustment of the propagation direction of the light containing the left-eye image and / or the propagation direction of the light containing the right-eye image, and ultimately changes the position of the point where the light converges on the imaging side, so that the entire naked-eye 3D aerial imaging system 10 can refresh the aerial three-dimensional stereoscopic image in real time according to the coordinates of the user's two eyes.

[0066] Furthermore, the slit grating 123 shown in FIG. 10 and the lenticular lens array 124 shown in FIG. 11 can both be arranged parallel to the arrangement direction of the pixels in the left-eye screen pixels 121 and the right-eye screen pixels 122, or can be arranged at a certain angle. Preferably, the extension direction of the prisms in the slit grating 123 or the lenticular lens array 124 can be arranged at a certain angle to the arrangement direction of the pixels in the left-eye screen pixels 121 and the right-eye screen pixels 122, thereby reducing moiré patterns, i.e., color fringes, and improving the system's display quality.

[0067] In some embodiments, the display area of ​​the 3D image emitted by the naked-eye 3D display module 1 can be calculated according to the following method. The left-eye screen pixels 121 are located in the odd-column display area, and the right-eye screen pixels 122 are located in the even-column display area. Assuming the pixel array of the display area is m (rows) × n (columns), x represents the row coordinate of the pixel point, y represents the column coordinate of the pixel point, and f(x, y) represents the pixel value of the pixel coordinate of the xth row and yth column (x = 1, 2, 3 ... m; y = 1, 2, 3 ... n). The display area is represented by a matrix, and the formula is as follows.

[0068] Among them, formula (1-1) is the expression of the odd column display area, that is, the left eye display area, where P (L) is the matrix of the odd column display area; Formula (1-2) is the expression of the even column display area, that is, the right eye display area, where P (R) The display area of ​​the entire naked-eye 3D display module 1 is the sum of the odd column display area and the even column display area. Therefore, according to formula (1-1) and formula (1-2), formula (1-3) can be obtained, that is, P (3D) =P (L) +P (R) , where P(3D) It is a matrix of the display area of ​​the naked-eye 3D display module 1.

[0069] Alternatively, the naked-eye 3D display module 1 may utilize a naked-eye 3D display device based on the principle of directional light source technology. This directional light source technology utilizes two sets of LEDs at different angles, located on the left and right sides, along with a high-refresh rate LCD panel and a reflective prism module. This allows the image to be reflected to the left and right eyes in an alternating order of odd and even frames, achieving a three-dimensional effect. The specific structure of the naked-eye 3D display device based on the principle of directional light source technology will not be further described here.

[0070] Based on the above, the naked-eye 3D aerial imaging system 10 of the disclosed embodiment combines naked-eye 3D technology with aerial imaging technology to achieve naked-eye 3D stereoscopic display of images. The eye tracking module 3 also tracks the user's eye position in real time, adjusting the 3D viewpoint position according to changes in the user's eye position to refresh the aerial 3D image. This ensures that the user, regardless of their location, always sees a 3D image with a greater sense of space and depth.

[0071] In some embodiments of the second aspect of the present disclosure, a naked-eye 3D aerial imaging device is also proposed, as shown in Figure 12, which is a block diagram of a naked-eye 3D aerial imaging device according to an embodiment of the present disclosure, wherein the naked-eye 3D aerial imaging device 100 includes a device body 20 and a naked-eye 3D aerial imaging system 10 of any one of the above embodiments, and the naked-eye 3D aerial imaging system 10 is arranged on the device body 20.

[0072] According to the naked-eye 3D aerial imaging device 100 proposed in the second embodiment of the present disclosure, by adopting the naked-eye 3D aerial imaging system 10 of the first embodiment above, naked-eye 3D technology is combined with aerial imaging technology to realize naked-eye three-dimensional stereoscopic display of images, and the 3D viewpoint position can be adjusted in time according to the changes in the position of the user's eyes to refresh the three-dimensional stereoscopic image in the air. Since there is a certain difference between the images entering the user's left eye and right eye, based on the display principle of binocular parallax, it is ensured that the user can always view a three-dimensional stereoscopic image with a better sense of space and depth no matter where he is.

[0073] In some embodiments of the third aspect of the present disclosure, as shown in Figure 13, it is a flowchart of a naked-eye 3D aerial imaging method according to an embodiment of the present disclosure, wherein the naked-eye 3D aerial imaging method is used for the naked-eye 3D aerial imaging device 100 of the above second aspect embodiment, and the naked-eye 3D aerial imaging method includes the following steps, which are specifically as follows.

[0074] S1, displaying a 3D image and projecting the 3D image to a 3D viewpoint position on an imaging side, and forming an aerial three-dimensional stereoscopic image on the imaging side.

[0075] Among them, the naked-eye 3D technology can be combined with the aerial imaging technology. From the above embodiments, it can be seen that by combining the naked-eye 3D display module in any embodiment of the first aspect and the equivalent negative refractive index optical element, a three-dimensional stereoscopic image with a sense of space and depth can be achieved.

[0076] S2, obtain the coordinates of the user's eyes.

[0077] Specifically, an eye tracking module 3 can be set up, which can track the changes in the characteristics of the eye and its surroundings, changes in the iris angle, etc. based on the principle of eye tracking technology, and can also actively project infrared light beams to the iris to extract features, and then obtain the coordinates of the user's eyes.

[0078] S3, acquiring image signals according to the coordinates of the user's eyes.

[0079] S4, adjusting the 3D viewpoint position according to the image signal.

[0080] As can be seen from the above first embodiment, the eye tracking module 3 can transmit the coordinates of the user's eyes, acquired in real time, to the controller 4. After receiving the coordinates of the user's eyes, the controller 4 calculates data containing the new 3D viewpoint position based on the coordinates of the user's eyes and transmits a corresponding image signal based on this data to the naked-eye 3D display module 1. The naked-eye 3D display module 1 then adjusts the light propagation direction of the displayed 3D image in accordance with the image signal to adjust the 3D viewpoint position. Furthermore, by repeating steps S2-S4, the 3D viewpoint position can be adjusted in real time based on the changes in the position of the user's eyes, thereby refreshing the aerial three-dimensional image in real time.

[0081] According to the naked-eye 3D aerial imaging method proposed in the third embodiment of the present disclosure, the naked-eye 3D aerial imaging device 100 used in the second embodiment above can not only realize the naked-eye three-dimensional stereoscopic display of images, but also adjust the 3D viewpoint position in time according to the position changes of the user's eyes to refresh the aerial three-dimensional stereoscopic image, ensuring that the user can always view the three-dimensional stereoscopic image with a better sense of space and depth regardless of their position.

[0082] In order to achieve the above-mentioned objectives, the fourth embodiment of the present disclosure further proposes a non-temporary computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the naked-eye 3D aerial imaging method as described in the third embodiment above is implemented.

[0083] According to the non-temporary computer-readable storage medium proposed in the embodiment of the present disclosure, when the computer program stored thereon is executed by a processor, the naked-eye 3D aerial imaging method as described in the third embodiment above is implemented, which can not only realize the naked-eye three-dimensional stereoscopic display of the image, but also adjust the 3D viewpoint position in time according to the changes in the position of the user's eyes to refresh the aerial three-dimensional stereoscopic image, ensuring that the user can always view the three-dimensional stereoscopic image with a better sense of space and depth regardless of their position.

[0084] Other structures and operations of the naked-eye 3D aerial imaging device 100 and the naked-eye 3D aerial imaging system 10 according to the embodiments of the present disclosure are well known to those skilled in the art and will not be described in detail here.

[0085] Although the embodiments of the present disclosure have been shown and described above, it is understood that the above embodiments are illustrative and are not to be construed as limitations on the present disclosure. A person skilled in the art may change, modify, replace and vary the above embodiments within the scope of the present disclosure.

[0086] Throughout this specification, reference to terms such as "one embodiment," "some embodiments," "illustrative embodiments," "example," "specific example," or "some examples" means that a specific feature, structure, material, or characteristic described in conjunction with the embodiment or example is included in at least one embodiment or example of the present disclosure. In this specification, illustrative expressions of the above terms do not necessarily refer to the same embodiment or example.

[0087] Although the embodiments of the present disclosure have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and alterations may be made to the embodiments without departing from the principles and spirit of the present disclosure, the scope of which is defined by the claims and their equivalents.

Claims

1. A naked-eye 3D aerial imaging system, characterized in that: include: A naked-eye 3D display module, wherein the naked-eye 3D display module is used to display 3D images, wherein the 3D images include a left-eye image and a right-eye image; An equivalent negative refractive index optical element, wherein the naked-eye 3D display module is located on one side of the equivalent negative refractive index optical element, the one side being a light source side, and the other side of the equivalent negative refractive index optical element being an imaging side. The equivalent negative refractive index optical element is configured to converge the light rays emitted by the naked-eye 3D display module, including the left-eye image and the right-eye image, at a 3D viewpoint position on the imaging side, and form an aerial three-dimensional stereoscopic image on the imaging side. An eye tracking module, which is used to obtain the coordinates of the user's eyes in real time; and A controller is connected to the eye tracking module and the naked-eye 3D display module, and is used to send image signals to the naked-eye 3D display module according to the coordinates of the user's eyes, adjust the 3D viewpoint position to refresh the aerial three-dimensional stereoscopic image in real time.

2. The naked-eye 3D aerial imaging system according to claim 1, characterized in that: The equivalent negative refractive index optical element includes a first optical waveguide array and a second optical waveguide array formed by stacking a plurality of reflective units. The first optical waveguide array and the second optical waveguide array are closely attached to each other in the same plane and are orthogonally arranged.

3. The naked-eye 3D aerial imaging system according to claim 2, characterized in that: The cross-section of at least one of the reflection units along the thickness direction of the equivalent negative refractive index optical element is rectangular, and the angle between the extension direction of the sub-waveguide in the first optical waveguide array and the extension direction of one side of the at least one reflection unit satisfies 30°≤θ≤60°.

4. The naked-eye 3D aerial imaging system according to claim 3, characterized in that: θ is equal to 45°.

5. The naked-eye 3D aerial imaging system according to any one of claims 1 to 4, characterized in that: The naked-eye 3D display module at least includes a light source and a light adjustment unit. The light adjustment unit is used to adjust the light emitted by the light source to form the left-eye image and the right-eye image.

6. The naked-eye 3D aerial imaging system according to claim 5, characterized in that: The controller is connected to the light adjustment unit and is used to send the image signal to the light adjustment unit to adjust the propagation direction of the light containing the left eye image and / or adjust the propagation direction of the light containing the right eye image in real time.

7. The naked-eye 3D aerial imaging system according to any one of claims 1 to 6, characterized in that: An angle is formed between the equivalent negative refractive index optical element and the naked-eye 3D display module.

8. A naked-eye 3D aerial imaging device, characterized in that: include: Equipment body; and The naked-eye 3D aerial imaging system according to any one of claims 1-7, wherein the naked-eye 3D aerial imaging system is arranged on the device body.

9. A naked-eye 3D aerial imaging method, used in the naked-eye 3D aerial imaging device according to claim 8, characterized in that: include: S1, displaying a 3D image and projecting the 3D image to a 3D viewpoint position on an imaging side, thereby forming an aerial three-dimensional stereoscopic image on the imaging side; S2, obtain the coordinates of the user's eyes; S3, acquiring image signals according to the coordinates of the user's eyes; S4, adjusting the 3D viewpoint position according to the image signal; Steps S2-S4 are repeatedly executed to refresh the aerial 3D image in real time.

10. A non-transitory computer-readable storage medium, characterized in that A computer program is stored thereon, and when the computer program is executed by a processor, the naked-eye 3D aerial imaging method according to claim 9 is implemented.

Images