In-vehicle aerial naked-eye 3D imaging system and vehicle

Abstract

An in-vehicle aerial naked-eye 3D imaging system and a vehicle, comprising: an image source, a pupil expansion module, a converging module, and a reflection module, wherein: the image source is used to emit a first light beam containing first image information and a second light beam containing second image information to the pupil expansion module; the pupil expansion module is used to expand the first light beam and the second light beam to obtain a first pupil-expanded light beam and a second pupil-expanded light beam; the converging module is located on the light-emitting side of the pupil expansion module and is used to converge the first pupil-expanded light beam and the second pupil-expanded light beam to obtain a first converged light beam and a second converged light beam; the reflection module is located on the light-emitting side of the converging module and is used to reflect the first converged light beam into a first eyebox area and reflect the second converged light beam into a second eyebox area, thereby forming a naked-eye visible aerial 3D real image.

Description

Technical Field

[0001] This application relates to the field of optical imaging technology, and more specifically to an in-vehicle aerial naked-eye 3D imaging system and a vehicle. Background Technology

[0002] Current human-computer interaction methods mainly focus on voice interaction, where drivers input control signals via voice, and the vehicle's infotainment system then displays and outputs the signals in voice format. However, with the continuous integration of various new functions and performance upgrades in intelligent vehicles, traditional voice interaction methods, due to their limited scope, are insufficient to meet the increasingly sophisticated human-computer interaction needs of drivers and vehicles. Therefore, it has been proposed to combine 3D imaging technology and virtual digital human technology to construct a realistic in-vehicle 3D virtual human as an interaction medium between the driver and the intelligent cockpit, using various interaction methods such as sound and images to improve the accuracy, safety, and entertainment value of human-computer interaction. Based on this, researching the key technologies of a novel information output method (3D virtual human display) in the human-computer interaction process of intelligent vehicles is of great significance for the further development of the intelligent vehicle field.

[0003] One of the essential conditions for realizing in-vehicle 3D virtual humans is building an optical system capable of achieving naked-eye 3D imaging in mid-air within the vehicle. This system mainly involves two key technologies: achieving aerial imaging and naked-eye 3D imaging. Currently, aerial imaging utilizes levitation systems based on semi-reflective films and concave mirrors, while naked-eye 3D imaging utilizes systems based on the principle of binocular parallax. However, the existing aerial imaging system structures are difficult to integrate with car windshields, and the existing naked-eye 3D imaging systems produce virtual images, making it difficult to focus the image inside the vehicle and form a real image in mid-air within the vehicle, thus failing to achieve the desired in-vehicle aerial naked-eye 3D imaging effect. Summary of the Invention

[0004] This application is made to address the aforementioned problems. According to one aspect of this application, an in-vehicle aerial naked-eye 3D imaging system is provided. The system includes an image source, a pupil-expanding module, a converging module, and a reflection module, wherein: the image source is used to emit a first beam containing first image information and a second beam containing second image information to the pupil-expanding module; the pupil-expanding module is used to expand the first beam and the second beam to obtain a first pupil-expanded beam and a second pupil-expanded beam; the converging module is located on the light-emitting side of the pupil-expanding module and is used to converge the first pupil-expanded beam and the second pupil-expanded beam to obtain a first converged beam and a second converged beam; the reflection module is located on the light-emitting side of the converging module and is used to reflect the first converged beam into a first eye-box area and reflect the second converged beam into a second eye-box area, thereby forming a naked-eye visible aerial 3D real image.

[0005] In one embodiment of this application, the pupil dilation module includes a first pupil dilation module and a second pupil dilation module. The first pupil dilation module is used to dilate the first light beam to obtain the first pupil-dilated light beam, and the second pupil dilation module is used to dilate the second light beam to obtain the second pupil-dilated light beam.

[0006] In one embodiment of this application, the image source includes a first image source and a second image source, wherein the first image source is used to emit the first light beam to the first pupil dilator module, and the second image source is used to emit the second light beam to the second pupil dilator module.

[0007] In one embodiment of this application, the converging module includes a first converging module and a second converging module, wherein the first converging module is located at the light output side of the first pupil dilation module and is used to converge the first pupil-dilated light beam to obtain the first converged light beam; the second converging module is located at the light output side of the second pupil dilation module and is used to converge the second pupil-dilated light beam to obtain the second converged light beam.

[0008] In one embodiment of this application, the first converging module and the second converging module include lenses or lens groups, the first converging module is located between the first pupil expanding module and the reflection module, and the second converging module is located between the second pupil expanding module and the reflection module.

[0009] In one embodiment of this application, the first converging module and the second converging module include a holographic grating structure carrying lens information. The first converging module is located on the first pupil expanding module or on the reflection module, and the second converging module is located on the second pupil expanding module or on the reflection module.

[0010] In one embodiment of this application, the reflective module is a windshield.

[0011] In one embodiment of this application, the first pupil dilator module and the second pupil dilator module include waveguide sheets.

[0012] In one embodiment of this application, the waveguide sheet is a volume holographic grating waveguide sheet or an embossed grating waveguide sheet.

[0013] In one embodiment of this application, the range of the first eye box and the range of the second eye box are smaller than the distance between human eyes, and the boundary distance between the range of the first eye box and the range of the second eye box is smaller than the distance between human eyes.

[0014] In one embodiment of this application, the image source includes only one image source, and a timing control module is provided between the image source and the first pupil dilation module and the second pupil dilation module. The timing control module is used to control the image source to alternately emit the first beam and the second beam.

[0015] According to another aspect of this application, a vehicle is provided that includes the aforementioned in-vehicle aerial naked-eye 3D imaging system.

[0016] The in-vehicle aerial naked-eye 3D imaging system and vehicle of this application couple a light beam emitted from an image source into a pupil-expanding module before exiting. The exited beam is then converged by a converging module and reflected by a reflection module into the ranges of the first and second eye-boxes. Through the principle of binocular parallax, a naked-eye visible aerial 3D image is obtained. This allows for the construction of a realistic aerial naked-eye 3D virtual human within the vehicle, improving the accuracy, safety, and entertainment value of human-computer interaction in the field of intelligent vehicles. Attached Figure Description

[0017] The above and other objects, features, and advantages of this application will become more apparent from the more detailed description of the embodiments of this application in conjunction with the accompanying drawings. The drawings are provided to further illustrate the embodiments of this application and form part of the specification. They are used together with the embodiments of this application to explain this application and do not constitute a limitation thereof. In the drawings, the same reference numerals generally represent the same components or steps.

[0018] Figure 1 A schematic structural diagram of an aerial naked-eye 3D imaging system according to an embodiment of this application is shown.

[0019] Figure 2 A schematic structural diagram of an aerial naked-eye 3D imaging system according to another embodiment of this application is shown.

[0020] Figure 3 A schematic structural diagram of an aerial naked-eye 3D imaging system according to another embodiment of this application is shown.

[0021] Figure 4 A schematic diagram showing the relationship between the left and right eye boxes of a binocular parallax scheme naked-eye 3D imaging system according to an embodiment of this application is provided.

[0022] Figure 5 A schematic top view showing the left and right parallax map imaging position relationship of a binocular parallax scheme naked-eye 3D imaging system according to an embodiment of this application. Detailed Implementation

[0023] To make the objectives, technical solutions, and advantages of this application more apparent, exemplary embodiments according to this application will be described in detail below with reference to the accompanying drawings. Obviously, the described embodiments are merely a part of the embodiments of this application, and not all of the embodiments of this application. It should be understood that this application is not limited to the exemplary embodiments described herein. Based on the embodiments of this application described herein, all other embodiments obtained by those skilled in the art without inventive effort should fall within the protection scope of this application.

[0024] First, refer to Figure 1 This application describes an in-vehicle aerial naked-eye 3D imaging system according to an embodiment of the present application. Figure 1 A schematic structural diagram of an in-vehicle aerial naked-eye 3D imaging system according to an embodiment of this application is shown. Figure 1 As shown, the in-vehicle aerial naked-eye 3D imaging system according to an embodiment of this application includes an image source 10, a pupil expansion module 20, a converging module 40, and a reflection module 50, wherein: the image source 10 is used to emit a first beam containing first image information and a second beam containing second image information to the pupil expansion module 20; the pupil expansion module 20 is used to expand the first beam and the second beam to obtain a first pupil-expanded beam 31 and a second pupil-expanded beam 32; the converging module 40 is located on the light-emitting side of the pupil expansion module 20 and is used to converge the first pupil-expanded beam 31 and the second pupil-expanded beam 32 to obtain a first converged beam and a second converged beam; the reflection module 50 is located on the light-emitting side of the converging module 40 and is used to reflect the first converged beam to a first eyebox range 71 and reflect the second converged beam to a second eyebox range 72, thereby forming a naked-eye visible aerial 3D real image.

[0025] In the embodiments of this application, firstly, an image source 10 emits a first beam containing first image information and a second beam containing second image information (i.e., a first beam containing information about the left view of the human eye and a second beam containing information about the right view of the human eye) to a pupil-expanding module 20. The first beam and the second beam enter the pupil-expanding module 20 through coupling. The pupil-expanding module 20 expands the pupils of the first beam and the second beam respectively, resulting in a first pupil-expanded beam 31 and a second pupil-expanded beam 31 (i.e., the first beam and the second beam coupled out by the pupil-expanding module 20). The first pupil-expanded beam 31 and the second pupil-expanded beam 31 are converged by a converging module 40 to obtain a first converged beam. The first and second converged beams are then reflected by the reflection module 50 into the first eyebox range 71 and the second eyebox range 72 respectively (the first eyebox range 71 and the second eyebox range 72 constitute the eyebox 70); the first eyebox range 71 presents the first real image 61 displayed by the first converged beam, and the second eyebox range 72 presents the first real image 62 displayed by the first converged beam; the first eyebox range 71 is also the range of the image that can be seen by the left eye of a person, and the second eyebox range 72 is the range of the image that can be seen by the right eye of a person. The images seen by both eyes can be used to obtain a naked-eye visible three-dimensional real image in the air through the principle of binocular parallax.

[0026] Therefore, the in-vehicle aerial naked-eye 3D imaging system according to this application couples the light beam emitted from the image source into the pupil expansion module before exiting. The exited light beam is then converged by the converging module and reflected by the reflection module into the range of the first and second eye boxes. Through the principle of binocular parallax, a naked-eye visible aerial 3D image is obtained. This allows for the construction of a realistic aerial naked-eye 3D virtual human inside the vehicle, improving the accuracy, safety, and entertainment value of human-computer interaction in the field of intelligent vehicles.

[0027] In embodiments of this application, an in-vehicle aerial naked-eye 3D imaging system includes an image source 10, a pupil expansion module 20 (including a first pupil expansion module 21 and a second pupil expansion module 22), a converging module 40 (including a first converging module 41 and a second converging module 42), and a reflection module 50. The image source 10 emits a first beam containing first image information to the first pupil expansion module 21 and a second beam containing second image information to the second pupil expansion module 22. Specifically, the image source 10 refers to a component used to provide a beam containing image information to generate the desired image. This application does not limit the specific type of the image source 10. The image source 10 is typically installed inside a vehicle and is usually referred to as a Picture Generation Unit (PGU) for generating images. The image source 10 can be a projection optics system, a projector, or other suitable image generation and beam shaping system. Image generation devices include, but are not limited to, curved liquid crystal displays (LCDs), liquid crystal on silicon (LCOS) projectors, digital micromirror device (DMD) projectors, micro-electro-mechanical systems (MEMS) projectors, or holographic projectors. Meanwhile, the image generated by image source 10 can be a photographed image, an image generated through image processing, software modeling, or other suitable methods; no specific limitations are imposed.

[0028] In this embodiment, the image source 10 includes a first image source 11 and a second image source 12. The first image source 11 emits a first light beam to the first pupil dilation module 21, and the second image source 12 emits a second light beam to the second pupil dilation module 22. Specifically, since the image information viewed by a person's left and right eyes has a certain parallax, the image information contained in the left and right eyes is also different. Therefore, two image sources can be used to provide light beams containing different image information. The first image source 11 can emit a first light beam containing the first image information to the first pupil dilation module 21 (that is, the first image source 11 can emit a first light beam containing the image information of the person's left eye to the first pupil dilation module 21), and the second image source 12 can emit a second light beam containing the second image information to the first pupil dilation module 22 (that is, the second image source 12 can emit a second light beam containing the image information of the person's right eye to the second pupil dilation module 22). For example, one PGU can emit a light beam containing the image information of the left eye to the first pupil dilation module 21, and another PGU can emit a light beam containing the image information of the right eye to the second pupil dilation module 22.

[0029] In the embodiments of this application, the image source 10 includes only one image source 10. A timing control module is provided between the image source 10 and the first pupil dilation module 21 and the second pupil dilation module 22. The timing control module is used to control the image source 10 to alternately emit the first beam and the second beam. Specifically, this application can also have a simplified solution, in which only one image source 10 is used to provide beams containing different image information to the first pupil dilation unit 21 and the second pupil dilation unit 22. Therefore, a timing control module needs to be set between the image source 10 and the first pupil expansion module 21 and the second pupil expansion module 22 (that is, a timing control system is added between the image source 10 and the pupil expansion module 20). This involves using one image source 10 and a timing control system that can alternately provide the first pupil expansion module 21 and the second pupil expansion module 22 with a first beam containing first image information and a second beam containing second image information. By having the image source 10 alternately display the first image and the second image (that is, to have one image source alternately display the left eye image and the right eye image), the first beam containing the left eye image information enters the first pupil expansion module 21, and the second beam containing the right eye image information enters the second pupil expansion module 22. This method saves one image source, that is, one image-providing device. This application does not impose a specific limit on the number of image sources; there can be one, two, or more image sources. In one example, image source 10 includes a first image source 11 and a second image source 12. The first image source 11 provides image information input to the first pupil expansion module 21, and the second image source 12 provides image information input to the second pupil expansion module 22. By matching one image source with one pupil expansion module, the use of a timing control module can be avoided, thereby increasing the refresh rate. In another example, four image sources can be used to provide beams containing image information. Two image sources can be used to provide a first beam containing the first image information (i.e., two image sources can be used to provide a beam containing the left eye image information), and another two image sources can be used to provide a second beam containing the second image information (i.e., another two image sources can be used to provide a beam containing the right eye image information). By using two image sources superimposed to provide a beam containing one type of image information, the resulting 3D real image can be brighter and clearer.

[0030] In embodiments of this application, the pupil-expanding module 20 includes a first pupil-expanding module 21 and a second pupil-expanding module 22. The first pupil-expanding module 21 is used to expand the pupil of a first light beam to obtain a first expanded pupil light beam 31; the second pupil-expanding module 22 is used to expand the pupil of a second light beam to obtain a second expanded pupil light beam 32. Since image sources generally use small-sized devices to emit light beams containing image information, the diameter of the emitted light beam is small, causing the human eye to only be able to observe the image within a small range. Therefore, in order to improve the user's viewing experience and facilitate the user to see the image within a larger range, it is necessary to perform pupil expansion processing on the light beam containing image information, that is, to expand the pupil of the light beam containing image information.

[0031] In the embodiments of this application, the first pupil-expanding module 21 and the second pupil-expanding module 22 include waveguide sheets. The first pupil-expanding module 21 and the second pupil-expanding module 22 constitute the pupil-expanding module 20. The pupil-expanding module 20 can use waveguide sheets to expand the pupil of the light beam. That is, the first waveguide sheet is used to expand the pupil of the first light beam containing left-eye image information coupled into the image source, and the second waveguide sheet is used to expand the pupil of the second light beam containing right-eye image information coupled into the image source. The outgoing light beam of the waveguide sheet is expanded to a certain extent to increase the range of the subsequent eye box, making it easier for the user to view the image. However, the area of ​​pupil expansion should not be too large to prevent the subsequent first eye box range 71 and second eye box range 72 from being too large, causing the first eye box range 71 and the second eye box range 72 to intersect, thereby causing the three-dimensional stereoscopic effect of the binocular parallax scheme to fail. Waveguide sheets are chosen as the pupil expansion module 20 in optical imaging systems because they are thin, light-transmitting, have a wide field of view, and offer good display effects. This results in a smaller overall size for the optical imaging system, making it a widely recognized and highly advantageous optical display solution for the future, and it already holds a place in the current market. In the long term, once waveguides overcome mass production bottlenecks, their thinness and superior display performance are expected to lead to rapid market penetration.

[0032] In this embodiment, a beam containing image information can enter the first pupil expansion module 21 and the second pupil expansion module 22 through coupling. That is, a beam containing left-eye image information enters the first waveguide plate through coupling, and a beam containing right-eye image information enters the second waveguide plate through coupling. There are various coupling methods for the waveguide plate, therefore this application does not specifically limit the coupling method. Specifically, from the perspective of high efficiency and a large field of view, prism coupling can be used. Prism coupling is an optical device that uses a prism to couple with a waveguide plate. By transmitting the beam from the center of the prism to the waveguide plate, energy is transferred between free-space photons and waveguide modes, achieving optical coupling. Prism couplers have very high coupling efficiency and are often used in high-speed, high-precision, and high-sensitivity optical systems. From the perspective of lightweighting and miniaturization, holographic grating coupling can also be used. Holographic grating coupling is based on beam transmission and coupling technology. It utilizes the interaction between the incident beam and the periodic refractive index change of the grating to generate a traveling beam effect, which can couple the incident beam into the waveguide. Holographic grating coupling offers numerous advantages, achieving high coupling efficiency and finding wide application in optical communication, sensing, and optical instruments. This technology enables efficient beam transmission and interconnection between different waveguide sheets, significantly facilitating the design and application of optical systems.

[0033] In the embodiments of this application, the waveguide sheet is a volume holographic grating waveguide sheet or an embossed grating waveguide sheet. Specifically, according to the different grating types, waveguide sheets can be mainly divided into two types: volume holographic grating waveguide sheets and embossed grating waveguides. The volume holographic grating waveguide sheet uses a volume holographic grating (VHG) as the coupling and coupling device of the waveguide sheet. A volume holographic grating is an optical element with a periodic structure. It is generally formed by interfering directly within a micrometer-thick photosensitive polymer film through double-beam holographic exposure, causing a periodic change in its refractive index, thereby forming a nanometer-scale grating structure, which can diffract the incident light; it can also be used to shape the exposure beam through the diffraction of special optical devices, thereby performing holographic exposure on the holographic film to obtain the grating structure. By combining the volume holographic grating and the waveguide sheet, the diffraction efficiency of the volume holographic grating can be adjusted by designing the relevant parameters of the volume holographic grating (such as the material refractive index, refractive index modulation factor, and thickness). Embossed grating waveguides use embossed gratings (SRGs) instead of traditional catadioptric optical devices as the coupling-in, coupling-out, and exit pupil expansion devices for the waveguide. Commonly used embossed gratings include tilted gratings, trapezoidal gratings, and rectangular grating structures. Of course, other suitable waveguides can also be selected, and no specific limitation is made.

[0034] In this embodiment, the converging module 40 includes a first converging module 41 and a second converging module 42. The first converging module 41 is located on the light-emitting side of the first pupil-expanding module 21 and is used to converge the first pupil-expanded beam 31 to obtain a first converged beam. The second converging module 42 is located on the light-emitting side of the second pupil-expanding module 22 and is used to converge the second pupil-expanded beam 32 to obtain a second converged beam. Specifically, the first converging module 41 and the second converging module 42 constitute the converging module 40, which converges the beam emitted from the pupil-expanding module 20, thereby forming a suspended real image in the air.

[0035] In embodiments of this application, the first converging module 41 and the second converging module 42 include lenses or lens groups. The first converging module 41 is located between the first pupil dilator module 21 and the reflection module 50, and the second converging module 42 is located between the second pupil dilator module 22 and the reflection module 50. Figure 1 As shown, when the first converging module 41 and the second converging module 42 are lenses or lens groups, the first image source 11 and the second image source 12 firstly emit a first beam containing left-eye image information and a second beam containing right-eye image information to the first pupil dilator 21 and the second pupil dilator 22, respectively. The first beam and the second beam enter the first pupil dilator 21 and the second pupil dilator 22 through coupling to dilate the pupil and obtain the first pupil dilated beam 31 and the second pupil dilated beam 32. The coupling method can be prism coupling, holographic grating coupling, or other suitable coupling methods, which are not specifically limited. The first pupil dilated beam 31 and the second pupil dilated beam 32 enter the first converging module 41 and the second converging module 42, respectively (that is, the first pupil dilated beam 31 and the second pupil dilated beam 32 enter the first lens or the first lens group and the second lens or the second lens group, respectively). The convergence of the beams at the two lens groups can form a suspended real image in the air.

[0036] In this embodiment, a lens is a transparent body bounded by two refractive surfaces, typically made of optical glass. Due to the refraction of the two surfaces, it has the effect of converging or diverging light beams, and can form an image of an object at any desired position. Therefore, it is an indispensable optical component in optical imaging and illumination systems. A lens group is an optical system composed of two or more lenses that can work together to change the direction of light transmission and focusing ability. Specifically, the lenses in a lens group or lens group can be Fresnel lenses, or other suitable lenses, without specific limitations. At the same time, the size of the lens should be larger than the size of the image coupled out from the waveguide sheet to better achieve beam shaping of the image. The focal length of the lens can be specifically selected based on the spatial position of the user's eyes when sitting in the seat, so that the light focus is near the user's eyes.

[0037] In the embodiments of this application, the first converging module 41 and the second converging module 42 include holographic grating structures carrying lens information. The first converging module 41 is located on the first pupil expanding module 21 or on the reflection module 50, and the second converging module 42 is located on the second pupil expanding module 22 or on the reflection module 50. Since lenses or lens groups have large sizes and heavy masses, a holographic grating structure carrying lens information can also be used to achieve the same function as a lens or lens group. See below for reference. Figure 2 This describes the situation where the converging module 40 is a holographic grating structure carrying lens information, and the holographic grating structure carrying lens information is located on the pupil expanding module 20. For example... Figure 2 As shown, firstly, the first image source 11 and the second image source 12 emit a first beam containing left-eye image information and a second beam containing right-eye image information to the first pupil-expanding unit 21 and the second pupil-expanding unit 22, respectively. The first beam and the second beam enter the first pupil-expanding module 21 and the second pupil-expanding module 22 through coupling to expand the pupil and obtain the first pupil-expanded beam and the second pupil-expanded beam. The coupling method can be prism coupling, holographic grating coupling, or other suitable coupling method, which is not specifically limited. The first pupil-expanded beam and the second pupil-expanded beam enter the first converging module 31 and the second converging module 32, respectively. The first converging module 31 and the second converging module 32 are a first holographic grating structure carrying lens information and a second holographic grating structure carrying lens information. The first holographic grating structure carrying lens information and the second holographic grating structure carrying lens information are attached to the first pupil expanding unit 21 and the second pupil expanding unit 22 (that is, the first holographic grating structure carrying lens information is attached to the first waveguide sheet, and the second holographic grating structure carrying lens information is attached to the second waveguide sheet). The first converged beam 41 and the second converged beam 42 after being converged by the first converging module 31 and the second converging module 32 can form a suspended real image in the air.

[0038] In this embodiment, the holographic grating structure carrying lens information is a technical solution to address the problems of large size and mass of lenses or lens groups, leading to a large optical system size. It can also correct distortions in the system, such as those caused by windshield glass. The holographic grating structure records the information of the original lens or lens group into the holographic grating, thereby reducing thickness and mass. Specifically, during the fabrication of the holographic grating waveguide, the original lens or lens group can be added to the optical path, and holographic exposure technology can be used to record the lens or lens group information into the grating. Using a holographic grating structure carrying lens information simplifies the optical system structure; alternatively, computational holography can be used to obtain the design parameters of the holographic grating for fabrication.

[0039] In the embodiments of this application, the first converging module 41 and the second converging module 42 are holographic grating structures carrying lens information. The first converging module 41 is located on the first pupil expanding module 21, on the reflection module 50, or between the first pupil expanding module 21 and the reflection module 50. The second converging module 42 is located on the second pupil expanding module 22, on the reflection module 50, or between the second pupil expanding module 22 and the reflection module 50. (Refer to the following...) Figure 3 This describes the situation where the converging module 40 is a holographic grating structure carrying lens information, and the holographic grating structure carrying lens information is located on the reflecting module 50. For example... Figure 3 As shown, firstly, the first image source 11 and the second image source 12 emit a first beam containing left-eye image information and a second beam containing right-eye image information to the first pupil-expanding unit 21 and the second pupil-expanding unit 22, respectively. The first beam and the second beam enter the first pupil-expanding module 21 and the second pupil-expanding module 22 through coupling to expand the pupil and obtain the first pupil-expanded beam 41 and the second pupil-expanded beam 42. The coupling method can be prism coupling, holographic grating coupling, or other suitable coupling method, which is not specifically limited. The first pupil-expanded beam 41 and the second pupil-expanded beam 42 enter the first converging module 31 and the second converging module 32, respectively. At this time, the first converging module 31 and the second converging module 32 are the first holographic grating structure carrying lens information and the second holographic grating structure carrying lens information, respectively attached to the reflection module 50. The beams converged by the first converging module 31 and the second converging module 32 can form a suspended real image in the air. Specifically, the holographic grating structure carrying lens information is created by adding the aforementioned lens or lens group into the optical path during the fabrication of the holographic grating waveguide, and then using holographic exposure technology to record the original lens or lens group information into the grating. Using a holographic grating structure carrying lens information simplifies the optical system structure and reduces its size and weight.

[0040] In embodiments of this application, the reflection module 50 is located on the light-emitting side of the first converging module 41 and the second converging module 42, and is used to reflect the first converged light beam to the first eyebox range 71 and the second converged light beam to the second eyebox range 72, thereby forming a naked-eye visible three-dimensional real image in the air. Specifically, the reflection module 50 is a windshield, which reflects the first and second converged light beams converged by a lens or lens group (or a holographic grating structure carrying lens information) to the first eyebox range 71 and the second eyebox range 72. Through binocular parallax, a naked-eye three-dimensional real image in the air inside the vehicle can be obtained.

[0041] In embodiments of this application, the first eyebox range 71 and the second eyebox range 72 are smaller than the interocular distance, and the boundary distance between the first eyebox range 71 and the second eyebox range 72 is smaller than the interocular distance. (See below for further details.) Figure 4 This is a schematic diagram illustrating the relationship between the left and right eye boxes of a binocular parallax scheme naked-eye 3D imaging system according to an embodiment of this application. For example... Figure 4 As shown, specifically, the eyebox refers to the movable range within which the human eye can see the complete image; the image can be seen even when the human eye moves left, right, up, and down. The first eyebox range 71 and the second eyebox range respectively present the first real image 61 formed by the first converged beam reflected by the reflection module 50 and the second real image 62 formed by the second converged beam reflected by the reflection module 50.

[0042] In this embodiment, such as Figure 4 As shown, due to the binocular parallax-based naked-eye 3D imaging method, the left eye needs to see only the left parallax map, and the right eye only the right parallax map. Therefore, when viewing naked-eye 3D images, the user should ensure that the left and right eyes are within the first eyebox range 71 and the second eyebox range 72, respectively (i.e., the left eye is within the left eyebox range and the right eye is within the right eyebox range). Therefore, the first eyebox range 71 and the second eyebox range 72 need to be smaller than the interocular distance. Figure 4 In this context, d represents the eye box range (i.e., d is less than the interocular distance). This ensures that the left eye can only see the left view within the left eye box, and the right eye can only see the right view within the right eye box, preventing both eyes from seeing the same disparity map within the same eye box. Simultaneously, the boundary distance between the first eye box range 71 and the second eye box range 72 must be less than the interocular distance. Figure 4 L represents the boundary distance between the first eye box range 71 and the second eye box range 72 (that is, the boundary distance L between the left and right eye boxes is less than the distance between a person's two eyes). The boundary distance between the first eye box range 71 and the second eye box range 72 should be as small as possible to ensure that the left and right eyes can see the images in the left and right eye boxes respectively, satisfy the binocular parallax condition, and experience the naked-eye three-dimensional stereoscopic image effect.

[0043] In the embodiments of this application, reference is made to Figure 5 This is a top view describing the left and right parallax image position relationship of the naked-eye 3D imaging system of the binocular parallax scheme according to an embodiment of this application. The positions of the first real image 61 formed by the first converged beam after reflection by the reflection module 50 and the second real image 62 formed by the second converged beam are as follows: Figure 5As shown. Specifically, the area visible to the human eye of the first real image 61 (i.e., the first eyebox area 71) is the small triangular region below the position of the first real image 61, and the area visible to the human eye of the second real image 62 (i.e., the second eyebox area 72) is the small triangular region below the position of the second real image 62. Based on the imaging principle of binocular parallax, the positions of the first real image 61 and the second real image 62 will have a small spatial difference. The positions of the first real image 61 and the second real image 62 will have a small difference in up, down, front, back, left, and right. This small difference cannot be too large, otherwise it will be difficult to form a stereoscopic effect of a three-dimensional real image. If the positions of the first real image 61 and the second real image 62 are basically overlapped, a stereoscopic effect of a three-dimensional real image can be achieved.

[0044] Therefore, the in-vehicle aerial naked-eye 3D imaging system according to this application couples the light beam emitted from the image source into the pupil expansion module before exiting. The exited light beam is then converged by the converging module and reflected by the reflection module into the range of the first and second eye boxes. Through the principle of binocular parallax, a naked-eye visible aerial 3D image is obtained. This allows for the construction of a realistic aerial naked-eye 3D virtual human inside the vehicle, improving the accuracy, safety, and entertainment value of human-computer interaction in the field of intelligent vehicles.

[0045] Furthermore, according to embodiments of this application, a vehicle is also provided, which may include the in-vehicle aerial naked-eye 3D imaging system described above.

[0046] Based on the above description, the in-vehicle aerial naked-eye 3D imaging system and vehicle of this application couple the light beam emitted from the image source into the pupil expansion module and then out. The outgoing light beam is converged by the converging module and then reflected by the reflection module into the range of the first and second eye boxes. By utilizing the principle of binocular parallax, a naked-eye visible aerial 3D real image is obtained. This allows for the construction of a realistic aerial naked-eye 3D virtual human inside the vehicle, improving the accuracy, safety, and entertainment value of human-computer interaction in the field of intelligent vehicles.

[0047] Although exemplary embodiments have been described herein with reference to the accompanying drawings, it should be understood that the above exemplary embodiments are merely illustrative and are not intended to limit the scope of this application. Various changes and modifications can be made therein by those skilled in the art without departing from the scope and spirit of this application. All such changes and modifications are intended to be included within the scope of this application as claimed in the appended claims.

[0048] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0049] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another device, or some features may be ignored or not executed.

[0050] Numerous specific details are set forth in the specification provided herein. However, it will be understood that embodiments of this application may be practiced without these specific details. In some instances, well-known methods, structures, and techniques have not been shown in detail so as not to obscure the understanding of this specification.

[0051] Similarly, it should be understood that, in order to streamline this application and aid in understanding one or more of the various inventive aspects, features of this application may sometimes be grouped together in a single embodiment, figure, or description thereof in the description of exemplary embodiments of this application. However, this approach should not be construed as reflecting an intention that the claimed application requires more features than are expressly recited in each claim. Rather, as reflected in the corresponding claims, its inventive point lies in solving the corresponding technical problem with features fewer than all features of a single disclosed embodiment. Therefore, the claims following the detailed description are hereby expressly incorporated into that detailed description, wherein each claim itself is a separate embodiment of this application.

[0052] Those skilled in the art will understand that, apart from the mutual exclusion of features, all features disclosed in this specification (including the accompanying claims, abstract, and drawings) and all processes or units of any method or apparatus so disclosed can be combined in any combination. Unless otherwise expressly stated, each feature disclosed in this specification (including the accompanying claims, abstract, and drawings) may be replaced by an alternative feature that serves the same, equivalent, or similar purpose.

[0053] Furthermore, those skilled in the art will understand that although some embodiments described herein include certain features included in other embodiments but not others, combinations of features from different embodiments are intended to be within the scope of this application and form different embodiments. For example, in the claims, any one of the claimed embodiments can be used in any combination.

[0054] The various component embodiments of this application can be implemented in hardware, or as software modules running on one or more processors, or a combination thereof. Those skilled in the art will understand that microprocessors or digital signal processors (DSPs) can be used in practice to implement some or all of the functions of some modules according to the embodiments of this application. This application can also be implemented as a program (e.g., a computer program and computer program product) for performing part or all of the methods described herein. Such a program implementing this application can be stored on a computer-readable medium, or can be in the form of one or more signals. Such signals can be downloaded from an Internet website, provided on a carrier signal, or provided in any other form.

[0055] It should be noted that the above embodiments are illustrative of this application and not limiting of it, and that those skilled in the art can devise alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses should not be construed as limiting the claims. The word "comprising" does not exclude the presence of elements or steps not listed in the claims. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. This application can be implemented by means of hardware comprising several different elements and by means of a suitably programmed computer.

[0056] The above description is merely a specific embodiment or illustration of the embodiments of this application. The scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. The scope of protection of this application shall be determined by the scope of the claims.

Claims

1. An in-vehicle aerial naked-eye 3D imaging system, characterized in that, The system includes an image source, a pupil expansion module, a convergence module, and a reflection module, wherein: The image source is used to emit a first beam containing first image information and a second beam containing second image information to the pupil expansion module; The pupil-expanding module is used to expand the pupils of the first beam and the second beam to obtain a first pupil-expanded beam and a second pupil-expanded beam. The converging module is located on the light-emitting side of the pupil-expanding module and is used to converge the first pupil-expanded beam and the second pupil-expanded beam to obtain a first converged beam and a second converged beam. The reflective module is located on the light-emitting side of the converging module and is used to reflect the first converged light beam to the first eye box range and the second converged light beam to the second eye box range. The first eye box range presents a first real image formed by the first converged light beam, and the second eye box range presents a second real image formed by the second converged light beam. The first real image and the second real image form a naked-eye visible three-dimensional real image in the air. The ranges of the first eye box and the second eye box are smaller than the distance between human eyes, and the boundary distance between the ranges of the first eye box and the second eye box is smaller than the distance between human eyes. The reflective module is a windshield.

2. The system according to claim 1, characterized in that, The pupil dilation module includes a first pupil dilation module and a second pupil dilation module. The first pupil dilation module is used to dilate the first beam to obtain the first dilated beam, and the second pupil dilation module is used to dilate the second beam to obtain the second dilated beam.

3. The system according to claim 2, characterized in that, The image source includes a first image source and a second image source. The first image source is used to emit the first light beam to the first pupil dilator module, and the second image source is used to emit the second light beam to the second pupil dilator module.

4. The system according to claim 2, characterized in that, The aggregation module includes a first aggregation module and a second aggregation module, wherein... The first converging module is located at the light output side of the first pupil expanding module and is used to converge the first pupil expanded beam to obtain the first converged beam. The second converging module is located at the light output position of the second pupil expansion module and is used to converge the second pupil expansion beam to obtain the second converged beam.

5. The system according to claim 4, characterized in that, The first converging module and the second converging module include lenses or lens groups. The first converging module is located between the first pupil expanding module and the reflection module, and the second converging module is located between the second pupil expanding module and the reflection module.

6. The system according to claim 4, characterized in that, The first converging module and the second converging module include a holographic grating structure carrying lens information. The first converging module is located on the first pupil expanding module or on the reflection module, and the second converging module is located on the second pupil expanding module or on the reflection module.

7. The system according to any one of claims 2-6, characterized in that, The first pupil expansion module and the second pupil expansion module include waveguide sheets.

8. The system according to claim 7, characterized in that, The waveguide sheet is a volume holographic grating waveguide sheet or an embossed grating waveguide sheet.

9. The system according to claim 2, characterized in that, The image source includes only one image source, and a timing control module is provided between the image source and the first pupil expansion module and the second pupil expansion module. The timing control module is used to control the image source to alternately emit the first beam and the second beam.

10. A vehicle, characterized in that, The vehicle includes an in-vehicle aerial naked-eye 3D imaging system as described in any one of claims 1-9.

Images