Imaging system, vehicle and man-machine interaction system based on aerial imaging

Abstract

The invention discloses an imaging system, a vehicle and a man-machine interaction system based on aerial imaging, and the imaging system comprises an imaging device which is used for emitting image light; the floating device comprises a first optical device and a second optical device which are arranged at an interval, the first optical device is used for projecting the image light into the air to present a first floating image, the second optical device is used for projecting the image light into the air to present a second floating image, and the first floating image and the second floating image are arranged at an interval. According to the imaging system, the functions of two sets of imaging devices can be achieved by adopting one set of imaging device, the occupied space of the imaging system can be reduced, the overall cost of the imaging system can be reduced, and meanwhile the watching requirements of multiple persons can be met.

Description

Technical Field

[0001] The present invention relates to the field of imaging technology, and in particular to an imaging system, a vehicle, and a human-computer interaction system based on aerial imaging. Background Art

[0002] In the related technologies, the imaging technologies used in vehicles have relatively simple functions and cannot meet the needs of multiple drivers and passengers in the vehicle. Summary of the invention

[0003] The present invention aims to solve at least one of the technical problems existing in the prior art. To this end, the present invention proposes an imaging system, which can reduce the occupied space of the imaging system and reduce the overall cost of the imaging system, while meeting the viewing needs of multiple people.

[0004] The present invention also provides a vehicle, comprising the above-mentioned imaging system.

[0005] The present invention also provides a human-computer interaction system based on aerial imaging, and the human-computer interaction system based on aerial imaging includes the above-mentioned imaging system.

[0006] According to an embodiment of the present invention, the imaging system includes: an imaging device, which is one and is used to emit image light; a floating device, which includes a first optical device and a second optical device that are arranged at intervals, the first optical device is used to project the image light into the air to present a first floating image, the second optical device is used to project the image light into the air to present a second floating image, and the first floating image and the second floating image are arranged at intervals.

[0007] According to the imaging system of the embodiment of the present invention, by providing an imaging device for emitting image light, and providing a first optical device and a second optical device which are spaced apart from each other for receiving image light and projecting the received image light into the air to respectively form a first floating image and a second floating image which are spaced apart from each other, it is possible to use one imaging device to realize the functions of two imaging devices, thereby reducing the occupied space of the imaging system and the overall cost of the imaging system, and at the same time meeting the viewing needs of multiple people.

[0008] According to some embodiments of the present invention, the imaging device includes: a display, the display is used to display the image source of the first floating image and the second floating image, and the display surface of the display faces the floating device; and a lens array, the lens array is arranged between the display and the floating device and is spaced apart from the display.

[0009] In some embodiments of the present invention, the image elements displayed by the display correspond one-to-one to the multiple lenses in the lens array.

[0010] In some embodiments of the present invention, a barrier array is provided between the display and the lens array.

[0011] In some embodiments of the present invention, the display is a liquid crystal screen, a LED screen, an OLED screen, an AMOLED screen, a MiniLED screen or a Micro LED screen.

[0012] In some embodiments of the present invention, the lens array is a quartz glass piece, a resin material piece or a liquid crystal piece.

[0013] In some embodiments of the present invention, the lens array is a microlens array or a cylindrical lens array.

[0014] According to some embodiments of the present invention, the first optical device is a holographic optical element, which is used to form a virtual image or a real image of the first floating image on a side of the first optical device facing away from the imaging device.

[0015] In some embodiments of the present invention, the first optical device has at least two lenses with different focal lengths recorded in different regions.

[0016] According to some embodiments of the present invention, the second optical device is a semi-transmissive and semi-reflective device or an inversely reflective device, which is used to form a real image of the second floating image on a side of the second optical device facing the imaging device.

[0017] In some embodiments of the present invention, the second optical device is a semi-transparent and semi-reflective film, a polarized reflective film, a holographic optical element with a semi-transparent and semi-reflective function, a retroreflective film, a dihedral array, an equivalent negative refractive index device, a corner cone retroreflector array, a roof array or a holographic optical element with a retroreflective function.

[0018] According to some embodiments of the present invention, in an arrangement direction of the first optical device and the second optical device, the imaging device is located between the first optical device and the second optical device.

[0019] A vehicle according to an embodiment of the present invention comprises: a vehicle body having a main driver's seat and a co-driver's seat; the above-mentioned imaging system, wherein the imaging system is arranged in the vehicle body, the first optical device is arranged opposite to the main driver's seat in the front-to-back direction and is located in front of the main driver's seat, and the second optical device is arranged opposite to the co-driver's seat in the front-to-back direction and is located in front of the co-driver's seat.

[0020] According to the vehicle of the embodiment of the present invention, through the above-mentioned imaging system, an imaging device is provided for emitting image light, and a first optical device located in front of the main driver's seat and a second optical device located in front of the co-driver's seat are provided for receiving image light and projecting the received image light into the air to form a first floating image and a second floating image respectively. It is possible to use one imaging device to realize the functions of two imaging devices, reduce the space occupied by the imaging system and reduce the overall cost of the imaging system, and at the same time meet the viewing needs of the main driver and the additional driver.

[0021] In some embodiments of the present invention, the vehicle body has a front windshield, the first optical device is a membrane-like structure, and the first optical device is arranged on the front windshield.

[0022] In some embodiments of the present invention, the first optical device is disposed on the surface of the front windshield facing the interior of the vehicle body; or the front windshield includes a first layer of glass and a second layer of glass that are stacked, and the first optical device is disposed on one of the two wall surfaces of the first layer of glass and the second layer of glass that face each other.

[0023] In some embodiments of the present invention, the vehicle body has a front windshield, the second optical device is a membrane-like structure, and the second optical device is arranged on the front windshield.

[0024] In some embodiments of the present invention, the second optical device is disposed on the surface of the front windshield facing the interior of the vehicle body; or the front windshield includes a first layer of glass and a second layer of glass that are stacked, and the second optical device is disposed on one of the two wall surfaces of the first layer of glass and the second layer of glass facing each other.

[0025] In some embodiments of the present invention, it also includes: a transparent plane structure, which is arranged in the vehicle body and located in front of the main driving seat and the co-pilot seat, the first optical device and the second optical device are film-like structures and at least one is arranged on one of the two wall surfaces opposite to each other in the thickness direction of the transparent plane structure.

[0026] In some embodiments of the present invention, the vehicle body includes a dashboard, and the imaging device is disposed on the dashboard; or, the imaging device is disposed on an inner top wall of the vehicle body.

[0027] According to an embodiment of the present invention, a human-computer interaction system based on aerial imaging includes: the above-mentioned imaging system, wherein the second floating image is a floating real image; a sensor, used to sense a touch or gesture directed to the second floating image, and generate a sensing signal according to the touch or gesture; and a controller, connected to the sensor and the imaging device, used to receive the sensing signal, and used to control the imaging device to display an image corresponding to the touch or gesture according to the sensing signal.

[0028] According to the human-computer interaction system based on aerial imaging of the embodiment of the present invention, by setting the above-mentioned imaging system, it is possible to use one set of imaging devices to realize the functions of two sets of imaging devices, which can reduce the occupied space of the imaging system and reduce the overall cost of the imaging system, and at the same time meet the viewing needs of multiple people. At the same time, the second floating image is a floating real image, which can realize human-computer interaction.

[0029] Additional aspects and advantages of the present invention will be given in part in the following description and in part will be obvious from the following description, or will be learned through practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] The above and / or additional aspects and advantages of the present invention will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, in which:

[0031] Figure 1 is a schematic diagram of an imaging system according to an embodiment of the present invention;

[0032] Figure 2 A schematic diagram of a dual-viewing area based on an imaging system. Figure 1 ;

[0033] Figure 3 A schematic diagram of a dual-viewing area based on an imaging system. Figure 2 ;

[0034] Figure 4 A schematic diagram of a dual-viewing area based on an imaging system. Figure 3 ;

[0035] Figure 5 A schematic diagram of a dual-viewing area based on an imaging system. Figure 4 ;

[0036] Reference numerals:

[0037] 100. Vehicles;

[0038] 10. Imaging system;

[0039] 1. Imaging device; 11. Display; 12. Microlens array;

[0040] 2. floating device; 21. first optical device; 22. second optical device;

[0041] 3. Barrier array;

[0042] 4. The first floating image; 5. The second floating image;

[0043] 6. Mixed image element; 61. First image element; 62. Second image element; 63. Main driver's viewing area; 64. Second driver's viewing area;

[0044] 20, vehicle body; 201, front windshield; 202, driver's seat; 203, co-driver's seat;

[0045] 30. Driver; 40. Co-driver. DETAILED DESCRIPTION

[0046] Embodiments of the present invention are described in detail below, examples of which are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present invention, and cannot be understood as limiting the present invention.

[0047] In the description of the present invention, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", "clockwise", "counterclockwise", "axial", "radial", "circumferential" and the like indicate positions or positional relationships based on the positions or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation on the present invention. In addition, features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the present invention, unless otherwise specified, "multiple" means two or more.

[0048] In the description of the present invention, it should be noted that, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0049] Reference below Figure 1-Figure 5An imaging system 10 according to an embodiment of the present invention is described.

[0050] like Figure 1 As shown, an imaging system 10 according to an embodiment of the present invention includes an imaging device 1 and a floating device 2 .

[0051] Specifically, Figure 1 As shown, the imaging device 1 is one, and is used to emit image light. The floating device 2 includes a first optical device 21 and a second optical device 22 arranged at intervals, the first optical device 21 is used to project the image light into the air to present a first floating image 4, and the second optical device 22 is used to project the image light into the air to present a second floating image 5, and the first floating image 4 and the second floating image 5 are arranged at intervals.

[0052] The image light emitted by the imaging device 1 can be emitted to the first optical device 21 and the second optical device 22 respectively. The first optical device 21 is used to project the received image light into the air to present a first floating image 4. The second optical device 22 is used to project the received image light into the air to present a second floating image 5. The first floating image 4 and the second floating image 5 are arranged at intervals. Thus, the functions of two sets of imaging devices can be realized by one imaging device 1 and two optical devices, namely the first optical device 21 and the second optical device 22, so that different people can watch different images at different positions, while reducing the occupied space of the imaging system 10 and reducing the cost of the imaging device 1.

[0053] When the imaging system 10 is applied to the vehicle 100, the first optical device 21 and the second optical device 22 can be located in front of the main driver 30 and the co-driver 40, respectively, and form the first floating image 4 and the second floating image 5 in front of the main driver 30 and the co-driver 40, respectively. The first floating image 4 can be used for viewing by the main driver 30, and the second floating image 5 can be used for viewing by the co-driver 40, thereby meeting the usage needs of the main driver 30 and the co-driver 40. At the same time, taking into full consideration that the space in the front cabin of the vehicle 100 is very limited, the space can be greatly saved and the overall cost can be reduced.

[0054] In the related art, the imaging system on the vehicle is only suitable for single-person viewing and cannot meet the needs of multiple people watching at the same time. In addition, the function is single. Even if multiple people watch at the same time, the image they see is the same image, which cannot meet the different viewing needs of multiple people.

[0055] According to the imaging system 10 of the embodiment of the present invention, by providing an imaging device 1 for emitting image light, and providing two optical devices, a first optical device 21 and a second optical device 22, which are spaced apart, for receiving image light and projecting the received image light into the air to respectively form a first floating image 4 and a second floating image 5 which are spaced apart, it is possible to use one imaging device 1 to realize the functions of two imaging devices, thereby reducing the occupied space of the imaging system 10 and reducing the overall cost of the imaging system 10, and at the same time meeting the viewing needs of multiple people.

[0056] In some embodiments of the present invention, Figure 1 As shown, the imaging device 1 includes a display 11 and a lens array 12. The display 11 is used to display the image source of the first floating image 4 and the second floating image 5, and the display surface of the display 11 faces the floating device 2, so that the image light of the image source displayed by the display 11 can be emitted to the first optical device 21 and the second optical device 22 respectively, so that the first optical device 21 and the second optical device 22 display the first floating image 4 and the second floating image 5 respectively.

[0057] The lens array 12 is disposed between the display 11 and the floating device 2 and is spaced apart from the display 11. Optionally, the lens array 12 may be a micro lens array or a cylindrical lens array. The micro lens array is an array composed of lenses with a light aperture and a relief depth of micrometers. Like a traditional lens, the smallest functional unit may also be a spherical lens, an aspherical lens, a cylindrical lens, a prism, etc. It can also achieve focusing, imaging, beam transformation and other functions at a micro-optical angle. Moreover, due to its small unit size and high integration, it can constitute many new optical systems and complete functions that traditional optical elements cannot complete.

[0058] The display 11 and the lens array 12 are combined, and the display 11 and the lens array 12 are arranged at a certain interval, so that different 3D scenes can be displayed in a specific area of ​​a specific depth plane, improving the user experience and having better 3D imaging quality.

[0059] In the related art, floating devices (such as concave lenses and semi-transparent and semi-reflective mirrors) are often used to realize aerial imaging of two-dimensional images, which does not give a strong sense of reality; or the binocular parallax principle is used to watch 3D scenes by wearing 3D glasses, which greatly affects the experience of users wearing myopic glasses. Even if a three-dimensional display is used in the prior art to display a floating 3D real image, a concave mirror is used as an imaging module and is arranged on the optical path of the image light to reflect the image light. However, when the concave mirror re-images a 3D image with a certain depth range, the axial magnification is different, resulting in a large aberration of the aerial 3D image and poor image quality.

[0060] In some embodiments of the present invention, Figure 2 and Figure 4As shown, the image elements displayed by the display 11 correspond one to one with the multiple lenses in the lens array 12, so that the image light of each image element displayed by the display 11 can be reflected through a lens in a lens array 12, thereby ensuring the integrity and clarity of the image displayed on the first optical device 21 and the second optical device 22.

[0061] Specifically, multiple image elements are arranged one by one relative to multiple lenses in the lens array 12, so that the image light of each image element displayed on the display 11 can be better refracted through a lens in a lens array 12, thereby ensuring the integrity and clarity of the image displayed on the first optical device 21 and the second optical device 22.

[0062] Furthermore, if Figure 3 and Figure 5 As shown, a barrier array 3 is provided between the display 11 and the lens array 12. Each barrier in the barrier array 3 is set according to the relative position of the image element and the lens, and the one-to-one corresponding image elements and lenses are separately enclosed together, so that the light emitted by the image element can only pass through the corresponding lens, but cannot pass through the adjacent lens, thereby effectively avoiding the crosstalk phenomenon of the image. For example, in Figure 5 In the example shown, each barrier is arranged at equal intervals.

[0063] In some embodiments of the present invention, the display 11 is a liquid crystal screen, an LED (Light-Emitting DiodeLight) screen, an OLED (Organic Light-Emitting Diode) screen, an AMOLED (Active Matrix / OrganicLight Emitting Diode) screen, a Mini LED (Mini Light Emitting Diode Display) screen, or a Micro LED (Micro Light Emitting Diode Display) screen. This can expand the wide range of material selection for the imaging system 10. Of course, the display 11 can also use LED as a backlight source, which is collimated by a Fresnel lens and then illuminates a transparent liquid crystal screen for display.

[0064] In some embodiments of the present invention, the lens array 12 is made of quartz glass, resin or liquid crystal, thereby expanding the material selection of the imaging system 10 .

[0065] In some embodiments of the present invention, Figure 1As shown, the first optical device 21 is a holographic optical element, which is used to form a virtual image or a real image of the first floating image 4 on the side of the first optical device 21 away from the imaging device 1. The holographic optical element can record the phase information of the wavefront on the holographic material through the interference of the reference light and the signal light, so as to realize the functions of the elements such as the grating, the lens, the microlens array, the scattering sheet, the polarizer grating, etc. The holographic optical element can record the lens information of different focal lengths and change the propagation direction of the light. For example, the holographic optical element records two lenses of different focal lengths in different areas, so that the 3D images of different areas of the viewing area, such as the upper and lower parts, pass through the lenses of the corresponding focal lengths respectively, so that the two displayed 3D virtual images are at different depth positions, and the superposition of different phases can simultaneously compensate for the aberration and change the propagation direction of the light.

[0066] Among them, Figure 1 As shown, when the imaging system 10 is arranged on the vehicle 100 and the first optical device 21 is located in front of the main driving seat 202, the 3D scene of the main driving view area 63 can be reconstructed at different depths after passing through the holographic optical element to achieve a head-up display with an augmented reality effect. The first optical device 21 can record two lenses with different focal lengths in the upper and lower regions. The first optical device 21 can pass the 3D images of different regions of the main driving view area 63, such as the upper and lower parts, through lenses with corresponding focal lengths respectively so that the displayed 3D virtual images A and 3D virtual images B are at different depths. Among them, the 3D virtual image A and the 3D virtual image B can be navigation information and the driving speed of the vehicle 100, respectively, and can be displayed in front of the main driver 30, such as on the road surface in front of the vehicle 100, so that the main driver 30 can look up and view the three-dimensional navigation information and vehicle speed information. Among them, the 3D virtual image A and the 3D virtual image B constitute the first floating image 4.

[0067] In some embodiments of the present invention, the first optical device 21 records at least two lenses with different focal lengths in different areas. Thus, after the 3D images in different areas of the viewing area are respectively passed through the lenses with corresponding focal lengths, the displayed multiple 3D virtual images are at different depth positions, and virtual images of multiple information can be displayed, which is convenient for users to watch and meets the user's usage requirements.

[0068] For example, in Figure 1 In the example shown, the first optical device 21 has two lenses with different focal lengths recorded in the upper and lower regions respectively, and two virtual images A and B can be displayed on the front side of the first optical device 21, such as navigation information and vehicle speed information respectively.

[0069] In some embodiments of the present invention, Figure 1As shown, the second optical device 22 is a semi-transmissive or inverse device, which is used to form a real image of the second floating image 5 on the side of the second optical device 22 facing the imaging device 1. The semi-transmissive and semi-reflective device has a partial reflection and partial transmission property, so that the three-dimensional image has a certain screen-out effect, so as to realize human-computer interaction.

[0070] For example, in Figure 1 In the example shown, the imaging system 10 is applied to the vehicle 100, the second optical device 22 is located in front of the co-pilot seat 203, and the semi-transparent and semi-reflective device is used to reflect the 3D scene of the co-pilot viewing area 64, so that the 3D real image C of the area has a certain screen distance, and the co-pilot 40 can interact with the virtual 3D image by voice, gesture, etc., without affecting the co-pilot 40 receiving the light from the external environment of the car penetrating into the car. Among them, the 3D real image C is the second floating image 5.

[0071] Optionally, the second optical device 22 is a semi-transmissive and semi-reflective film, a polarized reflective film, a holographic optical element with a semi-transmissive and semi-reflective function, a retroreflective film, a dihedral array, an equivalent negative refractive index device, a corner pyramid retroreflector array, a roof array or a holographic optical element with a retroreflective function.

[0072] In some embodiments of the present invention, Figure 1 As shown, in the arrangement direction of the first optical device 21 and the second optical device 22, the imaging device 1 is located between the first optical device 21 and the second optical device 22. This facilitates the image light of the imaging device 1 to be emitted to the first optical device 21 and the second optical device 22, while ensuring the imaging effect of the first optical device 21 and the second optical device 22.

[0073] The following is combined with the above structure reference Figure 1 The imaging principle of the imaging system 10 according to the embodiment of the present invention is described.

[0074] The imaging system 10 of the present application adopts integrated imaging technology, which first uses a lens array 12, such as a microlens array, to record the 3D scene as an image element array, and then displays the 3D scene according to the principle of reversible optical path. Figure 1 As shown, the hybrid image element 6 array displayed by the display 11 includes 3D scene information of the main driver's viewing area 63 and 3D scene information of the auxiliary driver's viewing area 64. Each pixel in the display 11 represents a ray of light, which is refracted by the microlens array 12 and then superimposed, thereby reproducing the corresponding 3D scene in each viewing area.

[0075] Figure 2 Schematic diagram of a dual viewing area top view based on the imaging system 10 Figure 1The imaging device 1 is composed of a display 11 and a microlens array 12, and the distance between the two can be adjusted in real time by a displacement stage. Among them, the image element array displayed by the display 11 needs to first obtain the corresponding image element array from the 3D scenes of the two viewing zones respectively, and then select the respective effective pixels through light directional mapping, and obtain the mixed image element array after cutting and splicing. Therefore, the mixed image element 6 includes a first image element 61 that records the 3D scene information of the main driver's viewing zone 63 and a second image element 62 that records the 3D scene information of the co-driver's viewing zone 64. The pixel size and number of pixels of the display 11 affect the resolution of the imaging system 10, the aperture, focal length and number of the microlens array 12 affect the resolution and viewing angle of the imaging system 10, the distance between the display 11 and the microlens array 12 affects the viewing angle of the imaging system 10, and the generation algorithm and pixel density of the mixed image element 6 affect the viewing range and imaging quality of the main driver's viewing zone 63 and the co-driver's viewing zone 64. There is a mutually restrictive relationship between the above parameters.

[0076] Figure 3 Schematic diagram of a dual viewing area top view based on the imaging system 10 Figure 2 ,exist Figure 3 In the imaging system 10, Figure 2 On the basis of the above, a barrier array 3 is added between the display screen and the microlens array 12, and each barrier is set according to the relative position of the mixed image element 6 and the microlens, so that the light emitted by the mixed image element 6 can only pass through the microlens corresponding to it, but cannot pass through the adjacent microlens, thereby effectively avoiding image crosstalk.

[0077] Figure 4 Schematic diagram of a dual viewing area top view based on the imaging system 10 Figure 3 ,exist Figure 4 In the mixed image element 6, the left and right halves of each image element in the two viewing areas are directly selected and spliced ​​without light directional mapping. The obtained mixed image element 6 array is refracted by the microlens array 12 to display the main driver's viewing area 63 and the co-driver's viewing area 64 in a small range, which is prone to overlap and crosstalk between the two 3D scenes. Figure 4 The method in is simpler and more convenient.

[0078] Figure 4 Schematic diagram of a dual viewing area top view based on the imaging system 10 Figure 4 ,exist Figure 5 In the embodiment of the present invention, the integrated imaging system 10 is Figure 4 On the basis of the above, a barrier array 3 is added between the display screen and the microlens array 12, and each barrier is arranged at equal intervals, so that the light emitted by the mixed image element 6 can only pass through the corresponding microlens, effectively avoiding the image crosstalk phenomenon.

[0079] The imaging system 10 of the present application has the advantages of being viewable with naked eyes, full parallax, full color, no visual fatigue, continuous viewpoints, and high technical maturity.

[0080] The following describes a vehicle 100 according to an embodiment of the present invention.

[0081] like Figure 1 As shown, a vehicle 100 according to an embodiment of the present invention includes a vehicle body 20 and the above-mentioned imaging system 10 .

[0082] Specifically, Figure 1 As shown, the vehicle body 20 has a main driving seat 202 and a co-pilot seat 203, the imaging system 10 is arranged in the vehicle body 20, the optical device 21 is arranged opposite to the main driving seat 202 in the front-to-back direction and is located in front of the main driving seat 202, and the second optical device 22 is arranged opposite to the co-pilot seat 203 in the front-to-back direction and is located in front of the co-pilot seat 203. The first optical device 21 and the second optical device 22 form a first floating image 4 and a second floating image 5 in front of the main driver 30 and the co-pilot 40, respectively. The first floating image 4 is arranged opposite to the main driving seat 202 in the front-to-back direction and is located in front of the main driving seat 202, and the second floating image 5 is arranged opposite to the co-pilot seat 203 in the front-to-back direction and is located in front of the co-pilot seat 203. The first floating image 4 can be used for viewing by the main driver 30, and the second floating image 5 can be used for viewing by the co-driver 40. Only one set of imaging device 1 is used to realize the functions of two sets of imaging devices, meeting the usage needs of the main driver 30 and the co-driver 40. At the same time, taking into full consideration that the front cabin space of the vehicle 100 is very limited, the present application can efficiently utilize the limited space inside the vehicle, meet the different viewing needs of the main driver 30 and the co-driver 40, save space and reduce overall costs.

[0083] In addition, when the imaging device 1 forms a 3D image, the imaging system 10 generates different 3D scenes in the main driver's viewing area 63 and the co-driver's viewing area 64, respectively, and the main driver 30 and the co-driver 40 respectively view the effects of different three-dimensional scenes. For example, the main driver 30 can look up to view the three-dimensional navigation information, and the co-driver 40 can interact with the virtual 3D image through voice, gestures, etc.

[0084] According to the vehicle 100 of the embodiment of the present invention, by setting up the above-mentioned imaging system 10, an imaging device 1 is set up for emitting image light, and a first optical device 21 located in front of the main driver's seat 202 and a second optical device 22 located in front of the co-driver's seat 203 are set up for receiving image light and projecting the received image light into the air to form a first floating image 4 and a second floating image 5 respectively. It can be achieved that one set of imaging device 1 is used to realize the functions of two sets of imaging devices, which can reduce the occupied space of the imaging system 10 and reduce the overall cost of the imaging system 10, while meeting the viewing needs of the main driver and the additional driver.

[0085] In some embodiments of the present invention, the first optical device 21 is a film-like structure, and the first optical device 21 is disposed on the front windshield 201. The front windshield 201 can be used as a carrier of the first optical device 21, and a separate carrier of the first optical device 21 can be avoided, which can save space and reduce costs.

[0086] Furthermore, the first optical device 21 is arranged on the surface of the front windshield 201 facing the interior of the vehicle body 20, so that the front windshield 201 can better protect the first optical device 21, avoid rainwater outside the vehicle 100 from damaging the first optical device 21, ensure the reliability of the first optical device 21, and extend the life of the first optical device 21.

[0087] Of course, the present invention is not limited thereto. The front windshield 201 includes a first layer of glass and a second layer of glass that are stacked, and the first optical device 21 is disposed on one of the two wall surfaces of the first layer of glass and the second layer of glass that face each other. Thus, the front windshield 201 can better protect the first optical device 21, prevent rainwater outside the vehicle 100 from damaging the first optical device 21, ensure the reliability of the first optical device 21, and extend the life of the first optical device 21. At the same time, the front windshield 201 includes two layers of glass, the first layer of glass and the second layer of glass, which can improve the structural strength of the front windshield 201 and provide better protection for the driver and passengers.

[0088] In some embodiments of the present invention, the second optical device 22 is a film-like structure, and the second optical device 22 is disposed on the front windshield 201. The front windshield 201 can be used as a carrier of the second optical device 22, which can avoid the need to separately provide a carrier of the second optical device 22, thereby saving space and reducing costs.

[0089] Furthermore, the second optical device 22 is arranged on the surface of the front windshield 201 facing the interior of the vehicle body 20, so that the front windshield 201 can better protect the second optical device 22, avoid rainwater outside the vehicle 100 from damaging the second optical device 22, ensure the reliability of the second optical device 22, and extend the life of the second optical device 22.

[0090] Of course, the present invention is not limited thereto. The front windshield 201 includes a first layer of glass and a second layer of glass that are stacked, and the second optical device 22 is disposed on one of the two wall surfaces of the first layer of glass and the second layer of glass that face each other. Thus, the front windshield 201 can better protect the second optical device 22, prevent rainwater outside the vehicle 100 from damaging the second optical device 22, ensure the reliability of the second optical device 22, and extend the life of the second optical device 22. At the same time, the front windshield 201 includes two layers of glass, the first layer of glass and the second layer of glass, which can improve the structural strength of the front windshield 201 and provide better protection for the driver and passengers.

[0091] In some embodiments of the present invention, the vehicle 100 further includes a transparent plane structure, which is disposed in the vehicle body 20 and is located in front of the main driver's seat 202 and the co-driver's seat 203. The first optical device 21 and the second optical device 22 are membrane-like structures and at least one is disposed on one of the two wall surfaces opposite to each other in the thickness direction of the transparent plane structure. The transparent structure is independent of the vehicle body 20, which can make the setting positions of the first optical device 21 and the second optical device 22 more flexible and meet different viewing requirements. In addition, setting the carrier of the first optical device 21 and the second optical device 22 as a transparent plane structure can avoid affecting the main driver 30 and the co-driver 40 from receiving light outside the vehicle body 20, and the plane structure facilitates the setting of the first optical device 21 and the second optical device 22 and has a good imaging effect.

[0092] In some embodiments of the present invention, the vehicle body 20 includes a dashboard, and the imaging device 1 is arranged on the dashboard. At the same time, the imaging device 1 is located in the area between the main driver's seat 202 and the co-driver's seat 203, thereby facilitating the image light of the display 11 to be emitted toward the first optical device 21 located in front of the main driver's seat 202 and the second optical device 22 located in front of the co-driver's seat 203 without affecting the line of sight of the main driver 30 and the co-driver 40.

[0093] Of course, the present invention is not limited to this. The imaging device 1 can also be arranged on the inner top wall of the vehicle body 20, and the imaging device 1 is located in the area between the main driver's seat 202 and the co-driver's seat 203, thereby facilitating the image light of the display 11 to be emitted toward the first optical device 21 located in front of the main driver's seat 202 and the second optical device 22 located in front of the co-driver's seat 203 without affecting the sight lines of the main driver 30 and the co-driver 40.

[0094] The following describes a human-computer interaction system based on aerial imaging according to an embodiment of the present invention.

[0095] The human-computer interaction system based on aerial imaging according to an embodiment of the present invention includes the above-mentioned imaging device 1, a sensor and a controller.

[0096] Specifically, the second floating image 5 is a floating real image, the sensor is used to sense the touch or gesture directed to the second floating image 5, and generate a sensing signal according to the touch or gesture, the controller is connected to the sensor and the imaging device 1, for receiving the sensing signal, and for controlling the imaging device 1 to display an image corresponding to the touch or gesture according to the sensing signal.

[0097] The sensor is an optical sensor, including but not limited to far-infrared, near-infrared, ultrasonic, laser interferometer, grating, encoder, fiber-optic or charge-coupled device, etc. The best sensor type can be selected according to the installation space, viewing angle and use environment, so that the user can view or operate the second floating image 5 in the best posture, and the sensitivity and convenience of the user's operation can be improved. The controller can be a control chip, a control chipset or a computer host, etc. The controller and the sensor can be connected by wire or wirelessly to transmit digital or analog signals (that is, the sensing signal is a digital or analog signal), so that the volume of the human-computer interaction system can be flexibly controlled.

[0098] When the second floating image 5 is projected into the air, the user's hand can perform corresponding operations on the second floating image 5, such as touch or gesture. The sensor has a sensing area, and the sensing area of ​​the sensor is located in the same plane as the second floating image 5 or includes the three-dimensional space where the second floating image 5 is located. When the user's hand touches the second floating image 5, the sensor can sense the touch position and feed back the touch position to the controller, and the controller controls the display 11 to display the corresponding image according to the touch position. When the user's hand makes a gesture (such as drawing a circle) at a certain distance from the second floating image 5, the sensor can sense the gesture information and feed back the gesture information to the controller, and the controller controls the display 11 to display the corresponding image according to the gesture information.

[0099] According to the human-computer interaction system based on aerial imaging of the embodiment of the present invention, by setting the above-mentioned imaging system 10, it is possible to use one set of imaging devices 1 to realize the functions of two sets of imaging devices, which can reduce the occupied space of the imaging system 10 and reduce the overall cost of the imaging system 10, and at the same time meet the viewing needs of multiple people. At the same time, the second floating image 5 is a floating real image, which can realize human-computer interaction.

[0100] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "illustrative embodiments", "examples", "specific examples", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.

[0101] Although the embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the claims and their equivalents.

Claims

1. An imaging system, characterized in that: include: An imaging device, the imaging device being one and configured to emit image light; A floating device, comprising a first optical device and a second optical device arranged at intervals, wherein the first optical device is used to project image light into the air to present a first floating image, and the second optical device is used to project image light into the air to present a second floating image, and the first floating image and the second floating image are arranged at intervals.

2. The imaging system according to claim 1, characterized in that The imaging device comprises: A display, the display being used to display image sources of the first floating image and the second floating image, and a display surface of the display facing the floating device; A lens array is disposed between the display and the floating device and is spaced apart from the display.

3. The imaging system according to claim 2, characterized in that The image elements displayed by the display correspond one-to-one to the multiple lenses in the lens array.

4. The imaging system according to claim 2, characterized in that: A barrier array is arranged between the display and the lens array.

5. The imaging system according to claim 2, characterized in that: The display is a liquid crystal screen, a LED screen, an OLED screen, an AMOLED screen, a Mini LED screen or a Micro LED screen.

6. The imaging system according to claim 2, characterized in that: The lens array is a quartz glass piece, a resin material piece or a liquid crystal piece.

7. The imaging system according to claim 2, characterized in that: The lens array is a micro lens array or a cylindrical lens array.

8. The imaging system according to claim 1, characterized in that: The first optical device is a holographic optical element, which is used to form a virtual image or a real image of the first floating image on a side of the first optical device away from the imaging device.

9. The imaging system according to claim 8, characterized in that The first optical device has at least two lenses with different focal lengths recorded in different areas.

10. The imaging system according to claim 1, characterized in that The second optical device is a semi-transmissive and semi-reflective device or an inversely reflective device, and is used to form a real image of the second floating image on a side of the second optical device facing the imaging device.

11. The imaging system according to claim 10, characterized in that: The second optical device is a semi-transparent and semi-reflective film, a polarized reflective film, a holographic optical element with a semi-transparent and semi-reflective function, a retroreflective film, a dihedral array, an equivalent negative refractive index device, a corner pyramid retroreflector array, a roof array or a holographic optical element with a retroreflective function.

12. The imaging system according to claim 1, characterized in that In an arrangement direction of the first optical device and the second optical device, the imaging device is located between the first optical device and the second optical device.

13. A vehicle, characterized in that: include: A vehicle body, wherein the vehicle body has a main driver's seat and a co-driver's seat; The imaging system according to any one of claims 1 to 12, wherein the imaging system is arranged on the vehicle body.

14. The vehicle according to claim 13, characterized in that The first optical device is arranged opposite to the main driving seat in the front-to-back direction and is located in front of the main driving seat, and the second optical device is arranged opposite to the co-pilot seat in the front-to-back direction and is located in front of the co-pilot seat.

15. The vehicle according to claim 13 or 14, characterized in that The vehicle body has a front windshield, the first optical device is a film-like structure, and the first optical device is arranged on the front windshield.

16. The vehicle according to claim 15, characterized in that The first optical device is arranged on the surface of the front windshield facing the inside of the vehicle body; Or the front windshield includes a first layer of glass and a second layer of glass which are stacked, and the first optical device is arranged on one surface of two wall surfaces of the first layer of glass and the second layer of glass which face each other.

17. The vehicle according to claim 13 or 14, characterized in that The vehicle body has a front windshield, the second optical device is a film-like structure, and the second optical device is arranged on the front windshield.

18. The vehicle according to claim 17, characterized in that The second optical device is arranged on the surface of the front windshield facing the inside of the vehicle body; Or the front windshield includes a first layer of glass and a second layer of glass which are stacked, and the second optical device is arranged on one surface of two wall surfaces of the first layer of glass and the second layer of glass which face each other.

19. The vehicle according to claim 13 or 14, characterized in that Also includes: A transparent plane structure is provided in the vehicle body and is located in front of the main driving seat and the co-pilot seat. The first optical device and the second optical device are film-like structures and at least one is provided on one of the two wall surfaces opposite to each other in the thickness direction of the transparent plane structure.

20. The vehicle according to claim 13, characterized in that The vehicle body includes a dashboard, and the imaging device is arranged on the dashboard; Alternatively, the imaging device is arranged on the inner top wall of the vehicle body.

21. A human-computer interaction system based on aerial imaging, characterized in that: include: The imaging system according to any one of claims 1 to 12, wherein the second floating image is a floating real image; a sensor, configured to sense a touch or gesture directed to the second floating image, and generate a sensing signal according to the touch or gesture; as well as The controller is connected to the sensor and the imaging device, and is used to receive the sensing signal and to control the imaging device to display an image corresponding to the touch or gesture according to the sensing signal.

Images