Head-up display

By using light-guiding components and spectroscopic elements in the head-up display device to analyze the ambient spectrum, identify external concealments and image them in front of the driver, the problem that drivers find it difficult to identify dangerous factors in harsh environments is solved, and driving safety and information acquisition are improved ability.

CN118131478BActive Publication Date: 2024-11-15JIANGSU NEW VISION AUTOMOTIVE ELECTRONICS CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202311371663.X
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-10-20
Publication Date
2024-11-15
Estimated Expiration
2043-10-20

AI Technical Summary

Technical Problem

In road sections with insufficient light or glare, fog, and thick smoke, it is difficult for the driver to accurately identify environmental hazards and hidden objects around the vehicle, resulting in increased driver fatigue and safety hazards.

Method used

Design a head-up display device to guide ambient light into the light-transmitting plate through the light-guiding component, use the spectroscopy elements to form different wavelengths, and the detector receives and analyzes spectral information to identify hidden objects or hazardous sources in the external environment. The image light is turned into image in front of the driver to achieve the integration of environmental acquisition and image projection.

Benefits of technology

It improves the driver's ability to obtain vehicle driving information, enhances driving safety, especially assists in driving in harsh environments, reducing driver mental fatigue and safety hazards.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118131478B_ABST
    Figure CN118131478B_ABST
Patent Text Reader

Abstract

The present disclosure relates to the field of smart cockpit technology, and more specifically, to a head-up display device. The head-up display device includes a housing, a light introduction component, an image source, a spectroscopic element, and a detector. The housing includes a shell and a light-transmitting plate that is snapped onto the shell; the light introduction component is disposed outside the shell and includes a front telephoto lens; the spectroscopic element is disposed within the shell; the light introduction component is used to transmit ambient light to the light-transmitting plate so that the ambient light enters the spectroscopic element through the light-transmitting plate, and the spectroscopic element is used to disperse the complex light incident on the spectroscopic element to form a spectrum of different wavelengths; the spectroscopic element is also used to turn the image light emitted by the image source to the inner surface of the light-transmitting plate so that the image light passes through the light-transmitting plate and enters the projection medium; the detector is disposed within the shell and is used to receive the spectrum. The head-up display device disclosed in the present disclosure can integrate the environment acquisition function with the image projection function, which is conducive to improving driving safety.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the technical field of smart cockpits, and in particular to a head-up display device. Background Art

[0002] When a vehicle is driving through a road section with insufficient lighting or with glare, heavy fog, or thick smoke, the driver's visual range is short and is easily disturbed by the environment. The driver cannot accurately identify dangerous factors and hidden objects in the environment, which can easily lead to driver fatigue and pose a major safety hazard.

[0003] It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present disclosure, and therefore may include information that does not constitute the prior art known to ordinary technicians in the field. Summary of the invention

[0004] The purpose of the present disclosure is to provide a head-up display device that can obtain spectral information of the vehicle's external environment, which is beneficial to improving driving safety.

[0005] The present disclosure provides a head-up display device, comprising:

[0006] The housing comprises a shell and a light-transmitting plate buckled with the shell;

[0007] A light introduction component is arranged outside the housing, and the light introduction component includes a front telephoto lens;

[0008] An image source, disposed in the housing, for generating and emitting image light;

[0009] The light splitting element is arranged in the housing. The light introduction component is used to transmit the ambient light entering the front telephoto lens to the light-transmitting plate, so that the ambient light enters the light splitting element through the light-transmitting plate. The light splitting element is used to disperse the complex light entering the light splitting element to form a spectrum of different wavelengths. The light splitting element is also used to deflect the image light emitted by the image source to the inner surface of the light-transmitting plate, so that the image light passes through the light-transmitting plate and enters the projection medium.

[0010] The detector is arranged in the shell and is used for receiving the spectrum.

[0011] In an exemplary embodiment of the present disclosure, the light-transmitting plate has a slit area and a non-imaging area outside the slit area, the non-imaging area blocks the light of the first wavelength band, and the slit area transmits the light of the first wavelength band, so that the ambient light enters the spectroscopic element through the slit area; wherein the ambient light is imaged in the slit area to form a virtual object plane.

[0012] In an exemplary embodiment of the present disclosure, a first polarizing reflective film is provided on the outer surface of the non-imaging area of ​​the light-transmitting plate, the polarization direction of the first polarizing reflective film is consistent with the polarization direction of the image light, the ambient light enters the light-transmitting plate from the light-transmitting area of ​​the windshield, the front telephoto lens is provided in the light-transmitting area, the ambient light enters the front telephoto lens from the light-collecting area within the light-transmitting area, the light-transmitting area outside the light-collecting area is provided with a second polarizing reflective film, the polarization direction of the second polarizing reflective film is opposite to that of the first polarizing reflective film; the first polarizing reflective film has a notch to form a slit area, the slit area is provided with an anti-reflection film, and the anti-reflection film is used to transmit light of the first band.

[0013] In an exemplary embodiment of the present disclosure, the image light is located in the visible light band, and the first band does not overlap with the visible light band.

[0014] In an exemplary embodiment of the present disclosure, the spectroscopic element includes a reflection grating for allowing ambient light to enter the detector in one or more groups of non-zero-order diffraction light rays of the reflection grating; the reflection grating is also used to allow image light to exit to the projection medium in the zero-order diffraction light of the reflection grating.

[0015] In an exemplary embodiment of the present disclosure, the reflection grating is a concave grating, and the detector is arranged at a focusing position of the first-order diffraction light of the ambient light on the concave grating.

[0016] In an exemplary embodiment of the present disclosure, the spectroscopic element includes a transmissive reflective film and a transmissive spectroscopic element, wherein the transmissive reflective film is disposed on the light incident side of the transmissive spectroscopic element, the transmissive reflective film is used to reflect image light emitted by an image source, and the transmissive reflective film is also used to allow ambient light to pass through the transmissive reflective film and enter the transmissive spectroscopic element; the transmissive spectroscopic element is used to split the ambient light to form a spectrum to enter the detector.

[0017] In an exemplary embodiment of the present disclosure, the transmission spectroscopic element includes a transmission grating, which is used to allow ambient light to enter the detector through one or more groups of non-zero-order diffraction light of the transmission grating; or, the transmission spectroscopic element includes a spectroscopic prism, which is used to allow ambient light to enter the detector after being dispersed.

[0018] In an exemplary embodiment of the present disclosure, the spectroscopic element includes a concave reflector and a convex grating, the concave reflector and the convex grating are arranged opposite to each other, the image source and the convex grating are arranged opposite to each other, and the detector and the concave reflector are arranged opposite to each other; wherein the convex grating is used to deflect the image light emitted by the image source to the concave reflector, and the concave reflector is used to reflect the image light to the projection medium; the concave reflector has a first reflection area and a second reflection area, and the concave reflector is also used to: reflect ambient light to the convex grating in the first reflection area, and receive and reflect one or more groups of non-zero-order diffraction light of the ambient light in the second reflection area, so that the diffraction light enters the detector.

[0019] In an exemplary embodiment of the present disclosure, an object point O of ambient light is reflected by a first reflection zone to a convex grating, then diffracted by the convex grating to a second reflection zone, and finally focused and imaged to an image point I by the second reflection zone; a curvature circle where the reflection surface of the first reflection zone is located, a curvature circle where the reflection surface of the second reflection zone is located, and a curvature circle of the convex grating have an intersection C, the object point O and the image point I are symmetrical about the intersection C, and points O, I, and C are located in the same plane.

[0020] In an exemplary embodiment of the present disclosure, the head-up display device includes a collection controller, which is used to collect information according to the yaw angular velocity ω of the carrier on which the head-up display device is installed and the instantaneous field of view θ of the front telephoto lens. IFOV Determine the exposure time t of the detector camera, where ω = θ IFOV / t.

[0021] In an exemplary embodiment of the present disclosure, the acquisition controller is further used to send an intervention instruction when the yaw angular velocity ω of the carrier is less than a preset value ω0, and the intervention instruction is used to increase the yaw angular velocity ω of the carrier to ω≥ω0.

[0022] In an exemplary embodiment of the present disclosure, the image source is used to generate and emit image light corresponding to the display information according to the display information corresponding to the spectrum received by the detector.

[0023] In an exemplary embodiment of the present disclosure, a head-up display device includes a driving circuit board connected to an image source, the driving circuit board is also communicatively connected to the detector, and the driving circuit board is further used to obtain display information corresponding to the spectrum based on the spectrum received by the detector, and send the display information to the image source, so that the image source generates and emits image light corresponding to the spectrum.

[0024] In an exemplary embodiment of the present disclosure, a driving circuit board is communicatively connected to an electronic controller of a carrier on which a head-up display device is installed, and the electronic controller or the driving circuit board is used to determine the position of an object corresponding to the ambient light according to the speed of the carrier and the spectrum received by the detector, and the driving circuit board is used to generate display information corresponding to the spectrum according to the position of the object, and send the display information to an image source; wherein, after the image source emits image light corresponding to the spectrum to a projection medium, the image light reflected by the projection medium overlaps with the ambient light.

[0025] When the head-up display device of the exemplary embodiment of the present disclosure is working, on the one hand, the ambient light entering the front telephoto lens can be guided to the light-transmitting plate through the light-introducing component outside the shell. The ambient light is a complex light. After entering the spectroscopic element through the light-transmitting plate, it is dispersed under the spectroscopic action of the spectroscopic element, thereby forming a spectrum of different wavelengths entering the detector. After the detector receives the spectrum information of the ambient light, it can identify whether there are hidden objects or dangerous sources in the external environment by analyzing the spectrum, so that the head-up display device has an environment collection function; on the other hand, the spectroscopic element can also deflect the image light emitted by the image source to form a target virtual image in front of the driver for the driver to watch, so that the head-up display device integrates the environment collection function and the image projection function, further improving the driver's ability to obtain vehicle driving information and improving driving safety. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] The accompanying drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the specification are used to explain the principles of the present disclosure. Obviously, the accompanying drawings described below are only some embodiments of the present disclosure, and for ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without creative work.

[0027] In order to better understand the present disclosure, reference may be made to the embodiments shown in the following drawings. The components in the drawings are not necessarily to scale, and related elements may be omitted in order to emphasize and clearly illustrate the technical features of the present disclosure. In addition, related elements or components may have different arrangements as known in the art. In addition, in the drawings, the same reference numerals represent the same or similar components in each drawing. Among them:

[0028] Figure 1 is a schematic diagram of an exemplary embodiment of the head-up display device disclosed herein;

[0029] Figure 2 is a schematic diagram of a light splitting element of an exemplary embodiment of the head-up display device disclosed herein;

[0030] Figure 3 A schematic diagram of a concave grating of an exemplary embodiment of a head-up display device disclosed herein;

[0031] Figure 4 is a schematic diagram of a light splitting element of another exemplary embodiment of the head-up display device disclosed herein;

[0032] Figure 5 is a schematic diagram of a light splitting element of another exemplary embodiment of the head-up display device disclosed herein;

[0033] Figure 6is a schematic diagram of a convex grating of an exemplary embodiment of the head-up display device disclosed herein;

[0034] Figure 7 This is a schematic diagram of the calculation of the conversion between the vehicle body coordinates and the geodetic coordinates;

[0035] Figure 8 A schematic diagram of detector scanning imaging of an exemplary embodiment of the head-up display device disclosed herein;

[0036] Fig. 9 A schematic diagram of the matching relationship between the detector exposure time and the detector rotation speed of an exemplary embodiment of the head-up display device disclosed herein;

[0037] Fig.10 A schematic diagram of the matching relationship between the detector exposure time and the detector rotation speed of an exemplary embodiment of the head-up display device disclosed herein;

[0038] Fig.11 A schematic diagram of the matching relationship between the detector exposure time and the detector rotation speed of an exemplary embodiment of the head-up display device disclosed herein;

[0039] Fig.12 It is a schematic diagram of the overall architecture of an exemplary embodiment of the head-up display device disclosed in the present invention.

[0040] The following are the descriptions of the reference numerals:

[0041] 11. Shell; 12. Light-transmitting plate; 2. Light-introducing assembly; 3. Spectral element; 4. Detector; 5. Image source; 6. Windshield; 7. Eye box; 31. Concave grating; 32. Transmission grating; 321. Transmission reflection film; 322. Diffraction surface; 33. Correction mirror; 34. Concave reflection mirror; 341. First reflection area; 342. Second reflection area; 35. Convex grating; 8. Image adjustment reflection mirror. DETAILED DESCRIPTION

[0042] The following will be combined with the accompanying drawings in the exemplary embodiments of the present disclosure to clearly and completely describe the technical solutions in the exemplary embodiments of the present disclosure. The exemplary embodiments described herein are only for illustrative purposes and are not intended to limit the scope of protection of the present disclosure. Therefore, it should be understood that various modifications and changes can be made to the exemplary embodiments without departing from the scope of protection of the present disclosure.

[0043] Unless otherwise specified or explained, the technical terms or scientific terms used in the present disclosure shall have the usual meanings understood by persons with ordinary skills in the field to which the present disclosure belongs. The present disclosure uses "first" and "second" etc. only as labels, and does not limit the quantity, importance or order of its objects. "Include" or "comprise" and other similar words mean that the elements or objects appearing before the word include the elements or objects listed after the word and their equivalents, without excluding other elements or objects. The term "connection" can be a fixed connection, a detachable connection, or an integral connection; it can be directly connected or indirectly connected through an intermediate medium. "Communication connection" can be a wired communication connection or a wireless communication connection, and can be direct communication or indirect signal connectivity through an intermediate medium.

[0044] Furthermore, in the description of the present disclosure, it should be understood that the directional words such as "inside" and "outside" described in the exemplary embodiments of the present disclosure are only used to indicate relative positional relationships. For convenience, the description is made according to the position and state of the head-up display device when it is actually working, or according to the angles shown in the accompanying drawings, which should not be understood as limiting the exemplary embodiments of the present disclosure. It can be known to those skilled in the art that when the absolute position of the described object changes, the relative positional relationship may also change accordingly, and such changes will not cause obstacles to the understanding of those skilled in the art.

[0045] In addition, the "concave" or "convex" of an optical surface described in the present disclosure is relative to the direction of the light incident on the surface. For example, if an optical surface is a "concave surface", the distance from a point on the incident light ray to the center of the surface on the optical axis is greater than the distance from the point to the periphery of the surface.

[0046] To facilitate explanation of the scheme of the present disclosure, a possible application scenario provided by the present disclosure is applied to a car as an example. Those skilled in the art should understand that the carrier of the head-up display device of the exemplary embodiment of the present disclosure may also include, for example, sanitation vehicles, fire trucks, military vehicles, and of course, it can also be applied to the fields of ships, aviation, etc., for example, it can be applied to aircraft such as fighter jets.

[0047] In the related art, the head-up display device (Head Up Display), also known as the head-up display device, is referred to as HUD. Its principle is to project important driving information such as speed and navigation onto a projection medium, such as a windshield 6 or a special screen in the cockpit, through a designed optical path. The image light enters the driver's eye box 7 after being reflected by the projection medium. The reverse extension line of the light forms a target virtual image at a preset position in front of the driver, avoiding the safety hazards caused by the driver lowering his head to look at the display information of the instrument or other driving assistance equipment, thereby increasing driving safety. For augmented reality head-up display devices (AR-HUD), relevant information can also be combined with environmental information such as roads, vehicles, and pedestrians, and integrated with ADAS (Advanced Driving Assistance System) related functions to further promote cockpit intelligence.

[0048] In the exemplary embodiment of the present disclosure, the projection medium is the windshield 6 of the vehicle.

[0049] The present disclosure provides a head-up display device, referring to Figure 1-Figure 2 As shown, it includes a housing, a light introduction component 2, a spectroscopic element 3, a detector 4 and an image source 5, wherein the housing includes a shell 11 and a light-transmitting plate 12 buckled with the shell 11; the light introduction component 2 is arranged outside the shell 11, and the spectroscopic element 3 is arranged inside the shell 11; the light introduction component 2 includes a front telephoto lens, which is used to transmit the ambient light entering the front telephoto lens to the light-transmitting plate 12, so that the ambient light enters the spectroscopic element 3 through the light-transmitting plate 12, and the spectroscopic element 3 is used to disperse the complex light incident on the spectroscopic element 3 to form a spectrum of different wavelengths; the detector 4 is arranged inside the shell 11, and is used to receive the spectrum. The spectroscopic element 3 is also used to deflect the image light emitted by the image source 5 to the inner surface of the light-transmitting plate 12, so that the image light passes through the light-transmitting plate 12 and enters the projection medium.

[0050] When the head-up display device of the exemplary embodiment of the present disclosure is working, on the one hand, the ambient light entering the front telephoto lens can be guided to the light-transmitting plate 12 through the light-introducing component 2 outside the housing 11. The ambient light is a complex light. After entering the spectroscopic element 3 through the light-transmitting plate 12, it is dispersed under the spectroscopic action of the spectroscopic element 3, thereby forming a spectrum of different wavelengths entering the detector 4. After the detector 4 receives the spectrum information of the ambient light, it can identify whether there are hidden objects or dangerous sources in the external environment by analyzing the spectrum, so that the head-up display device has an environment collection function; on the other hand, the spectroscopic element 3 can also deflect the image light emitted by the image source 5 to form a target virtual image in front of the driver for the driver to watch, so that the head-up display device integrates the environment collection function and the image projection function, further improving the driver's ability to obtain vehicle driving information and improving driving safety.

[0051] Specifically, in an exemplary embodiment of the present disclosure, the front telephoto lens is used to collect the light information radiated by the objects in the external environment and image it at its image plane position, at which time any image point on the image plane contains the spatial and spectral information of the corresponding object point. The light-transmitting plate 12 has a slit area and a non-imaging area outside the slit area, wherein the non-imaging area cannot transmit the light of the first band, and the slit area can transmit the light of the first band, so that the ambient light collected by the light-introducing component 2 can only be incident on the spectroscopic element 3 through the slit area, and the slit area is coplanar with the image plane of the light-introducing component 2, and the ambient light is imaged in the slit area. After the light-introducing component 2 is imaged in the slit area, it continues to be incident on the spectroscopic element 3 in the housing 11, and at this time the slit area is equivalent to the virtual object plane of the spectroscopic system.

[0052] The light introduction component 2 may also include a deflection mirror. For example, the front telephoto lens is disposed above the front instrument panel of the vehicle, or at the position of the sunshade in the cab, and the main optical axis of the front telephoto lens is consistent with the length direction of the vehicle; the housing of the head-up display device may be disposed below the instrument panel, and the deflection mirror may be disposed at the position of the sunshade in the cab, and adjacent to the front telephoto lens, for deflecting the ambient light collected by the front telephoto lens to the light-transmitting plate 12. The deflection mirror may form an off-axis telephoto system with the front telephoto lens to ensure that the external ambient light is focused on the slit area. In some exemplary embodiments, the light introduction component 2 may also include a curved waveguide to achieve the angle deflection of the external ambient light.

[0053] The head-up display device of the present disclosure uses the detector 4 to receive the spectral information of the external environment to obtain the external environment conditions. Specifically, the head-up display device can use the spectrum formed by the ambient light in a certain band. For example, the head-up display device can use the light of the first band to form a spectral image, and the first band is located in the visible light band. In an exemplary embodiment of the present disclosure, the head-up display device uses light in a non-visible light band. For example, the head-up display device can use the ultraviolet light band to form an ultraviolet spectrum, or use the infrared light band to form an infrared spectrum, which is more suitable for assisting the driver to judge the external environment conditions in an environment where the visible light is insufficient and the driver cannot see clearly.

[0054] The detector 4 can be a linear array detector 4 or a planar array detector 4, and can realize the collection of target spectral data in conjunction with a corresponding scanning method. According to the working mode, the detector 4 can be an infrared cooling detector 4 or an infrared non-cooling detector 4. In an exemplary embodiment of the present disclosure, the number of spectral channels collected by the detector 4 is between dozens and hundreds, and the detector 4 is connected to the vehicle electronic controller (Electronic Control Unit, ECU) by wired or wireless communication. After the detector 4 obtains the hyperspectral information of the object corresponding to the ambient light, it can be combined with the vehicle electronic controller to quickly analyze the hyperspectral information, and voice prompts, alarms, or intelligent assisted driving functions can be turned on through the vehicle driving assistance system. In an exemplary embodiment, the number of spectral channels collected by the detector 4 is more than 1000, and the gas composition of the external environment can be distinguished through the collected spectral information. When the vehicle is driving in a dangerous gas environment, the vehicle electronic controller can identify and issue a timely warning through the driving assistance system.

[0055] The head-up display device includes an image source 5 and a driving circuit board connected to the image source 5. The driving circuit board is communicatively connected to one or more of the vehicle's instruments, navigation system and electronic controller to determine the image to be displayed, obtain the required display information, and send the display information to the image source 5. The image source 5 is used to generate and emit corresponding image light according to the display information.

[0056] Specifically, the image source 5 can be a display imaging device, or a virtual image or a real image formed by the display imaging device. For example, the display imaging device can include a liquid crystal screen, and the backlight source of the liquid crystal screen can include one or more of laser, light emitting diode, organic light emitting diode, stimulated fluorescent luminescent material, and quantum dot excitation light source; the display imaging device can also include an active light-emitting dot matrix screen composed of light-emitting point light sources such as LED, OLED, and plasma light-emitting point; or, the display imaging device can also include a projection imaging system based on projection technologies such as digital light processing (DLP), liquid crystal on silicon (LCoS), and liquid crystal display (LCD), driven by light sources such as LED, OLED, laser, and fluorescence, or a combination thereof, reflected or transmitted by a display panel such as a digital micromirror display (DMD), LcoS, and LCD, and then projected on a projection screen through a projection lens to form an image; the display imaging device can also include a laser beam scanning (LBS) projection imaging system that scans a laser beam on a screen to form an image. For another example, a real image or a virtual image formed by one or more refractions or reflections of a display imaging device can also be used as an image source. In the exemplary embodiment of the present disclosure, as long as the image light with uniform brightness and meeting the imaging requirements can be emitted, the specific structural form of the image source 5 is not particularly limited.

[0057] The light-transmitting plate 12 may include a transparent substrate. For example, the transparent substrate may be made of optical plastic such as polymethyl methacrylate (PMMA), polystyrene (PS) or polyethylene (PE), etc., which has good light transmittance and can isolate water vapor and impurities. In an exemplary embodiment of the present disclosure, the image light emitted by the image source 5 is in the visible light band, and the first band received by the detector 4 is in the infrared light band. The image source 5 is used to generate and emit image light with a first polarization state, such as an S polarization state or a P polarization state. A first polarizing reflective film is provided on the outer surface of the non-imaging area of ​​the light-transmitting plate 12. The polarization direction of the first polarizing reflective film is consistent with the polarization direction of the image light, and is used to transmit the image light of the first polarization state. The first polarizing reflective film has a notch to form a slit area, and the slit area is provided with an anti-reflection film to improve the transmittance of ambient light in the infrared light band entering the interior of the housing 11 in the slit area.

[0058] The windshield 6 has a light-transmitting area, wherein ambient light can enter the outer surface of the light-transmitting plate 12 from the light-transmitting area, and external ambient light entering the area outside the light-transmitting area of ​​the windshield 6 will not be projected onto the outer surface of the light-transmitting plate 12. The front telephoto lens is arranged in a light collection area within the light-transmitting area, and the light collection area corresponds to the light-entering area of ​​the front telephoto lens, and ambient light enters the front telephoto lens from the light collection area. The light-transmitting area outside the light collection area is provided with a second polarized reflective film, and the polarization direction of the second polarized reflective film is opposite to that of the first polarized reflective film.

[0059] Therefore, for external ambient light, in the process of entering the vehicle through the light-transmitting area, except for the ambient light entering the front telephoto lens, all other light passes through the second polarized reflective film; when entering the outer surface of the light-transmitting plate 12, the ambient light entering the non-imaging area passes through the first polarized reflective film and is filtered out. Therefore, only the ambient light passing through the front telephoto lens incident slit area can pass through the light-transmitting plate 12 to enter the head-up display. As for the image light, since the first polarized reflective film is consistent with the polarization direction of the image light, it can pass through the image light, and the image light is imaged on the windshield 6 through the reflection of the inner surface of the windshield 6, so the second polarized reflective film will not filter the image light. The slit area is located on the focal plane of the light-introducing component 2, which is equivalent to the image field stop of the light-introducing component 2. Therefore, the length and width of the slit area respectively determine the spatial field of view FOV (Field of View) of the optical system of the entire head-up display device together with the light-introducing component 2. At the same time, since the virtual object plane formed by the slit area is located on the front focal plane of the light-splitting element 3, the width of the slit area also affects the spectral resolution of the head-up display device disclosed in the present invention. Specifically, the smaller the width of the slit area, the higher the spectral resolution, but the lower the energy of the light signal received by the detector 4, the lower the signal-to-noise ratio. In an exemplary embodiment of the present disclosure, it can be calculated based on the wavelength of the light in the first band, the magnification of the light introduction component 2 and the spectroscopic component, and the effective pixel size of the detector 4 for receiving the spectral image in the spectral dimension. For example, in an exemplary embodiment, the slit width is 10 μm and the slit length is 10 mm, so that the ideal slit spectral image corresponding to each wavelength in the first band can be imaged within a pixel size of the detector 4 in the spectral dimension direction.

[0060] In another exemplary embodiment of the present disclosure, the light-transmitting plate 12 may be made of photonic crystals, thereby having a unidirectional conduction effect on light of a specific wavelength, so as to achieve blocking of light of the first wavelength band in the non-imaging area and transmission of light of the first wavelength band in the slit area.

[0061] In an exemplary embodiment of the present disclosure, the beam splitter 3 includes a reflection grating, which is used to allow the ambient light to enter the detector 4 in one or more groups of non-zero-order diffraction light of the reflection grating; the reflection grating is also used to allow the image light to exit the projection medium in the zero-order diffraction light of the reflection grating. Figure 2 As shown, for the ambient light incident on the reflection grating from the slit area, each wavelength of the light satisfies the grating equation, and the detector 4 can receive non-zero-order diffraction light to obtain the spectral data of the target object. For the image light emitted from the image source 5, the zero-order diffraction light is equivalent to the reflected light, and the image light is emitted from the light-transmitting plate 12 after turning the reflection grating and projected onto the projection medium.

[0062] Exemplarily, the reflection grating may be a plane grating, and is focused into the detector 4 by an optical element such as a lens. In an exemplary embodiment of the present disclosure, the reflection grating may be a concave grating 31, which has a focusing imaging property in addition to a diffraction property. The concave grating 31 is used to make the light both diffract and focus. Specifically, for the concave grating 31, refer to Figure 3 As shown, the groove surface of the grating is distributed on a large circle with a radius of R = 2r. That is, with the line connecting the midpoint O of the light ellipse where the concave surface is located and the center of curvature C as the diameter, and the midpoint OC as the center of the circle, a Rowland circle with a radius of r is drawn, then: the light beam emitted from any point P1 on the Rowland circle is approximately reflected to another point P' on the circle after being diffracted by the concave grating 31, and is also diffracted to other points P2 and P3 on the circle, which are the foci of diffracted light rays of each order respectively. The diffraction angle θ and the incident angle α satisfy the relationship d(sinθ±sinα)=mλ. Among them, d is the grating constant, m is the grating order, and λ is the diffraction wavelength. It can be seen that the diffraction angle θ is wavelength-dependent. When a beam of complex light waves is emitted from point P1 and is diffracted by the concave grating 31, different wavelengths will be focused at different positions on the Rowland circle. In an exemplary embodiment of the present disclosure, the detector 4 is arranged at the focusing position of the first-order diffraction light of the ambient light on the concave grating 31, for example, near point P2, and the spectral data of the target object can be obtained by using the first-order diffraction light with higher energy.

[0063] In an exemplary embodiment of the present disclosure, the beam splitter element 3 includes a transmissive reflective film 321 and a transmissive beam splitter element 3. Figure 4As shown, for example, the transmission spectroscopic element 3 may include a transmission grating 32, the light incident surface of the transmission grating 32 is provided with a transmission reflective film 321, the light exit surface of the transmission grating 32 is a diffraction surface 322, the ambient light incident on the transmission spectroscopic element 3 is diffracted on the diffraction surface 322, and then the correction mirror 33 converges one or more groups of non-zero-order diffraction light into the detector 4. The image light emitted by the image source 5 passes through the transmission reflective film 321 and is reflected to the outside of the head-up display device. Exemplarily, the head-up display device may also include one or more image adjustment reflectors 8, which may be convex mirrors, plane mirrors, concave mirrors or free-form mirrors, etc., for adjusting the image light and the ambient light according to the overall optical path arrangement of the head-up display device and the need to correct aberrations.

[0064] For example, refer to Figure 4 As shown, an image adjustment reflector 8 is disposed in the housing 11, and a transmission grating 32 is adjacent to the image adjustment reflector 8. The side of the transmission grating 32 close to the image adjustment reflector 8 is a light incident surface, and the side of the transmission grating 32 away from the image adjustment reflector 8 is a diffraction surface 322. The detector 4 is disposed on the side of the transmission grating 32 away from the image adjustment reflector 8, opposite to the diffraction surface 322, and the image source 5 is disposed on the side of the transmission grating 32 close to the image adjustment reflector 8, opposite to the partially reflective and partially transmissive surface.

[0065] In another exemplary embodiment of the present disclosure, the transmissive spectroscopic element 3 may include a spectroscopic prism, and the transmissive reflective film 321 is disposed on the light incident side of the spectroscopic prism. For example, the transmissive reflective film 321 is disposed between the spectroscopic prism and the image adjustment reflector 8, and the ambient light is incident on the transmissive reflective film 321 from the image adjustment reflector 8, and the light passing through the transmissive reflective film 321 is dispersed in the spectroscopic prism, and then the corrective lens 33 converges the dispersed spectrum in the detector 4. The image light emitted by the image source 5 passes through the transmissive reflective film 321 and is reflected to the outside of the head-up display device. In other exemplary embodiments, the transmissive spectroscopic element 3 may also include other spectroscopic structures as long as they can produce a dispersed spectrum.

[0066] In an exemplary embodiment of the present disclosure, reference Figure 5As shown, the spectroscopic element 3 includes a concave reflector 34 and a convex grating 35. The concave reflector 34 and the convex grating 35 are arranged opposite to each other, the image source 5 and the convex grating 35 are arranged opposite to each other, and the detector and the concave reflector 34 are arranged opposite to each other. When the head-up display device is working, the image light emitted by the image source 5 is diffracted by the convex grating 35 at the zero-order diffracted light, i.e., the reflected light, to the concave reflector 34. The concave reflector 34 is used to reflect the image light to the projection medium. The concave reflector 34 has a first reflection area 341 and a second reflection area 342. The ambient light is incident on the first reflection area 341 of the concave reflector 34. The concave reflector 34 is used to reflect the ambient light to the convex grating 35. The non-zero-order diffracted light of the ambient light on the convex grating 35 is projected to the second reflection area 342 of the concave reflector 34. The concave reflector 34 receives and reflects the diffracted light in the second reflection area 342, so that the diffracted light enters the detector 4.

[0067] Compared with the implementation method of using the transmission spectrometer element 3 for spectrometry, the implementation method of using the convex grating 35 for reflective diffraction spectrometry can arrange the image source 5 and the detector 4 on the same side of the convex grating 35, that is, the image source 5 and the detector 4 can be arranged between the concave reflector 34 and the convex grating 35, thereby shortening the lateral size of the head-up display device, which is beneficial to the spatial arrangement of the head-up display device.

[0068] In an exemplary embodiment of the present disclosure, reference Figure 6 As shown, the object point O of the ambient light is reflected by the first reflection area 341 to the convex grating 35, then diffracted by the convex grating 35 to the second reflection area 342, and finally focused and imaged to the image point I by the second reflection area 342. Among them, the curvature circle where the reflection surface of the first reflection area 341 is located, the curvature circle where the reflection surface of the second reflection area 342 is located, and the curvature circle of the convex grating 35 have an intersection C, the object point O and the image point I are symmetrical about the intersection C, and the points O, I and C are located in the same plane. Since the object point O and the image point I have good symmetry, it has a strong aberration correction capability and has the advantages of simple and compact structure.

[0069] In some exemplary embodiments of the present disclosure, the concave reflector 34 is rotatably connected to the housing 11. For windshields 6 with different tilt angles and different eyebox 7 positions, the image light can be projected to the appropriate position of the projection medium by changing the tilt angle of the concave reflector 34. Exemplarily, by changing the tilt angle of the concave reflector 34, the angle of the light incident on the first reflection area 341 and the angle of the light emitted from the second reflection area 342 can also be adjusted, thereby adjusting and correcting the aberration of the light splitting element 3.

[0070] In an exemplary embodiment of the present disclosure, the head-up display further includes a collection controller for collecting information based on the yaw angular velocity ω of the vehicle and the instantaneous field of view θ of the front telephoto lens. IFOV Determine the exposure time t of the camera of the detector 4. Specifically, for conventional detectors 4, it is usually necessary to cooperate with a turntable to rotate and scan the object within the field of view in order to obtain complete three-dimensional spectral data of the object. In an exemplary embodiment of the present disclosure, since the head-up display is installed in the vehicle, the vehicle is usually not strictly traveling in a straight line during driving, but has a certain yaw angular velocity. Therefore, the head-up display of the present disclosure may not use a turntable, but may use the vehicle's own swing to scan objects outside the vehicle, and identify, splice, and fuse each image obtained through a background algorithm, thereby obtaining hyperspectral data of target objects outside the vehicle.

[0071] The vehicle yaw angle refers to the lateral swing angle of the vehicle relative to the forward direction of the vehicle body during driving, that is, the deflection of the vehicle around the vertical axis. The vehicle yaw angle is the angle between the vehicle head direction and the X-axis of the geodetic coordinate system. It is defined in the geodetic coordinate system, so the vehicle yaw angle can be calculated based on the conversion between the vehicle body coordinates and the geodetic coordinates. For example, refer to Figure 7 As shown, in, is the longitudinal velocity of the center of mass, is the lateral speed of the center of mass, In an exemplary embodiment of the present disclosure, the acquisition controller may be connected to the electronic controller of the vehicle for communication, so as to obtain the vehicle yaw angular velocity ω in real time using the vehicle inertial navigation system.

[0072] Furthermore, the exposure time t of the camera of the detector 4 represents the acquisition rate of the detector 4. During the process of the detector 4 acquiring an image of a certain external target, reference Figure 8 As shown, during the rotation process, the detector 4 completes a scan of the slit every time it rotates through an angle of β, and completes the first, second, ... kth scans from left to right in sequence, and the angles passed by each scan are tangent, and finally a complete spectrum image is obtained. Figures 9 to 11 As shown, the matching relationship between the exposure time and the rotation speed of the detector 4 will affect the accuracy of the collected spectral image. Fig. 9 A schematic diagram of a spectrum image when the rotation speed of the detector 4 matches the exposure time is shown; Fig.10 shows a schematic diagram of a spectrum image when the rotation speed of the detector 4 is too slow; Fig.11The figure shows a schematic diagram of a spectrum image when the rotation speed of the detector 4 is too fast. When the rotation speed of the detector 4 is too slow, since the exposure time of each scan is constant, the number of single imaging scans is more, resulting in lateral stretching of the image; when the rotation speed of the detector 4 is too fast, the number of single imaging scans is less, resulting in lateral compression of the image.

[0073] The field of view angle of the vehicle for the target object will change during the driving process. For example, for a fixed object outside the vehicle, the field of view angle will increase as the vehicle moves from far to near. In an exemplary embodiment of the present disclosure, the acquisition controller can calculate the instantaneous field of view angle θ of the front telephoto lens for the target object according to the speed and acceleration state of the vehicle. IFOV , and determine the exposure time t of the camera of the detector 4 in combination with the vehicle yaw angular velocity ω, specifically, ω=θ IFOV / t, so that the exposure time t can be adjusted at any time to match the rotation speed of the detector 4 on the vehicle relative to the external object.

[0074] In an exemplary embodiment of the present disclosure, when the vehicle yaw rate ω is too small, human intervention, such as slightly turning the steering wheel, can be used to meet the requirement of the detector 4 to rotate and scan. For example, the acquisition controller is also used to send an intervention instruction to the vehicle electronic controller when the vehicle's yaw rate ω is less than a preset value ω0, so as to increase the vehicle's yaw rate ω to ω≥ω0. The acquisition controller can be an independent controller disposed in the housing of the head-up display device, or it can be a module integrated in the vehicle electronic controller.

[0075] For example, when the vehicle is traveling at high speed, the yaw angle is usually between 10° and 15°; when the vehicle is making an emergency turn, the yaw angle is usually between 15° and 30°, depending on factors such as the turning radius, turning speed, and the vehicle suspension system; when the vehicle has a low road adhesion coefficient, such as when traveling on a slippery road, the yaw angle is usually between 10° and 20°, and when the vehicle is traveling on a general road, the yaw angle is usually within 10°. According to different usage scenarios, the exposure time t of the camera of the detector 4 can be determined according to the yaw angular velocity ω of the vehicle. In an exemplary embodiment of the present disclosure, the detector 4 is used to obtain hyperspectral data corresponding to the external environment target. In order to ensure that the computing power required to obtain the hyperspectral data is sufficient and has strong real-time performance, the total rotation angle required for the camera of the detector 4 to shoot can be determined according to the preset yaw angle range of the vehicle, so that when the vehicle is driving normally, no manual intervention is required, and the rotation scanning of the detector 4 can be realized by using the vehicle's own swing.

[0076] In the head-up display device of the related art, the head-up display device only has the transmission function, and the driver receives and distinguishes all the information outside the vehicle and the information projected by the head-up display device, which is easy to cause mental fatigue and is easily affected by the driver's subjective emotions and concentration. Fig.12 As shown, the driver circuit board is also connected to the detector for communication. After the detector 4 receives the spectral information of the target outside the vehicle, it can identify and screen the information to determine the type, volume and other information of the target object. If it is an object that the driver needs to be vigilant about, such as falling rocks or road collapse, the driver circuit board can obtain display information corresponding to the relevant information of the target object and send it to the image source 5, so that the image source 5 projects and displays the information that needs attention, thereby improving the intelligence level of the head-up display device, enriching the content of the information displayed by the head-up display device, and being able to display the simplest and clearest information to the driver, thereby improving the driving experience.

[0077] Further, in some exemplary embodiments of the present disclosure, the head-up display device can transmit the information of the identified target object to the windshield 6 through the image source 5, and superimpose it on the target object; or directly transmit the hyperspectral image of the identified target object to the windshield 6, and superimpose it on the target object, so as to assist the driver in judging the external environment. Exemplarily, the driver circuit board is connected to the electronic controller of the vehicle in communication, and the electronic controller or the driver circuit board can determine the position of the target object according to the vehicle speed, acceleration and other information, combined with the spectral information received by the detector 4. The driver circuit board can generate corresponding display information according to the position of the target object. After the image source 5 receives the display information, the position and angle of the image light can be adjusted so that the image light reflected by the windshield 6 and entering the human eye overlaps with the ambient light entering the human eye through the windshield 6, forming the effect of integrating the virtual image of the target object related prompt information or the hyperspectral image of the target object with the real scene of the target object. In some exemplary embodiments, the electronic controller or the driver circuit board can also accurately identify and locate the target object in combination with the information detected by the vehicle-mounted laser radar and millimeter wave radar.

[0078] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure, which follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The description and examples are intended to be exemplary only, and the true scope and spirit of the present disclosure are indicated by the appended claims.

[0079] It should be understood that the present disclosure is not limited to the precise structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from its scope. The scope of protection of the present disclosure is limited only by the appended claims.

Claims

1. A head-up display device, characterized in that: include: The housing comprises a shell and a light-transmitting plate buckled with the shell; A light introduction component is arranged outside the housing, and the light introduction component includes a front telephoto lens; An image source, disposed in the housing, for generating and emitting image light; A beam splitter element is disposed inside the housing. The light introduction component is used to transmit the ambient light entering the front telephoto lens to the light-transmitting plate, so that the ambient light enters the beam splitter element through the light-transmitting plate. The beam splitter element is used to disperse the complex light entering the beam splitter element to form a spectrum of different wavelengths. The beam splitter element is also used to deflect the image light emitted by the image source to the inner surface of the light-transmitting plate, so that the image light passes through the light-transmitting plate and enters the projection medium. A detector, disposed in the housing, and configured to receive the spectrum; The image source is used to generate and emit image light corresponding to the display information according to the display information corresponding to the spectrum received by the detector.

2. The head-up display device according to claim 1, characterized in that: The light-transmitting plate has a slit area and a non-imaging area outside the slit area, the non-imaging area blocks the light of the first wavelength band, and the slit area transmits the light of the first wavelength band, so that the ambient light enters the spectroscopic element through the slit area; wherein the ambient light is imaged in the slit area to form a virtual object plane.

3. The head-up display device according to claim 2, characterized in that: A first polarizing reflective film is disposed on the outer surface of the non-imaging area of ​​the light-transmitting plate, and the polarization direction of the first polarizing reflective film is consistent with the polarization direction of the image light. The ambient light enters the light-transmitting plate from the light-transmitting area of ​​the windshield, and the front telephoto lens is disposed in the light-transmitting area. The ambient light enters the front telephoto lens from the light collection area within the light-transmitting area. A second polarizing reflective film is disposed in the light-transmitting area outside the light collection area, and the polarization direction of the second polarizing reflective film is opposite to that of the first polarizing reflective film. The first polarizing reflective film has a notch to form the slit area, and the slit area is provided with an anti-reflection film, and the anti-reflection film is used to transmit the light of the first wavelength band.

4. The head-up display device according to claim 2, characterized in that: The image light is in the visible light band, and the first band does not overlap with the visible light band.

5. The head-up display device according to any one of claims 1 to 4, characterized in that: The beam splitter element comprises a reflection grating, which is used to allow one or more groups of non-zero-order diffracted light rays of the ambient light at the reflection grating to enter the detector; The reflection grating is also used to allow the image light to be emitted to the projection medium as the zero-order diffraction light of the reflection grating.

6. The head-up display device according to claim 5, characterized in that: The reflection grating is a concave grating, and the detector is arranged at the focusing position of the first-order diffraction light of the ambient light on the concave grating.

7. The head-up display device according to any one of claims 1 to 4, characterized in that: The beam splitter element includes a transmissive reflective film and a transmissive beam splitter element, wherein the transmissive reflective film is disposed on the light incident side of the transmissive beam splitter element, the transmissive reflective film is used to reflect the image light emitted by the image source, and the transmissive reflective film is also used to allow the ambient light to pass through the transmissive reflective film and enter the transmissive beam splitter element; The transmission light splitting element is used to split the ambient light to form the spectrum entering the detector.

8. The head-up display device according to claim 7, characterized in that: The transmission spectroscopic element comprises a transmission grating, which is used to allow the ambient light to enter the detector through one or more groups of non-zero-order diffraction light of the transmission grating; or, the transmission spectroscopic element comprises a spectroscopic prism, which is used to allow the ambient light to enter the detector after being dispersed.

9. The head-up display device according to any one of claims 1 to 4, characterized in that: The light splitting element comprises a concave reflector and a convex grating, the concave reflector and the convex grating are arranged opposite to each other, the image source and the convex grating are arranged opposite to each other, and the detector and the concave reflector are arranged opposite to each other; Wherein, the convex grating is used to deflect the image light emitted by the image source to the concave reflector, and the concave reflector is used to reflect the image light to the projection medium; The concave reflector has a first reflective area and a second reflective area, and the concave reflector is further used for: The ambient light is reflected to the convex grating in the first reflection area, and one or more groups of non-zero-order diffraction light of the ambient light are received and reflected in the second reflection area, so that the diffracted light enters the detector.

10. The head-up display device according to claim 9, characterized in that: The object point O of the ambient light is reflected by the first reflection area to the convex grating, then diffracted by the convex grating to the second reflection area, and finally focused and imaged to the image point I by the second reflection area; The curvature circle where the reflection surface of the first reflection area is located, the curvature circle where the reflection surface of the second reflection area is located, and the curvature circle of the convex grating have an intersection C, the object point O and the image point I are symmetrical about the intersection C, and points O, I and C are located in the same plane.

11. The head-up display device according to claim 1, characterized in that: The head-up display device includes an acquisition controller, which is used to obtain a yaw angular velocity ω of a carrier on which the head-up display device is installed and an instantaneous field of view θ of the front telephoto lens. IFOV Determine the exposure time t of the detector camera, where ω = θ IFOV / t.

12. The head-up display device according to claim 11, characterized in that: The acquisition controller is further used to send an intervention instruction when the yaw angular velocity ω of the carrier is less than a preset value ω0, and the intervention instruction is used to increase the yaw angular velocity ω of the carrier to ω≥ω0.

13. The head-up display device according to claim 1, characterized in that: The head-up display device includes a driving circuit board connected to the image source, and the driving circuit board is also communicatively connected to the detector. The driving circuit board is also used to obtain the display information corresponding to the spectrum based on the spectrum received by the detector, and send the display information to the image source, so that the image source generates and emits the image light corresponding to the spectrum.

14. The head-up display device according to claim 13, characterized in that: The driving circuit board is communicatively connected with an electronic controller of a carrier on which the head-up display device is installed, the electronic controller or the driving circuit board is used to determine the position of the object corresponding to the ambient light according to the speed of the carrier and the spectrum received by the detector, and the driving circuit board is used to generate the display information corresponding to the spectrum according to the position of the object, and send the display information to the image source; Wherein, after the image source emits the image light corresponding to the spectrum to the projection medium, the image light reflected by the projection medium overlaps with the ambient light.