ARHUD and holographic instrument fused man-machine interaction system and automobile

Abstract

The invention discloses an ARHUD and holographic instrument fused man-machine interaction system and an automobile, and relates to the field of automobiles, in the imaging process of an imaging system, a first light beam and a second light beam carrying different projection information are generated through an image generation unit, and then the second light beam is diffused through a diffusion element; then the first light beam and the second light beam are projected to a first position and a second position through a reflector assembly, the first light beam projected to the first position forms a real image under the action of a holographic optical element, and projection information carried by the first light beam is displayed through the real image. And the second light beam projected at the second position forms a long-range virtual image in front of the windshield, and projection information carried by the second light beam is displayed through the long-range image. According to the scheme, display of two paths of projection information can be completed only by adopting one holographic optical element and one set of optical transmission system, and the ARHUD and holographic instrument fused man-machine interaction system is simple in structure and smaller in size.

Description

Technical Field

[0001] The present invention relates to the field of automobiles, and particularly to a human-machine interaction system and an automobile integrating an AR HUD and a holographic instrument. Background Art

[0002] An automotive head-up display (Head Up Display, hereinafter referred to as HUD) is an advanced driving assistance device, also known as a head-up imaging system. In the process of the continuous development and evolution of automotive head-up display technology, the pursuit of better imaging effects and richer information presentation has always been one of the core goals. The HUD based on geometric optical principles occupies an important position in traditional HUD applications with its mature technical architecture, while the holographic optical element 40 head-up display (Holographic Optical Element HUD, hereinafter referred to as HOE-HUD) based on diffraction optical principles shows great development potential due to the unique advantages of the holographic optical element 40. The existing technical solutions are mainly single- and double-light-path HUD imaging systems.

[0003] For the existing HUD imaging systems, the single-light-path imaging projects limited information, and the driver's adaptive experience under different road conditions is poor; the double-light path mostly adopts combinations such as double displays and double reflection modules, with inflexible structural layouts and larger volumes. Summary of the Invention

[0004] In view of this, the embodiments of the present invention provide a human-machine interaction system integrating an AR HUD and a holographic instrument, which can not only achieve virtual and real double-image display, but also improve the flexibility of the optical path design in terms of structure, making the volume more optimized.

[0005] To achieve the above object, the embodiments of the present invention provide the following technical solutions:

[0006] A human-machine interaction system integrating an AR HUD and a holographic instrument, comprising:

[0007] An image generation unit, which is used to generate a first light beam and a second light beam, where the first light beam carries near-view image information and the second light beam carries far-view image information;

[0008] A diffusion element, which is used to diffuse and homogenize the second light beam;

[0009] A mirror assembly, which is used to reflect the first light beam and the diffused second light beam to corresponding target positions on the windshield, where the target positions include a first position where the holographic optical element is located on the windshield and a second position on the windshield;

[0010] The first light beam diffracts at the first position of the windshield to form a real image, and after the diffused second light beam is reflected at the second position of the windshield, a virtual distant view image is formed in front of the windshield.

[0011] Optionally, in the above-mentioned human-machine interaction system integrating AR HUD and holographic instrument, the image generation unit is an image generation unit based on DLP / LCOS / LBS;

[0012] Optionally, in the above-mentioned human-machine interaction system integrating AR HUD and holographic instrument, the image generation unit includes a first display area and a second display area. The first display area is used to generate a first light beam, and the second display area is used to generate a second light beam.

[0013] Optionally, in the above-mentioned human-machine interaction system integrating AR HUD and holographic instrument, the diffusion film in the diffusion element is a gradient diffusion film or a deflection diffusion film.

[0014] Optionally, in the above-mentioned human-machine interaction system integrating AR HUD and holographic instrument, the mirror assembly includes at least one mirror group, and the mirror group is used to reflect the incident light beam corresponding to the mirror group to its corresponding target position.

[0015] Optionally, in the above-mentioned human-machine interaction system integrating AR HUD and holographic instrument, the mirror group includes a first mirror group, and the first mirror group includes:

[0016] A first mirror and a second mirror. The second light beam is projected to the second position after being reflected by the first mirror and the second mirror in sequence.

[0017] Optionally, in the above-mentioned human-machine interaction system integrating AR HUD and holographic instrument, the first mirror is a plane mirror or a curved mirror, and the second mirror is a curved mirror.

[0018] Optionally, in the above-mentioned human-machine interaction system integrating AR HUD and holographic instrument, the mirror group further includes a second mirror group, and the second mirror group includes:

[0019] A third mirror, and the third mirror is used to reflect the first light beam to the first position.

[0020] Optionally, in the above-mentioned human-machine interaction system integrating AR HUD and holographic instrument, the third mirror is a plane mirror.

[0021] Optionally, in the above-mentioned human-machine interaction system integrating AR HUD and holographic instrument, the projection information carried by the first light beam includes vehicle status information, and the information carried by the second light beam includes non-vehicle status information.

[0022] Optionally, in the above-mentioned human-machine interaction system integrating AR HUD and holographic instrument, the vehicle state information includes at least any one or a combination of instrument information, vehicle speed information, fuel quantity information, prompt information, and alarm information;

[0023] The non-vehicle state information includes at least any one or a combination of navigation and positioning information, traffic safety warning information, intelligent office information, and entertainment information.

[0024] Optionally, in the above-mentioned human-machine interaction system integrating AR HUD and holographic instrument, it further includes:

[0025] An optoelectronic control module, which is used to realize the eye tracking and brightness adaptive adjustment of the projection images at the first position and the second position.

[0026] Optionally, in the above-mentioned human-machine interaction system integrating AR HUD and holographic instrument, the optoelectronic control module includes a DMS information processing system;

[0027] The DMS information processing system is used to obtain the eye position and line-of-sight direction of the driver, determine the gaze area in the first position or the second position that the driver is concerned about based on the eye position and line-of-sight direction, and send the coordinate information of the gaze area to the image generation unit;

[0028] The image generation unit is further used to, after obtaining the coordinate information of the gaze area, perform enhancement processing on the output information of the pixels matching the coordinate information of the gaze area to realize the eye tracking function.

[0029] Optionally, in the above-mentioned human-machine interaction system integrating AR HUD and holographic instrument, the optoelectronic control module further includes a front camera information processing system;

[0030] The front camera information processing system is used to obtain the image brightness information and color data matching the external environment and send them to the image generation unit;

[0031] The image generation unit is further used to, after obtaining the image brightness information and color data, adjust the image display information corresponding to the first light beam and the second light beam based on the image brightness information and color data, so that the brightness of the projection images at the first position and the second position matches the external scene.

[0032] A vehicle includes the human-machine interaction system integrating AR HUD and holographic instrument described in any one of the above.

[0033] In the imaging process of the human-computer interaction system integrating AR HUD and holographic instrument disclosed in the embodiments of the present application, a first light beam and a second light beam carrying different projection information are generated by an image generation unit. Then, a diffusion element is used to diffuse and homogenize the second light beam, and a mirror assembly is used to project the first light beam and the second light beam to a first position and a second position respectively. The first light beam projected on the first position undergoes a diffraction effect under the action of a holographic optical element to form a real image on the windshield, and the projection information carried by the first light beam is displayed through the real image of the HOE. The second light beam projected on the second position forms a distant virtual image on the windshield, and the projection information carried by the second light beam is displayed through the distant view image. In the human-computer interaction system integrating AR HUD and holographic instrument, only one holographic optical element and a set of optical transmission systems are needed to complete the display of two-way projection information. The human-computer interaction system integrating AR HUD and holographic instrument has a simple structure and a smaller volume. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings required for the description of the embodiments or the prior art. Obviously, the drawings in the following description are only the embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained according to the provided drawings without creative efforts.

[0035] Figure 1 It is a schematic structural diagram of an imaging system provided by an embodiment of the present application;

[0036] Figure 2 It is a schematic structural diagram of an imaging system provided by another embodiment of the present application;

[0037] Figure 3 It is a schematic flowchart of spatial positioning based on eye position and line of sight direction provided by an embodiment of the present application;

[0038] Figure 4 It is a schematic flowchart of adaptive adjustment of the brightness of projection information provided by an embodiment of the present application. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0039] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

[0040] See Figure 1, a human - machine interaction system integrating an AR HUD and a holographic instrument disclosed in an embodiment of the present application, includes: an image generation unit 10, a diffusion element 20, a mirror assembly 30, and a holographic optical element 40;

[0041] The image generation unit 10 is used to generate a target light beam, the target light beam includes a first light beam and a second light beam, the first light beam carries near - scene image information, the second light beam carries far - scene image information, and the content of the image information carried by the first light beam and the second light beam is different; the image generation unit 10 can generate two light beams carrying different projection information through the optical elements and imaging technology inside it. For example, one light beam carries type - A projection information, and the other light beam carries type - B projection information.

[0042] The diffusion element 20 performs multiple reflections and refractions on the incident light through the internal microstructure, thereby realizing uniform diffusion of the light. In this solution, the diffusion element 20 is arranged on the transmission path of the second light beam and is used to diffuse the second light beam. In order to ensure that the second light beam can be clearly and accurately presented in the driver's field of view, it is necessary to diffuse and homogenize the projected second light beam. After diffusion, the second light beam projects into a virtual - image projection at the second position, and the virtual - image projection can display the projection data more clearly and three - dimensionally.

[0043] The mirror assembly 30 is an optical assembly mainly composed of a mirror and a package. In this solution, the mirror assembly 30 is used to project the target light beam to the corresponding target position, where the target light beam is the first light beam and the second light beam that cannot be directly projected to the corresponding target position, and the target positions include the first position where the holographic optical element 40 on the windshield is located and the second position on the windshield, and the coordinates of the first position and the second position are different on the windshield. In this solution, the mirror assembly 30 is at least used to reflect the second light beam to the second position, and the second light beam projected at the second position will form a far - scene image on the windshield. The first light beam can be projected to the first position after being reflected by the mirror assembly 30, or can be directly projected to the first position without being reflected by the mirror assembly 30.

[0044] The holographic optical element 40 (Holographic Optical Elements, HOE) is an optical element made according to the principle of holography, usually made on a photosensitive thin - film material. Their function is based on the principle of light diffraction, and they are a kind of diffractive optical element. In this solution, the holographic optical element 40 is used to perform a diffraction effect on the first light beam to form a near - scene image on the windshield.

[0045] In the imaging process of the human-machine interaction system integrating AR HUD and holographic instrument disclosed in the embodiments of the present application, the image generation unit 10 generates a first light beam and a second light beam carrying different projection information, then the diffusion element 20 is used to diffuse and homogenize the second light beam, and then the mirror assembly 30 is used to project the first light beam and the second light beam to the first position and the second position respectively. The first light beam projected on the first position undergoes a diffraction effect under the action of the holographic optical element 40 to form a HOE real image on the windshield (the HOE real image refers to the real image generated by the holographic optical element (HOE, Holographic Optical Element)), and the projection information carried by the first light beam is displayed through the HOE real image. The second light beam projected on the second position forms a distant view virtual image on the windshield, and the projection information carried by the second light beam is displayed through the distant view image. In this human-machine interaction system integrating AR HUD and holographic instrument, only one holographic optical element and a set of optical transmission systems are needed to complete the display of two-way projection information, and the structure of the human-machine interaction system integrating AR HUD and holographic instrument is simple and the volume is smaller.

[0046] In the technical solution disclosed in this embodiment, the type of the image generation unit 10 can be selected according to the design requirements. For example, the image generation unit 10 can be any one of the image generation units based on DLP, LCOS, and LBS technologies. Among them, digital light processing (DLP) technology is a projection technology based on a digital micromirror device (DMD). The DMD chip is an optical microelectromechanical system that can realize spatial light modulation, including millions of tiny aluminum mirrors, each mirror corresponding to a pixel, and the number of mirrors determines the display resolution. Liquid crystal on silicon (LCOS) technology is a new display technology that combines the advantages of LCD (Liquid Crystal Display) and DLP (Digital Light Processing). The image generation unit (PGU) based on laser beam scanning (LBS) technology is one of the core components of the HUD (Head-Up Display) system. Of course, the above various types of image generation units are only examples in this application. When designing, users can also select other types of image generation units according to their own design requirements.

[0047] In this embodiment, to ensure that the first light beam and the second light beam generated by the image generating unit 10 do not interfere with or be confused with each other, the image generating unit 10 may include a first display area and a second display area. The first display area is used to generate the first light beam, and the second display area is used to generate the second light beam. The emission angles of the light beams generated by the image generating unit 10 may be different, so that the light beams are separated from each other after emission, to more conveniently arrange the diffusion element 20 and the mirror assembly 30.

[0048] In the technical solution disclosed in this embodiment, the specific type of the diffusion element 20 may be selected according to design requirements. It may be any diffusion film known in the existing solutions that can meet the diffusion requirements in this solution. For example, it may be a gradient diffusion film or a deflection diffusion film.

[0049] In the technical solution disclosed in this embodiment, the specific structure of the mirror assembly 30 may be arranged according to the incident direction of the light beam to be intervened and its corresponding target position. In this embodiment, the mirror assembly 30 may include at least one mirror group. Each mirror group corresponds to a different light beam, and the mirror group is used to reflect the incident light beam corresponding to the mirror group to the target position corresponding to the light beam.

[0050] For example, referring to Figure 1 , the mirror assembly 30 includes a first mirror group. The mirror assembly 30 includes a first mirror 31 and a second mirror 32. The first mirror 31 and the second mirror 32 are arranged opposite to each other, so as to reflect the second light beam to its corresponding second position through the first mirror 31 and the second mirror 32. When correcting the optical path of the second light beam by using the first mirror 31 and the second mirror 32, the positions and angles of the first mirror and the second mirror may be arranged according to the incident angle of the second light beam and its corresponding second position.

[0051] In this embodiment, the type of the mirror in the mirror assembly 30 may be set according to the reflection requirements. The mirror may be a plane mirror or a curved mirror. For example Figure 1 in the shown embodiment, the first mirror may be a plane mirror or a curved mirror, and the second mirror is a curved mirror.

[0052] In this embodiment, the mirror group may further include a second mirror group, which is configured to reflect the first light beam to its corresponding first position. In the technical solution disclosed in this embodiment, when it is necessary to correct the path of the first light beam by using the mirror assembly 30 so that the first light beam falls on the first position, a second mirror group for correcting the path of the first light beam needs to be provided in the mirror assembly 30. The number and distribution of the mirrors in this mirror group may be determined based on the incident angle of the first light beam and the first position. For example, in Figure 2 the example of Figure 2 , only one mirror is required to reflect the first light beam to the first position. Therefore, the second mirror group may include only one mirror, denoted as the third mirror 33. The third mirror 33 is configured to reflect the incident light beam to the first position. The third mirror may be a plane mirror, and the reflection angle of the third mirror may be determined based on the incident angle of the first light beam and the specific position of the first position.

[0053] In the technical solution disclosed in this embodiment, the projection information carried by the first light beam and the second light beam may be determined according to the involved requirements. The user may, according to their own needs, independently adjust the specific content of the projection information carried by the first light beam and the second light beam generated by the image generating unit 10 through system control. For example, in this embodiment, the projection information carried by the first light beam includes vehicle status information, and the information carried by the second light beam includes non-vehicle status information. The vehicle status information includes at least any one or more combinations of instrument information, vehicle speed information, fuel quantity information, prompt information, and alarm information; the non-vehicle status information includes at least any one or more combinations of navigation and positioning information, traffic safety warning information, intelligent office information, and entertainment information.

[0054] In this embodiment, when the target user (in an automotive scenario, the target user may be the driver) views the projection images at the first position and the second position, the target user may pay more attention to the data in a certain area of the projection images. Moreover, under different ambient brightness levels, the user's adaptability to projection images of different brightness levels is different. For example, in a case of higher ambient brightness, it is necessary to increase the brightness of the projection image, and in a case of lower ambient brightness, it is necessary to decrease the brightness of the projection image. In order to implement the eye tracking function of the projection images at the first position and the second position and the adaptive adjustment function of the projection image brightness, the human-machine interaction system integrating AR HUD and holographic instrument disclosed in this embodiment may further include an optoelectronic control module, and the optoelectronic control module is used to implement the eye tracking function and the brightness adaptive adjustment function of the projection images at the first position and the second position. At this time, the human-machine interaction system integrating AR HUD and holographic instrument can automatically adjust the projection images at the first position and the second position according to the user's line of sight, and automatically adjust the brightness of the projection images at the first position and the second position, so that the projection images follow the user's line of sight and automatically adjust their own brightness based on the ambient brightness.

[0055] In order to implement the eye tracking function of the projection images at the first position and the second position, the optoelectronic control module disclosed in the above embodiment of the present application includes a DMS (Driver Monitor System) information processing system. The DMS information processing system is specifically used for: acquiring the eye position and the line of sight direction of the driver, determining the fixation area in the first position or the second position that the driver pays attention to based on the eye position and the line of sight direction, and sending the coordinate information of the fixation area to the image generation unit. The image generation unit is further used for, after acquiring the coordinate information of the fixation area, performing enhancement processing on the output information of the pixels that match the coordinate information of the fixation area to implement the eye tracking function. The pixels refer to the pixels used to generate the first light beam and the second light beam.

[0056] Specifically, referring to Figure 3 , the data processing flow of the DMS information processing system includes:

[0057] Step S301: Acquire the eye features of the driver based on the acquired image.

[0058] In this embodiment, an image of the driver can be collected by an image acquisition device (such as a DMS (Driver Monitor System) camera or other image acquisition devices), and the collected image of the driver is sent as a collected image to the DMS information processing system. The DMS information processing system extracts features from the collected image to obtain the eye features of the driver. The specific content of the eye features can be determined according to design requirements. For example, the eye features may include the position of the human eye iris. When obtaining the position of the human eye iris of the driver, an iris detection and eye tracking algorithm for HUD applications can be used, and based on a specific training model based on a spatial attention mechanism, feature recognition is performed on the collected image to identify the position of the human eye iris of the driver. The eye features may also include the spatial coordinates of key points within the driver's pupil that affect the line of sight direction.

[0059] Step S302: Determine the eye position and line of sight direction of the driver based on the eye features.

[0060] In this step, the eye position of the driver can be determined based on the obtained position of the human eye iris of the driver. After converting the spatial coordinates of the key points within the driver's pupil that affect the line of sight direction into iris camera coordinates, the line of sight direction of the driver can be determined based on the conversion result.

[0061] Step S303: Determine the fixation area in the first position or the second position that the driver is interested in based on the eye position and line of sight direction.

[0062] After determining the eye position and line of sight direction of the driver, determine the intersection area between the first position and the second position and the line of sight, and use this intersection area as the fixation area of the target user.

[0063] Step S304: Send the coordinate information of the fixation area to the image generation unit.

[0064] In this step, after sending the coordinate information of the fixation area to the image generation unit, the image generation unit will perform enhancement processing on the output information of the pixels that match the coordinate information of the fixation area, so that the fixation area is always within the best line of sight range of the driver.

[0065] In this embodiment, the optoelectronic control module can also adjust the projection effect according to the external environmental information to make the user's eyes more comfortable when watching the projection. Specifically, the optoelectronic control module may further include a front-view camera information processing system. The front-view camera information processing system is used to acquire and process the image brightness information and color data that match the external environment, and send them to the image generation unit. After acquiring the image brightness information and color data sent by the front-view camera information processing system, the image generation unit is further used to adjust the image display information corresponding to the first light beam and the second light beam based on the image brightness information and color data, so that the brightness of the projection images at the first position and the second position matches the external scene.

[0066] Specifically, referring to Figure 4 , the data processing flow of the front-view camera information processing system includes:

[0067] Step S401: Acquire the exposure parameters and pixel information that match the external environment.

[0068] The external environment image of the vehicle is captured in real time through a camera module (which can be the front-view camera module of the vehicle), and the exposure parameters and pixel information of the environment image are obtained by analyzing the environment image.

[0069] Step S402: Calculate the brightness value and color data based on the exposure parameters and pixel information.

[0070] Then, the scene perception algorithm is used to deeply analyze the pixel information and exposure parameters, so as to calculate the image configuration information of the external environment image. The image configuration information may include the brightness value and color data.

[0071] Step S403: Send the brightness value and color data to the image configuration unit.

[0072] The brightness value and color data calculated by the image configuration unit will be transmitted to the image generation unit. The image generation unit adjusts the configuration information corresponding to the first light beam and the second light beam based on the image configuration information, so that the projection effect of the projection images at the first position and the second position matches the external environmental information. When adjusting the configuration information corresponding to the first light beam and the second light beam, the adjustment is mainly focused on the brightness of the first light beam and the second light beam.

[0073] As can be seen from the above solutions, the present invention provides a human-computer interaction system integrating an AR HUD and a holographic instrument panel. First, more content can be presented to the user through the virtual image of the long-range HUD and the real image of the near-range HOE. Second, by introducing the extraction of the driver's eye position and line-of-sight direction information, the display content on the projection of the two beams of light is always within the driver's optimal line-of-sight range, achieving the effect of eye tracking. By introducing a front camera to capture external scene information, the display brightness of the projection of the two beams of light is adapted to different environments, realizing automatic environmental perception and brightness adaptive adjustment, and improving the fitting effect with the real world.

[0074] In addition, it should be noted that the device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed to multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. In addition, in the attached drawings of the device embodiments provided in this application, the connection relationship between the modules indicates that they have a communication connection, which can be specifically implemented as one or more communication buses or signal lines.

[0075] Through the description of the above embodiments, those skilled in the art can clearly understand that this application can be implemented by means of software plus necessary general hardware, and of course, it can also be implemented by means of dedicated hardware including application-specific integrated circuits, dedicated CPUs, dedicated memories, dedicated components, etc. Generally, functions completed by computer programs can be easily implemented by corresponding hardware, and the specific hardware structures for implementing the same function can also be various, such as analog circuits, digital circuits or dedicated circuits. However, for this application, in more cases, software program implementation is a better implementation method. Based on such an understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a readable storage medium, such as a floppy disk, USB flash drive, mobile hard disk, ROM, RAM, magnetic disk or optical disc of a computer, and includes several instructions for causing a computer device (which can be a personal computer, training device, or network device, etc.) to execute the methods described in various embodiments of this application.

[0076] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product.

[0077] The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions described in the embodiments of the present application are generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions may be transmitted from one website, computer, training device, or data center to another website, computer, training device, or data center via wired (such as coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) means. The computer-readable storage medium may be any available medium that can be stored by a computer or a data storage device such as a training device or a data center that includes one or more integrated available media. The available medium may be a magnetic medium (such as a floppy disk, hard disk, magnetic tape), an optical medium (such as a DVD), or a semiconductor medium (such as a solid state disk (SSD)), etc.

Claims

1. A human-computer interaction system integrating ARHUD and holographic instrument, characterized in that: include: An image generating unit, the image generating unit is used to generate a first light beam and a second light beam, the first light beam carries near-view image information, and the second light beam carries far-view image information; A diffusion element, used for diffusing and homogenizing the second light beam; a reflector assembly, the reflector assembly being used to reflect the first light beam and / or the diffused second light beam to a target position corresponding to the windshield, wherein the target position includes a first position on the windshield where the holographic optical element is located, and a second position on the windshield; The first light beam is diffracted at a first position of the windshield to form a real image, and the diffused second light beam is reflected at a second position of the windshield to form a distant virtual image in front of the windshield.

2. The human-computer interaction system integrating ARHUD and holographic instrument according to claim 1, characterized in that: The image generation unit is an image generation unit based on DLP / LCOS / LBS; The image generating unit includes a first display area and a second display area, the first display area is used to generate a first light beam, and the second display area is used to generate a second light beam.

3. The human-computer interaction system integrating ARHUD and holographic instrument according to any one of claims 1-2, characterized in that: The reflector assembly includes at least one reflector group, and the reflector group is used to reflect an incident light beam corresponding to the reflector group to its corresponding target position.

4. The human-computer interaction system integrating ARHUD and holographic instrument according to claim 3 is characterized in that: The reflector group includes a first reflector group, and the first reflector group includes: A first reflector and a second reflector, the second light beam is reflected by the first reflector and the second reflector in sequence and then projected to a second position.

5. The human-computer interaction system integrating ARHUD and holographic instrument according to claim 3 is characterized in that: The reflector group further includes a second reflector group, wherein the second reflector group includes: A third reflecting mirror is used to reflect the first light beam to a first position.

6. The human-computer interaction system integrating ARHUD and holographic instrument according to any one of claims 1-2, characterized in that: The projection information carried by the first light beam includes vehicle status information, and the information carried by the second light beam includes non-vehicle status information; the vehicle status information includes at least instrument information, vehicle speed information, fuel level information, prompt information, and alarm information, any one or a combination of multiple thereof; The non-vehicle status information includes at least one or a combination of navigation positioning information, traffic safety warning information, smart office information, and entertainment information.

7. The human-computer interaction system integrating ARHUD and holographic instrument according to claim 1, characterized in that: Also includes: A photoelectric control module is used to realize human eye following and brightness adaptive adjustment of the projected images at the first position and the second position.

8. The human-computer interaction system integrating ARHUD and holographic instrument according to claim 7, characterized in that: The photoelectric control module includes a DMS information processing system; The DMS information processing system is used to obtain the eye position and sight direction of the driver, determine the gaze area in the first position or the second position that the driver is paying attention to based on the eye position and sight direction, and send the coordinate information of the gaze area to the image generation unit; The image generation unit is further configured to, after acquiring the coordinate information of the gaze area, enhance the output information of the pixels matching the coordinate information of the gaze area, so as to realize the human eye tracking function.

9. The human-computer interaction system integrating ARHUD and holographic instrument according to any one of claims 7-8, characterized in that: The photoelectric control module also includes a front-view camera information processing system; The front-view camera information processing system is used to obtain image brightness information and color data that match the external environment and send them to the image generation unit; The image generating unit is further configured to adjust the image display information corresponding to the first light beam and the second light beam based on the image brightness information and the color data after acquiring the image brightness information and the color data, so that the brightness of the projected images at the first position and the second position matches the external scene.

10. An automobile, characterized in that: A human-computer interaction system comprising the ARHUD and holographic instrument fusion as described in any one of claims 1 to 9.

Images