Vehicle-mounted head-up display system, vehicle and vehicle display driving method

Abstract

The application discloses a vehicle-mounted head-up display system, a vehicle and a vehicle display driving method, relates to the technical field of vehicle-mounted display, and the vehicle-mounted head-up display system comprises a first display module and a second display module. The first display module is configured to project an image captured by a streaming rearview mirror system to a virtual image display outside a windshield glass in front of a driver. The second display module is configured to project head-up display content to a virtual image display outside the windshield glass in front of the driver. Thus, the head-up display content and the image captured by the streaming rearview mirror system constitute an integrated visual field. The driver can simultaneously watch the front road, the head-up display content and the image of the streaming rearview mirror system without shifting the line of sight and the focal length, greatly improves the driving safety, and can build a fused and coherent virtual image picture, and improves the driving experience.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of vehicle display, in particular to a vehicle head-up display system, a vehicle and a vehicle display driving method. BACKGROUND

[0002] Head-up display (HUD) is a system device that projects vehicle performance parameters and navigation images and other content as virtual images outside the windshield in front of the driver, which can reduce the safety hazards caused by the driver's visual line shift or looking down to check the instrument panel.

[0003] The streaming rearview mirror is a camera-monitor system (CMS), which sets up a camera module outside the vehicle to shoot real-time pictures of the rear of the vehicle, and then transmits the pictures to the display module inside the vehicle, so that the driver can understand the road conditions outside the vehicle by watching the pictures displayed on the display module inside the vehicle. Compared with the physical rearview mirror, the streaming rearview mirror system can make the driver move a shorter distance and turn his head a smaller angle between watching the display module inside the vehicle and the road ahead, and the driver has a wider and clearer view with a smaller blind area.

[0004] However, in the existing vehicle, the display module inside the vehicle of the streaming rearview mirror system is usually fixed on the door trim or the inner side of the column (also known as A-pillar and B-pillar) between the front windshield and the front door, and the driver still needs to frequently shift his visual line and focal length between the road ahead and the display module inside the vehicle of the streaming rearview mirror system; and the head-up display system projects the head-up display content as virtual images outside the windshield, while the streaming rearview mirror system presents the captured images as real images on the display module inside the vehicle, so that the visual fields of the head-up display system and the streaming rearview mirror system are mutually divided, and the imaging distances of the two systems also have a gap, which causes the driver to still need to frequently shift his visual line and focal length between the two visual fields, causing a certain degree of visual fatigue, increasing the cognitive burden and safety hazards. SUMMARY

[0005] To solve the above technical problems, the present application provides a vehicle head-up display system, a vehicle and a vehicle display driving method to reduce the safety hazards of the driver shifting his visual line and focal length between the road ahead, the images of the streaming rearview mirror system and the head-up display content, and improve the driving safety.

[0006] To achieve the above purpose, the present application provides the following technical solutions:

[0007] In a first aspect, the present application provides a vehicle head-up display system, comprising:

[0008] The first display module is configured to display an image captured by the streaming rearview mirror system to generate first image light; the first image light is projected to a windshield in front of the driver, and after being reflected by the windshield, a first virtual image is formed outside the windshield and received within an eyebox range of the driver;

[0009] The second display module is configured to display head-up display content to generate second image light; the second image light is projected to the windshield, and after being reflected by the windshield, a second virtual image is formed outside the windshield and received within the eyebox range of the driver.

[0010] In a second aspect, the present application also provides a vehicle, comprising an intelligent cockpit domain controller, a streaming rearview mirror system, a vehicle head-up display system, and a pixel headlight, wherein the vehicle head-up display system is the vehicle head-up display system described above.

[0011] The intelligent cockpit domain controller is configured to receive and process an image captured by the streaming rearview mirror system to generate a first data signal output to a first display module of the vehicle head-up display system; receive and process head-up display data to generate a second data signal output to a second display module of the vehicle head-up display system; and generate a third data signal for controlling display of the pixel headlight.

[0012] In a third aspect, the present application also provides a vehicle display driving method applied to an intelligent cockpit domain controller of a vehicle, wherein the vehicle further comprises a streaming rearview mirror system, a vehicle head-up display system, and a pixel headlight, and the vehicle head-up display system is the vehicle head-up display system described above.

[0013] The vehicle display driving method comprises:

[0014] receiving and processing an image captured by the streaming rearview mirror system to generate a first data signal output to a first display module of the vehicle head-up display system; receiving and processing head-up display data to generate a second data signal output to a second display module of the vehicle head-up display system; and generating a third data signal for controlling display of the pixel headlight, wherein the first data signal, the second data signal, and the third data signal are time-synchronized.

[0015] Compared with the prior art, the above technical solution has the following advantages:

[0016] The vehicle-mounted head-up display system provided by the application comprises a first display module and a second display module, wherein the first display module is configured to display images captured by a streaming rearview mirror system, generate first image light, so that the first image light is projected to a windshield in front of a driver, after being reflected by the windshield, a first virtual image is formed outside the windshield and received within a driver's eyebox range; the second display module is configured to display head-up display content, generate second image light, so that the second image light is projected to the windshield in front of the driver, after being reflected by the windshield, a second virtual image is formed outside the windshield and received within the driver's eyebox range; that is, not only the image light of the head-up display content displayed and generated by the second display module is projected to the virtual image display outside the windshield in front of the driver, but also the image light of the images captured by the streaming rearview mirror system displayed and generated by the first display module is projected to the virtual image display outside the windshield in front of the driver, so that the head-up display content and the images captured by the streaming rearview mirror system constitute an integrated visual field, the driver can simultaneously watch the front road, the head-up display content and the images of the streaming rearview mirror system without shifting the line of sight and focal length, greatly improving the driving safety. Moreover, the head-up display content and the images captured by the streaming rearview mirror system are both displayed as virtual images outside the windshield in front of the driver, and a fused and coherent virtual image picture can also be constructed, improving the driving experience. BRIEF DESCRIPTION OF DRAWINGS

[0017] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings needed to be used in the embodiments or prior art description. Obviously, the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can also be obtained without creative labor based on these drawings.

[0018] Figure 1 A light path transmission schematic diagram of a vehicle-mounted head-up display system provided by an embodiment of the present application;

[0019] Figure 2 A structure schematic diagram of a vehicle-mounted head-up display system provided by an embodiment of the present application from a side view of a vehicle;

[0020] Figure 3 A structure schematic diagram of a vehicle-mounted head-up display system provided by an embodiment of the present application from a top view of a vehicle;

[0021] Figure 4 A structure schematic diagram of a vehicle-mounted head-up display system provided by an embodiment of the present application from a front view at a central position of a vehicle;

[0022] Figure 5 A display effect schematic diagram of a vehicle-mounted head-up display system provided by an embodiment of the present application;

[0023] Figure 6 Another display effect schematic diagram of a vehicle-mounted head-up display system provided by an embodiment of the present application;

[0024] Figure 7 A simplified schematic diagram of Figure 3 ;

[0025] Figure 8 A schematic diagram of a virtual image field of view of a windshield outside as seen by a human eye at a central position of a vehicle;

[0026] Figure 9 A structure schematic diagram of a first display module and a second display module in a vehicle-mounted head-up display system provided by an embodiment of the present application;

[0027] Figure 10a A partial top view schematic diagram of a collimating lens array being a plano-convex lens array;

[0028] Figure 10b A partial side view schematic diagram of a collimating lens array being a plano-convex lens array;

[0029] Figure 11a A partial top view schematic diagram of a collimating lens array being a Fresnel lens array;

[0030] Figure 11b A three-dimensional schematic diagram of a collimating lens being a Fresnel lens;

[0031] Figure 12a A structure schematic diagram of a backlight module of a first display module and a second display module in a vehicle-mounted head-up display system provided by an embodiment of the present application;

[0032] Figure 12b A structure schematic diagram of another backlight module of a first display module and a second display module in a vehicle-mounted head-up display system provided by an embodiment of the present application;

[0033] Figure 12c A structure schematic diagram of still another backlight module of a first display module and a second display module in a vehicle-mounted head-up display system provided by an embodiment of the present application;

[0034] Figures 13a-13c An illumination distribution simulation result of a backlight module of a first display module and a second display module in a vehicle-mounted head-up display system provided by an embodiment of the present application at a display screen;

[0035] Figure 14A schematic diagram of a vehicle provided by the embodiments of the present application, in which an intelligent cockpit domain controller is in communication connection with a streaming rearview mirror system, a head-up display system and a pixel headlight;

[0036] Figure 15 A schematic diagram of time synchronization between a system-on-chip and a microcontroller unit inside the intelligent cockpit domain controller;

[0037] Figure 16 A schematic diagram of a scenario in which a vehicle changes lanes at high speed;

[0038] Figure 17 A schematic diagram of a scenario in which a vehicle has a pedestrian passing by.

[0039] Explanation of reference signs:

[0040] First display module 100; first image light S1; windshield 10; driver eyebox range 20; first virtual image P1; second display module 200; second image light S2; second virtual image P2; vehicle width direction X; longitudinal center line L1 of vehicle axle; A-pillar 31; B-pillar 32; horizontal line of sight D0; display virtual image center D1; backlight module 110; display screen 120; LED array 111; collimating lens array 112; multifunctional film layer 113; LED lamp bead 1; collimating lens 2; diffusion film layer 3; reflective polarized film layer 4; angle deflection film layer 5; angle deflection reflective polarized film layer 6; haze reflective polarized film layer 7; intelligent cockpit domain controller CDC; streaming rearview mirror system CMS; head-up display system HUD; pixel headlight 300; first data signal Q1; second data signal Q2; third data signal Q3; system-on-chip SoC; in-memory computing accelerator 400; data processing engine 410; visual rendering engine 420; microcontroller unit MCU; clock module 500. DETAILED DESCRIPTION

[0041] The technical solutions in the embodiments of the present application will be described clearly and completely below in combination with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative labor fall within the scope of protection of the present application.

[0042] The terms "first", "second", and the like in the description and in the claims of the present application and above drawings are used for distinguishing between similar objects and not necessarily for describing a specific sequential or chronological order. It is to be understood that the terms so used are interchangeable under appropriate circumstances and that the embodiments of the present application are capable of functioning in other sequences than described or otherwise illustrated herein. Furthermore, the terms "comprise", "include", "contain" and "have" and any variations thereof used in the description and in the claims of the present application are intended to cover both a complete and an incomplete set of elements, processes, methods, systems, products or apparatuses, so that any of the described elements, processes, methods, systems, products or apparatuses can be included in a process, method, system, product or apparatus that is encompassed by the present application.

[0043] As described in the background section, in the prior art, the in-vehicle display module of the streaming rearview mirror system is usually fixed on the door trim or the inner side of the pillar (also known as A-pillar and B-pillar) between the front windshield and the front door, and the driver still needs to frequently shift the line of sight and focal length between the front road and the in-vehicle display module of the streaming rearview mirror system; and the heads-up display system projects the heads-up display content to the virtual image display outside the windshield, while the streaming rearview mirror system presents the captured image on the real image display on the in-vehicle display module, so that the fields of view of the heads-up display system and the streaming rearview mirror system are mutually fragmented, and the imaging distances of the two are also different, which causes the driver to still need to frequently shift the line of sight and focal length between the two fields of view, causing a certain degree of visual fatigue, increasing the cognitive burden and safety hazards.

[0044] Therefore, the embodiments of the present application provide a vehicle-mounted heads-up display system, Figure 1 The optical path transmission schematic diagram of the vehicle-mounted heads-up display system provided by the embodiments of the present application is shown, Figure 2 The structural schematic diagram of the vehicle-mounted heads-up display system provided by the embodiments of the present application is shown in the side view angle of the vehicle, Figure 3 The structural schematic diagram of the vehicle-mounted heads-up display system provided by the embodiments of the present application is shown in the top view angle of the vehicle, Figure 4 The structural schematic diagram of the vehicle-mounted heads-up display system provided by the embodiments of the present application is shown in the front view angle at the central position of the vehicle, as Figures 1-4As shown, the vehicle head-up display system provided in this application embodiment includes a first display module 100. The first display module 100 is configured to display images captured by a streaming media rearview mirror system and generate a first image light S1. The first image light S1 is projected onto the windshield 10 in front of the driver. After being reflected by the windshield 10, a first virtual image P1 is formed outside the windshield 10 and received within the driver's eye box range 20. In other words, the image of the streaming media rearview mirror system is displayed as a virtual image outside the windshield 10 and received within the driver's eye box range 20, thereby allowing the driver to switch between looking at the road ahead and the image of the streaming media rearview mirror system without shifting their gaze and focus, thus improving driving safety.

[0045] At the same time, such as Figures 1-4 As shown, the vehicle head-up display system provided in this application embodiment further includes a second display module 200. The second display module 200 is configured to display head-up display content and generate a second image light S2, so that the second image light S2 is projected onto the windshield 10, and after being reflected by the windshield 10, forms a second virtual image P2 located outside the windshield 10 and received within the driver's eye box range 20. Figure 2 This is a schematic diagram of the optical path of the first image light S1 generated by the first display module 100, and also a schematic diagram of the optical path of the second image light S2 generated by the second display module 200. The optical paths of the first image light S1 and the second image light S2 are similar.

[0046] In the vehicle head-up display system provided in this application embodiment, not only does the second display module 200 display and generate image light of the head-up display content, projecting the content onto the windshield in front of the driver as a virtual image, but the first display module 100 also displays and generates image light of the image captured by the streaming rearview mirror system, projecting the image onto the windshield in front of the driver as a virtual image. Thus, the head-up display content and the image captured by the streaming rearview mirror system form an integrated field of view, allowing the driver to simultaneously view the road ahead, the head-up display content, and the image from the streaming rearview mirror system without shifting their gaze or focus, greatly improving driving safety. Furthermore, since both the head-up display content and the image captured by the streaming rearview mirror system are displayed as virtual images outside the windshield in front of the driver, a fused and continuous virtual image can be constructed, enhancing the driving experience.

[0047] It should be noted that the second display module 200 can include at least one of a panoramic head-up display (PHUD) module, an augmented reality head-up display (AR-HUD) module, and a holographic head-up display (3D-HUD) module, wherein the panoramic head-up display (PHUD) content can include vehicle performance parameters, navigation images, entertainment, song lyrics, and time information; the augmented reality head-up display (AR-HUD) content can include 3D guide marks, AR images, augmented reality guide marks with AR, and interaction with the real world; and the holographic head-up display (3D-HUD) eliminates the need for a screen and can provide a more immersive and realistic 3D viewing experience.

[0048] Optionally, the images captured by the streaming rearview mirror system can be projected as virtual images by the first display module 100 outside the windshield in front of the driver, at which time there is no need to set the in-vehicle display module of the streaming rearview mirror system. Alternatively, the in-vehicle display module of the streaming rearview mirror system can still be set, so that the images captured by the streaming rearview mirror system are projected as virtual images by the first display module 100 outside the windshield in front of the driver and are also displayed as real images by the in-vehicle display module.

[0049] Optionally, as shown in Figures 2-4 The first display module 100 and the second display module 200 are independently arranged from each other.

[0050] It can be understood that the image light generated by the first display module 100 and the second display module 200 is projected to the windshield 10 in front of the driver, and after being reflected once by the windshield 10, the virtual image is displayed, therefore, the object space is the first display module 100 and the second display module 200, and the image space is the virtual image outside the windshield, then according to the reflection law and the reversibility of light propagation, the position and attitude of the corresponding display module in the vehicle space can be determined according to the pre-set spatial position and attitude of the virtual image through light tracing. Specifically, the specific positions and attitudes of a plurality of virtual images can be determined in space according to the number of virtual images, the spacing between different virtual images, the tilt attitude of each virtual image, and the requirement of the virtual image relative to the position of the driver's eyes, and then the position and attitude of the corresponding display module in the vehicle space are calculated through light tracing. The first display module 100 and the second display module 200 are independently arranged from each other, which can facilitate independent adjustment of the positions and attitudes of the first display module 100 and the second display module 200, and further independent adjustment of the positions and attitudes of the first virtual image P1 and the second virtual image P2.

[0051] It can also be understood that, as shown in Figures 2-4As shown, there can be one or more first display modules 100. For example, there are two first display modules 100, and correspondingly, there are also two first virtual images P1, which respectively display the images captured by the left and right camera modules in the streaming media rearview mirror system.

[0052] like Figures 2-4 As shown, there can be one or more second display modules 200 to display different head-up display content. For example, there can be three second display modules 200, and correspondingly, there can also be three second virtual images P2. One second virtual image P2 can display vehicle instrument information, specifically including vehicle speed, vehicle status, etc.; another second virtual image P2 can display navigation information and voice assistant functions; and yet another second virtual image P2 can display social media information and present audiovisual content. The specific display effect is as follows: Figure 5 As shown.

[0053] Alternatively, the first display module 100 and the second display module 200 can also be an integrated display module. In this case, different areas of the integrated display module display images captured by the streaming media rearview mirror system and different content from the head-up display, as shown in the specific display effect. Figure 6 As shown, the virtual image outside the windshield 10 includes images captured by the left and right camera modules of the streaming rearview mirror system, vehicle instrument information, navigation information, voice assistant functions, and social media information.

[0054] It is understandable that when the first display module 100 and the second display module 200 are integrated display modules, the integrated display module may be required to have a certain degree of extensibility and flexibility in order to adapt to the virtual image display corresponding to different areas of the integrated display module.

[0055] Optional, see reference Figures 2-4 As shown, the first display module 100 and the second display module 200 are arranged below the dashboard (IP) in the vehicle to facilitate the projection of the image light generated by the first display module 100 and the second display module 200 onto the windshield 10 in front of the driver.

[0056] As previously known, by adjusting the position and orientation of the first display module 100 and the second display module 200, the position and orientation of the first virtual image P1 and the second virtual image P2 can be adjusted accordingly. The settings of the first virtual image P1 and the second virtual image P2 will be explained below.

[0057] Optional, such as Figure 3 and Figure 4 As shown, the first display module 100 is arranged on both sides of the second display module 200 along the vehicle width direction X. Correspondingly, the first virtual image P1 is located on both sides of the second virtual image P2 along the vehicle width direction X, so as to better meet regulatory requirements and driving habits.

[0058] Further, Figure 7 A simplified schematic diagram of Figure 3 is shown, in combination with Figure 3 , Figure 4 and Figure 7 , optionally, the first virtual image P1 and the second virtual image P2 as a whole can be symmetrically distributed along the longitudinal center line L1 of the vehicle axle. In this way, from the perspective of the coordinate system of the whole vehicle, the first virtual image P1 and the second virtual image P2 as a whole are symmetrically distributed in an arc shape relative to the longitudinal center line L1 of the vehicle axle, that is, a ring-shaped distribution, the central part is the heads-up display content, and the images on both sides are captured by the left and right camera modules in the streaming rearview mirror system, and the distance between different virtual images is close, so as to present a large-range virtual image display effect that is transversely continuous, thereby improving the visual fusion effect of the heads-up display content and the images of the streaming rearview mirror system.

[0059] Among them, the first virtual image P1 and the second virtual image P2 as a whole can basically cover the range from the left A-pillar 31 to the right B-pillar 32 in the vehicle width direction X, and the A-pillar 31 and the B-pillar 32 are two pillars between the front windshield and the front door.

[0060] Figure 8 A schematic diagram of the virtual image field outside the windshield as seen by the human eye at the central position of the vehicle is shown, as shown in Figure 8 , optionally, the center of the first virtual image P1 and the center of the second virtual image P2 can be set to be the same as the downward viewing angle θ of the driver. It can be understood that the downward viewing angle of the driver refers to the vertical angle formed between the horizontal line of sight D0 of the driver in the normal driving posture and the line of sight looking at the center D1 of the display virtual image. The horizontal line of sight D0 of the driver represents the line of sight direction when the driver looks straight ahead, which is the reference line of the driver's viewing angle. By setting the center of the first virtual image P1 and the center of the second virtual image P2 to be the same as the downward viewing angle of the driver, the center of the first virtual image P1 and the center of the second virtual image P2 are at the same viewing height relative to the driver, which means that when the driver views the first virtual image P1 and the second virtual image P2, the driver's eyes can basically remain stationary in the vertical direction, and only need to be horizontally rotated, which can further reduce the focusing fatigue of the driver when viewing the heads-up display content and the images of the streaming rearview mirror system, so that the focal length of the driver's eyeball remains stable, and the visual fusion effect of the heads-up display content and the images of the streaming rearview mirror system can be further improved.

[0061] For example, the center of the first virtual image P1 and the center of the second virtual image P2 are -8.25° relative to the driver's downward viewing angle θ. This means that the driver needs to turn his line of sight downward by about 8.25° from the horizontal line of sight D0 to see the center of the first virtual image P1 and the center of the second virtual image P2. At this time, the driver only needs to slightly lower his line of sight, which is within the natural and relaxed range of head and eye movement, without having to look down.

[0062] Optional, such as Figure 2 As shown, the difference between the virtual image distance of the first virtual image P1 and the virtual image distance of the second virtual image P2 does not exceed a first threshold. Here, virtual image distance refers to the distance between the plane containing the virtual image perceived by the driver's eyes and the driver's eyes. Therefore, the virtual image distances of the first virtual image P1 and the second virtual image P2 are close, making them approximately located on the same virtual image plane, which can further improve the visual fusion effect of the head-up display content and the streaming rearview mirror system images. Optionally, the first threshold is 1 mm.

[0063] At this point, it is also necessary to avoid the overlap of the first virtual image P1 and the second virtual image P2. Optionally, there can be a gap between the first virtual image P1 and the second virtual image P2 to avoid overlap. Alternatively, the virtual image distance of the second virtual image P2 can be set to be slightly smaller than the virtual image distance of the first virtual image P1, or the virtual image distance of the first virtual image P1 can be slightly smaller than the virtual image distance of the second virtual image P2. In this way, the virtual images of the head-up display content and the virtual images of the images captured by the streaming media rearview mirror system are spatially offset from each other, thereby avoiding the overlap of the first virtual image P1 and the second virtual image P2.

[0064] Optionally, the field of view (FOV) of the first virtual image P1 can be 7°×4°, where 7° is the horizontal field of view, representing the field of view that the first virtual image P1 can cover in the left and right width, and 4° is the vertical field of view, representing the field of view that the first virtual image P1 can cover in the up and down height.

[0065] Optionally, the field of view (FOV) of the second virtual image P2 can be 14°×2°, where 14° is the horizontal field of view, representing the field of view that the second virtual image P2 can cover in the left and right width, and 2° is the vertical field of view, representing the field of view that the second virtual image P2 can cover in the up and down height.

[0066] Understandably, the first virtual image P1 needs to display the real-world view outside the vehicle, where the scene may vary more significantly in the vertical direction, such as showing the entire body of a vehicle behind it. Therefore, it requires a higher vertical field of view. The second virtual image P2, on the other hand, mainly displays symbolic instrument and navigation information, which has a lower information density in the vertical direction, resulting in a relatively narrower vertical field of view.

[0067] It can also be understood that the second virtual image P2 has a wider horizontal field of view and can display more abundant graphic information, such as complete navigation intersections and multiple lane information. Although the first virtual image P1 is narrower, it is sufficient to clearly display the vehicles or obstacles behind the side.

[0068] It should be noted that although the first display module 100 and the in-vehicle display module in the streaming rearview mirror system will display the image of the streaming rearview mirror system, the first display module 100 displays the image of the streaming rearview mirror system in order to generate the first image light S1 so that the first image light S1 is projected outside the windshield in front of the driver to form a virtual image display, and the in-vehicle display module in the streaming rearview mirror system directly displays the image as a real image, so the requirements for the two display modules are different, and the display brightness requirement for the first display module 100 is higher.

[0069] Moreover, although the display module in the head-up display system displays and generates image light of the head-up display content so that the image light of the head-up display content is projected outside the windshield in front of the driver to form a virtual image display, the display module in the existing head-up display system has problems such as low light efficiency and crosstalk. Specifically, the display module in the existing head-up display system is composed of a backlight module and a display screen, the backlight module is a core device, the backlight module provides illumination light for the display screen, the backlight module adopts a combination of an array of reflecting cups (or lamp covers) and a plurality of film layers, wherein the array of reflecting cups and the LED lamp beads are one-to-one aligned to realize local dimming, and the plurality of film layers include a diffusion plate, a diffusion film, a prism sheet (including a horizontal BEF and a vertical BEF), and a plurality of reflective polarizing films (DBEF). Because the backlight module uses a large number of film layers, the light beam is severely diffused, resulting in problems such as low light efficiency and crosstalk. Low light efficiency further leads to the need for an additional large-size heat dissipation device when the system needs to display high brightness, which is costly. Crosstalk further leads to a too large illumination range of a single LED lamp bead, and the local dimming effect is poor.

[0070] Based on this, in some embodiments of the present application, Figure 9 The structure of the first display module 100 and the second display module 200 in the vehicle-mounted head-up display system provided by the embodiments of the present application is shown, and the working principle of the first display module 100 and the second display module 200 is described in combination with Figure 1 and Figure 9 As shown in the figures, the first display module 100 and the second display module 200 include a backlight module 110 and a display screen 120; the backlight module 110 is configured to provide illumination light to the display screen 120; the display screen 120 is configured to modulate the illumination light provided by the backlight module 110 to display corresponding images (images captured by the streaming rearview mirror system or head-up display content) and generate corresponding image light (first image light S1 or second image light S2).

[0071] Optionally, the display screen 120 can be a thin-film transistor liquid crystal display (TFT-LCD), and a plurality of thin-film transistors on the screen independently and accurately control the liquid crystal "valve" opening degree of each pixel point according to the received signal, thereby modulating the illumination light provided by the backlight module 110, and the modulated illumination light becomes a light carrying specific image information, i.e., corresponding image light.

[0072] As shown in Figure 9 , the backlight module 110 includes an LED array 111, a collimating lens array 112, and a multifunctional film layer 113, wherein the LED array 111 includes a plurality of LED lamp beads 1 arranged in an array; the collimating lens array 112 includes a plurality of collimating lenses 2 arranged in an array, and the collimating lenses 2 are used to converge the light emitted by the LED lamp beads 1; and the multifunctional film layer 113 is used to modulate the light emitted by the LED lamp beads 1 after being converged by the collimating lenses 2.

[0073] It can be understood that the collimating lenses 2 can converge the light emitted by the LED lamp beads 1, thereby shrinking the light-emitting angle of the LED lamp beads 1 to significantly improve the light efficiency, and by adjusting the collimating lenses 2, the illumination range of the corresponding LED lamp beads 1 can be controlled, thereby improving the local dimming effect.

[0074] Optionally, the collimating lenses 2 can be arranged one-to-one corresponding to the LED lamp beads 1, the center of the collimating lens 2 is aligned with the center of the corresponding LED lamp bead 1, in this way, the illumination range of each LED lamp bead can be independently controlled, which is convenient for realizing accurate local dimming. However, the present application does not limit this, and other options can also be that the collimating lenses 2 are arranged corresponding to several LED lamp beads 1, which is determined according to the situation.

[0075] Optionally, the adjacent collimating lenses 2 can have a gap or overlap each other, which is determined according to the situation.

[0076] Optionally, the collimating lens array 112 can be any one of a plano-convex lens array and a Fresnel lens array, i.e., the collimating lens 2 can be any one of a plano-convex lens and a Fresnel lens, wherein the surface type of the plano-convex lens and the Fresnel lens can be any one of a spherical surface, an aspherical surface, and a free-form surface. For the convenience of understanding, Figure 10a a partial top view schematic diagram of the collimating lens array 112 as a plano-convex lens array is shown, Figure 10b a partial side view schematic diagram of the collimating lens array 112 as a plano-convex lens array is shown; Figure 11a a partial top view schematic diagram of the collimating lens array 112 as a Fresnel lens array is shown, Figure 11b a three-dimensional schematic diagram of the collimating lens 2 as a Fresnel lens is shown.

[0077] Figures 12a-12cStructure diagrams of three backlight modules 110 of the first display module 100 and the second display module 200 in the vehicle-mounted head-up display system provided by the embodiments of the present application are shown in FIGS. 1 to 3, wherein Figures 12a-12c As shown in FIG. 4, optionally, the multifunctional film layer 113 includes a diffusion film layer 3, a reflective polarized film layer 4 and an angle deflection film layer 5 stacked in a direction away from the collimating lens array 112.

[0078] The diffusion film layer 3 is configured to uniformly diffuse light. It can be understood that each LED lamp bead 1 in the LED array 111 emits a light spot, and the central brightness of the light spot is relatively large, and the area between the light spots is relatively dark. If there is no diffusion film layer 3, a light spot will be seen on the display screen 120 instead of a uniform bright surface. The diffusion film layer 3 contains a large number of tiny scattering particles, which refract and reflect light multiple times when the light passes through, scatter the point-like light spot, make the light diverge in different directions, and achieve uniform brightness of the entire display area.

[0079] The reflective polarized film layer 4 is configured to allow light of a preset polarization direction to pass through and recycle light of other polarization directions. It can be understood that the liquid crystal display screen needs linearly polarized light of a preset vibration direction to work. The reflective polarized film layer 4 first allows only polarized light of a correct vibration direction to pass through, and then reflects polarized light of an incorrect vibration direction that is blocked by the liquid crystal display screen. These reflected light will be refracted and reflected in the diffusion film layer 3, so that the polarization direction changes, and then when the light is shot at the reflective polarized film layer 4 again, a part of the light has become polarized light of a correct vibration direction and can pass through. In this way, the light utilization rate is greatly improved, and the brightness and contrast of the display screen are significantly improved.

[0080] The angle deflection film layer 5 is configured to change the angle of the light in a directional manner. The angle deflection film layer 5 is a micro-prism film, which has dense micro-prism structures on the surface and can “fold” back the light of a large-angle divergence, so that the light is emitted more vertically to the screen surface, thereby improving the forward brightness, aligning the main light, making the light direction of the screen center align with the eyebox center of the driver, and further compressing the system volume.

[0081] In summary, compared with the existing backlight module which adopts the combination of arrayed light reflection cup (or lampshade) and multiple film layers, there are problems such as low light efficiency and crosstalk. In the embodiment of the present application, the backlight module 110 adopts the collimating lens 2 to converge the light emitted by the LED lamp bead 1, shrink the light emitting angle, realize the requirements of high light efficiency, high brightness and low heat dissipation, and the collimating lens 2 and the LED lamp bead 1 are both arrayed design, one collimating lens 2 can correspond to one or more LED lamp beads 1, and the precise local dimming effect can be realized by adjusting the collimating lens 2; at the same time, the backlight module 110 is also matched with the multifunctional film layer 113 including the diffusion film layer 3, the reflective polarized film layer 4 and the angle deflection film layer 5 which are stacked in sequence, not only the number of stacked film layers is reduced, but also the uniform, bright and direction-controllable illumination light is finally obtained as the backlight of the display screen 120, which improves the brightness and contrast of the system and further compresses the system volume.

[0082] It should be noted that because the side of the reflective polarized film layer 4 close to the collimating lens array 112 needs to be provided with the diffusion film layer 3 which can convert part of the light reflected by the reflective polarized film layer 4 back to the light which can pass through the reflective polarized film layer 4, so as to increase the total outgoing light and improve the light efficiency, therefore, the side of the reflective polarized film layer 4 close to the collimating lens array 112 needs to be provided with the diffusion film layer 3.

[0083] In addition, because the purpose of the angle deflection film layer 5 is to make the light path of the light emitted from the screen consistent with the virtual image of the screen, so as to maximize the light utilization rate, therefore, no other film layer can be added on the angle deflection film layer 5, because the film layer generally has a certain scattering property, which will reduce the light utilization rate.

[0084] Therefore, in the multifunctional film layer 113, the diffusion film layer 3, the reflective polarized film layer 4 and the angle deflection film layer 5 are stacked in sequence in the direction away from the collimating lens array 112.

[0085] Optionally, as shown in Figure 12a , the diffusion film layer 3, the reflective polarized film layer 4 and the angle deflection film layer 5 are separate film layers.

[0086] Another optional, as shown in Figure 12b , the diffusion film layer 3 is an independent film layer, and the reflective polarized film layer 4 and the angle deflection film layer 5 are pressed together to form a reflective polarized film layer 6 with angle deflection, which combines the functions of the reflective polarized film layer 4 and the angle deflection film layer 5, and is used for aligning the main light and improving the contrast and brightness of the system.

[0087] Still another optional, as shown in Figure 12cAs shown, the diffusion film layer 3 and the reflective polarizing film layer 4 are laminated together to form a haze reflective polarizing film layer 7, and the angle deflection film layer 5 is an independent film layer. The haze reflective polarizing film layer 7 combines the functions of the diffusion film layer 3 and the reflective polarizing film layer 4, and is used for diffusion and uniform light, improving the brightness uniformity, and improving the brightness and contrast of the display screen.

[0088] Alternatively, the diffusion film layer 3, the reflective polarizing film layer 4 and the angle deflection film layer 5 can be laminated together.

[0089] That is, at least two adjacent ones of the diffusion film layer 3, the reflective polarizing film layer 4 and the angle deflection film layer 5 are laminated together to further compress the system volume.

[0090] Figures 13a-13c The simulation result of the illuminance distribution of the backlight module 110 of the first display module 100 and the second display module 200 of the vehicle-mounted head-up display system at the display screen 120 is shown. It can be seen that the illuminance distribution of the backlight module 110 at the display screen 120 is very uniform, and the brightness is high.

[0091] Further, considering that the head-up display system, the streaming rearview mirror system and the pixel headlamp in the existing vehicle are each driven by an independent controller, the problems of asynchronous display, repeated or conflicting cross-device information and large spatial alignment error of dynamic targets are prone to occur, the embodiments of the present application further provide a vehicle, as shown in the figure. Figure 14 As shown, the vehicle includes an intelligent cabin domain controller CDC, a streaming rearview mirror system CMS, a vehicle-mounted head-up display system HUD and a pixel headlamp 300. The intelligent cabin domain controller CDC is in communication connection with the streaming rearview mirror system CMS, the vehicle-mounted head-up display system HUD and the pixel headlamp 300.

[0092] The streaming rearview mirror system CMS is provided with a camera module outside the vehicle to shoot real-time pictures of the rear of the vehicle side.

[0093] The vehicle-mounted head-up display system HUD is the vehicle-mounted head-up display system provided by any of the above embodiments, which includes a first display module 100 and a second display module 200. The first display module 100 is used to project the image shot by the streaming rearview mirror system CMS to a virtual image display outside the windshield glass in front of the driver. The second display module 200 is used to project the head-up display content to a virtual image display outside the windshield glass in front of the driver. The second display module 200 can include at least one of a panoramic head-up display module PHUD, an augmented reality head-up display module AR-HUD and a holographic head-up display module 3D-HUD.

[0094] The pixel headlamp 300 has the functions of road projection and dynamic shading.

[0095] The intelligent cockpit domain controller CDC is configured to receive and process images captured by the streaming rearview mirror system CMS, and generate a first data signal Q1 output to the first display module 100 of the vehicle head-up display system HUD, so that the first display module 100 projects the images captured by the streaming rearview mirror system CMS as a virtual image outside the windshield in front of the driver.

[0096] The intelligent cockpit domain controller CDC is also configured to receive and process head-up display data, which can include driving data (such as vehicle speed, engine speed, mileage, acceleration, brake force, steering angle, light status, vehicle status information, etc.), ADAS data (various information, signals and records collected, processed and generated by the advanced driving assistance system during vehicle operation), map navigation data and cloud data, etc., and generate a second data signal Q2 output to the second display module 200 of the vehicle head-up display system HUD, so that the second display module 200 projects the processed head-up display content as a virtual image outside the windshield in front of the driver.

[0097] The intelligent cockpit domain controller CDC is also configured to generate a third data signal Q3 for controlling the display of the pixel headlight 300.

[0098] That is, the intelligent cockpit domain controller CDC uniformly receives and processes images captured by the streaming rearview mirror system CMS and various head-up display data, and realizes multi-channel output to the first display module 100 and the second display module 200 of the vehicle head-up display system HUD and the pixel headlight 300, which is conducive to realizing the linkage display and interaction of the head-up display content, the images of the streaming rearview mirror system and the pixel headlight, and enhancing the intelligent and experience.

[0099] Optionally, as shown in Figure 14 The intelligent cockpit domain controller CDC includes a system-on-chip SoC, which includes an in-memory computing accelerator 400 including a data processing engine 410 and a visual rendering engine 420.

[0100] The data processing engine 410 is configured to receive and process images captured by the streaming rearview mirror system and head-up display data, and output the processed data to the visual rendering engine 420; the visual rendering engine 420 is configured to fuse and render the data processed by the data processing engine 410, and generate a first data signal Q1, a second data signal Q2 and a third data signal Q3 as data sources output to the first display module 100, the second display module 200 and the pixel headlight 300 of the vehicle head-up display system HUD, respectively.

[0101] Specifically, as shown in Figure 14As shown, the data processing engine 410 receives the image taken by the streaming mirror system, performs image quality optimization and data format conversion using the image signal processing module (ISP), and then transmits the image to the visual rendering engine 420.

[0102] The data processing engine 410 receives driving data (such as vehicle speed, engine speed, mileage, acceleration, brake force, steering angle, light state, vehicle state information, etc.), and obtains a vehicle state model after calculation and processing.

[0103] The data processing engine 410 receives ADAS data, and establishes a scene model after calculation and processing.

[0104] The data processing engine 410 receives map navigation data, and establishes a position trajectory model after calculation and processing.

[0105] The data processing engine 410 receives cloud data (video data), and obtains transcoded video frame data after preprocessing.

[0106] The various data processed by the data processing engine 410 is transmitted to the visual rendering engine 420, the video data is subjected to brightness and chrominance equalization processing, and then matched with the vehicle model, the scene model and the position trajectory model. After data matching, the data is subjected to data fusion by the data fusion module. The fused data is processed into corresponding data sources (first data signal Q1, second data signal Q2 and third data signal Q3) in the rendering module according to the requirements of the display terminals (first display module 100, second display module 200 and pixel headlamp 300), and finally transmitted to the display terminals for display.

[0107] Further optionally, in order to make the display content and projection timing of the first display module 100, the second display module 200 and the pixel headlamp 300 of the vehicle head-up display system HUD visually coordinated, it is necessary to ensure the time synchronization inside the intelligent cabin domain controller CDC and the time synchronization of each sensor and display terminal inside and outside the intelligent cabin domain controller CDC.

[0108] For the time synchronization inside the intelligent cabin domain controller CDC, as shown in Figure 14 As shown, the intelligent cabin domain controller CDC further includes a microcontroller unit MCU and a clock module 500. The system on chip SoC, the microcontroller unit MCU and the clock module 500 are communicatively connected through a system bus. The system on chip SoC and the microcontroller unit MCU are both time synchronized with the clock module 500.

[0109] Specifically, as shown in Figure 15As shown, a timestamp heterogeneous synchronization mechanism is adopted between the system-on-chip SoC and the microcontroller unit MCU to realize time synchronization. The microcontroller unit MCU records the current time Tx, initiates a request to the system-on-chip SoC and carries the Tx timestamp information; the system-on-chip SoC receives the request of the microcontroller unit MCU and records the current time T1 of the system-on-chip SoC; the system-on-chip SoC processes and responds to the microcontroller unit MCU and carries the current time T2 information; the microcontroller unit MCU receives the response and timestamp information of the system-on-chip SoC and records the current time T3 of the microcontroller unit MCU, and so on. For the interaction between the system-on-chip SoC and the microcontroller unit MCU, the operation time becomes plaintext information, thereby realizing time synchronization inside the intelligent cockpit domain controller CDC.

[0110] For time synchronization of each sensor and display terminal inside and outside the intelligent cockpit domain controller CDC, it mainly refers to time synchronization of the intelligent cockpit domain controller CDC inside and the streaming media rearview mirror system CMS, each sensor generating head-up display data, and these sensors inputting data to the intelligent cockpit domain controller CDC, and time synchronization of the intelligent cockpit domain controller CDC inside and the first display module 100, the second display module 200 and the pixel headlamp 300 in the vehicle head-up display system HUD, which are display terminals.

[0111] Specifically, the microcontroller unit MCU in the intelligent cockpit domain controller CDC is used to send a global time synchronization message to the streaming media rearview mirror system CMS, each sensor generating head-up display data, the vehicle head-up display system HUD and the pixel headlamp 300, the streaming media rearview mirror system CMS, each sensor generating head-up display data, the vehicle head-up display system HUD and the pixel headlamp 300 process the global clock message with the highest priority and correct the current information; and the data interaction between the external sensor (the streaming media rearview mirror system CMS and each sensor generating head-up display data) and the intelligent cockpit domain controller CDC, and between the intelligent cockpit domain controller CDC and each display terminal (the vehicle head-up display system HUD and the pixel headlamp 300) carries timestamp information; thereby the streaming media rearview mirror system CMS, each sensor generating head-up display data, the vehicle head-up display system HUD and the pixel headlamp 300 are also time synchronized with the clock module 500 through global clock calibration and timestamp transmission.

[0112] On the basis of time synchronization of the intelligent cockpit domain controller CDC and the sensors and display terminals inside and outside the intelligent cockpit domain controller CDC, the visual rendering engine 420 in the system-on-chip SoC only needs to output the time-synchronized first data signal Q1, second data signal Q2 and third data signal Q3 to the corresponding first display module 100, second display module 200 and pixel headlamp 300, so as to realize the visual cooperation of the display content and projection timing of the first display module 100, second display module 200 and pixel headlamp 300.

[0113] It should be noted that the intelligent cockpit domain controller CDC also includes a power management unit, a memory, etc. Figure 14 For the sake of clear illustration, some components are not shown.

[0114] In actual application, for example, when meeting at night, the pixel headlamp 300 performs dynamic shading, the second virtual image P2 formed by the second display module 200 displays the speed and avoidance zone, the first virtual image P1 formed by the first display module 100 performs high-light frame display on the oncoming vehicle, and the cooperative display is realized; for another example, when high-speed separation, the second virtual image P2 formed by the second display module 200 displays the safety time interval and performs lane-level guidance, the pixel headlamp 300 projects the steering auxiliary line, and the first virtual image P1 formed by the first display module 100 prompts the lane-changing risk, and the cooperative display is realized.

[0115] Correspondingly, the embodiment of the application also provides a vehicle display driving method, applied to an intelligent cockpit domain controller CDC of a vehicle, referring to Figure 14 The vehicle also includes a streaming rearview mirror system CMS, a head-up display system HUD and a pixel headlamp 300, the head-up display system HUD is the head-up display system provided by any of the above-mentioned embodiments; the vehicle display driving method comprises:

[0116] S1: receiving and processing the image captured by the streaming rearview mirror system CMS, generating a first data signal Q1 output to the first display module 100 of the head-up display system HUD, so that the first display module 100 projects the image captured by the streaming rearview mirror system CMS outside the windshield glass in front of the driver to form a virtual image display;

[0117] receive and process the head-up display data, which can include driving data (such as vehicle speed, engine speed, mileage, acceleration, brake force, steering angle, light status, vehicle status information, etc.), ADAS data (various information, signals and records collected, processed and generated by the advanced driving assistance system during vehicle operation), map navigation data and cloud data, etc., to generate a second data signal Q2 output to the second display module 200 of the vehicle head-up display system HUD, so that the second display module 200 projects the processed head-up display content onto the windshield in front of the driver as a virtual image display;

[0118] and generate a third data signal Q3 for controlling the display of the pixel headlight 300.

[0119] Among them, the first data signal Q1, the second data signal Q2 and the third data signal Q3 are time-synchronized, so that the first display module 100, the second display module 200 and the pixel headlight 300 of the vehicle head-up display system HUD can be displayed synchronously.

[0120] That is, the vehicle display driving method, by uniformly receiving and processing the images captured by the streaming rearview mirror system CMS and various head-up display data, realizes the synchronous output of the first display module 100, the second display module 200 and the pixel headlight 300 of the vehicle head-up display system HUD, which is beneficial to realize the linkage display and interaction of the head-up display content, the image of the streaming rearview mirror system and the pixel headlight, and enhance the intelligence and experience.

[0121] Further optionally, in the vehicle display driving method, the first data signal Q1, the second data signal Q2 and the third data signal Q3 are time-synchronized, so that the display content and projection timing of the first display module 100, the second display module 200 and the pixel headlight 300 of the vehicle head-up display system HUD are visually coordinated.

[0122] Further optionally, the vehicle display driving method further comprises:

[0123] S2: According to the image captured by the streaming rearview mirror system CMS and the head-up display data, identify the risk information of the vehicle.

[0124] S3: Based on the risk information, render at least two warning information that need to be displayed synchronously.

[0125] S4: Determine which one of the first display module 100, the second display module 200 and the pixel headlight 300 is the optimal view domain for each warning information, and assign each warning information to the optimal view domain for synchronous display, and the optimal view domains corresponding to the at least two warning information are different.

[0126] For example, in high-speed lane-changing scenarios, combined with Figure 14 and Figure 16 As shown, the streaming rearview mirror system (CMS) captures high-definition wide-angle video from the sides and rear of the vehicle via a camera. Built-in algorithms ensure clear images and low-latency transmission. This data is then transmitted to the intelligent cockpit domain controller (CDC). The CDC fuses the images captured by the CMS with the head-up display (HUD) data to identify vehicle risk information, specifically identifying dangerous vehicles in front of and to the sides and rear of the vehicle. The HUD data received by the CDC includes ADAS data, which includes image data from the forward-facing camera; therefore, it can also identify dangerous vehicles in front of the vehicle.

[0127] Subsequently, the Intelligent Cockpit Domain Controller (CDC) renders at least two warning messages based on the identified risk information; for example, one warning message is a color change or flashing frequency to provide a safety reminder; another warning message is the time distance to the dangerous vehicle; and yet another warning message is a highlighted box to mark the dangerous vehicle in the CMS image.

[0128] Since the first display module 100 projects images captured by the streaming media rearview mirror system (CMS) onto the windshield in front of the driver as a virtual image, the second display module 200 projects head-up display content onto the windshield in front of the driver as a virtual image, and the pixel headlights 300 are used for road projection and dynamic shading, and each display terminal has a different display area and viewing angle, the intelligent cockpit domain controller (CDC) determines which of the first display module 100, the second display module 200, and the pixel headlights 300 is the optimal field of view for each warning message, and assigns each warning message to the optimal field of view for display. For example, the warning message of color change or flashing frequency and the warning message of distance from dangerous vehicles are assigned to the second display module 200 for head-up display reminders; the warning message of a highlighted frame is assigned to the first display module 100 to mark dangerous vehicles in the CMS image. In addition, if driving at night, the pixel headlights can also be used to provide flexible shading for vehicles ahead.

[0129] For example, when pedestrians are crossing around the vehicle, the intelligent cockpit domain controller (CDC) fuses and judges the images captured by the streaming rearview mirror system (CMS) and the head-up display data to identify the vehicle's risk information, specifically the risk information that pedestrians are crossing around the vehicle.

[0130] Subsequently, the intelligent cockpit domain controller (CDC) renders at least two warning messages based on the identified risk information; for example, one warning message is a highlighted image of a pedestrian to provide a safety reminder; the other warning message is a distance warning for the pedestrian and a suggestion to slow down.

[0131] The intelligent cockpit domain controller CDC determines which one of the first display module 100, the second display module 200 and the pixel headlamp 300 is the optimal visual field for each warning information, and allocates each warning information to the optimal visual field for display; for example, the warning information of the highlighted pedestrian image is allocated to the first display module 100 for magnified display in the CMS image; the warning information of the distance from the pedestrian and the deceleration suggestion is allocated to the second display module 200 for heads-up display reminder. In addition, the pixel headlamp can also be used for low-brightness display around the pedestrian.

[0132] Therefore, the linkage display of the first display module 100, the second display module 200 and the pixel headlamp 300 can significantly enhance the situational awareness ability of the driver to the environment and the seamless interactive experience. The second display module 200 for heads-up display mainly serves as a focal point prompter of the decision result, the first display module 100 for CMS image display mainly serves as a video content provider, and the brightness and illumination area of the pixel headlamp are also matched with the display, thereby greatly reducing the cognitive load and driving risk of the driver and improving the trust degree of the driver to the intelligent cockpit display system.

[0133] It should be noted that the linkage display of the first display module 100, the second display module 200 and the pixel headlamp 300 follows the following principles: the same object is displayed only once in the optimal visual field at the same time, and relay animation and unified semantic style are used across devices; that is, an object at one time (for example, a pedestrian object behind the vehicle at one time) is displayed in the optimal visual field according to which one of the first display module 100, the second display module 200 and the pixel headlamp 300 is the optimal visual field; the same object at another time (for example, a pedestrian object moving to the front of the vehicle at another time) is displayed in the optimal visual field according to which one of the first display module 100, the second display module 200 and the pixel headlamp 300 is the optimal visual field; the first display module 100 for displaying the CMS image may be allocated as the optimal visual field for display at the previous time, and the second display module 200 for displaying the heads-up display content may be allocated as the optimal visual field for display at the next time. Although the same object is displayed only in the corresponding optimal visual field at the same time, there is a certain connection and interaction between the objects displayed across devices. Even at the same time, there is a certain connection and interaction between the objects displayed by different devices (for example, different warning information for the same risk information).

[0134] The various parts in the specification are described in a combination of parallel and progressive manners, and each part mainly explains the difference from other parts. The same and similar parts between the various parts can be referred to each other.

[0135] Having described above several embodiments of the disclosure, features of the various embodiments described in this specification can be combined with each other, or substituted for each other or in various embodiments, without departing from the spirit or essential characteristics of the disclosure. Various modifications to the embodiments described in this specification will be readily apparent to those with skill in the art, and the general principles defined herein can be applied to other embodiments without departing from the spirit or scope of the disclosure. Thus, the present disclosure is not intended to be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A vehicle-mounted head-up display system, characterized in that, include: The first display module is configured to display images captured by the streaming rearview mirror system and generate first image light; The first image light is projected onto the windshield in front of the driver, and after being reflected by the windshield, forms a first virtual image located outside the windshield and received within the driver's eye box. The second display module is configured to display head-up display content and generate a second image light; the second image light is projected onto the windshield, and after being reflected by the windshield, forms a second virtual image located outside the windshield and received within the driver's eye box; The center of the first virtual image and the center of the second virtual image are the same relative to the driver's downward viewing angle; the difference between the virtual image distance of the first virtual image and the virtual image distance of the second virtual image does not exceed a first threshold, and there is a gap between the first virtual image and the second virtual image; The first display module and the second display module each include a backlight module and a display screen; the backlight module is configured to provide illumination light to the display screen; The display screen is configured to modulate the illumination light, display a corresponding image, and generate a corresponding image light; The backlight module includes: LED array, comprising multiple LED beads arranged in an array; A collimating lens array includes multiple collimating lenses arranged in an array, wherein the collimating lenses are used to converge the light emitted by the LED beads; A multifunctional film layer is used to modulate the light emitted by the LED beads after being focused by the collimating lens. The multifunctional film layer includes a diffusion film layer, a reflective polarizing film layer, and an angle deflection film layer stacked in a direction away from the collimating lens array. The diffusion film layer is configured to uniformly diffuse light. The reflective polarizing film layer is configured to allow light with a preset polarization direction to pass through and to recycle light with other polarization directions. The angle-deflecting film is configured to directionally change the angle of light.

2. The vehicle head-up display system according to claim 1, characterized in that, The first display module is arranged on both sides of the second display module along the vehicle width direction, and the first virtual image is located on both sides of the second virtual image along the vehicle width direction; The first virtual image and the second virtual image are symmetrically distributed along the longitudinal centerline of the vehicle.

3. The vehicle head-up display system according to claim 1, characterized in that, The diffusion film, the reflective polarizing film, and the angle deflection film are each separate films; Alternatively, at least two of the diffusion film, the reflective polarizing film, and the angle deflection film may be laminated together.

4. A vehicle, characterized in that, The system includes an intelligent cockpit domain controller, a streaming media rearview mirror system, an in-vehicle head-up display system, and pixel headlights, wherein the in-vehicle head-up display system is the in-vehicle head-up display system as described in any one of claims 1-3; The intelligent cockpit domain controller is used to receive and process images captured by the streaming media rearview mirror system, generate a first data signal and output it to the first display module of the vehicle head-up display system; and receive and process head-up display data, generate a second data signal and output it to the second display module of the vehicle head-up display system. And generate a third data signal, which is used to control the display of the pixel headlight.

5. The vehicle according to claim 4, characterized in that, The intelligent cockpit domain controller includes a system-on-a-chip, which includes an in-memory computing accelerator, which includes a data processing engine and a visual rendering engine. The data processing engine is used to receive and process the images captured by the streaming media rearview mirror system and the head-up display data, and output the processed data to the visual rendering engine. The visual rendering engine is used to fuse and render the data processed by the data processing engine, generating the first data signal, the second data signal, and the third data signal.

6. The vehicle according to claim 5, characterized in that, The intelligent cockpit domain controller also includes a microcontroller unit and a clock module, and both the system-on-a-chip and the microcontroller unit are synchronized with the clock module. The microcontroller unit is used to send a global time synchronization message to the streaming media rearview mirror system, each sensor that generates head-up display data, the vehicle head-up display system, and the pixel headlights, so that the streaming media rearview mirror system, each sensor that generates head-up display data, the vehicle head-up display system, and the pixel headlights are all synchronized with the clock module. The visual rendering engine in the system-on-a-chip outputs the time-synchronized first data signal, second data signal, and third data signal to the first display module, the second display module, and the pixel headlight, respectively.

7. A vehicle display driving method, characterized in that, A smart cockpit domain controller for use in a vehicle, the vehicle further comprising a streaming media rearview mirror system, an in-vehicle head-up display system, and pixel headlights, wherein the in-vehicle head-up display system is the in-vehicle head-up display system as described in any one of claims 1-3; The display driving method for the vehicle includes: The system receives and processes images captured by the streaming media rearview mirror system, generates a first data signal and outputs it to the first display module of the vehicle head-up display system; receives and processes head-up display data, generates a second data signal and outputs it to the second display module of the vehicle head-up display system; and generates a third data signal, which is used to control the display of the pixel headlights, wherein the first data signal, the second data signal and the third data signal are time-synchronized.

8. The vehicle display driving method according to claim 7, characterized in that, The vehicle display driving method further includes: Based on the images captured by the streaming rearview mirror system and the head-up display data, identify vehicle risk information; Based on the aforementioned risk information, at least two warning messages that need to be displayed simultaneously are rendered; Determine which of the first display module, the second display module, and the pixel headlights is the optimal viewing area for each of the warning messages, and assign each of the warning messages to the optimal viewing area for synchronous display, wherein at least two of the warning messages correspond to different optimal viewing areas.

Images