Head-up display device, display control method and device, storage medium and vehicle

Abstract

The invention provides a head-up display device, a display control method and device, a storage medium and a vehicle, and belongs to the technical field of auxiliary driving. The method comprises the following steps: acquiring environment information of a vehicle; and adjusting the display setting of the display information of the HUD according to the environment information. The display setting of the display information of the HUD can be adaptively adjusted, and the user experience and the driving safety are improved.

Description

Technical Field

[0001] This disclosure relates to the field of driver assistance technology, and in particular to a head-up display device, a display control method, an apparatus and storage medium, and a vehicle. Background Technology

[0002] A Head-Up Display (HUD) is a transparent display device that projects important information about driving directly into the driver's line of sight. This technology allows drivers to obtain critical information such as vehicle status, navigation, speed, and traffic sign recognition without taking their eyes off the road, thereby reducing driver distraction and improving driving safety. Summary of the Invention

[0003] This disclosure provides a head-up display (HUD), a display control method, an apparatus, a storage medium, and a vehicle, which can adaptively adjust the display settings of the HUD to improve user experience and driving safety.

[0004] The technical solution disclosed herein is implemented as follows:

[0005] In a first aspect, this disclosure provides a display control method, which includes: acquiring environmental information of the vehicle; and adjusting the display settings of the head-up display (HUD) based on the environmental information.

[0006] Secondly, this disclosure provides a display control device, which includes: an acquisition part and an update part; the acquisition part is configured to acquire environmental information of the vehicle; the update part is configured to adjust the display settings of the head-up display (HUD) based on the environmental information.

[0007] Thirdly, this disclosure provides a display control device, the device comprising: a processor and a memory; the processor being configured to execute instructions stored in the memory to implement the display control method as described in the first aspect.

[0008] Fourthly, this disclosure provides a computer-readable storage medium storing at least one instruction, which is executed by a processor to implement the display control method as described in the first aspect.

[0009] Fifthly, this disclosure provides a head-up display device, which includes a display control unit and a display unit; wherein the display control unit is configured to acquire environmental information of the vehicle and adjust the display settings of the head-up display device HUD according to the environmental information; and the display unit is configured to display on the windshield of the vehicle according to the display settings based on the control of the display control unit.

[0010] Sixthly, this disclosure provides a vehicle that includes the head-up display device of the fifth aspect.

[0011] This disclosure provides a head-up display (HUD), a display control method, an apparatus, a storage medium, and a vehicle. The method includes: acquiring environmental information of the vehicle; and adjusting the display settings of the HUD based on the environmental information. Thus, during vehicle operation, the display settings of the HUD can be adaptively adjusted according to the vehicle's environmental information. For example, the display position of the projected image can be adjusted so that the driver can view the entire projected image without moving their eyes up and down, or direct light can be avoided from affecting the driver's viewing of the projected image; or, the brightness and clarity of the projected image can be adjusted so that the driver can clearly and comfortably obtain the required information; or, the color of the displayed content of the projected image can be adjusted so that the driver can intuitively obtain the required information, etc. Therefore, in various driving scenarios, the driver can clearly and intuitively obtain the displayed content of the HUD's projected image, improving the driving experience and driving safety. Attached Figure Description

[0012] Figure 1 This is a schematic diagram of a vehicle-mounted system provided in this disclosure;

[0013] Figure 2 An exemplary top view of the vehicle provided in this disclosure;

[0014] Figure 3 This is an exemplary perspective view from a vehicle driver's seat provided in this disclosure;

[0015] Figure 4 This is a schematic diagram of the architecture of the head-up display device provided in this disclosure;

[0016] Figure 5 This is one of the flowcharts illustrating a display control method provided in this disclosure;

[0017] Figure 6 A schematic diagram illustrating a display object displayed in a display area according to this disclosure;

[0018] Figure 7 This is a second flowchart illustrating a display control method provided in this disclosure;

[0019] Figure 8a This is a schematic diagram illustrating the positional change of the display area when the target camera's shooting angle is 0 degrees.

[0020] Figure 8b This is a schematic diagram illustrating the change in the position of the display area when the shooting angle of the target camera is moved upwards.

[0021] Figure 8cThis is a diagram illustrating the change in the position of the display area when the shooting angle of the target camera is lowered.

[0022] Figure 9a This is a diagram illustrating the change in the position of an object when the camera's shooting angle is 0 degrees.

[0023] Figure 9b This is a diagram illustrating the change in the position of the target object as the camera's shooting angle is moved upwards.

[0024] Figure 10 This is the third flowchart illustrating a display control method provided in this disclosure;

[0025] Figure 11 This is the fourth flowchart illustrating a display control method provided in this disclosure;

[0026] Figure 12 A schematic diagram of the illuminance components provided in this disclosure;

[0027] Figure 13 This is the fifth flowchart illustrating a display control method provided in this disclosure;

[0028] Figure 14 A schematic diagram illustrating the movement of the display area along the height direction provided in this disclosure;

[0029] Figure 15 This is a schematic diagram illustrating the movement of the display object along the height direction provided in this disclosure;

[0030] Figure 16 This is the sixth flowchart illustrating a display control method provided in this disclosure;

[0031] Figure 17 This is the seventh flowchart illustrating a display control method provided in this disclosure;

[0032] Figure 18 This is the eighth flowchart illustrating a display control method provided in this disclosure;

[0033] Figure 19 This is the ninth flowchart illustrating a display control method provided in this disclosure;

[0034] Figure 20 A structural block diagram of a system provided in this disclosure;

[0035] Figure 21 A flowchart illustrating the height calibration provided in this disclosure;

[0036] Figure 22 This is a flowchart illustrating the display object calibration and brightness calibration process provided in this disclosure;

[0037] Figure 23This is a schematic diagram of the composition of a display control device provided in this disclosure;

[0038] Figure 24 This is a schematic diagram of the structure of a display control device provided in this disclosure. Detailed Implementation

[0039] The technical solutions in this disclosure will now be clearly and completely described with reference to the accompanying drawings.

[0040] See Figure 1 The document illustrates an example of an in-vehicle system 100 to which the technical solutions of this disclosure are applicable. In some examples, the vehicle equipped with the system 100 may be an internal combustion engine vehicle powered by an engine, a hybrid vehicle powered by both an engine and an electric motor, an electric vehicle powered by an electric motor, and other types of vehicles. In the following description, the vehicle equipped with the in-vehicle system 100 will be referred to as the "vehicle."

[0041] like Figure 1 As shown, the vehicle-mounted system 100 includes: a navigation subsystem 110, an environmental detection device group 120 for acquiring the vehicle's environment during vehicle operation, a vehicle driving status detection device group 130, a data processing unit 140, a display control unit 150, and a display unit 160. These components or device groups are coupled together via a communication bus 12. In some examples, the communication bus 12 is used for communication between these components or device groups. It should be noted that... Figure 1 Only a portion of the vehicle system 100 is shown, not all of the components of the vehicle system 100.

[0042] exist Figure 1 The navigation subsystem 110 includes a positioning device 111 and a map information storage device 112. The positioning device 111 can determine the vehicle's location based on various positioning systems, including the Global Positioning System (GPS), China's BeiDou system, Russia's GLONASS system, Europe's Galileo system, Japan's Quasi-Zenith Satellite System (QZSS), and India's Indian Regional Navigation Satellite System (IRNSS), thus obtaining the vehicle's location information. The map information storage device 112 stores map information and can retrieve a navigation path to the destination based on the location information obtained from the positioning device 111, displaying the location information and navigation path in a map application.

[0043] exist Figure 1In this system, the environmental monitoring equipment group 120 may include in-vehicle communication equipment 121, radar 122, laser rangefinder 123, camera 124, and light sensor 125. These devices are capable of acquiring environmental information representing the interior or exterior of the vehicle.

[0044] The vehicle-mounted communication device 121 can wirelessly communicate with one or more devices, either directly or via a communication network. These devices can communicate with the vehicle-mounted communication device 121, including other vehicles, roadside vehicles or roadside stations, and mobile terminal devices used by occupants of the vehicle. In some examples, the vehicle-mounted communication device 121 can use 3G cellular communication, such as code division multiple access (CDMA), EVDO, Global System for Mobile Communications (GSM) / General Packet Radio Service (GPRS), or 4G cellular communication, such as long term evolution (LTE), or 5G cellular communication. In some examples, the vehicle-mounted communication device 121 can also communicate using WiFi and a wireless local area network (WLAN). In some embodiments, the vehicle-mounted communication device 121 can also communicate directly with devices using an infrared link, Bluetooth, or ZigBee. In some examples, the vehicle-mounted communication device 121 can also communicate with devices using other wireless protocols.

[0045] Radar 122 is used to sense objects in the vehicle's surrounding environment, and can also be used to sense the speed and / or direction of travel of these objects. In some examples, radar 122 can use electromagnetic waves or lasers as a medium to detect objects based on time-of-flight (TOF) or phase-shift methods, and detect the position of the detected object, the distance to the detected object, and the relative speed. In some examples, in order to detect objects located in front of, behind, or to the side of the vehicle, radar 122 can be configured at an appropriate location outside the vehicle.

[0046] The laser rangefinder 123 can use lasers to sense objects in the environment in which the vehicle is located. In some embodiments, the laser rangefinder 123 may include one or more laser sources, a laser scanner, and one or more detectors, as well as other system components.

[0047] Camera 124 can be used to capture multiple images of the vehicle's surrounding environment. Camera 124 can be a still camera or a video camera. In some examples, to acquire external images of the vehicle, camera 124 can be located at an appropriate position outside the vehicle. For example, to acquire an image of the front of the vehicle, camera 124 can be configured close to the windshield inside the vehicle's interior. Alternatively, camera 124 can be configured around the front bumper or radiator grille. In some examples, to acquire images of the rear of the vehicle, camera 124 can be configured close to the rear window inside the vehicle's interior. Alternatively, camera 124 can be configured around the rear bumper, trunk, or tailgate. In some examples, to acquire side images of the vehicle, camera 124 can be configured close to at least one of the side windows inside the vehicle's interior. Alternatively, camera 124 can be configured around a side mirror, fender, or door. In some examples, to acquire a foreground image of the vehicle in the same field of vision as the driver, camera 124 can be located around the steering wheel.

[0048] The light sensor 125 can be used to detect the ambient light level of the vehicle. Specifically, it can be a sensor that only detects ambient light level, or it can be a sensor that detects ambient light level and has other functions (such as a rain sensor). In some examples, to detect the ambient light level inside the vehicle for controlling interior lighting, the light sensor 125 can be positioned on the roof console, near the reading lights. In some examples, to detect the ambient light level inside the vehicle for controlling the brightness of interior lighting and dashboard backlighting, the light sensor 125 can be positioned behind or inside the dashboard. In some examples, to detect ambient light entering the vehicle interior, the light sensor 125 can be positioned inside the windshield, near the rearview mirror. In some examples, to detect ambient light entering the vehicle interior for determining the degree of impact on the driver, the light sensor 125 can be positioned inside or outside the steering wheel. In some examples, to detect the ambient light level outside the vehicle for automatically adjusting the anti-glare function of the rearview mirror, the light sensor 125 can be positioned on or near the rearview mirror. To detect the illuminance of ambient light outside the vehicle for automatic headlight control, a light sensor 125 may be positioned near the front bumper or front grille. To detect ambient light illuminance outside the vehicle, avoid interference from direct or reflected light, and provide more accurate illuminance readings, the light sensor 125 may be positioned on the side or corner of the vehicle. In some advanced driver assistance systems, the light sensor 125 may be integrated with a forward-facing camera or other sensors to provide ambient light information.

[0049] exist Figure 1In this system, the vehicle driving state detection device group 130 may include: a steering angle sensor 131 for detecting the vehicle's steering angle, a vehicle speed sensor 132 for detecting the vehicle's speed, and an acceleration sensor 133 for detecting the acceleration applied to the vehicle. In some examples, as shown in the dashed box, it may also include an inertial sensor 134 for detecting changes in the vehicle's position and orientation based on inertial acceleration. In specific implementations, the inertial sensor 134 may be a combination of the acceleration sensor 133 and a gyroscope.

[0050] exist Figure 1 In this system, the data processing unit 140 can be implemented as a computing system having a memory, a processor, input / output interfaces, and a bus connecting these. In some examples, the data processing unit 140 causes the processor to execute multiple commands via program instructions stored in the memory to process data obtained from the navigation subsystem 110, the environmental detection device group 120, and the vehicle driving status detection device group 130. In some examples, the data processing unit 140 can also partially or completely control the driving of the vehicle based on the processed data.

[0051] exist Figure 1 As shown in the dashed box, the display control unit 150 and the display unit 160 can serve as the main body of the head-up display (HUD) device 170. The display control unit 150 can receive data processed by the data processing unit 140, or data obtained from the navigation subsystem 110, the environmental detection equipment group 120, and the vehicle driving status detection equipment group 130, process the received data to obtain the display settings to be displayed, and project the display settings onto the windshield of the vehicle through the display unit 160 for display.

[0052] Combination Figure 2 An exemplary top view of the vehicle shown is as follows: Figure 3 The illustrated exemplary perspective view from the driver's seat of this vehicle shows that the vehicle includes a windshield 204 located at the front of the vehicle. The driver and passengers in the passenger compartment 208 of this vehicle can see ahead of the vehicle through the windshield 204.

[0053] exist Figure 3 In this configuration, the windshield 204 is visually positioned above the vehicle's dashboard 206. The driver can turn the steering wheel 210 within the passenger cabin 208 to steer the vehicle, for example, to change lanes, merge, and park. In some embodiments, the steering wheel 210 may be retracted or omitted.

[0054] Head-up display device 170 (see) Figure 4An image 212 (e.g., a virtual image) is projected onto a portion of the windshield 204 through one or more holes (e.g., hole 216) in the dashboard 206. Although Figure 3 An example size of the displayed image 212 is shown, but the displayed image 212 can be presented in a larger or smaller area. Examples of displayed image 212 include various vehicle information, such as current vehicle speed, current gear of the vehicle's transmission, engine speed, vehicle direction, current infotainment system settings, and / or other vehicle information. The head-up display 170 provides information to the vehicle driver without requiring the driver to take their eyes off objects in front of the vehicle.

[0055] See Figure 4 The exemplary implementation architecture of the head-up display device 170 shown includes a display control unit 150 generating a signal 412 based on data processed by the data processing unit 140, or data 420 transmitted from the navigation subsystem 110, the environmental detection device group 120, and the vehicle driving status detection device group 130. The display unit 160 may include a light source 161 and an optical path assembly 162. The light source 161 outputs light (e.g., a virtual image) based on the signal 412 from the display control unit 150 for display on the windshield 204. For example, the light source 161 may include one or more lasers and output red, green, and blue light.

[0056] The optical path assembly 162 reflects the output of the light source 161 onto the windshield 204 through the aperture 216. A viewer (e.g., a driver) can view the displayed image 212 projected onto the windshield 204 in the display area. In some examples, the optical path assembly 162 may include one or more reflectors (plane mirrors) and concave mirrors (magnifying glasses). The output of the light source 161 is reflected back via the reflector and magnified by the concave mirror before being reflected back onto the windshield 204 to form a virtual image 40 that can be visually observed by the driver. The visual effect of this virtual image 40 is that it is projected onto a projection surface 41 at a predetermined distance in front of the vehicle, but the real environment remains visible through the projection surface 41. In some examples, the optical path assembly 162 may be omitted, and the light source 161 may project the displayed image 212 directly onto the windshield 204 to form the virtual image 40 on the projection surface 41.

[0057] In combination with the above Figures 1 to 4 As shown, during vehicle operation, the display unit 160 projects vehicle speed, navigation information, safety information, and other data onto the windshield 204. The driver can see this information without looking down, improving safety and convenience.

[0058] While existing head-up display (HUD) devices 170 can display driving information to assist drivers, current HUD devices 170 cannot adaptively adjust display settings. For example: when a vehicle enters a tunnel, the environment darkens, but the brightness of the displayed image 212 remains unchanged, the driver may feel that the brightness is too high, affecting driving; or when a vehicle leaves a tunnel, the environment brightens, but the brightness of the displayed image 212 remains unchanged, resulting in a blurry virtual image due to low brightness; or, if the colors of the displayed objects are fixed, and the background color outside the vehicle is the same as or similar to the color of the displayed objects, the displayed objects may be difficult to see; or, if the displayed image 212 is displayed in a fixed position, the different field of vision for drivers of different heights will cause some drivers to need to look down or up to view the HUD projection image, affecting driving safety; or, if the display area of ​​the displayed image 212 happens to overlap with the taillights of the vehicle in front, the excessive light intensity will increase the difficulty for the driver to recognize the information in the HUD projection image, etc.

[0059] Based on the above description, this disclosure aims to provide a display control method that can adaptively adjust the display position of displayed information according to environmental information, such as... Figure 5 As shown, it illustrates an example of a display control method provided in this disclosure, which can be executed by the aforementioned head-up display device 170, and in particular by the display control unit 150 in the aforementioned head-up display device 170. Figure 5 The method shown includes steps S501 to S502.

[0060] In step S501, the environmental information of the vehicle is obtained.

[0061] Among them, environmental information refers to external information that affects the driver's viewing of the HUD display; environmental information includes: in-vehicle environmental information, out-of-vehicle environmental information, or in-vehicle and out-of-vehicle environmental information.

[0062] In step S502, the display settings of the HUD are adjusted according to the environmental information.

[0063] The vehicle pre-stores the correspondence between environmental information and display settings. Specifically, the vehicle system or HUD may pre-store multiple correspondences, each corresponding to a display setting for one piece of environmental information and one piece of display information. Alternatively, the vehicle system may pre-store an algorithm for determining the display settings for environmental information and display settings, using the algorithm to determine the display settings for the display information corresponding to the environmental information. Or, the vehicle system may pre-store a trained network model, using the network model to determine the display settings for the display information corresponding to the environmental information. This disclosure does not specifically limit this aspect.

[0064] Optionally, the display information includes at least one of the following: display area, display object. The display settings include at least one of the following: display position, color of the display object, brightness and sharpness of the display object, and brightness of the display area. The display position indicates the location of the display area on the windshield of this vehicle. Alternatively, the display position indicates the location of the display object within the display area. The display position can be represented using a horizontal and vertical coordinate system. The horizontal coordinate indicates the position in the horizontal direction, and changes in the horizontal coordinate indicate left or right movement; the vertical coordinate indicates the position in the vertical direction, and changes in the vertical coordinate indicate up or down movement. Therefore, adjusting the display position includes adjusting the display area vertically and horizontally, or adjusting the display object vertically and horizontally, or both simultaneously.

[0065] The displayed object is a marker containing specific prompts in the HUD projection image, such as... Figure 6 As shown, the display objects displayed in the display area 60 of the windshield 204 are exemplary. Display object 601 indicates that a left turn is imminent, display object 602 indicates that the current vehicle speed is 50 km / h, and display object 603 indicates that the current road speed limit is 60 km / h.

[0066] In this disclosure, the vehicle's infotainment system pre-stores the correspondence between environmental information and display settings. This correspondence can be stored before the vehicle leaves the factory or customized by the user after purchase based on their needs. The purpose of adjusting the display settings is to ensure that the display area is within the driver's direct line of sight and that the displayed objects are clear and intuitive. Thus, during vehicle operation, the HUD's display settings can be adaptively adjusted based on the vehicle's environmental information, ensuring that the driver can clearly and intuitively obtain the corresponding prompts in various scenarios, thereby improving the driving experience and driving safety.

[0067] To adaptively adjust the height of the display area so that the driver can see the entire display area without having to shift their gaze upwards or downwards while driving, thus improving driving safety, display settings include: display position; combined with... Figure 5 ,like Figure 7 As shown, before step S502 above, which adjusts the display settings of the head-up display (HUD) based on environmental information, the method further includes step S503 below.

[0068] In step S503, the height of the display position is adjusted to correspond to the shooting angle of the target camera.

[0069] The vehicle's infotainment system pre-stores the corresponding relationships between the shooting angles and heights of the target cameras, such as (10°, 500°), (11°, 505°), etc. The target cameras are typically positioned close to the steering wheel of the vehicle, and the images captured by these cameras are consistent with what the driver can see when looking directly ahead; in other words, the target camera acts as the driver's eyes. The target camera transmits the captured images to the vehicle's infotainment system, which then processes these images as what the driver sees.

[0070] For example, taking the display area as the display information, such as Figure 8a As shown, the target camera 1241 has no angular deflection, and the center point of the display area 802 is aligned with the center crosshair of the target camera 1241. The line connecting the two is used as a reference line. At this moment, the shooting angle of the target camera is recorded as 0 degrees, and the corresponding height is 0. Figure 8b As shown, if the driver feels the display area is too low, the driver will shift the shooting angle of the target camera 1241 upwards by an angle α. The height corresponding to angle α is h1. Therefore, the display area 802 will be vertically shifted upwards by h1. At this time, the center point of the display area 802 will be aligned with the central crosshair of the target camera 1241, or the deviation between the center point of the display area 802 and the central crosshair of the target camera 1241 will be less than the deviation threshold. Figure 8c As shown, if the driver feels that the height of the display area is too high, the driver will shift the shooting angle of the target camera 1241 down by angle β. The height corresponding to angle β is h2. Therefore, the display area 802 will be vertically shifted downward by h2. At this time, the center point of the display area 802 is aligned with the center cross of the target camera 1241, or the deviation between the center point of the display area 802 and the center cross of the target camera 1241 is less than the deviation threshold.

[0071] When the displayed information is a display object, the adjustment is similar to that of the display area. Each display object has a corresponding 0-degree reference line. Based on this, after the target camera's shooting angle is moved up or down, each display object is adjusted according to the corresponding upward or downward shooting angle. It should be noted that for each display object, the height corresponding to the same shooting angle may be the same or different, but the movement range of the display object is within the display area.

[0072] For example, with Figure 8a Use the reference line in the middle as a reference, such as Figure 9a As shown, this represents the display height of display objects 901 and 902 within the display area; Figure 9b As shown, the shooting angle of the target camera 1241 is moved up by θ degrees. The height corresponding to θ degrees is h3 for display object 901 and h4 for display object 902. Therefore, display object 901 will be vertically shifted upward by h1 and display object 902 will be vertically shifted upward by h4.

[0073] It should be noted that the adjustment of the displayed object is limited to the display area. Therefore, when making a fine adjustment to the shooting angle of the target camera, the height of the displayed object can be adjusted so that all displayed objects are within the driver's line of sight when looking directly at the camera. When making a larger adjustment to the angle of the target camera, the display height of the display area can be adjusted. The specific adjustment strategy is not limited in this disclosure.

[0074] In this way, if the driver feels that the displayed information is too high or too low, he can adjust the shooting angle of the target camera. As the shooting angle of the target camera changes, the displayed information also moves up and down, and the display height changes accordingly. Ultimately, the adjustment ensures that the displayed information is located in the center of the area where the driver's eyes are active, so that the driver can see the complete HUD projection image by looking straight ahead without having to move his line of sight up or down.

[0075] During vehicle operation, if the ambient light falling on the display area is too strong, the driver will experience glare and difficulty seeing the HUD projected image. However, this usually only affects the driver's ability to see the HUD projected image when the light intensity directly hitting the display area is high. Therefore, to avoid direct light hitting the display area and causing the driver to not be able to see the displayed object clearly, in some embodiments of this disclosure, combined with... Figure 7 ,like Figure 10 As shown, the environmental information includes: external light intensity; step S502 above adjusts the display settings of the HUD display information according to the environmental information, which can be achieved through step S502a below.

[0076] In step S502a, if the external illuminance is greater than the first illuminance threshold, the height of the display position will be adjusted from the current height to the first height.

[0077] The first height is the height corresponding to the external illuminance. When the external illuminance is greater than the first illuminance threshold, the greater the external illuminance, the greater the height that needs to be moved up or down; conversely, the smaller the external illuminance, the smaller the height that needs to be moved up or down. Alternatively, the first height can be the current height plus or minus a first preset height.

[0078] Specifically, the vehicle exterior illuminance is used to indicate the intensity of light outside the vehicle. The vehicle exterior illuminance can be detected by a sensor located outside the vehicle. Since this disclosure requires obtaining the light intensity at the display area, the sensor needs to be positioned close to the display area. The vehicle exterior illuminance can be determined by measuring at least one of forward light, top light, and infrared light.

[0079] When the external illuminance exceeds a first illuminance threshold, the displayed information will be moved up or down by a preset height to the first height, with the specific direction of movement determined according to actual needs. For example, when the external illuminance exceeds the first illuminance threshold, the display height of the display area will increase by 5mm, i.e., the display area will move up by 5mm; or, when the external illuminance exceeds the first illuminance threshold, the display height of the display area will decrease by 5mm, i.e., the display area will move down by 5mm. Alternatively, when the external illuminance exceeds the first illuminance threshold, the height of display object 1 will increase by 1mm, the height of display object 2 will increase by 1.5mm, and the height of display object 3 will increase by 1.5mm, i.e., the height moved up by each display object may be the same or different; or, when the external illuminance exceeds the first illuminance threshold, the height of display object 1 will decrease by 1mm, the height of display object 2 will decrease by 1.5mm, and the height of display object 3 will decrease by 1.5mm.

[0080] In this way, by adjusting the display position of the information, especially when there is strong light shining directly on the display area outside the vehicle while the vehicle is in motion (such as the taillights of the vehicle in front, or the supplementary lights of the auxiliary monitoring cameras on the road for clear shooting at night or in low light environments), the problem of direct light causing the driver to have difficulty obtaining the HUD projected image can be avoided, thereby improving driving safety and driving experience.

[0081] To more accurately determine the illuminance in the display area, in some embodiments, the environmental information further includes: the illuminance component of the external illuminance along the line connecting the midpoint of the target camera and the display area; combined with Figure 7 ,like Figure 11 As shown, the environmental information includes: external light intensity; the above step S502 adjusts the display settings of the HUD display information according to the environmental information, which can be achieved through the following step S502b.

[0082] In step 502b, if the illuminance component is greater than the second illuminance threshold, the height of the display position will be adjusted from the current height to the second height.

[0083] The second illuminance threshold is less than the first illuminance threshold. The second height is the height corresponding to the illuminance component. When the illuminance component is greater than the second illuminance threshold, the larger the illuminance component, the greater the height that needs to be moved up or down; conversely, the smaller the illuminance component, the smaller the height that needs to be moved up or down. Alternatively, the second height can be the current height plus or minus a second preset height.

[0084] like Figure 12The diagram illustrates the illuminance components. Since the primary light affecting the driver's viewing of the HUD projection image is the light from the display area, a sensor can be positioned inside the vehicle near the display area to measure the illuminance of the light directly reaching the display area through the windshield. Therefore, a sensor for detecting illuminance is placed on the center line connecting the target camera 1241 (within the driver's field of vision) and the display area to accurately determine the intensity of light entering the human eye. Figure 12 The dashed arrows represent light rays from various directions in the actual environment, with the dashed arrows indicating the light direction (i.e., illuminance component) that has the greatest impact on the driver's viewing of the HUD projection image. For instructions on shifting the displayed information up or down, please refer to the description of step S502a above; it will not be repeated here.

[0085] Therefore, when the HUD's projected image falls directly into the area illuminated by the taillights of the vehicle in front, the display area or object will be moved up or down by a certain distance to avoid the direct illumination of the taillights, thereby improving the visibility of the HUD's projected image and enhancing driving safety and experience.

[0086] In addition to detecting illuminance using a light sensor to determine whether the display height needs adjustment, the need for height adjustment can also be determined by analyzing the acquired foreground image. Specifically, in some embodiments of this disclosure, combined with... Figure 7 ,like Figure 13 As shown, the environmental information also includes: a foreground image. The above step S502 adjusts the display settings of the HUD display information according to the environmental information, which can be achieved through the following step S502c.

[0087] In step S502c, if the exposure of the target area in the foreground image is less than the exposure threshold, the height of the display position will be adjusted from the current height to the third height.

[0088] The foreground image, captured by the target camera, includes both displayed information and the actual environment image visible through the display area; essentially, the foreground image is a fusion of the HUD projection image and the actual environment image. The target area is the region in the foreground image corresponding to the actual display area. The third height is a preset height that is increased or decreased from the current height.

[0089] Because the HUD projected image is significantly affected by the taillights of vehicles ahead or direct, strong headlights while the vehicle is in motion, visibility is typically poor at night. When the display area falls directly into the range of a bright, oncoming taillight or strong headlight, the exposure of the target area in the foreground image captured by the target camera will increase due to the direct light. Therefore, the presence of direct light in the target area can be determined by measuring the exposure. Thus, without adding a sensor for directly detecting illuminance, since the target camera aligns with the driver's field of vision, it can capture a foreground image and determine whether to shift the displayed information up or down by measuring the exposure of the target area within that image. This allows for improved HUD visibility by shifting the displayed information up or down when visibility is poor due to direct, strong light, without requiring additional hardware for illuminance detection.

[0090] Since the visibility of the display area is more likely to be affected by the on-screen taillights of the vehicle in front, optionally, if the target area in the foreground image is identified to include the on-screen taillights, the height of the display position is adjusted from the current height to a fourth height.

[0091] One approach is to use image recognition methods to identify whether a parking light is on in the foreground image. This can be done by extracting the color, texture, and edges of the target area, using color detection (if the color of the taillights is known, color can be used to determine whether the taillights are on), using pixel values ​​to determine whether the taillights are on, detecting bright spots in the target area and marking them to determine whether the taillights are on, or training a classifier to determine whether the target area has on taillights.

[0092] The strategy of determining whether to move the displayed information up or down by identifying whether the foreground image includes on taillights is simpler, requires less image analysis, and thus reduces the vehicle's resource consumption.

[0093] For example, such as Figure 14 The diagram shows a schematic of adjusting the display area. The display position of display area 60 on the windshield 204 is shown in the figure. Display area 60 will be shifted horizontally along the dotted line 1401, and the center point of display area 204 will move from a2 to a1. Figure 15The diagram shows the adjustment of the display objects. Display object 601 moves upward along the dotted line (center line), and the center point of display object 601 moves from b2 to b1. Display object 602 moves upward along the dotted line, and the center point of display object 602 moves from c2 to c1. Display object 603 moves upward along the dotted line, and the center point of display object 603 moves from d2 to d1.

[0094] It should be noted that in the above steps S502a to 502c, after the height of the display position is adjusted, during the driving process, after a preset time interval, the display position will be adjusted back to the position before the adjustment; or, the current position will remain unchanged, but when the adjustment is continued according to steps S502a to 502c, the direction of the adjustment will be opposite to that of the previous adjustment. For example, the first adjustment is to move the display area up by 5mm, and the next time the adjustment conditions are met, the display area will be moved down by 5mm, and so on.

[0095] Excessive or insufficient brightness of the displayed object can affect the driver's driving experience. For example, excessive brightness may cause eye fatigue or even glare, affecting driving safety; while insufficient brightness may result in unclear displayed content, affecting the driver's acquisition of information. Therefore, in some embodiments of this disclosure, environmental information includes: external illuminance; display information includes: the displayed object; display settings include: brightness and clarity; the above step S502 adjusts the display settings of the HUD display information according to the environmental information, which can be specifically implemented through the following step S502d.

[0096] In step S502d, the brightness and sharpness of the displayed object are adjusted to match the object brightness and sharpness corresponding to the external lighting conditions.

[0097] The description of the external illuminance is as described in step S502a, and will not be repeated here.

[0098] The vehicle pre-stores the correspondence between external illuminance, brightness, and sharpness. Alternatively, the vehicle pre-stores the correspondence between external illuminance and drawing number. The drawing number is used to uniquely identify a display object. The brightness and sharpness of the display object are adjusted to the brightness and sharpness corresponding to the external illuminance, that is, the display object is adjusted to the display object indicated by the drawing number corresponding to the external illuminance.

[0099] Because the brightness and sharpness of the displayed object are affected not only by the illuminance but also by the foreground image; for example, under the same illuminance, a black foreground image requires less brightness than a white foreground image. Therefore, to more accurately adjust the brightness of the displayed object and the sharpness to match the brightness, making the HUD's projected image clearer and more comfortable to view; in some examples, environmental information also includes: exterior illuminance and the primary color of the foreground image; display information includes: the displayed object; display settings include: brightness and sharpness; combined with Figure 10 ,like Figure 16 As shown, step S502 above adjusts the display settings of the HUD display information according to the environmental information, which can be specifically achieved through step S161 below.

[0100] In step S161, the brightness and sharpness of the displayed object are adjusted to match the external lighting conditions and the object brightness and sharpness corresponding to the foreground image.

[0101] The foreground image refers to the image corresponding to the display area, that is, the image of the outside of the vehicle as seen from the display area. The vehicle system analyzes and obtains the primary color (which can also be understood as the background color) of the foreground image. Since the human eye has different sensitivities to different colors, under the same illuminance and brightness, the human eye perceives the brightness as brighter in a darker primary color and as lower in a brighter primary color. Therefore, adjusting the brightness of the displayed object by combining the illuminance outside the vehicle and the primary color of the foreground image is more accurate and more comfortable for the human eye to view.

[0102] In some examples, the environmental information also includes: external illuminance and internal illuminance; the display information includes: the display object; the display settings include: brightness and sharpness; the above step S502 adjusts the display settings of the HUD display information according to the environmental information, which can be specifically achieved through the following steps S502e and S502f.

[0103] In step S502e, if the difference between the external illuminance and the internal illuminance of the vehicle is greater than a first difference threshold, the brightness and sharpness of the displayed object will be adjusted to the object brightness and sharpness corresponding to the difference.

[0104] In step S502f, if the difference between the external illuminance and the internal illuminance is less than or equal to the first difference threshold, the brightness and sharpness of the displayed object will be adjusted to the object brightness and sharpness corresponding to the external illuminance or the internal illuminance.

[0105] The interior illuminance can be detected by a light sensor installed inside the vehicle. The location of the light sensor is not limited. For example, it can be installed on the roof console, near the reading light, behind or inside the instrument panel, or inside the windshield, near the rearview mirror.

[0106] The vehicle pre-stores the correspondence between the difference in external and internal illuminance, brightness, and sharpness, as well as the correspondence between illuminance, brightness, and sharpness; alternatively, the vehicle pre-stores the correspondence between the difference in external and internal illuminance and drawing numbers, as well as the correspondence between illuminance and drawing numbers. The brightness of the displayed object is adjusted to the brightness and sharpness corresponding to the difference in external and internal illuminance, that is, the displayed object is adjusted to the display object indicated by the drawing number corresponding to the difference in external and internal illuminance.

[0107] Specifically, if cost savings are considered, only one light sensor can be set up according to the solution in step S502d to detect the illuminance outside the vehicle; if the goal is to adjust the brightness and clarity of the displayed object more accurately (for example, if there is a large difference between the illuminance inside and outside the vehicle, adjusting the brightness only according to the illuminance outside the vehicle may lead to excessive brightness and cause eye fatigue for the driver), so that the display effect of the displayed object can make the driver feel comfortable regardless of the change in environment from bright to dark or from dark to bright, then at least two light sensors can be set up according to the solutions in steps S502e and S502f, respectively, to detect the illuminance outside the vehicle and the illuminance inside the vehicle.

[0108] Specifically, if the interior illuminance is greater than the exterior illuminance and the difference exceeds a first difference threshold, such as in a nighttime environment or when entering a tunnel, the brightness of the displayed object can be reduced (compared to the brightness of the displayed object corresponding to the exterior illuminance when only considering the exterior illuminance) to adapt to the external environment and avoid glare or visibility issues. If the exterior illuminance is greater than the interior illuminance and the difference exceeds a first difference threshold, such as in direct sunlight or when there are direct headlights outside the vehicle, the brightness of the displayed object can be increased to ensure that the HUD projected image remains visible even in strong light.

[0109] When the difference between the external illuminance and the internal illuminance is less than or equal to the first difference threshold, that is, when the internal illuminance and the external illuminance are close, the object brightness and object sharpness of the displayed object can be determined according to the external illuminance or the internal illuminance as needed.

[0110] Since higher resolution is not always better when brightness is fixed, excessively high resolution can make displayed objects look unnatural, such as having overly sharp edges or obvious signs of artificial processing. Therefore, when brightness and resolution are properly matched, the driver will feel comfortable viewing the image, thus improving the driving experience.

[0111] Based on a concept similar to step S161 above, in some examples, the environmental information also includes: external illuminance, internal illuminance, and the main color of the foreground image; the display information includes: the display object; the display settings include: brightness and sharpness; step S502 above adjusts the display settings of the HUD display information according to the environmental information, which can be specifically implemented through the following steps S162 and S163.

[0112] In step S162, if the difference between the external illuminance and the internal illuminance is greater than the second difference threshold, the brightness of the display area will be adjusted to the area brightness corresponding to the difference and the main color.

[0113] In step S163, if the difference between the external illuminance and the internal illuminance is less than or equal to the second difference threshold, the brightness of the display area will be adjusted to the brightness of the area corresponding to the illuminance and the main color.

[0114] Illuminance refers to either external illuminance or internal illuminance.

[0115] It should be noted that the relevant descriptions of steps S162 and S163 can be found in steps S161, S502e and S502f above, and will not be repeated here.

[0116] In addition to adjusting the brightness of the displayed object according to the external illuminance of the vehicle, the overall brightness of the display area can also be adjusted, so that the overall viewing effect is comfortable and the displayed object is clearly distinguishable; in some examples of this disclosure, the environmental information includes: external illuminance of the vehicle; the display information includes: display area; the display settings also include: brightness; the above step S502 adjusts the display settings of the HUD display information according to the environmental information, which can be specifically done through the following step S502g.

[0117] In step S502g, the brightness of the display area is adjusted to the area brightness corresponding to the external illuminance of the vehicle.

[0118] Specifically, when the external light intensity is high, the brightness of the display area can be appropriately reduced; when the external light intensity is low, the brightness of the display area can be appropriately increased to highlight the display object with the prompt information.

[0119] In some examples, environmental information includes: exterior illuminance and the primary color of the foreground image; display information includes: display area; the display settings include: brightness; combined with Figure 10 ,like Figure 17 As shown, step S502 can be implemented in the following step S171.

[0120] In step S171, the brightness of the display area is adjusted to match the external illuminance and the brightness of the area corresponding to the main color.

[0121] In some examples, environmental information includes: interior illuminance and exterior illuminance; display information includes: display area; display settings include: brightness; step S502 adjusts the display settings of the HUD display information according to the environmental information, which can be done through the following steps S502h and S502i.

[0122] In step S502h, if the difference between the external illuminance and the internal illuminance is greater than the second difference threshold, the brightness of the display area will be adjusted to the brightness of the area corresponding to the difference.

[0123] In step S502i, if the difference between the external illuminance and the internal illuminance is less than or equal to the second difference threshold, the brightness of the display area will be adjusted to the area brightness corresponding to the external illuminance or the internal illuminance.

[0124] Specifically, if the interior illuminance is greater than the exterior illuminance and the difference exceeds a second difference threshold, the brightness of the display area can be appropriately reduced (compared to the brightness of the display area corresponding to the exterior illuminance when only considering the exterior illuminance) to avoid visual interference or glare caused by an overly bright HUD display in a darker external environment. If the exterior illuminance is greater than the interior illuminance and the difference exceeds a second difference threshold, the brightness can be appropriately increased to ensure the readability of the HUD projected image. When the difference between the exterior and interior illuminance is small, the area brightness can be set according to either the exterior or interior illuminance.

[0125] In some examples, environmental information includes: interior illuminance, exterior illuminance, and the primary color of the foreground image; display information includes: display area; the display settings include: brightness; the above step S502 can be specifically implemented through the following steps S172 and S173.

[0126] In step S172, if the difference between the external illuminance and the internal illuminance is greater than the second difference threshold, the brightness of the display area will be adjusted to the area brightness corresponding to the difference and the main color.

[0127] In step S173, if the difference between the external illuminance and the internal illuminance is less than or equal to a second difference threshold, the brightness of the display area is adjusted to the area brightness corresponding to the illuminance and the main color. Here, illuminance refers to either the external illuminance or the internal illuminance.

[0128] It should be noted that, based on the same concept as steps S502d to S502f and steps S161 to S163, the effects of steps S502g to S502i and steps S171 to S173 can be referred to the descriptions of steps S502d to S502f and steps S161 to S163, and will not be repeated here.

[0129] If the color of the object displayed in the HUD's projected image is similar to or close to the color of the corresponding actual environment, it will result in poor visibility of the displayed object, making it difficult for the driver to quickly obtain the information they need. For example, if the display area corresponds to a gray-black road, and the color of the displayed object in the projected image is gray, meaning the background color of the gray displayed object is gray-black, the gray displayed object will be difficult to distinguish. Therefore, in some embodiments of this disclosure, the environmental information also includes: the primary color of the foreground image, the display information includes: the displayed object, and the display settings include: color; combined with Figure 5 ,like Figure 18 As shown, step S502 can be specifically achieved through step S181.

[0130] In step S181, the color of the displayed object is adjusted to a color corresponding to the main color.

[0131] The foreground image corresponding to the display area is captured by the target camera. The vehicle system analyzes the dominant color (which can also be understood as the background color) in the foreground image. After obtaining the dominant color, the color of the display object is updated to the color corresponding to the dominant color. For example, considering that the human eye has different sensitivities to different color combinations, if the dominant color is black, the display object color is white or yellow; if the dominant color is blue, the display object color is white or black; if the dominant color is green, the display object color is white or black, etc. The specific correspondence between the dominant color and the display color is determined according to actual needs, as long as the content of the display object can be intuitively and clearly obtained on the dominant color, and the visibility is good.

[0132] The vehicle pre-stores the correspondence between primary colors and display object colors. For example, the vehicle's infotainment system pre-stores multiple color correspondences, each corresponding to the red, green, and blue (RGB) values ​​of a primary color and the RGB values ​​of the display object. Alternatively, the vehicle can pre-store the correspondence between primary colors and drawing numbers, updating the display object's color to the primary color's corresponding color, i.e., updating the display object to the display object corresponding to the drawing number.

[0133] In this way, the colors of the displayed objects are updated in a timely manner based on the dominant color of the actual environment outside the vehicle, ensuring that the displayed objects are highly recognizable and improving the driving experience.

[0134] The adjustments to the display objects in the above steps require explanation. The example provides the following stored correspondences: correspondence between primary color and display object color; correspondence between exterior or interior illuminance, brightness, and sharpness; correspondence between the difference in interior and exterior illuminance and brightness and sharpness; correspondence between exterior illuminance, primary color, brightness, and sharpness; correspondence between exterior and interior illuminance, primary color, brightness, and sharpness; or correspondence between primary color and drawing number; correspondence between exterior or interior illuminance and drawing number; correspondence between the difference in interior and exterior illuminance and drawing number; correspondence between exterior illuminance, primary color, and drawing number; correspondence between exterior and interior illuminance, primary color, and drawing number. In practical applications, if it is necessary to adjust the color, brightness, and sharpness of the displayed object, only two correspondences can be stored: the correspondence between the primary color, illuminance, displayed object color, brightness, and sharpness, and the correspondence between the difference in illuminance inside and outside the vehicle, brightness, and sharpness; or the correspondence between the primary color, illuminance, and drawing number, and the correspondence between the difference in illuminance inside and outside the vehicle and the drawing number.

[0135] It should be noted that due to the limited storage space of the vehicle, the number of stored correspondences is also limited. Therefore, when a certain value is missing from all correspondences, such as when the vehicle only stores five correspondences for shooting angles and heights (-10°, 500), (-30°, 550), (0°, 600), (10°, 620), and (30°, 650), but the current shooting angle is 15°, one approach is to use 620, corresponding to the closest 10° to 15°, as the adjustment height. That is, the height corresponding to the angle closest to 15° is determined as the corresponding height for the unstored angle. However, this method has a large error. Another approach is to determine the height using linear interpolation. Linear interpolation is a method of estimating unknown data points given some known data points. Specifically, in the given data points, 15° falls between -10° and 30°, so (-10°, 500) and (30°, 650) are chosen as the basis for interpolation. The following linear interpolation formula is used. The calculation is performed, where x is the estimated 15°, (x1, y1) is (-10°, 500), and (x2, y2) is (30°, 650). The calculated value corresponding to 15° is approximately 593. The value determined in this way is more accurate, thus making the adaptive adjustment more precise. For any of the above correspondences, linear interpolation can be used to determine the corresponding value for the unstored value.

[0136] Different drivers have different preferences. Therefore, in order to accommodate the preferences of different drivers, some embodiments of this disclosure combine... Figure 5 ,like Figure 19 As shown, the display control method further includes the following step S504.

[0137] In step S504, the display design of the display information is adjusted based on the received adjustment instructions.

[0138] The display design includes at least one of the following: the font of the display object, the layout of the display object, and the background color of the display area.

[0139] Specifically, the vehicle provides an interface that the driver can operate. The driver can adjust the layout of each displayed object in the display area as needed (such as displaying the vehicle speed display object on the far left and the speed limit display object on the upper left of the display area), the font size, and select a preferred font (such as KaiTi, Cartoon, SongTi, etc.), and change the background color of the display area (such as cool color, warm color, soft, dark, etc.).

[0140] In some embodiments, the correspondence between the above-mentioned environmental information and display settings is stored during the pre-shipment testing phase, or it can be customized by the user according to their needs after purchasing the vehicle. Figure 20 The diagram shown illustrates the system block diagram required to determine the correspondence between environmental information and display settings.

[0141] A target camera 1241 is positioned in front of the steering wheel to acquire a fused image of the real-world external environment as seen from the human eye's perspective and the HUD projected image. An in-vehicle light sensor 1251 acquires the in-vehicle illuminance, and an external light sensor 1252 acquires the illuminance of at least one of the following: forward light, top light, and infrared light. A host computer 190 sends Unified Diagnostic Services (UDS) diagnostics to the HUD 170 to control adjustments such as image quality, height, brightness, and sharpness. The vehicle infotainment system 180 adjusts the HUD projection height, brightness, and color values ​​based on the information collected by the in-vehicle target camera 1241 and the light sensor 125. The vehicle infotainment system 180 sends the display objects to the display unit 160 for display and sends height and brightness adjustment commands to the display control unit 150 for response and adjustment.

[0142] Specifically, the process for obtaining the corresponding relationships that need to be stored in the vehicle is as follows: Figure 21 and Figure 22 As shown, Figure 21 The height calibration process is shown, including the following steps 1 to 13.

[0143] 1. The host computer sends the UDS diagnostic diagram adjustment command to the vehicle system.

[0144] Upon entering UDS diagnostics, the host computer controls the vehicle's infotainment system to begin altitude calibration, sending an adjustment command, including the drawing number and display altitude, to the vehicle's infotainment system.

[0145] 2. The vehicle system sends the crosshair calibration image and display height to the HUD.

[0146] 3. The HUD projects the crosshair image onto the windshield at the display height for display.

[0147] 4. The target camera acquires a fused image observed from the human eye's perspective.

[0148] 5. The target camera sends the fused image to the host computer.

[0149] 6. The host computer determines whether the downward viewing angle deviation calculated based on the fused image is less than the deviation threshold.

[0150] If yes, proceed to steps 11 to 13; otherwise, proceed to steps 7 to 10.

[0151] 7. The host computer determines the adjustment height based on the downward viewing angle deviation.

[0152] 8. The host computer sends a height adjustment command to the vehicle system.

[0153] 9. The vehicle infotainment system sends a height adjustment command to the HUD.

[0154] 10. The HUD adjusts the height of the displayed information according to the height indicated by the height adjustment command.

[0155] After step 10, repeat steps 4 to 13 until the downward viewing angle deviation is less than the deviation threshold.

[0156] 11. The host computer sends the height and shooting angle to the vehicle system.

[0157] 12. The vehicle's infotainment system sends the altitude and shooting angle to the HUD.

[0158] 13. The correspondence between HUD storage height and shooting angle.

[0159] Optionally, the correspondence between height and shooting angle can also be stored in the vehicle's infotainment system.

[0160] Typically, after the HUD stores the correspondence between height and shooting angle, it sends a positive response to the host computer, which then confirms that the height calibration is complete.

[0161] It should be noted that steps 1 to 13 only show the steps to obtain the correspondence between one shooting angle and height. To determine the correspondence between multiple shooting angles and heights, simply adjust the angle of the target camera and repeat steps 1 to 13. This will not be elaborated here.

[0162] Figure 22The display object calibration and brightness calibration processes are illustrated. The display object calibration process includes steps 14 to 26 below. The brightness calibration process includes steps 27 to 34 below.

[0163] 14. The light sensor detects the illuminance outside the vehicle.

[0164] 15. The light sensor sends the external light intensity to the host computer.

[0165] 16. The target camera acquires a fused image observed from the human eye's perspective.

[0166] 17. The target camera sends the fused image to the host computer.

[0167] 18. The host computer determines the color of the display object based on the main color of the fused image, and determines the brightness and clarity of the display object based on the external light intensity and the main color.

[0168] 19. The host computer determines the label of the display object that meets the requirements of display object color, display object brightness and clarity.

[0169] 20. The host computer sends the label and map adjustment instructions to the vehicle system.

[0170] The host computer identifies the display object that meets the requirements for color, brightness, and clarity, and sends the unique identifier of the display object to the vehicle system.

[0171] 21. The vehicle system sends the label and map adjustment command to the HUD.

[0172] 22. The HUD retrieves and displays the display object indicated by the label according to the map adjustment command.

[0173] 23. The host computer checks whether it has received the first storage instruction.

[0174] If yes, proceed to steps 24 to 26; otherwise, proceed to steps 18 to 26 until the host computer receives the first storage instruction.

[0175] After the HUD projects the display object onto the windshield according to the image adjustment command, the testers observe whether the display object meets the standard. If it does, a storage command is triggered on the host computer; if it does not meet the standard, the adjustment continues.

[0176] 24. The host computer sends a storage instruction, including the main color and the external illuminance, to the vehicle system.

[0177] 25. The vehicle system sends a storage command, including the primary color and the external light intensity, to the HUD.

[0178] 26. The HUD stores the correspondence between the primary color, the external light intensity, the color of the displayed object, the brightness of the displayed object, and the sharpness of the displayed object.

[0179] Typically, after the HUD stores the correspondence between the primary color, the vehicle's external illuminance, and the colors, brightness, and sharpness of the displayed objects, it sends a positive response to the host computer, which then confirms that the display object calibration is complete.

[0180] It should be noted that steps 14 to 26 only illustrate the steps for obtaining the correspondence between a primary color, exterior illuminance, and the colors, brightness, and sharpness of the displayed object. To determine the correspondence between multiple primary colors, exterior illuminance, and the colors, brightness, and sharpness of the displayed object, simply adjust the scene and repeat steps 14 to 26; this will not be elaborated further here. The correspondence between the difference between interior and exterior illuminance, and between the primary color and the brightness and sharpness of the displayed object, can be found in steps 14 to 26, simply replacing the exterior illuminance with the difference between interior and exterior illuminance; this will not be elaborated further here.

[0181] Furthermore, the final stored correspondence is: primary color, vehicle exterior illuminance and display object color, display object brightness and display object sharpness. In practical applications, the stored correspondence can also be: the correspondence between primary color and display object color, and the correspondence between vehicle exterior illuminance and brightness and sharpness. That is, the brightness and sharpness of the display object can be determined based on the vehicle exterior illuminance, and the color of the display object can be determined based on the primary color.

[0182] 27. The host computer determines the target brightness of the display area based on the external illuminance and the main color.

[0183] 28. The host computer sends a brightness adjustment command, including the target brightness, to the vehicle system.

[0184] Optionally, the host computer can also send a brightness adjustment command, including the pulse width modulation duty ratio (PWMDuty) corresponding to the target brightness, to the vehicle system. Since the brightness of the display area needs to be changed, what is actually adjusted is the PWMDuty. Therefore, the PWMDuty corresponding to the target brightness can be sent directly here.

[0185] 29. The vehicle system sends a brightness adjustment command, including the target brightness, to the HUD.

[0186] 30. Adjust the brightness of the HUD display area to the target brightness.

[0187] 31. The host computer checks whether it has received the second storage instruction.

[0188] If yes, proceed to steps 32 to 34; otherwise, proceed to steps 27 to 34 until the host computer receives the second storage instruction.

[0189] 32. The host computer sends a storage instruction, including the vehicle's exterior illuminance and primary color, to the vehicle's infotainment system.

[0190] 33. The vehicle system sends a storage command, including the external light intensity and the main color, to the HUD.

[0191] 34. The relationship between the external illuminance, main color, and brightness of the display area in the HUD storage vehicle.

[0192] Typically, after the HUD stores the correspondence between the vehicle's external illuminance and the brightness of the display area, it sends a positive response to the host computer, which then confirms that the brightness calibration is complete.

[0193] It should be noted that steps 27 to 34 only illustrate the steps for obtaining a single correspondence between exterior illuminance, primary color, and display area brightness. To determine multiple correspondences between exterior illuminance, primary color, and display area brightness, simply adjust the scene and repeat steps 27 to 34; this will not be elaborated further here. The correspondence between interior illuminance and the difference between exterior illuminance, and between primary color and display area brightness, can be found in steps 27 to 34, simply replacing exterior illuminance with the difference between interior illuminance and exterior illuminance; this will not be elaborated further here.

[0194] The steps 1 to 34 above ultimately yield various correspondences. To reduce storage pressure, an algorithm can be determined based on the established correspondences, or a model can be trained. The final algorithm or model can then be stored in the vehicle.

[0195] Based on the same inventive concept as the aforementioned technical solution, see [link to inventive concept]. Figure 23 It illustrates a display control device 230 provided in this disclosure, which can be a display control device 230. Figure 1 , Figure 4 The display control unit shown includes an acquisition section 2301 and an adjustment section 2302. The acquisition section 2301 is configured to acquire environmental information of the vehicle. The adjustment section 2302 is configured to adjust the display settings of the head-up display (HUD) based on the environmental information.

[0196] In some embodiments of this disclosure, the display settings include: display position; the adjustment portion 2302 is further configured to adjust the height of the display position to a height corresponding to the shooting angle, based on the shooting angle of the target camera, before adjusting the display settings of the head-up display (HUD) display information according to environmental information.

[0197] In some embodiments of this disclosure, the environmental information includes: the adjustment part 2302 is specifically configured to adjust the height of the display position from the current height to the first height when the external illuminance is greater than a first illuminance threshold.

[0198] In some embodiments of this disclosure, the environmental information includes: the illuminance component of the vehicle exterior illuminance along the line connecting the midpoint of the target camera and the display area; the adjustment part 2302 is specifically configured to adjust the height of the display position from the current height to the second height when the illuminance component is greater than the second illuminance threshold.

[0199] In some embodiments of this disclosure, the environmental information includes: a foreground image; the adjustment portion 2302 is specifically configured to adjust the height of the display position from the current height to a third height when the exposure of the target area in the foreground image is greater than an exposure threshold.

[0200] In some embodiments of this disclosure, environmental information includes: vehicle exterior illuminance and the primary color of the foreground image; display information includes: display object; display settings include: brightness and sharpness; the adjustment part 2302 is specifically configured to adjust the brightness and sharpness of the display object to the object brightness and object sharpness corresponding to the vehicle exterior illuminance and the primary color.

[0201] In some embodiments of this disclosure, the environmental information includes: external illuminance and the primary color of the foreground image; the display information includes: the display area; the display settings include: brightness and sharpness; the adjustment part 2302 is specifically configured to adjust the brightness of the display area to the brightness of the area corresponding to the external illuminance and the primary color.

[0202] In some embodiments of this disclosure, environmental information includes: in-vehicle illuminance, out-of-vehicle illuminance, and the primary color of the foreground image; display information includes: the display object; display settings include: brightness and sharpness; the adjustment part 2302 is specifically configured to adjust the brightness and sharpness of the display object to the object brightness and sharpness corresponding to the difference and the primary color when the difference between the out-of-vehicle illuminance and the in-vehicle illuminance is greater than a first difference threshold; and to adjust the brightness and sharpness of the display object to the object brightness and sharpness corresponding to the illuminance and the primary color when the difference between the out-of-vehicle illuminance and the in-vehicle illuminance is less than or equal to the first difference threshold, wherein the illuminance is either the out-of-vehicle illuminance or the in-vehicle illuminance.

[0203] In some embodiments of this disclosure, environmental information includes: in-vehicle illuminance, out-of-vehicle illuminance, and the primary color of the foreground image; display information includes: display area; display settings include: brightness; the adjustment part 2302 is specifically configured to adjust the brightness of the display area to the area brightness corresponding to the difference and the primary color when the difference between the out-of-vehicle illuminance and the in-vehicle illuminance is greater than a second difference threshold; and to adjust the brightness of the display area to the area brightness corresponding to the illuminance and the primary color when the difference between the out-of-vehicle illuminance and the in-vehicle illuminance is less than or equal to the second difference threshold, wherein the illuminance is either the out-of-vehicle illuminance or the in-vehicle illuminance.

[0204] refer to Figure 24 This diagram illustrates a structural block diagram of a display control device provided in an exemplary embodiment of this disclosure. In some examples, the display control device has communication capabilities and can access a wired or wireless network. In some examples, the display control device can receive data based on the accessed wired or wireless network. It is understood that the display control device undertakes the computational and processing work of the technical solutions of this disclosure, and this disclosure does not limit its scope.

[0205] like Figure 24 As shown, the display control device in this disclosure may include one or more of the following components: processor 2410 and memory 2420.

[0206] Optionally, the processor 2410 connects various parts within the computing device using various interfaces and lines, and performs various functions and processes data by running or executing instructions, programs, code sets, or instruction sets stored in the memory 2420, and by calling data stored in the memory 2420. Optionally, the processor 2410 can be implemented using at least one hardware form of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), or Programmable Logic Array (PLA). The processor 2410 can integrate one or a combination of several of the following: Central Processing Unit (CPU), Graphics Processing Unit (GPU), Neural-network Processing Unit (NPU), and baseband chip. Specifically, the CPU primarily handles the operating system, user interface, and applications; the GPU is responsible for rendering and drawing the content required for display on the touch screen; the NPU is used to implement Artificial Intelligence (AI) functions; and the baseband chip is used for wireless communication. It is understandable that the aforementioned baseband chip may not be integrated into the processor 2410, but may be implemented as a separate chip.

[0207] The memory 2420 may include random access memory (RAM) or read-only memory (ROM). Optionally, the memory 2420 may include a non-transitory computer-readable storage medium. The memory 2420 may be used to store instructions, programs, code, code sets, or instruction sets. The memory 2420 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as touch function, sound playback function, image playback function, etc.), instructions for implementing the various method embodiments described above, etc.; the data storage area may store data created according to the use of the computing device, etc.

[0208] In addition, those skilled in the art will understand that the structure of the computing device shown in the above figures does not constitute a limitation on the computing device. The computing device may include more or fewer components than shown, or combine certain components, or have different component arrangements. For example, the computing device may also include a display screen, camera assembly, microphone, speaker, radio frequency circuit, input unit, sensors (such as accelerometer, angular velocity sensor, light sensor, etc.), audio circuit, WiFi module, power supply, Bluetooth module, etc., which will not be described in detail here.

[0209] This disclosure also provides a computer-readable storage medium storing at least one instruction that is executed by a processor to implement the display control method described in the above embodiments.

[0210] This disclosure also provides a head-up display device, which includes a display control unit and a display unit; wherein the display control unit is configured to acquire environmental information of the vehicle and adjust the display position system of the head-up display device HUD according to the environmental information; and the display unit is configured to display the information on the windshield of the vehicle based on the control of the display control unit.

[0211] This disclosure also provides a vehicle that includes the aforementioned head-up display device.

[0212] This disclosure also provides a computer program product including computer instructions stored in a computer-readable storage medium; a processor of a computing device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computing device to perform the display control method described in the above embodiments.

[0213] Those skilled in the art will recognize that the functions described in this disclosure in one or more of the examples above can be implemented using hardware, software, firmware, or any combination thereof. When implemented in software, these functions can be stored in a computer-readable medium or transmitted as one or more instructions or code on a computer-readable medium. Computer-readable media include computer storage media and communication media, wherein communication media include any medium that facilitates the transfer of a computer program from one place to another. Storage media can be any available medium accessible to a general-purpose or special-purpose computer.

[0214] It should be noted that the technical solutions described in this disclosure can be combined arbitrarily as long as they do not conflict.

[0215] The above description is merely a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in the present invention should be included within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

Claims

1. A display control method, characterized in that, The method includes: Obtain environmental information for this vehicle; The display settings of the head-up display (HUD) are adjusted according to the environmental information.

2. The method according to claim 1, characterized in that, The display settings include: display position; before adjusting the display settings of the head-up display (HUD) based on the environmental information, the method further includes: Based on the shooting angle of the target camera, the height of the display position is adjusted to correspond to the shooting angle.

3. The method according to claim 2, characterized in that, The environmental information includes: external illuminance; adjusting the display settings of the head-up display (HUD) based on the environmental information includes: If the external illuminance is greater than a first illuminance threshold, the height of the display position will be adjusted from the current height to the first height.

4. The method according to claim 2, characterized in that, The environmental information includes: the illuminance component of the external illuminance along the line connecting the midpoint of the target camera and the display area; adjusting the display settings of the head-up display (HUD) based on the environmental information includes: If the illuminance component is greater than the second illuminance threshold, the height of the display position is adjusted from the current height to the second height.

5. The method according to claim 2, characterized in that, The environmental information includes: a foreground image; adjusting the display settings of the head-up display (HUD) based on the environmental information includes: If the exposure of the target area in the foreground image is greater than the exposure threshold, the height of the display position is adjusted from the current height to a third height.

6. The method according to any one of claims 1 to 5, characterized in that, The environmental information includes: external light intensity and the primary color of the foreground image; the display information includes: the displayed object; the display settings include: brightness and sharpness; adjusting the display settings of the head-up display (HUD) according to the environmental information includes: The brightness and sharpness of the displayed object are adjusted to match the object brightness and sharpness corresponding to the vehicle exterior illumination and the main color.

7. The method according to any one of claims 1 to 5, characterized in that, The environmental information includes: interior illuminance, exterior illuminance, and the primary color of the foreground image; the display information includes: the displayed object; the display settings include: brightness and sharpness; adjusting the display settings of the head-up display (HUD) based on the environmental information includes: If the difference between the external illuminance and the internal illuminance of the vehicle exceeds a first difference threshold, the brightness and sharpness of the displayed object will be adjusted to match the object brightness and sharpness corresponding to the difference and the main color. When the difference between the external illuminance and the internal illuminance is less than or equal to a first difference threshold, the brightness and sharpness of the displayed object are adjusted to the object brightness and object sharpness corresponding to the illuminance and the main color, wherein the illuminance is the external illuminance or the internal illuminance.

8. The method according to any one of claims 1 to 5, characterized in that, The environmental information includes: external light intensity and the primary color of the foreground image; the display information includes: display area; the display settings include: brightness; adjusting the display settings of the head-up display (HUD) according to the environmental information includes: The brightness of the display area is adjusted to match the brightness of the area corresponding to the vehicle's external illuminance and the main color.

9. The method according to any one of claims 1 to 5, characterized in that, The environmental information includes: interior illuminance, exterior illuminance, and the primary color of the foreground image; the display information includes: display area; the display settings include: brightness; adjusting the display settings of the head-up display (HUD) according to the environmental information includes: If the difference between the external illuminance and the internal illuminance of the vehicle exceeds a second difference threshold, the brightness of the display area will be adjusted to the area brightness corresponding to the difference and the main color. When the difference between the external illuminance and the internal illuminance is less than or equal to a second difference threshold, the brightness of the display area is adjusted to the area brightness corresponding to the illuminance and the main color, wherein the illuminance is the external illuminance or the internal illuminance.

10. A display control device, characterized in that, The device includes: an acquisition section and an adjustment section; The acquisition section is configured to acquire environmental information of the vehicle. The adjustment section is configured to adjust the display settings of the head-up display (HUD) based on the environmental information.

11. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores at least one instruction, which is executed by a processor to implement the display control method as described in any one of claims 1 to 9.

12. A head-up display device, characterized in that, The head-up display device includes a display control unit and a display unit; wherein... The display control unit is configured to acquire environmental information of the vehicle. And adjust the display settings of the head-up display (HUD) based on the environmental information; The display unit is configured to display information on the windshield of the vehicle according to the display settings, based on the control of the display control unit.

Images