A display method, apparatus and system

Abstract

The application relates to a display method, device and system, wherein the method comprises the following steps: acquiring environment information corresponding to a vehicle; the environment information comprises light intensity information and / or position information; adjusting a display mode of a display device of the vehicle according to the environment information; the display mode comprises at least one of display brightness, display position, display content, display color, display style or display size; according to the application, the display mode of the display device is adjusted according to the environment information, so that the display mode of the display device can adapt to the current environment, and the display effect and driving safety are improved.

Description

[0001] This application claims priority to Chinese Patent Application No. 202111593514.9, filed on December 23, 2021, entitled "A Display Method", the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to the field of intelligent vehicle technology, and in particular to a display method, device and system. Background Technology

[0003] With economic development and the rapid increase in vehicle ownership, vehicle technology and computer technology are increasingly merging. Intelligent vehicles have become a new trend in vehicle development. In addition to technologies such as autonomous driving and high-precision maps, human-machine interaction in intelligent cockpits has also become a hot topic of attention.

[0004] Smart cockpits typically feature a variety of display devices. As vehicles are a highly sensitive safety environment, maintaining good display performance of these devices is of great importance. Summary of the Invention

[0005] This application proposes a display method, apparatus, system, storage medium, and computer program product to improve display stability and user experience. It should be understood that the display method provided in this application can be applied to a processing device, which may be a processor, a processing chip, a display device (e.g., an in-vehicle display, a head-up display (HUD), a vehicle-mounted device with processing capabilities, and a vehicle. The processor or processing chip may be located in the display device or the in-vehicle device, or may communicate with the electronic device or the in-vehicle device via wired or wireless means, such as the processor of the HUD or the processor of the vehicle's infotainment system. In implementation, the processing device may be one or more processing devices. For example, the processing chip in the vehicle's infotainment system processes data and sends key information to the processing device in the HUD to generate the image to be projected. The aforementioned processing device may include one or more processing devices. In specific implementation, one processing device may process data, while another processing device obtains the image to be projected based on the processed data, generates the image to be projected, and projects it onto the windshield via an optical engine. Alternatively, the same processor may perform both data processing and image generation. For example, the vehicle's processor processes the image and then displays it on the in-vehicle display screen.

[0006] In a first aspect, embodiments of this application provide a display method, the method comprising: acquiring environmental information corresponding to a vehicle; the environmental information including light intensity information and / or location information; adjusting the display mode of the vehicle's display device according to the environmental information; the display mode including at least one of display brightness, display position, display content, display color, display style, or display size.

[0007] The display device can be an in-vehicle display, such as a central control display or an entertainment screen, or a head-up display, such as a HUD or an AR HUD device.

[0008] By acquiring environmental information about the vehicle and adjusting the display mode accordingly, the system adapts its display to the current environment, improving display quality and driving safety. When significant changes occur in the vehicle's environment, such as entering a tunnel or encountering substantial obstructions that alter the driver's view of ambient light, the display mode is adjusted to ensure the driver's vision remains unaffected, thus ensuring driving safety. For example, when entering a tunnel, the display brightness is reduced to prevent excessive brightness from impacting driving safety. When exiting a tunnel, the display brightness is increased so the driver can clearly see navigation and other information, ensuring driving safety. Furthermore, when entering a tunnel, the display mode is switched to night mode, and when exiting, it is switched to daytime mode to ensure driver safety. Additionally, when entering a tunnel, icons and information are moved further away from the driver's line of sight, hidden, or their transparency and color / brightness are reduced to minimize eye strain. The icons and information can also be restored when the vehicle exits the tunnel.

[0009] According to the first aspect, in a first possible implementation of the first aspect, the location information includes the position of the vehicle and / or the position of the area where ambient light is blocked in the direction of the vehicle's travel; adjusting the display mode of the vehicle's display device according to the environmental information includes: adjusting the display mode of the vehicle's display device according to the position of the vehicle and / or the position of the area where ambient light is blocked in the direction of the vehicle's travel.

[0010] As one example, the vehicle's location can be obtained to determine its environment, and the display mode of the vehicle's display device can be adjusted based on the environment, such as a tunnel, under an overpass, on a highway, or on a flat road. As another example, the location of the area where ambient light is obstructed in the vehicle's direction of travel can be obtained, and the display mode of the vehicle's display device can be adjusted based on this location. As yet another example, both the vehicle's location and the location of the area where ambient light is obstructed in the vehicle's direction of travel can be obtained, thereby adjusting the display mode of the vehicle's display device. For instance, based on the vehicle's location and the location of the tunnel, the display mode of the vehicle's display device can be adjusted as the vehicle is about to enter the tunnel.

[0011] According to the first aspect, in a second possible implementation of the first aspect, the location information includes the position of the vehicle and / or the position of the area where ambient light is blocked in the direction of travel of the vehicle; adjusting the display mode of the vehicle's display device according to the environmental information includes: determining a first distance between the vehicle and the area where ambient light is blocked according to the position of the vehicle and / or the position of the area where ambient light is blocked; and adjusting the display mode of the display device according to the first distance.

[0012] Based on the above technical solution, when a vehicle is about to enter an area where ambient light is obscured, the display mode of the display device is pre-adjusted according to the distance between the vehicle and the area where ambient light is obscured. This effectively solves the problem of adjustment lag, thereby ensuring that when the vehicle enters an area where ambient light is obscured, the display mode of the display device can better adapt to the area where ambient light is obscured, without interfering with the driver's vision. This effectively reduces the impact of changes in ambient light intensity on the driver's or passengers' vision, improves the user experience, and ensures driving safety.

[0013] According to the first aspect or various possible implementations of the first aspect, in a third possible implementation of the first aspect, the display mode includes a first display brightness; the light intensity information includes: the intensity of ambient light received by the optical element of the display device and / or the intensity of ambient light corresponding to the imaging position of the display device; adjusting the display mode of the vehicle's display device according to the environmental information further includes: adjusting the first display brightness of the display device according to the intensity of ambient light received by the optical element of the display device and / or the intensity of ambient light corresponding to the imaging position of the display device; wherein, the first display brightness is positively correlated with the intensity of ambient light received by the optical element of the display device and positively correlated with the intensity of ambient light corresponding to the imaging position of the display device.

[0014] Based on the above technical solution, considering that ambient light incident on the optical elements of the display device is reflected by the optical elements and enters the driver's or passenger's eyes along the optical path of the display device, thus affecting the driver's or passenger's perception of the display device, and that ambient light corresponding to the imaging position of the display device also affects the driver's or passenger's vision, this solution comprehensively considers the impact of ambient light from multiple sources on the driver's or passenger's perception of the display device. It fuses the intensity of ambient light received by the optical elements of the display device and the intensity of ambient light corresponding to the imaging area of ​​the display device, thereby accurately reproducing the true light intensity of the image observed by the driver or passenger. The display brightness of the display device is automatically adjusted based on the intensity of the fused ambient light, resulting in a brightness that better matches the true perception of the human eye and meets the requirement for clear display. This effectively solves the problem of drivers or passengers not being able to see the image of the display device when only considering a single source of ambient light, improving driving safety. Furthermore, it eliminates the need for manual operation by the driver or passenger, enhancing the user experience and demonstrating strong practicality.

[0015] According to the first aspect or various possible implementations of the first aspect, in a fourth possible implementation of the first aspect, the light intensity information further includes the intensity of ambient light corresponding to at least one imaging area of ​​the display device, and the display mode includes a display position; adjusting the display mode of the vehicle's display device according to the environmental information further includes: determining a target imaging area according to the intensity of ambient light corresponding to at least one imaging area of ​​the display device; and adjusting the display position of the display device according to the target imaging area.

[0016] Based on the above technical solution, the display position of the display device is dynamically adjusted according to the intensity of the ambient light corresponding to at least one imaging area of ​​the display device, thereby ensuring that the driver can clearly see the content presented by the display device and avoiding the impact of excessively high or low ambient light intensity on the driver's vision, thus greatly improving driving safety.

[0017] According to the various possible implementations of the first aspect above, in the fifth possible implementation of the first aspect, adjusting the display mode of the display device according to the first distance further includes: adjusting the display mode of the display device when the first distance is less than a preset distance.

[0018] Based on the above technical solution, when the distance between the vehicle and the area where ambient light is blocked is less than a preset distance, it indicates that the vehicle is about to enter the area where ambient light is blocked. At this time, the display mode of the display device is pre-adjusted so that the display mode is adapted to the area where ambient light is blocked when the vehicle arrives, effectively avoiding the impact of adjustment lag on the driver's or passenger's vision and greatly improving driving safety.

[0019] According to the various possible implementations of the first aspect above, in the sixth possible implementation of the first aspect, the display mode includes a second display brightness; the step of adjusting the display mode of the display device according to the first distance further includes: adjusting the second display brightness according to the first distance, wherein the second display brightness is negatively correlated with the first distance.

[0020] Based on the above technical solution, as the vehicle is about to enter the area where the ambient light is blocked, the display brightness is weighted and corrected according to the first distance between the vehicle and the area where the ambient light is blocked. As the vehicle approaches the area where the ambient light is blocked, the display brightness is continuously adjusted, so that the display brightness gradually decreases and transitions smoothly, and the display brightness adjustment is completed before the vehicle reaches the area where the ambient light is blocked.

[0021] According to the various possible implementations of the first aspect described above, in the seventh possible implementation of the first aspect, the display device includes a head-up display (HUD), and the light intensity information includes: the intensity of ambient light received by the optical element of the HUD optical engine; the acquisition of environmental information corresponding to the vehicle includes: acquiring the incident angle of the ambient light received at the light outlet of the HUD optical engine, the exit angle of the HUD emitted light, and the intensity of the ambient light received at the light outlet of the HUD optical engine; determining the intensity of the ambient light received by the optical element of the HUD optical engine based on the incident angle, the exit angle, and the intensity of the ambient light received at the light outlet; wherein the intensity of the ambient light received by the optical element of the HUD optical engine is positively correlated with the intensity of the ambient light received at the light outlet and negatively correlated with the difference between the incident angle and the exit angle.

[0022] Based on the above technical solution, since the incident angle of ambient light and the intensity of ambient light at the output port of the HUD optical engine will affect the intensity of ambient light reaching the optical elements of the HUD optical engine, the intensity of ambient light received by the optical elements of the HUD optical engine can be determined more accurately based on the deviation between the incident angle of ambient light and the output angle corresponding to the HUD output light and the intensity of ambient light received at the output port of the HUD optical engine.

[0023] According to the various possible implementations of the first aspect described above, in the eighth possible implementation of the first aspect, the display device includes a HUD, and the light intensity information includes: the intensity of ambient light received by the optical element of the HUD optical engine; the acquisition of environmental information corresponding to the vehicle further includes: determining a first angle between the ambient light and the horizontal plane, a second angle between the projection of the ambient light on the horizontal plane and the direction of travel of the vehicle; determining a third angle between the HUD emitted light and the horizontal plane, a fourth angle between the projection of the HUD emitted light on the horizontal plane and the direction of travel of the vehicle; determining a first difference between the first angle and the third angle, and a second difference between the second angle and the fourth angle; determining the intensity of ambient light received by the optical element of the HUD optical engine based on the first difference, the second difference, and the intensity of ambient light received at the light output port of the HUD optical engine; wherein the intensity of ambient light received by the optical element of the HUD optical engine is positively correlated with the intensity of ambient light received at the light output port of the HUD optical engine, negatively correlated with the first difference, and negatively correlated with the second difference.

[0024] Based on the above technical solution, the deviation of the angle between the ambient light and the horizontal plane relative to the angle between the HUD emitted light and the horizontal plane, the deviation of the angle between the projection of the ambient light on the horizontal plane and the vehicle's direction of travel relative to the angle between the projection of the HUD emitted light on the horizontal plane and the vehicle's direction of travel, and the intensity of the ambient light at the output port of the HUD optical engine will affect the intensity of the ambient light reaching the optical elements of the HUD optical engine. Therefore, based on the deviation of the angle between the ambient light and the horizontal plane relative to the angle between the HUD emitted light and the horizontal plane, the deviation of the angle between the projection of the ambient light on the horizontal plane and the vehicle's direction of travel relative to the angle between the projection of the HUD emitted light on the horizontal plane and the vehicle's direction of travel, and the intensity of the ambient light received at the output port of the HUD optical engine, the intensity of the ambient light received by the optical elements of the HUD optical engine can be determined more accurately.

[0025] According to the various possible implementations of the first aspect described above, in the ninth possible implementation of the first aspect, the step of obtaining the environmental information corresponding to the vehicle further includes: obtaining image information in front of the vehicle and the position of the human eye; and determining the intensity of the ambient light corresponding to at least one imaging area of ​​the display device based on the image information and the position of the human eye.

[0026] Based on the above technical solution, the intensity of ambient light corresponding to each imaging area of ​​the display device can be accurately determined according to the image information in front of the vehicle and the position of the human eye. In some examples, the image in front of the vehicle may include the ground background corresponding to at least one imaging area of ​​the display device, and the image information in front of the vehicle may include the grayscale value of each pixel in the image in front of the vehicle; the intensity of ambient light corresponding to the imaging area may include the grayscale value of the imaging area; thus, the ground background corresponding to each imaging area can be accurately determined according to the position of the human eye, and the grayscale value corresponding to each imaging area in the display device can be obtained using the grayscale value of each pixel in the image in front of the vehicle, thereby achieving accurate determination of the grayscale value corresponding to each imaging area of ​​the display device.

[0027] According to the various possible implementations of the first aspect described above, in the tenth possible implementation of the first aspect, the ambient light includes direct sunlight and / or sunlight reflected by a reflective object.

[0028] In some examples, both direct sunlight and sunlight reflected by reflective objects may enter the HUD optical engine. After reaching the optical elements in the HUD optical engine, the light is reflected by the optical elements and projected onto the windshield through the optical engine port along the reflected light path, and finally enters the driver's eyes. In this way, by taking into account the impact of ambient light from multiple sources on the driver's or passenger's perception of the HUD virtual image surface, the effect of adjusting the brightness of the HUD virtual image surface can be further improved by determining the intensity of direct sunlight received by the optical elements of the HUD optical engine and the intensity of sunlight reflected by reflective objects.

[0029] According to the various possible implementations of the first aspect described above, in the eleventh possible implementation of the first aspect, the method further includes: obtaining the distance between a marker point corresponding to the ambient light occluded area and the ambient light occluded area, wherein the marker point is located outside the ambient light occluded area; adjusting the display mode of the display device according to the first distance includes: adjusting the display mode of the display device according to the first distance, the preset distance, and the distance between the marker point and the ambient light occluded area.

[0030] Based on the above technical solution, the display mode of the display device is pre-adjusted according to the first distance, the preset distance, and the distance between the marker point and the area where the ambient light is blocked. This allows the display mode to be adjusted before the vehicle enters the area where the ambient light is blocked, and the adjusted display mode can better adapt to the area where the ambient light is blocked, thereby further improving driving safety.

[0031] Secondly, embodiments of this application provide an electronic device, including: an acquisition module for acquiring environmental information corresponding to a vehicle; the environmental information including light intensity information and / or location information; and an adjustment module for adjusting the display mode of the vehicle's display device according to the environmental information; the display mode including at least one of display brightness, display position, display content, display color, display style, or display size.

[0032] Based on the above technical solution, the environmental information corresponding to the vehicle is obtained, and the display mode of the display device is adjusted according to the environmental information, so that the display mode of the display device can adapt to the current environment, thereby improving the display effect and driving safety.

[0033] According to the second aspect, in a first possible implementation of the second aspect, the location information includes the position of the vehicle and / or the position of the area where ambient light is blocked in the direction of travel of the vehicle; the adjustment module is further configured to: adjust the display mode of the vehicle's display device according to the position of the vehicle and / or the position of the area where ambient light is blocked in the direction of travel of the vehicle.

[0034] According to the second aspect, in a second possible implementation of the second aspect, the location information includes the position of the vehicle and / or the position of the ambient light-blocked area in the direction of the vehicle's travel; the adjustment module is further configured to: determine a first distance between the vehicle and the ambient light-blocked area based on the position of the vehicle and / or the position of the ambient light-blocked area; and adjust the display mode of the display device based on the first distance.

[0035] Based on the above technical solution, when a vehicle is about to enter an area where ambient light is obscured, the display mode of the display device is pre-adjusted according to the distance between the vehicle and the area where ambient light is obscured. This effectively solves the problem of adjustment lag, thereby ensuring that when the vehicle enters an area where ambient light is obscured, the display mode of the display device can better adapt to the area where ambient light is obscured, without interfering with the driver's vision. This effectively reduces the impact of changes in ambient light intensity on the driver's or passengers' vision, improves the user experience, and ensures driving safety.

[0036] According to the second aspect or various possible implementations of the second aspect, in a third possible implementation of the second aspect, the display method includes a first display brightness; the light intensity information includes: the intensity of ambient light received by the optical element of the display device and / or the intensity of ambient light corresponding to the imaging position of the display device; the adjustment module is further configured to: adjust the first display brightness of the display device according to the intensity of ambient light received by the optical element of the display device and / or the intensity of ambient light corresponding to the imaging position of the display device; wherein, the first display brightness is positively correlated with the intensity of ambient light received by the optical element of the display device and positively correlated with the intensity of ambient light corresponding to the imaging position of the display device.

[0037] Based on the above technical solution, considering that ambient light incident on the optical elements of the display device is reflected by the optical elements and enters the driver's or passenger's eyes along the optical path of the display device, thus affecting the driver's or passenger's perception of the display device, and that ambient light corresponding to the imaging position of the display device also affects the driver's or passenger's vision, this solution comprehensively considers the impact of ambient light from multiple sources on the driver's or passenger's perception of the display device. It fuses the intensity of ambient light received by the optical elements of the display device and the intensity of ambient light corresponding to the imaging area of ​​the display device, thereby accurately reproducing the true light intensity of the image observed by the driver or passenger. The display brightness of the display device is automatically adjusted based on the intensity of the fused ambient light, resulting in a brightness that better matches the true perception of the human eye and meets the requirement for clear display. This effectively solves the problem of drivers or passengers not being able to see the image of the display device when only considering a single source of ambient light, improving driving safety. Furthermore, it eliminates the need for manual operation by the driver or passenger, enhancing the user experience and demonstrating strong practicality.

[0038] According to the second aspect or various possible implementations of the second aspect above, in the fourth possible implementation of the second aspect, the light intensity information further includes the intensity of ambient light corresponding to at least one imaging area of ​​the display device, and the display mode includes a display position; the adjustment module is further configured to: determine a target imaging area according to the intensity of ambient light corresponding to at least one imaging area of ​​the display device; and adjust the display position of the display device according to the target imaging area.

[0039] Based on the above technical solution, the display position of the display device is dynamically adjusted according to the intensity of the ambient light corresponding to at least one imaging area of ​​the display device, thereby ensuring that the driver can clearly see the content presented by the display device and avoiding the impact of excessively high or low ambient light intensity on the driver's vision, thus greatly improving driving safety.

[0040] According to the various possible implementations of the second aspect above, in the fifth possible implementation of the second aspect, the adjustment module is further configured to: adjust the display mode of the display device when the first distance is less than a preset distance.

[0041] Based on the above technical solution, when the distance between the vehicle and the area where ambient light is blocked is less than a preset distance, it indicates that the vehicle is about to enter the area where ambient light is blocked. At this time, the display mode of the display device is pre-adjusted so that the display mode is adapted to the area where ambient light is blocked when the vehicle arrives, effectively avoiding the impact of adjustment lag on the driver's or passenger's vision and greatly improving driving safety.

[0042] According to the various possible implementations of the second aspect above, in the sixth possible implementation of the second aspect, the display method includes a second display brightness; the adjustment module is further configured to: adjust the second display brightness according to the first distance, wherein the second display brightness is negatively correlated with the first distance.

[0043] Based on the above technical solution, as the vehicle is about to enter the area where the ambient light is blocked, the display brightness is weighted and corrected according to the first distance between the vehicle and the area where the ambient light is blocked. As the vehicle approaches the area where the ambient light is blocked, the display brightness is continuously adjusted, so that the display brightness gradually decreases and transitions smoothly, and the display brightness adjustment is completed before the vehicle reaches the area where the ambient light is blocked.

[0044] According to the various possible implementations of the second aspect described above, in the seventh possible implementation of the second aspect, the display device includes a head-up display (HUD), and the light intensity information includes: the intensity of ambient light received by the optical element of the HUD optical engine; the acquisition module is further configured to: acquire the incident angle corresponding to the ambient light received at the light outlet of the HUD optical engine, the exit angle corresponding to the HUD emitted light, and the intensity of the ambient light received at the light outlet of the HUD optical engine; determine the intensity of the ambient light received by the optical element of the HUD optical engine based on the incident angle, the exit angle, and the intensity of the ambient light received at the light outlet; wherein the intensity of the ambient light received by the optical element of the HUD optical engine is positively correlated with the intensity of the ambient light received at the light outlet and negatively correlated with the difference between the incident angle and the exit angle.

[0045] Based on the above technical solution, since the incident angle of ambient light and the intensity of ambient light at the output port of the HUD optical engine will affect the intensity of ambient light reaching the optical elements of the HUD optical engine, the intensity of ambient light received by the optical elements of the HUD optical engine can be determined more accurately based on the deviation between the incident angle of ambient light and the output angle corresponding to the HUD output light and the intensity of ambient light received at the output port of the HUD optical engine.

[0046] According to the various possible implementations of the second aspect described above, in the eighth possible implementation of the second aspect, the display device includes a HUD, and the light intensity information includes: the intensity of ambient light received by the optical element of the HUD optical engine; the acquisition module is further configured to: determine a first angle between the ambient light and the horizontal plane, a second angle between the projection of the ambient light on the horizontal plane and the direction of travel of the vehicle; determine a third angle between the HUD emitted light and the horizontal plane, a fourth angle between the projection of the HUD emitted light on the horizontal plane and the direction of travel of the vehicle; determine a first difference between the first angle and the third angle, and a second difference between the second angle and the fourth angle; determine the intensity of ambient light received by the optical element of the HUD optical engine based on the first difference, the second difference, and the intensity of ambient light received at the light output port of the HUD optical engine; wherein the intensity of ambient light received by the optical element of the HUD optical engine is positively correlated with the intensity of ambient light received at the light output port of the HUD optical engine, negatively correlated with the first difference, and negatively correlated with the second difference.

[0047] Based on the above technical solution, the deviation of the angle between the ambient light and the horizontal plane relative to the angle between the HUD emitted light and the horizontal plane, the deviation of the angle between the projection of the ambient light on the horizontal plane and the vehicle's direction of travel relative to the angle between the projection of the HUD emitted light on the horizontal plane and the vehicle's direction of travel, and the intensity of the ambient light at the output port of the HUD optical engine will affect the intensity of the ambient light reaching the optical elements of the HUD optical engine. Therefore, based on the deviation of the angle between the ambient light and the horizontal plane relative to the angle between the HUD emitted light and the horizontal plane, the deviation of the angle between the projection of the ambient light on the horizontal plane and the vehicle's direction of travel relative to the angle between the projection of the HUD emitted light on the horizontal plane and the vehicle's direction of travel, and the intensity of the ambient light received at the output port of the HUD optical engine, the intensity of the ambient light received by the optical elements of the HUD optical engine can be determined more accurately.

[0048] According to the various possible implementations of the second aspect above, in the ninth possible implementation of the second aspect, the acquisition module is further configured to: acquire image information of the front of the vehicle and the position of the human eye; and determine the intensity of ambient light corresponding to at least one imaging area of ​​the display device based on the image information and the position of the human eye.

[0049] In some examples, the image in front of the vehicle may include the ground background corresponding to at least one imaging area of ​​the display device, and the image information in front of the vehicle may include the grayscale value of each pixel in the image in front of the vehicle; the intensity of the ambient light corresponding to the imaging area may include the grayscale value of the imaging area; in this way, the ground background corresponding to each imaging area can be accurately determined according to the position of the human eye, and the grayscale value of each imaging area in the display device can be obtained by using the grayscale value of each pixel in the image in front of the vehicle, thereby achieving accurate determination of the intensity of the ambient light corresponding to each imaging area of ​​the display device.

[0050] According to the various possible implementations of the second aspect described above, in the tenth possible implementation of the second aspect, the ambient light includes direct sunlight and / or sunlight reflected by reflective objects.

[0051] In some examples, both direct sunlight and sunlight reflected by reflective objects may enter the HUD optical engine. After reaching the optical elements in the HUD optical engine, the light is reflected by the optical elements and projected onto the windshield through the optical engine port along the reflected light path, and finally enters the driver's eyes. In this way, by taking into account the impact of ambient light from multiple sources on the driver's or passenger's perception of the HUD virtual image surface, the effect of adjusting the brightness of the HUD virtual image surface can be further improved by determining the intensity of direct sunlight received by the optical elements of the HUD optical engine and the intensity of sunlight reflected by reflective objects.

[0052] According to the various possible implementations of the second aspect above, in the eleventh possible implementation of the second aspect, the acquisition module is further configured to: acquire the distance between the marker point corresponding to the ambient light occluded area and the ambient light occluded area, wherein the marker point is located outside the ambient light occluded area; the adjustment module is further configured to: adjust the display mode of the display device according to the first distance, the preset distance and the distance between the marker point and the ambient light occluded area.

[0053] Based on the above technical solution, the display mode of the display device is pre-adjusted according to the first distance, the preset distance, and the distance between the marker point and the area where the ambient light is blocked. This allows the display mode to be adjusted before the vehicle enters the area where the ambient light is blocked, and the adjusted display mode can better adapt to the area where the ambient light is blocked, thereby further improving driving safety.

[0054] Thirdly, embodiments of this application provide an electronic device, including: a processor; and a memory for storing processor-executable instructions; wherein the processor is configured to execute the instructions to implement the technical solutions provided by the first aspect or any possible implementation thereof.

[0055] Fourthly, an electronic device provided in this application includes: a storage unit for storing program instructions; and a processing unit for executing the program instructions in the storage unit to implement the technical solution provided in the first aspect or any possible implementation thereof.

[0056] Fifthly, embodiments of this application provide a display system, including: a display device; a data acquisition device for acquiring environmental information; and an electronic device as provided in any of the second to fourth aspects or any possible implementation thereof.

[0057] As an example, the display system can be a vehicle, a display system consisting of an in-vehicle infotainment system and display devices, or a display device with a processor and a display. For example, the display device can be a device with display capabilities in an in-vehicle component such as a HUD, AR-HUD, or display, and the acquisition device can be a sensing device with acquisition or measurement functions.

[0058] Sixthly, embodiments of this application provide a computer-readable storage medium storing program code that, when executed by an electronic device or a processor in an electronic device, implements the technical solution provided in the first aspect or any possible implementation thereof.

[0059] In a seventh aspect, embodiments of this application provide a computer program product, wherein the program code contained in the computer program product, when executed by an electronic device or a processor in an electronic device, implements the technical solution provided in the first aspect or any possible implementation thereof.

[0060] It should be understood that the technical effects and implementation details of the technical solutions provided by the second to seventh aspects and any corresponding possible implementation methods can be referred to the technical effects and implementation details of the technical solutions provided by the first aspect, and will not be repeated here. Attached Figure Description

[0061] The accompanying drawings, which are included in and form part of this specification, illustrate exemplary embodiments, features, and aspects of this application together with the specification and are used to explain the principles of this application, but do not limit the scope of the embodiments of this application.

[0062] Figure 1 This diagram illustrates a structural schematic of a vehicle cabin according to an embodiment of the present application.

[0063] Figures 2-4 This diagram illustrates an application scenario according to an embodiment of the present application.

[0064] Figure 5A flowchart illustrating a display method according to an embodiment of this application is shown.

[0065] Figure 6 A schematic diagram illustrating the adjustment of display size according to an embodiment of this application is shown.

[0066] Figure 7 A schematic diagram showing an area where ambient light is blocked according to an embodiment of this application is illustrated.

[0067] Figure 8 A flowchart illustrating a display method according to an embodiment of this application is shown.

[0068] Figure 9 A schematic diagram showing the marker points corresponding to the area where ambient light is blocked according to an embodiment of this application.

[0069] Figure 10 A flowchart illustrating a display method according to an embodiment of this application is shown. Figure 11 A schematic diagram illustrating the ambient light sources affecting the brightness of a HUD display according to an embodiment of this application is shown.

[0070] Figure 12 A flowchart illustrating a display method according to an embodiment of this application is shown.

[0071] Figure 13 A schematic diagram showing the incident angle and exit angle at the output port of a HUD optical engine according to an embodiment of this application is provided.

[0072] Figure 14 A schematic diagram showing direct sunlight rays and HUD emitted rays according to an embodiment of this application is provided.

[0073] Figure 15 A schematic diagram showing the relative position of direct sunlight and the Earth according to an embodiment of this application.

[0074] Figure 16 This diagram illustrates the angle between the projection of direct sunlight onto a horizontal plane and the meridian EF, according to an embodiment of this application.

[0075] Figure 17 A schematic diagram showing sunlight rays reflected by a reflective object and light rays emitted from a HUD according to an embodiment of this application is shown.

[0076] Figure 18 A schematic diagram of a plurality of imaging regions in the virtual image plane of a HUD according to an embodiment of the present application is shown.

[0077] Figure 19 A schematic diagram showing the ground background corresponding to the virtual image plane of a vehicle-side outward-facing HUD according to an embodiment of this application.

[0078] Figure 20 This is a schematic diagram showing the ground background corresponding to the virtual image surface of the HUD in the forward view from inside the vehicle according to an embodiment of this application.

[0079] Figure 21 A flowchart illustrating a display method according to an embodiment of this application is shown.

[0080] Figure 22 The grayscale images of each imaging region in the virtual image plane of a HUD according to an embodiment of this application are shown.

[0081] Figure 23 This diagram illustrates the adjustment of the display position in the virtual image plane of a HUD according to an embodiment of this application.

[0082] Figure 24 This diagram illustrates the structure of an electronic device according to an embodiment of the present application.

[0083] Figure 25 A schematic diagram of the structure of an electronic device according to an embodiment of this application is shown.

[0084] Figure 26 A schematic diagram of the structure of a display system according to an embodiment of this application is shown.

[0085] Figure 27 This is a structural diagram of an automobile cabin provided in an embodiment of this application.

[0086] Figures 28-29 A schematic diagram illustrating an application scenario of the projection method provided in an embodiment of this application is shown.

[0087] Figure 30 A flowchart of a display method provided in an embodiment of this application is shown.

[0088] Figure 31 This is a schematic diagram of the light source for an AR-HUD.

[0089] Figure 32 This application provides a system architecture for its embodiments.

[0090] Figure 33 This describes the detailed data flow between each module.

[0091] Figure 34 This is a flowchart illustrating a display method provided in an embodiment of this application.

[0092] Figure 35 A schematic diagram showing the angle between sunlight and a vehicle is provided.

[0093] Figure 36 It is an abstract diagram of the relationship between sunlight and the Earth.

[0094] Figure 37This is a schematic diagram showing the angle between the sunlight projection and the meridian.

[0095] Figure 38 This is a schematic diagram showing the angle between the reflected light and the vehicle.

[0096] Figure 39 Flowchart for special road sections. Detailed Implementation

[0097] Various exemplary embodiments, features, and aspects of this application will now be described in detail with reference to the accompanying drawings. The same reference numerals in the drawings denote elements that have the same or similar functions. Although various aspects of the embodiments are shown in the drawings, they are not necessarily drawn to scale unless specifically indicated otherwise.

[0098] References to "one embodiment" or "some embodiments" as described in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0099] In this application, "at least one" means one or more, and "more than one" means two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can mean: A alone, A and B simultaneously, and B alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can mean: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or multiple.

[0100] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0101] The term “exemplary” as used herein means “serving as an example, embodiment, or illustration.” Any embodiment illustrated herein as “exemplary” is not necessarily to be construed as superior to or better than other embodiments.

[0102] Furthermore, to better illustrate this application, numerous specific details are provided in the following detailed embodiments. Those skilled in the art should understand that this application can be implemented even without certain specific details.

[0103] Figure 1 This diagram illustrates a structural schematic of a vehicle cabin according to an embodiment of this application. Inside the vehicle cabin, an automobile head unit (OTU), also known as an in-vehicle entertainment system, can be located in the central control area of ​​the vehicle, and the screen connected to it can also be called a central control display screen. With the gradual expansion of digital displays within the cabin, some vehicles have multiple displays, or a single large screen that can be split, used to display digital instrument clusters, in-vehicle entertainment systems, related information, and other content. Figure 1 As shown, the cockpit features multiple displays, including a digital instrument cluster display 101, a central control screen 102, an entertainment display 103 in front of the front passenger, and entertainment displays 104 and 105 in front of the rear passengers. To achieve different visual functions within the cockpit, multiple independent cameras 106 can be installed in various locations, such as the A-pillar, B-pillar, steering column, central control area, rearview mirror area, and steering wheel area. Furthermore, the cockpit can also include one or more projection-enabled display devices, such as a head-up display (HUD), augmented reality head-up display (AR-HUD), or other types of projectors. A HUD is a display device that projects images into the driver's or passenger's field of vision. HUDs can utilize the principle of optical reflection to project important relevant information as a two-dimensional image onto the vehicle's windshield or a separately displayed transparent screen, such as... Figure 1 As shown, the image can be projected onto the windshield 100 at approximately eye level with the driver or passenger. When the driver or passenger looks forward through the windshield 100, they can see the two-dimensional image projected by the HUD displayed on a virtual image surface in front of the windshield 100. Compared to traditional instrument panels and central control screens, the driver or passenger does not need to look down when viewing the HUD image, avoiding the need to switch back and forth between the image and the road surface, reducing reaction time in emergencies, and improving driving safety. Furthermore, AR-HUD can integrate the HUD's displayed image with real road information, enhancing the driver's or passenger's understanding of road conditions and enabling functions such as virtual reality (AR) navigation and AR warnings. Figures 2-4This diagram illustrates an application scenario according to an embodiment of the present application, with reference to... Figures 2-4 The application scenario of this embodiment may involve a vehicle, which has a data acquisition device 10, a display device 20, and a display device 30.

[0104] For example, the acquisition device 10 may include an external acquisition device and an internal acquisition device. The external acquisition device may be a sensing device with acquisition or measurement functions, such as a lidar, infrared sensor, brightness sensor, vehicle camera, digital video recorder (DVR), or other device or combination of devices with image acquisition, optical scanning, or light intensity detection functions. The external acquisition device may be installed on the top, front, or side of the rearview mirror of the vehicle 1 facing outwards. It may be installed inside or outside the vehicle. The external acquisition device is mainly used to detect and acquire environmental information in front of the vehicle 1. The environment in front of the vehicle 1 may include one or more of the following: road surface, vehicles, obstacles, road signs (such as tunnel, overpass, elevated road signs), ambient light, etc. For example, the position information of the environment in front of the vehicle 1 can be detected by lidar, and the light intensity information of the environment in front of the vehicle 1 can be acquired by a brightness sensor. Image information of the environment in front of the vehicle 1 can also be acquired by a vehicle camera or DVR. The in-vehicle data collection device can specifically employ equipment such as in-vehicle cameras and eye detectors. During implementation, the installation location of the in-vehicle data collection device can be set according to requirements. For example, it can be installed on the A-pillar or B-pillar of the vehicle cabin, or on the side of the rearview mirror facing the driver or passenger. It can also be installed near the steering wheel, center console, or above the display screen behind the seat. Its main purpose is to detect and collect the eye position information of the driver or passengers in the vehicle cabin. There can be one or multiple in-vehicle data collection devices; this application embodiment does not limit their installation location, quantity, or type.

[0105] For example, the display device 20 can be a HUD, AR-HUD, or other device with projection capabilities. It can be installed above or inside the center console of the vehicle cabin. It typically includes one or more of a projector, reflector, projection lens, adjustment motor, and control unit. The control unit is an electronic device, specifically a conventional chip processor such as a Central Processing Unit (CPU) or Microcontroller Unit (MCU), or terminal hardware such as a mobile phone or tablet. This control unit can communicate with the acquisition device 10. The control unit can have a preset imaging model or acquire a preset imaging model from other vehicle components. The parameters of this imaging model are related to the human eye position information acquired by the in-vehicle acquisition device. It can perform parameter calibration based on the human eye position information, and then generate a projected image based on the environmental information acquired by the external acquisition device, which is then output to the projector. Figure 3 As shown, the projected image can include augmented reality images generated based on environmental information, as well as images of vehicle speed, navigation, etc. It can also include prompts, vehicle status information, such as battery level.

[0106] For example, the imaging device 30 can be the windshield of a vehicle or a transparent screen with independent display, used to reflect the image light emitted by the display device 20 into the eyes of the driver or passenger, so that when the driver or passenger looks out of the vehicle through the imaging device 30, they can see a virtual image with a depth effect, which overlaps with the real world environment, presenting an augmented reality display effect to the driver or passenger.

[0107] For example, the data acquisition device 10, the display device 20, and other devices can communicate data via wired or wireless communication (such as Bluetooth or Wi-Fi). For instance, after acquiring environmental information, the data acquisition device 10 can transmit this information to the display device 20 via Bluetooth. As another example, the display device 20 can send control signals to the data acquisition device 10 via Bluetooth and adjust the acquisition parameters of the data acquisition device 10, such as the shooting angle. It should be understood that data processing can be completed in the display device 20, the data acquisition device 10, or other processing devices, such as vehicle infotainment systems or in-vehicle computers.

[0108] Through the above structure, such as Figure 4 As shown, the vehicle can achieve augmented reality display effects based on real-world environmental information, and can adjust the generated projected image according to the eye position information of the driver or passenger, so that the projected augmented reality display image is as close as possible to the real-world environmental information, thereby improving the immersive viewing experience of the driver or passenger.

[0109] This application provides a display method (detailed description below). The display method of this application embodiment can obtain environmental information corresponding to the vehicle and adjust the display mode of the display device according to the environmental information. The method can be executed by one or more devices, so that the display mode of the display device can adapt to the current environment, improve the display effect and driving safety.

[0110] This application does not limit the type of device used to execute the display method. For example, the device executing the display method can be the vehicle 1 described above, or other components in vehicle 1 with data processing capabilities, such as: an in-vehicle terminal, in-vehicle controller, in-vehicle module, in-vehicle assembly, in-vehicle component, in-vehicle chip, in-vehicle unit, or in-vehicle sensor. Vehicle 1 can execute the display method through the in-vehicle terminal, in-vehicle controller, in-vehicle module, in-vehicle assembly, in-vehicle component, in-vehicle chip, in-vehicle unit, or in-vehicle sensor. For example, the device executing the display method can also be other intelligent terminals with data processing capabilities besides vehicle 1, or components or chips disposed in intelligent terminals; wherein, the intelligent terminal can be a general-purpose device or a dedicated device; in specific implementations, the intelligent terminal can include a desktop computer, portable computer, network server, handheld computer (personal digital assistant, PDA), mobile phone, tablet computer, wireless terminal device, embedded device, or other devices with data processing capabilities. For example, the device executing the display method can also be a chip or processor with processing capabilities, and the device executing the display method can include multiple processors. The processor can be a single-core (single-CPU) processor or a multi-core (multi-CPU) processor.

[0111] As an example, the apparatus for performing the display method may include one or more of a display device, a processing device, or a control device; exemplaryly, the processing device and the control device may be devices such as processors and controllers. The display device, processing device, and control device may be separately configured or integrated into the same device. The display device may be a device with display capabilities in an in-vehicle component such as a HUD, AR-HUD, or display; for example, the display device may be one of the aforementioned... Figure 3 The display device 20; the processing unit can be used to acquire and process environmental information, for example, the processing unit can be the aforementioned Figure 3 The display device 20 or the acquisition device 10 can also be a vehicle-mounted system, vehicle computer, or other similar equipment; the control device can also be used to control the display mode of the display device, for example, the control device can be one of the aforementioned... Figure 3 Display device 20.

[0112] It should be noted that the application scenarios described in the embodiments of this application are for the purpose of more clearly illustrating the technical solutions of the embodiments of this application, and do not constitute a limitation on the technical solutions provided by the embodiments of this application. Those skilled in the art will know that the technical solutions provided by the embodiments of this application are also applicable to similar technical problems in the face of other similar or new display scenarios.

[0113] The display method provided in the embodiments of this application will be described in detail below.

[0114] Figure 5 A flowchart of a display method according to an embodiment of this application is shown, such as... Figure 5 As shown, the following steps may be included:

[0115] Step 501: Obtain the environmental information corresponding to the vehicle; wherein, the environmental information may include light intensity information and / or location information.

[0116] As an example, light intensity information may include one or more of the following: the display brightness of the display device, the intensity of ambient light corresponding to the imaging area of ​​the display device, the intensity of ambient light received by the optical elements of the display device, and the intensity of ambient light corresponding to the imaging position of the display device. For example, if the display device is a HUD, the light intensity information may include one or more of the following: the intensity of the emitted light from the HUD optical engine, the intensity of ambient light received by the optical elements of the HUD optical engine, and the intensity of ambient light corresponding to the virtual image surface of the HUD. As another example, light intensity information may include the intensity of ambient light corresponding to at least one imaging area of ​​the display device; for example, it may include the intensity of ambient light corresponding to each imaging area in the virtual image surface of the HUD. Exemplarily, the light intensity information may be information directly acquired by a brightness sensor, or information processed by a brightness sensor or other device.

[0117] For example, the display device can be an in-vehicle display screen, such as the one described above. Figure 1 The display includes a digital instrument cluster display 101, a central control screen 102, a display screen 103, a display screen 104, or a display screen 105; the display device can also be a HUD, an AR-HUD, or other devices with projection capabilities, for example, the aforementioned... Figure 3 The display device 20 can also be used for vehicle ambient lighting, such as ambient lighting installed on the steering wheel, center console, footwell lights, cup holders, roof, welcome lights, door sills, trunk, or headlights.

[0118] For example, ambient light may include direct sunlight and / or sunlight reflected by a reflective object; wherein the reflective object may include the ground, a building with glass walls, etc.

[0119] As an example, location information can include the vehicle's location and the location of the environment in front of the vehicle. For example, the vehicle's location can include the vehicle's positioning location, such as Global Positioning System (GPS), latitude and longitude information, etc. The vehicle's location can also include the current scene in which the vehicle is located, such as a tunnel, under an overpass, on a highway, or on a flat road. For example, the location of the environment in front of the vehicle can include one or more of the following: the location of the area where ambient light is blocked in the direction of the vehicle's travel, the location of the corresponding landmark in the area where ambient light is blocked, the location of reflective objects, etc. For example, the area where ambient light is blocked can include one or more of the following: overpass, tunnel, or overpass. The location of the area where ambient light is blocked, such as the overpass, tunnel, or overpass, marked on the navigation map or perceived in real time by the vehicle's sensors, or the location of the corresponding landmark in the area where ambient light is blocked, as well as the location of buildings with glass walls installed within a certain range in front of the vehicle, can be obtained.

[0120] For example, in some scenarios, time information can also be obtained, which may include one or more of the following: the current time, the current season, the estimated arrival time of the destination, the estimated arrival time of the area where ambient light is blocked, and the estimated arrival time of the corresponding landmark in the area where ambient light is blocked.

[0121] Step 502: Adjust the display mode of the vehicle's display device according to the environmental information; wherein the display mode may include at least one of the following: display brightness, display position, display content, display color, display style, or display size.

[0122] As an example, the display brightness of the display device can be adjusted based on environmental information. For instance, during vehicle operation, if there is a sudden change in ambient light intensity or if such a change is predicted, the vehicle's display brightness can be adjusted. For example, if the vehicle's position and the tunnel's location, or the estimated arrival time in the tunnel, indicate that the vehicle will be entering a tunnel, the display brightness can be pre-adjusted to adapt to the dimmer lighting inside the tunnel. For example, when it is determined that sunlight is affecting the driver's or passengers' vision, causing them to have difficulty seeing the road ahead or to see glare, the display brightness can be adjusted. For instance, if both the intensity of sunlight received by the display device's optical elements and the intensity of sunlight at the display device's imaging position are high, the display brightness can be increased.

[0123] As another example, the display position of the display device can be adjusted based on environmental information. For instance, the display position can be adjusted from an imaging area where the ambient light intensity is too strong or too weak to an imaging area where the ambient light intensity will not interfere with the driver's or passenger's vision, based on the ambient light intensity corresponding to multiple imaging areas of the display device. For example, when there is strong sunlight at the current display position, the display position can be adjusted to an imaging area with less sunlight exposure based on the sunlight intensity corresponding to each imaging area.

[0124] As another example, the display content of the display device can be adjusted based on environmental information. Exemplarily, the display content may include one or more of the following: instrument panel information, road condition information (such as pedestrian, vehicle, and obstacle information), road information (such as speed limit information, traffic light status information), navigation information, entertainment information, or prompts. For instance, when a vehicle is driving on a road with high ambient light intensity, the display content can be adjusted to be more abundant; conversely, when the vehicle enters a tunnel or other road section with low ambient light intensity, the light is dimmer, and the driver needs to concentrate more, so the display content can be adjusted to be less dense to avoid driver distraction and ensure driving safety, or the display content can be adjusted to provide prompts to remind the driver to drive carefully.

[0125] As another example, the display colors of the display device can be adjusted based on environmental information. For instance, when a vehicle is about to enter a tunnel, the color of the ambient lighting inside the vehicle can be pre-adjusted, for example, by adjusting the ambient lighting color to a dimmer color.

[0126] As another example, the display style of the display device can be adjusted according to environmental information. For example, the display style may include one or more of the following: minimalist style, rich style, etc. The minimalist style corresponds to less and simpler display content and icons. When driving on roads with low ambient light intensity, the display style can be adjusted to the minimalist style.

[0127] As another example, the display size of the display device can be adjusted based on environmental information; for instance, the display size may include one or more of the images, icons, text, etc., displayed on the display device; for example, when a vehicle enters a tunnel, the light dims, and the displayed images, icons, text, etc., can be reduced in size to minimize obstruction of the driver's view. Figure 6 This diagram illustrates adjusting the display size according to an embodiment of the present application, as shown below. Figure 6 As shown, before the vehicle enters the tunnel, the display shows images, icons, and text, such as... Figure 6 As shown in (a), when the vehicle enters the tunnel, the images, icons, and text displayed on the monitor should be reduced in size, such as... Figure 6As shown in (b), this reduces the impact on the driver's line of sight; for example, when the vehicle exits the tunnel, the images, icons, and text displayed on the monitor can be adjusted to their original size, for example, from... Figure 6 (b) The size of the images, icons, and text shown in (b) is adjusted to... Figure 6 (a) shows the size of the images, icons, and text.

[0128] In this embodiment, environmental information corresponding to the vehicle is obtained, and the display mode of the display device is adjusted according to the environmental information, so that the display mode of the display device can adapt to the current environment, effectively reducing the impact of changes in environmental information perceived by the driver or passengers on the visual experience, and improving the display effect and driving safety.

[0129] The following example illustrates the display method provided in this application embodiment, using the location information including the vehicle's position and / or the position of the area where ambient light is blocked in the vehicle's direction of travel.

[0130] When a vehicle moves from an area with unobstructed ambient light to an area with obstructed ambient light, the intensity of the ambient light changes abruptly. Display devices in areas with unobstructed ambient light may not adapt well to areas with obstructed ambient light and require adjustment. For example, consider a head-up display (HUD). Figure 7 A schematic diagram of an area where ambient light is blocked, according to an embodiment of this application, is shown. Figure 7 As shown, when a vehicle enters a tunnel during the day, the light intensity changes abruptly. Compared to the ambient light outside the tunnel, the intensity of the ambient light inside the tunnel suddenly decreases, requiring adjustment of the HUD's display brightness. Since vehicle speeds are typically high, the distance between the HUD's virtual image surface and the front of the vehicle is generally within 10 meters. The time between detecting a decrease in light intensity near the virtual image surface and the HUD interfering with the driver's vision is very short. If the brightness of the HUD's virtual image surface is adjusted manually by the driver or passengers or when a decrease in light intensity is detected near the virtual image surface, it cannot be guaranteed that the HUD display brightness adjustment will be completed before the vehicle enters the tunnel. This adjustment lag results in the brighter virtual image surface obstructing the driver's vision after the vehicle enters the tunnel, increasing the driving hazard.

[0131] Figure 8 This diagram illustrates a flowchart of a display method according to an embodiment of this application. The display method can be applied to a processing device, which may include a processor, a processing chip, a display device, an in-vehicle device with processing capabilities, and a vehicle. The processor or processing chip may be located in the display device or the in-vehicle device, and may communicate with the display device or the in-vehicle device via wired or wireless means, for example, a processor in a head-up display (HUD) or a processor in a vehicle infotainment system. Figure 8 As shown, the following steps may be included:

[0132] Step 701: Obtain the vehicle's location and / or the location of the area where ambient light is blocked in the vehicle's direction of travel.

[0133] For example, data such as the vehicle's position and attitude can be acquired from the vehicle positioning system. The vehicle positioning system may include one or more of the following: Global Positioning System, BeiDou Navigation Satellite System or other positioning systems, inertial measurement unit (IMU), etc.

[0134] The area where ambient light is blocked in the direction of vehicle travel can include the area where ambient light is blocked in the direction the vehicle is about to enter; for example, the area where ambient light is blocked can include one or more areas that block ambient light, such as tunnels, overpasses, and elevated roads. Figure 7 In tunnels, for example, the location of areas where ambient light is obscured can be pre-determined based on the vehicle's location and navigation maps, such as high-precision maps or standard-precision maps; or based on the estimated arrival time and predictions of the road or road conditions to be traversed. For instance, if a tunnel is in front of the vehicle, the location of the tunnel entrance can be obtained using the vehicle's location and navigation map. Alternatively, an in-vehicle image acquisition device can be used to acquire images of the area in front of the vehicle to determine the area where ambient light is obscured. For example, a camera installed in front of the vehicle can photograph road signs, and existing image recognition algorithms, such as neural networks, can be used to identify the tunnel sign and the location of the tunnel entrance indicated by the road signs.

[0135] Step 702: Determine the first distance between the vehicle and the area where ambient light is blocked based on the vehicle's position and / or the position of the area where ambient light is blocked in the vehicle's direction of travel.

[0136] Understandably, as the vehicle moves forward, the initial distance between the vehicle and the area where the ambient light is blocked changes continuously. For example, during the vehicle's journey, when the vehicle is about to enter the area where the ambient light is blocked, the vehicle's position and the position of the area where the ambient light is blocked can be periodically acquired, thereby periodically determining the initial distance between the vehicle and the area where the ambient light is blocked.

[0137] For example, positioning data and navigation data can be acquired periodically. The navigation data may include the location of areas where ambient light is obscured, thereby periodically determining a first distance between the vehicle and these obscured areas. To avoid the low frequency of determining the first distance due to the typically low frame rate of the positioning and navigation data, frame interpolation can be performed on the first distance. For instance, the vehicle's acceleration (such as linear and angular acceleration) and current speed, collected in real-time by the IMU, can be acquired, and the vehicle's acceleration can be used to interpolate frames for the first distance, thereby achieving a higher frequency (above 60 Hz) for determining the first distance and meeting real-time requirements. For example, frame interpolation can be performed on the first distance if it is less than a preset distance.

[0138] For example, suppose that at the current time t, the distance between the vehicle and the area where ambient light is blocked, determined based on navigation data, is S. t Then, the distance S between the vehicle and the obscured area at time t+1, obtained after IMU data compensation, is... t+1 for:

[0139]

[0140] Where a is the vehicle's acceleration at time t, and v t Let t be the speed of the vehicle at time t.

[0141] Step 703: Adjust the display mode of the display device according to the first distance.

[0142] In this embodiment, when the vehicle is about to enter an area where ambient light is blocked, the display mode of the display device is pre-adjusted according to the distance between the vehicle and the area where ambient light is blocked. This effectively solves the problem of adjustment lag, thereby ensuring that when the vehicle enters an area where ambient light is blocked, the display mode of the display device can better adapt to the area where ambient light is blocked, without interfering with the driver's vision. This effectively reduces the impact of changes in ambient light intensity on the driver's or passengers' vision, improves the user experience, and ensures driving safety.

[0143] In one possible implementation, when the first distance is less than a preset distance, the display mode of the display device is adjusted. The preset distance can be set according to needs and is not limited thereto. Thus, when the distance between the vehicle and the area where ambient light is blocked is less than the preset distance, indicating that the vehicle is about to enter the area, the display mode of the display device is pre-adjusted so that when the vehicle arrives at the area where ambient light is blocked, the display mode adapts to the area, effectively avoiding adjustment lag that could affect the driver's or passengers' vision, and greatly improving driving safety.

[0144] In one possible implementation, the distance between a marker point corresponding to the area where ambient light is blocked and the area where ambient light is blocked can be obtained. Then, based on a first distance, a preset distance, and the distance between the marker point and the area where ambient light is blocked, the display mode of the display device can be adjusted. The marker point is located outside the area where ambient light is blocked. Figure 9 A schematic diagram showing the marker points corresponding to the area where ambient light is blocked according to an embodiment of this application is illustrated, such as... Figure 9 As shown, the marker can be pre-set at a certain distance from the area where ambient light is obscured before the vehicle enters it. For example, a first difference between the first distance and the distance between the marker and the area where ambient light is obscured, and a second difference between the preset distance and the distance between the marker and the area where ambient light is obscured, can be calculated. The display mode of the display device can then be adjusted according to the ratio of the first difference to the second difference; the larger the ratio, the more suitable the corresponding display mode is for the area where ambient light is obscured. Thus, by pre-adjusting the display mode of the display device based on the first distance, the preset distance, and the distance between the marker and the area where ambient light is obscured, the display mode adjustment can be completed before the vehicle enters the area where ambient light is obscured. The adjusted display mode can better adapt to the area where ambient light is obscured, further improving driving safety.

[0145] The optional methods for adjusting the display mode in this step can be referred to the relevant description in step 502 above. As an example, the display brightness of the display device can be adjusted based on a first distance; for example, the display brightness of the display device can be adjusted based on the first distance, a preset distance, and the distance between the marker point and the area where ambient light is blocked. The display brightness of the display device is negatively correlated with the first distance. That is, the smaller the distance between the vehicle and the area where ambient light is blocked, the lower the display brightness. Thus, as the vehicle is about to enter the area where ambient light is blocked, the display brightness is weighted and corrected based on the first distance between the vehicle and the area where ambient light is blocked. As the vehicle approaches the area where ambient light is blocked, the display brightness is continuously adjusted, resulting in a gradual decrease in display brightness, a smooth transition, and ensuring that the display brightness adjustment is completed before the vehicle reaches the area where ambient light is blocked.

[0146] For example, taking a HUD as the display device, the display brightness of the HUD virtual image surface can be adjusted according to the distance between the vehicle and the area where ambient light is blocked, using the following formula (2):

[0147] L = L N +(L M -L w )*q t …………………………..(2)

[0148] Where L represents the display brightness of the HUD at time t; LN L represents the target display brightness of the HUD corresponding to the marker point. N The value can be set according to requirements; L M This indicates the brightness of the HUD before adjustment; for example, it could be the brightness of the HUD when there is a preset distance between the vehicle and an area where ambient light is blocked. t S represents the distance S between the vehicle and the area where ambient light is blocked at time t. t The corresponding weighting factor.

[0149] For example, the weighting factor q t It can be shown in the following formula (3):

[0150]

[0151] Among them, S M This indicates the preset distance, which is the initial distance between the vehicle and the area where ambient light is blocked; S N This indicates the distance between the marker and the obscured area, i.e., the distance between the vehicle and the area where ambient light is obscured when the adjustment is complete; S t This represents the distance between the vehicle and the area where ambient light is blocked at the current time t.

[0152] From the above formulas (2) and (3), it can be seen that when the vehicle is S away from the area where the ambient light is blocked... M At that time, i.e., S t =S M When, the corresponding weighting factor q t If the value is 1, then L = L M That is, the HUD's display brightness L remains at the original brightness; as the vehicle continues to move towards the area where the ambient light is blocked, the distance between the vehicle and the area where the ambient light is blocked gradually decreases, i.e., S. t Gradually decrease, corresponding to the weighting factor q t As the distance decreases, the corresponding HUD display brightness L gradually decreases; until the distance between the vehicle and the area where the ambient light is blocked is S. N At that time, i.e., S t =S N When, the corresponding weighting factor q t When L is 0, the corresponding L = L N This means that the HUD's display brightness L is adjusted to the brightness of the HUD corresponding to the marker point, thus completing the pre-adjustment of the display brightness. In this way, when the vehicle is at a distance S from the area where ambient light is blocked... N When the vehicle arrives at the marker, the display brightness has already been pre-adjusted to ensure that the HUD display brightness will not obstruct the driver's view when the vehicle enters an area where ambient light is blocked, thus ensuring driving safety.

[0153] The following example illustrates the display method provided in this application embodiment, using the location information including: the position of the vehicle or the position of the area where ambient light is blocked in the direction of the vehicle's travel. Figure 10 A flowchart illustrating a display method according to an embodiment of this application is shown, such as... Figure 10 As shown, it includes:

[0154] Step 901: Obtain the vehicle's location and / or the location of the area where ambient light is blocked in the vehicle's direction of travel.

[0155] The specific details regarding the vehicle's location and the location of the area where ambient light is blocked can be found in step 701 above, and will not be repeated here.

[0156] Step 902: Adjust the display mode of the vehicle's display device according to the vehicle's position and / or the position of the area where ambient light is blocked in the vehicle's direction of travel.

[0157] In this way, when the vehicle's environmental information changes significantly, such as when the vehicle enters a tunnel or encounters a large obstruction, causing a significant change in the ambient light seen by the driver, the display mode can be adjusted to ensure that the driver's vision is not affected and to ensure driving safety.

[0158] As an example, the system can obtain the vehicle's location and determine its environment. Based on this environment—such as a tunnel, under an overpass, on a highway, or on a flat road—the system can adjust the display settings of the vehicle's devices. For instance, when driving in a tunnel where lighting is dim, the display brightness can be reduced to prevent excessive brightness from affecting driving safety. When driving on a highway with good visibility and ample external light, the display brightness can be increased so the driver can clearly see information such as navigation systems, ensuring driving safety.

[0159] As another example, the location of the area where ambient light is obstructed in the direction of vehicle travel can be obtained. Based on this location, the display mode of the vehicle's display devices can be adjusted. For instance, when a tunnel is present in the direction of vehicle travel, the ambient light seen by the driver changes significantly. In this case, adjusting the display mode ensures that the driver's vision is not affected, thus ensuring driving safety. For example, when the vehicle enters a tunnel, the display brightness can be reduced to prevent the display from being too bright and affecting driving safety. When the vehicle exits a tunnel, the display brightness can be increased so that the driver can clearly see information such as in-vehicle navigation, ensuring driving safety. Another example is that when the vehicle enters a tunnel, the display mode can be adjusted to night mode, and when it exits a tunnel, the display mode can be adjusted to day mode to ensure driver safety. For example, when the vehicle enters a tunnel, display icons and information can be moved to areas further away from the driver's line of sight, or displayed altogether, or the transparency of the display can be increased, or the color and brightness of the display can be reduced to minimize the impact on the driver's eyes. The icons and information can also be restored when the vehicle exits the tunnel.

[0160] As another example, the vehicle's position and the location of areas where ambient light is blocked in the vehicle's direction of travel can be obtained, thereby adjusting the display mode of the vehicle's display device. For instance, based on the vehicle's position and the location of a tunnel in the direction of travel, the display mode of the vehicle's display device can be adjusted as the vehicle is about to enter the tunnel. For example, the brightness of the vehicle's display can be reduced to prevent the display device from being too bright and affecting driving safety.

[0161] The following example illustrates the display method provided in this application, using the display mode including display brightness and light intensity information including the intensity of ambient light received by the optical elements of the display device and / or the intensity of ambient light corresponding to the imaging position of the display device.

[0162] During vehicle operation, the intensity of ambient light constantly changes. These changes affect the driver's or passengers' perception of the display device and driving safety. To ensure driving safety, the display brightness of the device needs to be adaptively adjusted. Ambient light sources that affect the driver's or passengers' perception of the display device are numerous. For example, taking a HUD (Head-Up Display) as an example... Figure 11 A schematic diagram illustrating the ambient light sources affecting the brightness of a HUD display according to an embodiment of this application is shown; as follows: Figure 11As shown, when a driver views the HUD virtual image, ambient light reflected from the road surface corresponding to the HUD virtual image will enter the driver's eyes, affecting the driver's perception of the HUD virtual image and potentially causing the driver to not be able to see the HUD virtual image clearly. In addition, since the working principle of the HUD optical engine is to use multiple mirrors to form a reflected light path to project the outgoing light through the optical engine port onto the windshield, and then reflect it into the driver's eyes, if ambient light enters the optical engine along this reflected light path, after reaching the aforementioned mirrors, it will be reflected by the mirrors and projected onto the windshield through the optical engine port along the reflected light path, and then reflected into the driver's eyes. This will also affect the driver's perception of the HUD virtual image, causing the driver to not be able to see the HUD virtual image clearly. In related technologies, only the influence of ambient light near the HUD virtual image surface on the driver's perception of the HUD virtual image surface is considered. The display brightness of the HUD virtual image surface is adjusted according to the intensity of ambient light near the HUD virtual image surface. The intensity of ambient light from a single source may deviate from the light intensity of the HUD virtual image surface observed by the driver. The adjusted display brightness may not meet the clear display requirements, and the driver needs to manually adjust the display brightness, which is cumbersome and increases the driving danger.

[0163] Figure 12 A flowchart illustrating a display method according to an embodiment of this application is shown, such as... Figure 12 As shown, the following steps may be included:

[0164] Step 1001: Obtain the intensity of ambient light received by the optical elements of the vehicle's display device and / or the intensity of ambient light corresponding to the imaging position of the display device.

[0165] In one possible implementation, when the first distance between the vehicle and the ambient light blocking area is greater than or equal to a preset distance, the intensity of ambient light received by the optical element of the vehicle's display device and / or the intensity of ambient light corresponding to the imaging position of the display device can be obtained; for example, the intensity of ambient light received by the optical element of the display device and / or the intensity of ambient light corresponding to the imaging position of the display device can be obtained by the brightness sensor.

[0166] For example, the intensity E of the ambient light corresponding to the imaging position of the display device can be obtained. d Alternatively, the intensity E of ambient light received by the optical elements of the display device can be obtained. s Alternatively, the intensity of the ambient light corresponding to the imaging position of the display device and the intensity of the ambient light received by the optical elements of the display device can be obtained, i.e., the fused light intensity E can be obtained, where E = E d +E s .

[0167] For example, taking a head-up display (HUD) as an example, the intensity of ambient light received by the HUD's optical elements and the intensity of ambient light corresponding to the location of the HUD's virtual image surface can be obtained, and then the fused light intensity can be obtained. For instance, the intensity of ambient light at the HUD's virtual image surface collected by a brightness sensor installed in front of the vehicle can be obtained; the intensity of ambient light received by the HUD's optical elements can also be determined using the following exemplary methods.

[0168] Method 1 involves obtaining the incident angle of the ambient light received at the output port of the HUD optical engine, the exit angle of the emitted light from the HUD, and the intensity of the ambient light received at the output port of the HUD optical engine. Based on the incident angle, the exit angle, and the intensity of the ambient light received at the output port, the intensity of the ambient light received by the optical elements of the HUD optical engine is determined. The intensity of the ambient light received by the optical elements of the HUD optical engine is positively correlated with the intensity of the ambient light received at the output port and negatively correlated with the difference between the incident angle and the exit angle.

[0169] Since the incident angle of ambient light and the intensity of ambient light at the output port of the HUD optical engine affect the intensity of ambient light reaching the optical elements of the HUD optical engine, the intensity of ambient light received by the optical elements of the HUD optical engine can be more accurately determined by the deviation between the incident angle of ambient light and the corresponding output angle of the HUD output light and the intensity of ambient light received at the output port of the HUD optical engine.

[0170] For example, the incident angle of ambient light collected by the light angle sensor installed at the light output port of the HUD optical engine, and the corresponding emission angle of the emitted light from the HUD can be obtained; in addition, the emission angle corresponding to the emitted light from the HUD can also be pre-calibrated. For example, the intensity of ambient light received at the light output port of the HUD optical engine can be obtained by the brightness sensor.

[0171] Figure 13 A schematic diagram showing the incident angle and exit angle at the output port of a HUD optical engine according to an embodiment of this application is shown, as follows: Figure 13As shown, θ1 is the incident angle of the ambient light received at the output port of the HUD optical engine, and θ2 is the exit angle of the HUD output light. The smaller the difference between the incident angle θ1 and the exit angle θ2, the closer the ambient light entering the HUD optical engine is to being parallel to the HUD output light. Accordingly, with the intensity of the ambient light received at the output port of the HUD optical engine remaining constant, the intensity of the ambient light received by the optical elements of the HUD optical engine is higher. Conversely, the larger the difference between the incident angle θ1 and the exit angle θ2, the lower the intensity of the ambient light received by the optical elements of the HUD optical engine. Furthermore, with the difference between the incident angle θ1 and the exit angle θ2 remaining constant, the higher the intensity of the ambient light received at the output port of the HUD optical engine, the higher the intensity of the ambient light received by the optical elements of the HUD optical engine.

[0172] For example, ambient light may include direct sunlight and sunlight reflected off reflective objects. As described above. Figure 11 As shown, both direct sunlight and sunlight reflected from highly reflective buildings near the vehicle can enter the HUD optical engine. After reaching the optical elements in the HUD optical engine, the light is reflected by the optical elements and projected onto the windshield through the optical engine port along the reflected light path, eventually entering the driver's eyes. In this way, by comprehensively considering the impact of ambient light from multiple sources on the driver's or passenger's perception of the HUD virtual image surface, the effect of adjusting the brightness of the HUD virtual image surface can be further improved by determining the intensity of direct sunlight received by the optical elements of the HUD optical engine and the intensity of sunlight reflected from reflective objects.

[0173] Method 2: Determine the first angle between the ambient light and the horizontal plane, and the second angle between the projection of the ambient light onto the horizontal plane and the vehicle's direction of travel; determine the third angle between the HUD's emitted light and the horizontal plane, and the fourth angle between the projection of the HUD's emitted light onto the horizontal plane and the vehicle's direction of travel; determine the first difference between the first and third angles, and the second difference between the second and fourth angles; based on the first and second differences and the intensity of the ambient light received at the HUD optical engine's output port, determine the intensity of the ambient light received by the optical elements of the HUD optical engine; wherein, the intensity of the ambient light received by the optical elements of the HUD optical engine is positively correlated with the intensity of the ambient light received at the HUD optical engine's output port, negatively correlated with the first difference, and negatively correlated with the second difference.

[0174] Because the angle between the ambient light and the horizontal plane is different from the angle between the HUD emitted light and the horizontal plane, the angle between the projection of the ambient light on the horizontal plane and the vehicle's direction of travel is different from the angle between the projection of the HUD emitted light on the horizontal plane and the vehicle's direction of travel, and the intensity of the ambient light at the output port of the HUD optical engine, the intensity of the ambient light reaching the optical elements of the HUD optical engine will be affected. Therefore, based on the deviation of the angle between the ambient light and the horizontal plane relative to the angle between the HUD emitted light and the horizontal plane, the deviation of the angle between the projection of the ambient light on the horizontal plane and the vehicle's direction of travel, and the intensity of the ambient light received at the output port of the HUD optical engine, the intensity of the ambient light received by the optical elements of the HUD optical engine can be determined more accurately.

[0175] For example, vehicle attitude data collected by the vehicle positioning system can be acquired to determine the vehicle's direction of travel; the intensity of ambient light received at the output port of the HUD optical engine can be acquired by the brightness sensor.

[0176] As an example, let's take direct sunlight as the ambient light. Figure 14 A schematic diagram showing direct sunlight rays and HUD emitted rays according to an embodiment of this application is shown, as follows. Figure 14 As shown, this is the driver's forward-facing view from inside the vehicle, where θ s θ is the angle between the direct sunlight and the horizontal plane, i.e., the solar altitude angle at the current moment. s Let θ' be the angle between the projection of the direct sunlight onto the horizontal plane at the current moment and the direction of the vehicle's travel. h The angle θ between the HUD's outgoing ray and the horizontal plane. h θ h Let θ' be the angle between the projection of the HUD's emitted light rays onto the horizontal plane and the vehicle's direction of travel. It can be understood that at θ... s ′ and θ h Assuming the difference between θ′ and the intensity of direct sunlight received at the output port of the HUD optical engine remain constant, θ′ s With θ h The smaller the difference between θ and θ, the closer the sunlight directly entering the HUD optical engine is to parallel with the light rays emitted from the HUD. Correspondingly, the intensity of the direct sunlight received by the optical elements of the HUD optical engine is higher; conversely, the larger the difference, the lower the intensity. s With θ h The larger the difference between θ and θ, the lower the intensity of direct sunlight received by the optical elements of the HUD optical engine; similarly, at θ... s With θ h Assuming the difference in intensity and the intensity of direct sunlight received at the output port of the HUD optical engine remain constant, the intensity of direct sunlight received by the optical elements of the HUD optical engine varies with θ. s′ and θ h The difference between ′ and θ decreases, thus enhancing the effect; furthermore, at θ s With θ h The difference and θ s ′ and θ h If the difference between the two values ​​remains constant, the higher the intensity of direct sunlight received at the output port of the HUD optical engine, the higher the intensity of direct sunlight received by the optical elements of the HUD optical engine.

[0177] For example, the intensity E1′ of direct sunlight received by the optical elements of the HUD optical engine can be calculated using the following formula (4):

[0178]

[0179] Where k and w represent the light contraction intensity in the horizontal and vertical dimensions, respectively; for example, both k and w can be 1; E1 is the intensity of direct sunlight received at the output port of the HUD optical engine; θ s Let θ be the solar altitude angle at the current moment. s θ' is the angle between the projection of the direct sunlight onto the horizontal plane at the current moment and the direction of the vehicle's travel; h Let θ be the angle between the HUD's outgoing ray and the horizontal plane. h ′ is the angle between the projection of the HUD's emitted light rays onto the horizontal plane and the vehicle's direction of travel.

[0180] For example, the angle θ between the pre-calibrated HUD outgoing ray and the horizontal plane can be obtained. h and the angle θ between the projection of the HUD's emitted light rays onto the horizontal plane and the vehicle's direction of travel. h ′. For example, refer to Figure 15 and Figure 16 The solar altitude angle θ at the current moment can be calculated in the following way (5). s and the angle θ between the projection of the direct sunlight onto the horizontal plane at the current moment and the vehicle's direction of travel. s ′. Figure 15 A schematic diagram showing the relative position of direct sunlight and the Earth according to an embodiment of this application is provided. Figure 16 This diagram illustrates the angle between the projection of direct sunlight onto a horizontal plane and the meridian EF, according to an embodiment of this application. Figure 15 As shown, point O is the center of the Earth. Assuming the vehicle is currently traveling at point A, EF is the meridian passing through point A, h is the hour angle in the equatorial coordinate system, which is the angle between the meridian where point A is located and the right ascension; δ is the declination of the sun at the current moment, which is the angle between the point where the sun is directly overhead and the equator. It is the angle between the latitude of the vehicle's current location and the equator.

[0181] For example, the solar altitude angle θ can be calculated using the following formula (5). s :

[0182]

[0183] Where h is the hour angle in the equatorial coordinate system; δ is the declination of the sun's rays at the current moment; It is the angle between the latitude of the vehicle's current location and the equator. h, δ, The specific value can be determined based on information such as time and vehicle location.

[0184] For example, the angle between the projection of direct sunlight onto the horizontal plane and the north or south direction can be calculated first, and then the angle between the vehicle's direction of travel and the north or south direction can be calculated. For instance, the angle between the projection of direct sunlight onto the horizontal plane and the meridian corresponding to the vehicle's location (where the positive direction of the meridian can be assumed to be north) and the angle between the vehicle's direction of travel and the meridian corresponding to the vehicle's location can be calculated, thereby obtaining the angle θ between the projection of direct sunlight onto the horizontal plane and the vehicle's direction of travel. s Since sunlight shining on Earth can be considered as parallel light, such as... Figure 15 As shown, point B is the intersection of the line connecting the Sun and the Earth's center with the Earth's surface. The direct sunlight passing through point A is parallel to OB and intersects plane OAB, meaning the direct sunlight passing through point A lies on plane OAB. Therefore, the angle between the projection of the direct sunlight onto the horizontal plane and the meridian can be calculated, as follows: Figure 16 As shown, the angle θ between the projection of the direct sunlight passing through point A onto the horizontal plane and the meridian EF can be calculated. N That is, to find the angle between plane OAB and plane OEF.

[0185] For example, in the above Figure 15 In the middle, as On plane OEF, and Perpendicular to do If the vector is perpendicular to plane OAB, then... As shown in the following formula (6):

[0186]

[0187] Where h is the hour angle in the equatorial coordinate system; δ is the declination of the sun's rays at the current moment; It is the angle between the latitude of the vehicle's current location and the equator.

[0188] because Perpendicular to plane OAB, then It can be by and The cross product is obtained as shown in the following formula (7):

[0189]

[0190] Where h is the hour angle in the equatorial coordinate system; δ is the declination of the sun's rays at the current moment; It is the angle between the latitude of the vehicle's current location and the equator.

[0191] Because the angle θ between the projection of the direct sunlight passing through point A onto the horizontal plane and the meridian EF... N Since θ is complementary to ∠COD, it can be calculated using the following formula (8). N :

[0192]

[0193] in, For vectors The model, For vectors The model.

[0194] Therefore, the angle between the vehicle's heading angle and the meridian EF can be determined; furthermore, the angle θ between the projection of the direct sunlight passing through point A onto the horizontal plane and the meridian EF can be used. N Given the angle between the vehicle's direction of travel and the meridian EF, determine the angle θ between the projection of the direct sunlight onto the horizontal plane at the current moment and the vehicle's direction of travel. s ′.

[0195] As another example, consider ambient light as sunlight reflected by reflective objects; Figure 17 A schematic diagram showing sunlight rays reflected by a reflective object and HUD emitted light rays according to an embodiment of this application is shown, as follows. Figure 17 As shown, this is the driver's forward-facing view from inside the vehicle, where θ r Let θ be the angle between sunlight reflected from a reflective object and the horizontal plane. r θ' is the angle between the projection of sunlight reflected off the reflective object onto the horizontal plane and the direction of the vehicle's travel. s θ is the angle between the direct sunlight and the horizontal plane, i.e., the solar altitude angle at the current moment. s Let θ' be the angle between the projection of the direct sunlight onto the horizontal plane at the current moment and the direction of the vehicle's travel. h The angle θ between the HUD's outgoing ray and the horizontal plane. h θ h Let θ' be the angle between the projection of the HUD's emitted light rays onto the horizontal plane and the vehicle's direction of travel. It can be understood that at θ... r ′ and θ hAssuming the difference between θ and the intensity of sunlight reflected by reflective objects received at the output port of the HUD optical engine remain constant, θ r With θ h The smaller the difference between θ and θ, the closer the sunlight reflected from the reflective object into the HUD optical engine is to parallel with the light emitted from the HUD. Correspondingly, the intensity of the sunlight reflected from the reflective object received by the optical elements of the HUD optical engine is higher; conversely, the larger the difference, the lower the intensity. r With θ h The larger the difference, the lower the intensity of sunlight reflected from the reflective object received by the optical elements of the HUD optical engine; similarly, at θ r With θ h Assuming the difference in intensity and the intensity of sunlight reflected from the reflective object received at the output port of the HUD optical engine remain constant, the intensity of sunlight reflected from the reflective object received by the optical elements of the HUD optical engine varies with θ. r ′ and θ h The difference between ′ and θ decreases, thus enhancing the effect; furthermore, at θ r With θ h The difference and θ r ′ and θ h If the difference between the two values ​​remains constant, the higher the intensity of sunlight reflected by the reflective object received at the output port of the HUD optical engine, the higher the intensity of sunlight reflected by the reflective object received by the optical elements of the HUD optical engine.

[0196] For example, the angle θ between the pre-calibrated HUD outgoing ray and the horizontal plane can be obtained. h and the angle θ between the projection of the HUD's emitted light rays onto the horizontal plane and the vehicle's direction of travel. h For example, the angle θ between the sunlight reflected by the reflective object and the horizontal plane at the current moment can be calculated by the following method (9) and formula (10). r and the angle θ between the projection of sunlight reflected by the reflective object onto the horizontal plane at the current moment and the vehicle's direction of travel. r ′.

[0197] Since the reflective surface of a reflective object is perpendicular to the ground, the angle θ between the sunlight reflected by the reflective object and the horizontal plane is... r It can be represented as:

[0198] θ r =θ s ………………………………………..(9)

[0199] Where, θ s Let θ be the solar altitude angle at the current moment. s The value can be obtained by formula (5) above.

[0200] For example, the angle between the projection of sunlight reflected from the reflective object onto the horizontal plane and the north or south direction can be calculated first, and then the angle between the vehicle's direction of travel and the north or south direction can be calculated. For instance, the angle between the projection of sunlight reflected from the reflective object and the meridian corresponding to the vehicle's location, and the angle between the vehicle's direction of travel and the meridian corresponding to the vehicle's location, can be calculated to obtain the angle θ between the projection of sunlight reflected from the reflective object onto the horizontal plane and the vehicle's direction of travel. r Assume that at the current moment, the set of angles Θ = {θ_n} between the reflective surfaces of n reflective objects near the vehicle and the meridian is obtained from the navigation data. i} i＝1:n θ can be obtained by referring to the formulas (6)-(8) above. N The method is to calculate the angle θ between the reflective surface of the i-th reflective object and the meridian. i Then the angle θ′ between the projection of sunlight reflected by the i-th reflective object onto the horizontal plane and the vehicle's direction of travel is... ri It can be represented as:

[0201] θ′ ri =(2θ) i -θ′ s )mod2π………………………..(10)

[0202] Where, θ i Let θ be the angle between the reflective surface of the i-th reflective object and the meridian, where mod represents the remainder. s ′ is the angle between the projection of the direct sunlight onto the horizontal plane at the current moment and the direction of the vehicle's travel.

[0203] For example, the intensity E1″ of sunlight reflected by a reflective object and received by the optical elements of the HUD optical engine can be calculated using the following formula (11):

[0204]

[0205] Where k and w represent the light contraction intensity in the horizontal and vertical dimensions, respectively; for example, both k and w can be 1; n is the number of reflective objects, and θ i Let θ be the angle between the reflective surface of the i-th reflective object and the meridian; E1 is the intensity of sunlight received at the output port of the HUD optical engine; θ r θ is the angle between the sunlight reflected from the reflective object and the horizontal plane at the current moment. h Let θ be the angle between the HUD's outgoing ray and the horizontal plane. h Let θ' be the angle between the projection of the HUD's emitted light rays onto the horizontal plane and the vehicle's direction of travel. s ′ is the angle between the projection of the direct sunlight onto the horizontal plane at the current moment and the direction of the vehicle's travel.

[0206] As another example, taking the ambient light as direct sunlight and sunlight reflected by a reflective object, we can refer to the above example to calculate the intensity E1′ of the direct sunlight received by the optical element of the HUD optical engine and the intensity E1″ of the sunlight reflected by the reflective object received by the optical element of the HUD optical engine. The combined intensity E of the sunlight received by the optical element of the HUD optical engine can be obtained by the following formula (12). s :

[0207]

[0208] Where E1′ is the intensity of direct sunlight received by the optical element of the HUD optical engine, E1″ is the intensity of sunlight reflected by reflective objects received by the optical element of the HUD optical engine, k and w represent the light contraction intensity in the horizontal and vertical dimensions, respectively, and for example, both k and w can be 1; n is the number of reflective objects, θ i Let θ be the angle between the reflective surface of the i-th reflective object and due north; E1 is the intensity of sunlight received at the output port of the HUD optical engine; θ r θ is the angle between the sunlight reflected from the reflective object at the current moment and the horizontal plane. h Let θ be the angle between the HUD's outgoing ray and the horizontal plane. h Let θ' be the angle between the projection of the HUD's emitted light rays onto the horizontal plane and the vehicle's direction of travel. s Let θ be the solar altitude angle at the current moment. s ′ is the angle between the projection of the direct sunlight onto the horizontal plane at the current moment and the direction of the vehicle's travel.

[0209] Step 1002: Adjust the display brightness of the display device according to the intensity of ambient light received by the optical elements of the display device and / or the intensity of ambient light corresponding to the imaging position of the display device. The display brightness of the display device is positively correlated with the intensity of ambient light received by the optical elements of the display device and with the intensity of ambient light corresponding to the imaging position of the display device.

[0210] For example, the display brightness of the display device can be adjusted based on the intensity of ambient light received by the optical elements of the display device and the intensity of ambient light corresponding to the imaging position of the display device. It is understood that the higher the intensity of ambient light received by the optical elements of the display device, or the higher the intensity of ambient light corresponding to the imaging position of the display device, the stronger the interference of ambient light on the driver's viewing of the display device image; accordingly, the display brightness of the display device can be adjusted to a larger value. Similarly, the lower the intensity of ambient light received by the optical elements of the display device, or the lower the intensity of ambient light corresponding to the imaging position of the display device, the less the interference of ambient light on the driver's viewing of the display device image; accordingly, the display brightness of the display device can be adjusted to a lower value.

[0211] For example, taking a HUD as a display device, the display brightness of the HUD can be adjusted according to the intensity of the ambient light received by the optical elements of the HUD and the intensity of the ambient light corresponding to the imaging position of the HUD.

[0212] For example, the target display brightness L at the current moment can be calculated using the following formula (13), and then the display brightness of the HUD can be adjusted:

[0213]

[0214] Where E represents the fused light intensity of the ambient light intensity corresponding to the HUD imaging position and the ambient light intensity received by the HUD optical element. For example, it can be the fused intensity E of sunlight received by the optical element of the HUD optical engine as shown in the above formula (12). s ; 'a' is an adjustment coefficient, which can be determined based on empirical values; for example, 'a' can be 35. MIN_VALUE and MAX_VALUE are the minimum and maximum brightness achievable by the HUD virtual image surface, respectively. For example, the values ​​of MIN_VALUE and MAX_VALUE can be pre-calibrated or set. The Clamp function can limit the value of L within the normal operating range [MIN_VALUE, MAX_VALUE] corresponding to the display device, i.e., calculate... The value, if If the value is within the interval [MIN_VALUE, MAX_VALUE], then the L corresponding to the current time step is... like If the value is greater than MAX_VALUE, then the L at the current time is MAX_VALUE. If the value is less than MIN_VALUE, then L at the current moment is MIN_VALUE. This allows for dynamic adjustment of the intensity of the HUD within its normal operating range, based on the fused light intensity of the ambient light at the HUD imaging position and the ambient light received by the HUD's optical elements.

[0215] In this embodiment, considering that ambient light incident on the optical elements of the display device is reflected by the optical elements and enters the driver's or passenger's eyes along the optical path of the display device, thus affecting the driver's or passenger's perception of the display device, and that ambient light corresponding to the imaging position of the display device also affects the driver's or passenger's vision, this application comprehensively considers the impact of ambient light from multiple sources on the driver's or passenger's perception of the display device. It fuses the intensity of ambient light received by the optical elements of the display device and the intensity of ambient light corresponding to the imaging area of ​​the display device, thereby accurately reproducing the true light intensity of the image observed by the driver or passenger. The display brightness of the display device is automatically adjusted based on the intensity of the fused ambient light, resulting in a brightness that better matches the actual perception of the human eye and meets the requirement for clear display. This effectively solves the problem of drivers or passengers not being able to see the image of the display device when only considering a single source of ambient light, improving driving safety. Furthermore, it eliminates the need for manual operation by the driver or passenger, enhancing the user experience and demonstrating strong practicality.

[0216] The following example illustrates the display method provided in this application, taking as an example the display method including the display position and the light intensity information including the intensity of ambient light corresponding to at least one imaging area of ​​the display device.

[0217] When a display device includes multiple imaging areas, the intensity of ambient light varies across different imaging areas, resulting in varying degrees of visual interference for the driver or passengers. For example, taking a HUD (Head-Up Display) as an example... Figure 18 A schematic diagram of multiple imaging regions in the virtual image plane of a HUD according to an embodiment of this application is shown, such as... Figure 18 As shown, the virtual image plane of a HUD can include four imaging regions: A, B, C, and D. The HUD can image within one or more of these imaging regions. It should be noted that... Figure 18 The imaging areas shown are merely examples, and the number and shape of the imaging areas are not limited in the embodiments of this application. Figure 19 This diagram illustrates the ground background corresponding to the virtual image plane of a vehicle-side outward-facing HUD according to an embodiment of this application. Figure 20 This diagram illustrates the ground background corresponding to the virtual image surface of the HUD in a forward-facing view from inside the vehicle according to an embodiment of this application; as shown... Figure 19 and Figure 20 As shown, when the driver looks at the HUD virtual image surface, the ground coverage area defined by the driver's line of sight and the range of the virtual image surface is the ground background corresponding to the HUD virtual image surface. Figure 20As shown, A', B', C', and D' represent the ground backgrounds corresponding to imaging areas A, B, C, and D, respectively. Since the ground background reflects ambient light, and the intensity of the reflected ambient light varies depending on the imaging area, when the intensity of the reflected ambient light is high for a particular imaging area, the driver may not be able to clearly see the content displayed in that area, increasing driving hazards. Therefore, the display position in the HUD virtual image plane can be dynamically adjusted based on the intensity of the ambient light corresponding to different imaging areas.

[0218] Figure 21 A flowchart illustrating a display method according to an embodiment of this application is shown, such as... Figure 21 As shown, the following steps may be included:

[0219] Step 1901: Obtain the intensity of ambient light corresponding to at least one imaging area of ​​the vehicle's display device.

[0220] For example, the display device may include multiple imaging areas, and when the display device is working, one or more of the multiple imaging areas are used to present content; for example, the intensity of ambient light corresponding to each imaging area of ​​the vehicle's display device may be obtained; or, the intensity of ambient light corresponding to the imaging area currently used to present content may be obtained.

[0221] As an example, the intensity of ambient light corresponding to at least one imaging area collected by a brightness sensor installed in front of the vehicle can be obtained; for example, the intensity of ambient light corresponding to imaging areas collected by multiple brightness sensors can be obtained, wherein different brightness sensors collect the intensity of ambient light corresponding to different imaging areas.

[0222] As another example, image information of the area in front of the vehicle and the driver's eye position can be acquired. Based on the image information and the driver's eye position, the intensity of ambient light corresponding to at least one imaging area of ​​the display device can be determined. The image of the area in front of the vehicle can include the ground background corresponding to at least one imaging area of ​​the display device. For example, the image information of the area in front of the vehicle can include the grayscale values ​​of each pixel in the image. It is understood that a higher grayscale value indicates a higher intensity of ambient light reflected from the ground at the corresponding pixel, and vice versa. Therefore, the intensity of ambient light reflected from the ground background corresponding to each imaging area of ​​the display device can be represented by the grayscale values ​​of the ground background corresponding to each imaging area of ​​the display device, i.e., the intensity of ambient light corresponding to each imaging area. Furthermore, the ground background corresponding to each imaging area of ​​the display device is determined by the driver's eye position and the position of each imaging area of ​​the display device. The position of each imaging area of ​​the display device is usually fixed, while the driver's eye position may change. Therefore, the ground background corresponding to each imaging area is accurately determined based on the driver's eye position. In this way, the intensity of ambient light corresponding to each imaging area of ​​the display device can be accurately determined based on the image information of the area in front of the vehicle and the driver's eye position.

[0223] For example, an image of the front of the vehicle captured by the vehicle's DVR can be acquired, and the grayscale value of each pixel in the image can be obtained. Based on the grayscale value of each pixel in the image of the front of the vehicle, the intensity information of the ambient light reflected from the ground in front of the vehicle can be obtained. Based on the position of the human eye, the coordinates of each imaging area of ​​the display device are aligned with the image of the front of the vehicle, thereby determining the ground background corresponding to each imaging area in the image of the front of the vehicle. Then, based on the ground background corresponding to each imaging area in the image of the front of the vehicle and the intensity information of the ambient light reflected from the ground in front of the vehicle, the intensity of the ambient light corresponding to each imaging area in the display device is determined.

[0224] For example, as mentioned above Figure 19 and Figure 20 Taking a HUD as an example, it can acquire images of the front of the vehicle captured by a DVR camera. For instance, it can acquire these images via a Controller Area Network (CAN) and then convert them into a red, green, and blue (RGB) three-channel format. Let the representation of the converted RGB image be G = {(R...} i G i B i )} i＝1:w*h Where w and h represent image resolution, the RGB image is converted to grayscale and normalized to obtain the final grayscale image G. grayAs shown in the following formula (14):

[0225] G gray ={(R i *0.299+G i *0.587+B i *0.114) / 255} i＝1:w*h …………..(14)

[0226] Where w and h represent the image resolution of the RGB image, R i Let G be the light intensity of the red channel of the i-th pixel in the i-th RGB image. i Let B be the light intensity of the green channel of the i-th pixel in the i-th RGB image. i Let be the light intensity of the blue channel of the i-th pixel in the i-th RGB image.

[0227] Since the position of the HUD virtual image plane in the vehicle coordinate system is fixed, the coordinates of the spatial points corresponding to each pixel in the image of the front of the vehicle captured by the DVR camera in the vehicle coordinate system can be pre-calibrated. Let's assume the set of coordinates of these spatial points in the vehicle coordinate system is P. w The intrinsic parameters of the DVR camera are assumed to be K, and the extrinsic parameters of the DVR camera coordinate system relative to the vehicle body coordinate system are assumed to be R. x T x The set of pixel coordinates in the DVR camera coordinate system is P. x Then, the coordinates of the spatial points corresponding to the pixels in the image of the front of the vehicle captured by the DVR camera in the vehicle body coordinate system and the coordinates of the corresponding points in the DVR camera coordinate system have the following mapping relationship as shown in formula (15):

[0228]

[0229] Where Z represents the distance from the DVR camera to P. w The straight-line distance between points in midspace.

[0230] Assume the current position coordinates of the driver's eye in the vehicle coordinate system are {x} e ,y e ,z e In the 2D plane of the HUD virtual image surface, the set of coordinates of points in each imaging region in the HUD virtual image surface coordinate system is P. v If the downward viewing angle of the current HUD virtual image plane is θ, then the extrinsic parameter R of the human eye coordinate system relative to the vehicle body coordinate system is... e T e for:

[0231]

[0232]

[0233] The coordinates of the spatial points corresponding to the pixels in the image of the front of the vehicle captured by the DVR camera in the vehicle body coordinate system and the coordinates of the corresponding points in the HUD virtual image plane coordinate system have the following mapping relationship as shown in formula (18):

[0234]

[0235] Among them, L VID Z is the straight-line distance from the driver's eye to the center of the HUD virtual image plane. e For the driver's eye to set P w The straight-line distance between points in space.

[0236] Combining the above formulas (15)-(18), we can obtain the following mapping relationship between the coordinates of the pixels in the DVR camera coordinate system and the coordinates of the corresponding points under the HUD virtual image plane in the image captured by the DVR camera:

[0237]

[0238] Among them, P x Let P be the set of coordinates of pixels in the DVR camera coordinate system. v Z represents the set of coordinates of points in each imaging region in the HUD virtual image plane coordinate system; e For the driver's eye to set P w The straight-line distance between points in space; Z is the distance from the DVR camera to P. w The straight-line distance between points in midspace; P w L represents the set of coordinates of each pixel in the image of the front of the vehicle captured by the DVR camera, located in the vehicle's coordinate system. VID R is the straight-line distance from the driver's eye to the center of the HUD virtual image plane; K is the intrinsic parameter of the DVR camera coordinate system; x T x R is the extrinsic parameter of the DVR camera coordinate system relative to the vehicle body coordinate system; e T e The external parameter is the human eye coordinate system relative to the vehicle body coordinate system.

[0239] Thus, according to formula (19), based on the position of the human eye and the coordinates of the points in each imaging region of the HUD in the coordinate system of the HUD virtual image surface, the coordinates of the points in each imaging region of the HUD are aligned with the image in front of the vehicle captured by the DVR camera, thereby obtaining the pixel points corresponding to the points in each imaging region of the HUD in the coordinate system of the DVR camera, that is, determining the ground background corresponding to each imaging region in the image in front of the vehicle; then, the gray value of the corresponding pixel point in the coordinate system of the DVR camera is selected from the grayscale image obtained by formula (14); furthermore, based on the gray value of the corresponding pixel point in the coordinate system of the DVR camera, the average gray value of each imaging region can be calculated, thereby realizing the conversion of the gray value of the ground background corresponding to each imaging region in the image in front of the vehicle captured by the DVR camera into the gray value of each imaging region on the HUD virtual image surface. In this way, the dynamically determined gray value of each imaging region on the HUD virtual image surface can more accurately represent the intensity of the ambient light corresponding to each imaging region. For example, Figure 22 This illustrates grayscale images of various imaging regions in the virtual image plane of a HUD according to an embodiment of this application; as shown... Figure 22 As shown, this is the above. Figure 18 The grayscale images corresponding to imaging regions A, B, C, and D are shown.

[0240] Step 1902: Determine the target imaging area based on the intensity of ambient light corresponding to at least one imaging area of ​​the display device.

[0241] For example, the target imaging area can be determined based on the intensity of ambient light corresponding to each imaging area in the display device.

[0242] For example, if the intensity of the ambient light corresponding to the imaging area of ​​the display device used to present content does not interfere with the driver's or passenger's line of sight or the interference is minimal, then the imaging area of ​​the display device used to present content at the current moment is the target imaging area; if the intensity of the ambient light corresponding to the imaging area of ​​the display device used to present content at the current moment interferes with the driver's or passenger's line of sight or the interference is significant, then the imaging area of ​​the other imaging areas of the display device that causes the least interference with the driver's or passenger's line of sight is taken as the target imaging area.

[0243] For example, the target imaging area can be determined by the average gray value corresponding to each imaging area. For instance, if the average gray value of the imaging area currently used to present the content is greater than a preset value, such as 0.8, then the imaging area is considered overexposed and interferes with the driver's or passenger's vision, and other imaging areas need to be selected as the target imaging area. As another example, if the average gray value of the imaging area currently used to present the content is less than a preset value, such as 0.1, then the imaging area is considered underexposed and interferes with the driver's or passenger's vision, and other imaging areas need to be selected as the target imaging area.

[0244] Step 1903: Adjust the display position of the display device according to the target imaging area.

[0245] It is understandable that if the target imaging area determined above is the imaging area of ​​the currently presented content, the display position of the display device will still be the imaging area of ​​the currently presented content; if the target imaging area determined above is not the imaging area of ​​the currently presented content, the display position of the display device will be adjusted to the target imaging area, that is, the content will be presented through the target imaging area.

[0246] For example, Figure 23 This diagram illustrates the adjustment of the display position in the virtual image plane of a HUD according to an embodiment of this application, as shown below. Figure 23 As shown, imaging area A is the imaging area currently displaying the 2D instrument, and imaging area B is the determined target imaging area. The display position will then be adjusted to imaging area B, which is used to display the 2D instrument.

[0247] In this embodiment, the display position of the display device can be dynamically adjusted according to the intensity of ambient light corresponding to each imaging area of ​​the display device, for example, according to the grayscale value corresponding to each imaging area. This ensures that the driver can clearly see the content presented by the display device and avoids the impact on the driver's vision caused by excessively high or low ambient light intensity corresponding to the imaging area, thereby greatly improving driving safety.

[0248] It should be understood that the above Figure 5 , Figure 8 , Figure 12 or Figure 21 The display methods shown can be combined with each other. Figure 5 , Figure 8 , Figure 12 or Figure 21 The display methods shown and the implementation details of each optional embodiment can be referenced together, and will not be repeated here.

[0249] Based on the same inventive concept as the above method embodiments, this application also provides an electronic device for executing the technical solutions described in the above method embodiments. For example, it can execute the above... Figure 5 , Figure 8 , Figure 12 or Figure 21 The steps of the display method are shown below.

[0250] Figure 24 This diagram illustrates a structural diagram of an electronic device according to an embodiment of the present application, such as... Figure 24 As shown, it may include: an acquisition module 2201, used to acquire environmental information corresponding to the vehicle; the environmental information includes light intensity information and / or location information; and an adjustment module 2202, used to adjust the display mode of the vehicle's display device according to the environmental information; the display mode includes at least one of the following: display brightness, display position, display content, display color, display style, or display size.

[0251] In this embodiment, environmental information corresponding to the vehicle is obtained, and the display mode of the display device is adjusted according to the environmental information, so that the display mode of the display device can adapt to the current environment, thereby improving the display effect and driving safety.

[0252] In one possible implementation, the location information includes the position of the vehicle and / or the position of the area where ambient light is blocked in the direction of the vehicle's travel; the adjustment module 2202 is further configured to: determine a first distance between the vehicle and the area where ambient light is blocked based on the position of the vehicle and / or the position of the area where ambient light is blocked; and adjust the display mode of the display device based on the first distance.

[0253] In one possible implementation, the location information includes the position of the vehicle and / or the position of the area where ambient light is blocked in the direction of the vehicle's travel; the adjustment module 2202 is further configured to: adjust the display mode of the vehicle's display device according to the position of the vehicle and / or the position of the area where ambient light is blocked in the direction of the vehicle's travel.

[0254] In one possible implementation, the display method includes a first display brightness; the light intensity information includes: the intensity of ambient light received by the optical elements of the display device and / or the intensity of ambient light corresponding to the imaging position of the display device; the adjustment module 2202 is further configured to: adjust the first display brightness of the display device according to the intensity of ambient light received by the optical elements of the display device and / or the intensity of ambient light corresponding to the imaging position of the display device; wherein, the first display brightness is positively correlated with the intensity of ambient light received by the optical elements of the display device and positively correlated with the intensity of ambient light corresponding to the imaging position of the display device.

[0255] In one possible implementation, the light intensity information further includes the intensity of ambient light corresponding to at least one imaging area of ​​the display device, and the display method includes a display position; the adjustment module 2202 is further configured to: determine a target imaging area based on the intensity of ambient light corresponding to at least one imaging area of ​​the display device; and adjust the display position of the display device based on the target imaging area.

[0256] In one possible implementation, the adjustment module 2202 is further configured to: adjust the display mode of the display device when the first distance is less than a preset distance.

[0257] In one possible implementation, the display method includes a second display brightness; the adjustment module 2202 is further configured to: adjust the second display brightness according to the first distance, wherein the second display brightness is negatively correlated with the first distance.

[0258] In one possible implementation, the display device includes a head-up display (HUD), and the light intensity information includes the intensity of ambient light received by the optical elements of the HUD optical engine; the acquisition module 2201 is further configured to: acquire the incident angle corresponding to the ambient light received at the light outlet of the HUD optical engine, the exit angle corresponding to the HUD emitted light, and the intensity of the ambient light received at the light outlet of the HUD optical engine; determine the intensity of the ambient light received by the optical elements of the HUD optical engine based on the incident angle, the exit angle, and the intensity of the ambient light received at the light outlet; wherein the intensity of the ambient light received by the optical elements of the HUD optical engine is positively correlated with the intensity of the ambient light received at the light outlet and negatively correlated with the difference between the incident angle and the exit angle.

[0259] In one possible implementation, the display device includes a head-up display (HUD), and the light intensity information includes the intensity of ambient light received by the optical elements of the HUD optical engine. The acquisition module 2201 is further configured to: determine a first angle between the ambient light and the horizontal plane, and a second angle between the projection of the ambient light onto the horizontal plane and the vehicle's direction of travel; determine a third angle between the HUD emitted light rays and the horizontal plane, and a fourth angle between the projection of the HUD emitted light rays onto the horizontal plane and the vehicle's direction of travel; determine a first difference between the first angle and the third angle, and a second difference between the second angle and the fourth angle; determine the intensity of ambient light received by the optical elements of the HUD optical engine based on the first difference, the second difference, and the intensity of ambient light received at the light output port of the HUD optical engine; wherein the intensity of ambient light received by the optical elements of the HUD optical engine is positively correlated with the intensity of ambient light received at the light output port of the HUD optical engine, negatively correlated with the first difference, and negatively correlated with the second difference.

[0260] In one possible implementation, the acquisition module 2201 is further configured to: acquire image information of the front of the vehicle and the position of the human eye; and determine the intensity of ambient light corresponding to at least one imaging area of ​​the display device based on the image information and the position of the human eye.

[0261] In one possible implementation, the ambient light includes direct sunlight and / or sunlight reflected by reflective objects.

[0262] In one possible implementation, the acquisition module 2201 is further configured to: acquire the distance between the marker point corresponding to the ambient light occluded area and the ambient light occluded area, wherein the marker point is located outside the ambient light occluded area; the adjustment module 2202 is further configured to: adjust the display mode of the display device according to the first distance, the preset distance and the distance between the marker point and the ambient light occluded area.

[0263] The above Figure 24 The technical effects and specific descriptions of the electronic device and its various possible implementations can be found in the above display method, and will not be repeated here.

[0264] It should be understood that the division of modules in the above device is only a logical functional division. In actual implementation, they can be fully or partially integrated into a single physical entity, or they can be physically separated. Furthermore, the modules in the device can be implemented by a processor calling software; for example, the device includes a processor connected to a memory containing instructions. The processor calls the instructions stored in the memory to implement any of the above methods or to implement the functions of each module in the device. The processor can be, for example, a general-purpose processor, such as a Central Processing Unit (CPU) or a microprocessor, and the memory can be internal or external to the device. Alternatively, the modules in the device can be implemented as hardware circuits. The functionality of some or all modules can be achieved through the design of these hardware circuits, which can be understood as one or more processors. For example, in one implementation, the hardware circuit is an application-specific integrated circuit (ASIC). The functionality of some or all of the modules is achieved through the design of the logical relationships between the components within the circuit. In another implementation, the hardware circuit can be implemented using a programmable logic device (PLD). Taking a field-programmable gate array (FPGA) as an example, it can include a large number of logic gates. The connection relationships between these logic gates are configured through configuration files, thereby achieving the functionality of some or all of the modules. All modules of the above device can be implemented entirely through processor-invoked software, entirely through hardware circuits, or partially through processor-invoked software with the remaining parts implemented through hardware circuits.

[0265] In this application embodiment, a processor is a circuit with signal processing capabilities. In one implementation, the processor can be a circuit with instruction read and execute capabilities, such as a CPU, microprocessor, graphics processing unit (GPU) (which can be understood as a type of microprocessor), or digital signal processor (DSP). In another implementation, the processor can implement certain functions through the logical relationships of hardware circuits. These logical relationships of hardware circuits are fixed or reconfigurable. For example, the processor is a hardware circuit implemented by an ASIC or PLD, such as an FPGA. In a reconfigurable hardware circuit, the process of the processor loading a configuration document and configuring the hardware circuit can be understood as the process of the processor loading instructions to implement the functions of some or all of the above modules.

[0266] As can be seen, each module in the above device can be one or more processors (or processing circuits) configured to implement the methods of the above embodiments, such as: CPU, GPU, microprocessor, DSP, ASIC, FPGA, or a combination of at least two of these processor forms.

[0267] Furthermore, the modules in the above devices can be integrated in whole or in part, or they can be implemented independently. In one implementation, these modules are integrated together and implemented in the form of a System-on-Chip (SoC). The SoC may include at least one processor for implementing any of the above methods or implementing the functions of the modules of the device. The at least one processor may be of different types, such as CPU and FPGA, CPU and artificial intelligence processor, CPU and GPU, etc.

[0268] This application also provides an electronic device, including: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to implement the method of the above embodiments when executing the instructions. Exemplarily, the above can be implemented. Figure 5 , Figure 8 , Figure 12 or Figure 21 The steps of the display method are shown below.

[0269] Figure 25 This diagram illustrates the structure of an electronic device according to an embodiment of the present application, as shown below. Figure 25 As shown, the electronic device may include at least one processor 2301, a communication line 2302, a memory 2303, and at least one communication interface 2304.

[0270] The processor 2301 may be a general-purpose central processing unit, a microprocessor, an application-specific integrated circuit, or one or more integrated circuits used to control the execution of programs according to the present application.

[0271] Communication line 2302 may include a path for transmitting information between the aforementioned components.

[0272] The communication interface 2304 uses any transceiver-like device for communicating with other devices or communication networks, such as Ethernet, RAN, wireless local area networks (WLAN), etc.

[0273] The memory 2303 may be a read-only memory (ROM) or other type of static storage device capable of storing static information and instructions, random access memory (RAM) or other type of dynamic storage device capable of storing information and instructions, or it may be an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compressed optical discs, laser discs, optical discs, digital universal optical discs, Blu-ray discs, etc.), magnetic disk storage media or other magnetic storage devices, or any other medium capable of carrying or storing desired program code in the form of instructions or data structures and accessible by a computer, but is not limited thereto. The memory may exist independently and be connected to the processor via communication line 2302. The memory may also be integrated with the processor. The memory provided in this application embodiment is generally non-volatile. The memory 2303 is used to store computer execution instructions for executing the scheme of this application and is controlled by the processor 2301 for execution. The processor 2301 is used to execute computer execution instructions stored in the memory 2303, thereby implementing the method provided in the above embodiments of this application; exemplarily, the above can be implemented. Figure 5 , Figure 8 , Figure 12 or Figure 21 The steps of the display method are shown below.

[0274] The processor, processing chip, and processing device mentioned in the embodiments of this application can also be referred to as a controller, control chip, and control device. It should be understood that the division of units in the above device is only a logical functional division; in actual implementation, they can be fully or partially integrated into a single physical entity, or they can be physically separated. Furthermore, the units in the device can be implemented by the processor calling software; for example, the device includes a processor connected to a memory, which stores instructions. The processor calls the instructions stored in the memory to implement any of the above methods or to implement the functions of each unit in the device. The processor can be, for example, a general-purpose processor, such as a Central Processing Unit (CPU) or a microprocessor, and the memory can be internal or external to the device. Alternatively, the units in the device can be implemented as hardware circuits. The functionality of some or all units can be achieved through the design of these hardware circuits, which can be understood as one or more processors. For example, in one implementation, the hardware circuit is an application-specific integrated circuit (ASIC). The functionality of some or all of the above units is achieved through the design of the logical relationships between the components within the circuit. In another implementation, the hardware circuit can be implemented using a programmable logic device (PLD). Taking a field-programmable gate array (FPGA) as an example, it can include a large number of logic gates. The connection relationships between the logic gates are configured through a configuration file, thereby achieving the functionality of some or all of the above units. All units of the above device can be implemented entirely through processor-invoked software, entirely through hardware circuits, or partially through processor-invoked software with the remaining parts implemented through hardware circuits.

[0275] In this application embodiment, a processor is a circuit with signal processing capabilities. In one implementation, the processor can be a circuit with instruction read and execute capabilities, such as a Central Processing Unit (CPU), a microprocessor, a graphics processing unit (GPU) (which can be understood as a type of microprocessor), or a digital signal processor (DSP). In another implementation, the processor can implement certain functions through the logical relationships of hardware circuits. These logical relationships of hardware circuits are fixed or reconfigurable. For example, the processor is a hardware circuit implemented using an application-specific integrated circuit (ASIC) or a programmable logic device (PLD), such as an FPGA. In a reconfigurable hardware circuit, the process of the processor loading a configuration document and configuring the hardware circuit can be understood as the process of the processor loading instructions to implement some or all of the functions of the above units. In addition, it can also be a hardware circuit designed for artificial intelligence, which can be understood as an ASIC, such as a Neural Network Processing Unit (NPU), Tensor Processing Unit (TPU), Deep Learning Processing Unit (DPU), etc.

[0276] As can be seen, each unit in the above device can be one or more processors (or processing circuits) configured to implement the above methods, such as: CPU, GPU, NPU, TPU, DPU, microprocessor, DSP, ASIC, FPGA, or a combination of at least two of these processor forms.

[0277] Optionally, the computer execution instructions in the embodiments of this application may also be referred to as application code, and the embodiments of this application do not specifically limit this.

[0278] For example, processor 2301 may include one or more CPUs, such as Figure 25 CPU0 and CPU1 in the CPU.

[0279] For example, an electronic device may include multiple processors, such as Figure 25Processors 2301 and 2307 are mentioned. Each of these processors can be a single-core (single-CPU) processor or a multi-core (multi-CPU) processor. A processor here can refer to one or more devices, circuits, and / or processing cores used to process data (such as computer program instructions).

[0280] In a specific implementation, as one embodiment, the electronic device may further include an output device 2305 and an input device 2306. The output device 2305 communicates with the processor 2301 and can display information in various ways. For example, the output device 2305 may be a liquid crystal display (LCD), a light-emitting diode (LED) display device, a cathode ray tube (CRT) display device, or a projector, such as a vehicle-mounted HUD, AR-HUD, or monitor. The input device 2306 communicates with the processor 2301 and can receive user input in various ways. For example, the input device 2306 may be a mouse, keyboard, touchscreen device, or sensing device.

[0281] As an example, combined Figure 25 The electronic device shown above Figure 24 The acquisition module 2201 in the middle can be obtained by Figure 25 This is implemented through the communication interface 2304; the above Figure 24 The adjustment module 2202 in the middle can be made by Figure 25 It is implemented using the 2301 processor.

[0282] This application provides a display system, including: a display device; a data acquisition device for acquiring environmental information; and the electronic device described in any of the above embodiments.

[0283] As an example, the display system can be a vehicle, a display system consisting of an in-vehicle infotainment system and display devices, or a display device with a processor and a display. For example, the display device can be a device with display capabilities in an in-vehicle component such as a HUD, AR-HUD, or display, and the acquisition device can be a sensing device with acquisition or measurement functions. Exemplarily, the display device can be one of the above-mentioned... Figure 2 or Figure 3 The display device 20 shown can be a data acquisition device as described above. Figure 3 The data acquisition device 10 shown may include the electronic devices described above. Figure 24 The electronic device shown.

[0284] As another example, the above Figure 24The electronic device shown can be deployed in the vehicle's infotainment system, and the display device can be an AR-HUD. Figure 26 This diagram illustrates a structural schematic of a display system according to an embodiment of the present application, as shown below. Figure 26 As shown, the electronic device can be deployed in the AR-HUD engine of the vehicle application framework layer; the acquisition module 2201 can acquire environmental information collected by the acquisition device through the in-vehicle intelligent terminal (telematics box, TBOX), and can also acquire navigation data from the Advanced Driving Assistance System (ADAS); the adjustment module 2202 processes the data acquired by the acquisition module 2201 to obtain the display parameter values ​​of the AR-HUD optical engine, and sends the display parameter values ​​to the AR-HUD. The AR-HUD adjusts the display mode according to the display parameter values, thereby completing the adjustment of the display mode.

[0285] This application provides a computer-readable storage medium storing program code, which, when executed by an electronic device or a processor in an electronic device, implements the methods described in the above embodiments. Exemplarily, the above methods can be implemented. Figure 5 , Figure 8 , Figure 12 or Figure 21 The steps of the display method are shown below.

[0286] This application provides a computer program product, which may include, for example, computer-readable code or a non-volatile computer-readable storage medium carrying computer-readable code; when the program code contained in the computer program product is executed by an electronic device or a processor in an electronic device, it implements the methods described in the above embodiments. Exemplarily, the above can be performed... Figure 5 , Figure 8 , Figure 12 or Figure 21 The steps of the display method are shown below.

[0287] Computer-readable storage media can be tangible devices capable of holding and storing instructions for use by an instruction execution device. Computer-readable storage media can be, for example—but not limited to—electrical storage devices, magnetic storage devices, optical storage devices, electromagnetic storage devices, semiconductor storage devices, or any suitable combination thereof. More specific examples (a non-exhaustive list) of computer-readable storage media include: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static random access memory (SRAM), portable compact disc read-only memory (CD-ROM), digital multifunction disc (DVD), memory sticks, floppy disks, mechanical encoding devices, such as punch cards or recessed protrusions storing instructions thereon, and any suitable combination thereof. The computer-readable storage media used herein are not to be construed as transient signals themselves, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., light pulses through fiber optic cables), or electrical signals transmitted through wires.

[0288] The computer-readable program instructions described herein can be downloaded from computer-readable storage media to various computing / processing devices, or downloaded via a network, such as the Internet, local area network, wide area network, and / or wireless network, to an external computer or external storage device. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers. A network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards them to the computer-readable storage media in the respective computing / processing device.

[0289] The computer program instructions used to perform the operations of this application may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk, C++, etc., and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The computer-readable program instructions may be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or may be connected to an external computer (e.g., via the Internet using an Internet service provider). In some embodiments, electronic circuits, such as programmable logic circuits, field-programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), are personalized by utilizing state information from the computer-readable program instructions. These electronic circuits can execute the computer-readable program instructions to implement various aspects of this application.

[0290] Various aspects of this application are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0291] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0292] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0293] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction containing one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those marked in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0294] The various embodiments of this application have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen to best explain the principles, practical applications, or technological improvements to the embodiments in the market, or to enable others skilled in the art to understand the embodiments disclosed herein.

[0295] With economic development and the rapid increase in vehicle ownership, vehicle technology and computer technology are increasingly merging. Intelligent vehicles have become a new trend in vehicle development. In addition to technologies such as autonomous driving and high-precision maps, human-machine interaction in intelligent cockpits has also become a hot topic of attention.

[0296] Figure 27This is a schematic diagram of a car cabin structure provided as an embodiment of this application. Inside the car cabin, the vehicle head unit (VBU), also known as an in-vehicle entertainment system, can be located in the central control area of ​​the vehicle, and the screen connected to it can also be called a central control display screen or central control screen. With the gradual expansion of digital displays within the cabin, some vehicles have multiple displays, or a single large screen that can be split, used to display content such as the digital instrument panel and the in-vehicle entertainment system. Figure 27 As shown, the cockpit features multiple displays, including a digital instrument cluster display 2701, a central control screen 2702, an entertainment display 2703 in front of the front passenger, and entertainment displays 2704 and 2705 in front of the rear passengers. To provide different visual functions within the cockpit, multiple independent cameras 2706 can typically be installed in various locations within the cockpit, such as the A-pillar, B-pillar, steering column, central control area, rearview mirror area, and steering wheel area.

[0297] Vehicles are a highly sensitive scenario, and the display experience in vehicles is worth studying.

[0298] refer to Figures 27 to 29 As shown, a head-up display (HUD) is a display device that projects images into the driver's field of vision. HUDs utilize the principle of optical reflection to project important and relevant information as a two-dimensional image onto the windshield of a car, at approximately eye level. When the driver looks forward through the windshield, they see the two-dimensional image projected by the HUD onto a virtual image surface in front of the windshield. Compared to traditional instrument panels and center console screens, drivers do not need to look down when viewing the HUD image, avoiding the need to switch between the image and the road surface, reducing reaction time in emergencies, and improving driving safety. Augmented reality head-up displays (AR-HUDs), proposed in recent years, can integrate the HUD's displayed image with real road information, enhancing the driver's understanding of road conditions and enabling functions such as virtual reality (AR) navigation and AR warnings.

[0299] To achieve functions such as road navigation and early warning in AR-HUD, the three-dimensional perception data obtained by the sensor needs to be sent into a virtual three-dimensional space for augmented reality rendering. After rendering, it is mapped onto the two-dimensional virtual image surface displayed on the HUD, and finally mapped back into three-dimensional space by the human eye.

[0300] Figures 28-29 The diagram illustrates an application scenario of the projection method provided in this application embodiment, with reference to... Figures 28-29The application scenario of this embodiment specifically involves a vehicle 291, which has a data acquisition device 2910, a projection device 2920, and a display device 2930.

[0301] The data acquisition device 2910 may include an external data acquisition device and an internal data acquisition device. The external data acquisition device may specifically employ a lidar, an in-vehicle camera, or other devices with image acquisition or optical scanning capabilities, or a combination of multiple such devices. It can be installed on the top, head, or side of the rearview mirror facing outwards in the vehicle 1, either inside or outside the vehicle. Its main purpose is to detect and acquire image and positional information of the environment in front of the vehicle, including information related to vehicles ahead, obstacles, and road signs. The internal data acquisition device may specifically employ an in-vehicle camera, an eye detector, or other similar devices. In its implementation, the internal data acquisition device can be positioned as needed, for example, on the A-pillar, B-pillar, or side of the rearview mirror facing the user in the vehicle cabin. It can also be positioned near the steering wheel, center console, or above the display screen behind the seat. Its main purpose is to detect and acquire the eye position information of the driver or passengers in the vehicle cabin. There may be one or multiple internal data acquisition devices; this application does not limit their location or number.

[0302] The projection device 2920 can be a HUD, AR-HUD, or other device with projection capabilities. It can be installed above or inside the center console of the vehicle cabin. It typically includes a projector, a reflector, a projection mirror, an adjustment motor, and a control unit. The control unit is an electronic device, specifically a conventional chip processor such as a central processing unit (CPU) or a microprocessor (MCU), or terminal hardware such as a mobile phone or tablet. This control unit is communicatively connected to both the acquisition device 2910 and the display device 2930. The control unit can have a preset imaging model or acquire a preset imaging model from other vehicle components. The parameters of this imaging model are correlated with the eye position information collected by the in-vehicle acquisition device. It can perform parameter calibration based on the eye position information, and then generate a projected image based on the environmental information collected by the external acquisition device, which is then output to the projector. Figure 29 As shown, the projected image may include augmented reality display images generated based on environmental information, as well as images such as vehicle speed and navigation.

[0303] The display device 2930 can be the windshield of a vehicle or a transparent screen with independent display, used to reflect the image light emitted by the projection device and enter the user's eyes, so that when the driver looks out of the vehicle through the display device 30, he can see a virtual image with a depth effect, which overlaps with the real world environment, presenting an augmented reality display effect to the user.

[0304] As an example, the acquisition device 2910 can be the above-mentioned Figures 2-4 The acquisition device 10 and the projection device 2920 can be the above-mentioned Figures 2-4 The display device 20 and the display unit 2930 can be the above-mentioned Figures 2-4 30 medium-sized imaging devices.

[0305] The acquisition device 2910, projection device 2920, and other devices can communicate data via wired or wireless communication (such as Bluetooth or Wi-Fi). For example, after acquiring image information, the acquisition device 10 can transmit the image information to the projection device 2920 via Bluetooth. Similarly, the projection device 2920 can send control signals to the acquisition device 2910 via Bluetooth and adjust the acquisition parameters of the acquisition device 2910, such as the shooting angle. It should be understood that data processing can be completed in the projection device 2920, the acquisition device 2910, or other processing devices, such as vehicle infotainment systems or in-vehicle computers.

[0306] Through the above structure, the vehicle can achieve augmented reality display effects based on real-world environmental information, and can adjust the generated projected image according to the user's eye position information, so that the projected augmented reality display image overlaps with the real-world environmental information as much as possible, thereby improving the user's immersive viewing experience.

[0307] Figure 30 This application illustrates a display method provided by an embodiment of the present application. This method can be executed by one or more of a display device, a processing device, or a control device. The display device can be a device with display capabilities, such as a HUD, AR-HUD, or display screen in a vehicle. The processing device can be used to acquire and process information and data. The control device can also be used to control the display device to display information. The processing device and the control device can be devices such as processors or controllers.

[0308] S401: Obtain vehicle environmental information;

[0309] Here, the vehicle's environmental information can be one or more parameters such as vehicle location information, ambient brightness, altitude, road condition information, time information, surrounding building information, and sensor information. Vehicle location information can include the vehicle's position, such as GPS location, latitude and longitude, and the current scene, such as a tunnel, under an overpass, on an overpass, or on a flat road. Time information can include one or more parameters such as the current time, estimated arrival time at the destination, and estimated arrival time at key points along the route. Sensor information can be one or more of the following acquired by sensors: light intensity and incident angle from the HUD optical engine, ambient light brightness, display brightness, and cabin brightness. Sensors can be brightness sensors, geolocation sensors, etc. The above information can be directly collected by sensors or processed by sensors or other devices.

[0310] S402: Adjust the vehicle's display brightness based on the vehicle's environmental information.

[0311] Based on the vehicle information above, the vehicle's display brightness can be adjusted. For example, the brightness of the vehicle's in-vehicle display can be adjusted. This in-vehicle display can be the central control screen, digital instrument cluster display, entertainment screen, etc. The in-vehicle display can also be a HUD or AR-HUD display device.

[0312] For example, the vehicle's display brightness can be adjusted when it is about to enter or has already entered a tunnel. Similarly, if the vehicle is traveling and the light is blocked by other structures (such as tall buildings, elevated roads, or overpasses), resulting in poor display quality, the display brightness can be adjusted. Furthermore, the display brightness can be adjusted when there is strong external light or a sudden change in brightness while the vehicle is traveling. Finally, the display brightness can be adjusted if sunlight is affecting the user. The impact of sunlight on the human eye can be determined based on one or more parameters such as season, weather, and vehicle location. For example, the display brightness can be adjusted in scenarios that affect the user's vision, making it difficult to see the road ahead, or causing glare.

[0313] These adjustments reduce the impact of perceived brightness changes on the display, thereby improving driving safety. By predicting upcoming road conditions and making adjustments in advance, the impact of the HUD light window on the user's vision can be minimized, reducing the probability of danger in certain road sections.

[0314] In daily driving, when using an AR-HUD, the brightness of the virtual image is typically adjusted manually by the user or based on ambient light intensity detected by sensors. However, in situations involving sudden changes in lighting, such as tunnels, the system may not be able to adjust before entering the tunnel due to the vehicle's speed. This results in the virtual image being too bright, obstructing the driver's view and increasing the risk of accidents. Furthermore, since the HUD's optical engine works by using multiple mirrors to reflect light onto the windshield and then into the eyes, if ambient light follows the same path to the engine, it will also enter the eyes, causing the virtual image to be difficult to see. Figure 31 This is a schematic diagram of the light source for an AR-HUD; for example... Figure 31 As shown, the intensity and incident angle of sunlight entering the optical engine also have a significant impact on the brightness of the HUD virtual image surface.

[0315] This application proposes a location-based adjustment method that solves the problems of delayed adjustment in special road sections and incomplete introduction of factors affecting brightness adjustment. It can quickly respond to road sections with sudden brightness changes and adjust brightness more accurately. While making brightness adjustment more accurate, it greatly reduces driving hazards and has great practical significance.

[0316] like Figure 32 As shown in the figure, this application embodiment provides a system architecture that can be deployed in the AR-HUD Engine within the vehicle infotainment application framework layer. Signals from ADAS and TBOX are input to various algorithm modules of the AR-HUD Engine, and the calculated brightness adjustment values ​​are sent to the AR-HUD optical engine for brightness adjustment.

[0317] Detailed data flow between modules, such as Figure 33 As shown, the attitude estimation module combines GNSS and IMU signals to calculate the vehicle's current pose, including its current geographical location and orientation. The illuminance calculation module calculates the solar altitude angle based on the current time and season, and, combined with the vehicle's current pose and geographical location, calculates the incident angle and intensity of sunlight directly or reflected into the HUD optical engine. The special road segment management module dynamically changes the weighting factor of the HUD brightness adjustment based on the vehicle's current position, achieving the goal of adjusting the HUD brightness before entering road segments with sudden changes in light intensity. The light intensity fusion module combines the light information from the HUD optical engine port, the light intensity near the virtual image plane, and the distance to the special road segment to perform fusion correction of the HUD brightness adjustment, obtaining the final value of the HUD brightness to be adjusted at a certain moment. The brightness adjustment module adjusts the brightness of the HUD optical engine based on the calculated final value.

[0318] The embodiments of this application can be applied to vehicle-mounted AR-HUD devices, solving the problems of adjustment lag in special road sections and incomplete introduction of brightness adjustment influencing factors. It can be implemented in hardware together with the AR-HUD optical engine, or it can be implemented separately in software and loaded into other HUD hardware.

[0319] In this embodiment, a special road segment management module can sense the distance between the vehicle body and areas of sudden changes in light intensity in real time, and use this information to correct brightness adjustments, ensuring that adjustments are completed before reaching the affected area. An illuminance calculation module can also calculate the incident angle of sunlight on the HUD surface in real time, and, combined with the sensors of the HUD optical engine, comprehensively calculate the light intensity entering the optical engine. Furthermore, a brightness adjustment module can model the brightness based on the distance to the area of ​​sudden changes in light intensity, the light intensity entering the optical engine, and the light intensity near the virtual image surface, and then adjust the brightness accordingly. This allows for a more comprehensive consideration of factors such as adjustment lag in special road segments and brightness adjustment, avoiding obstruction of the field of vision and ensuring driving safety.

[0320] like Figure 34 As shown in the embodiment of this application, a method is provided: First, the HUD function is enabled, and the algorithm module is started simultaneously; Second, the light intensity and incident angle of the HUD optical engine port are calculated based on the current vehicle position, road condition information, current time information, and light sensor data to obtain the light intensity incident on the optical engine. This light will be directly reflected through the optical engine optical path and enter the human eye, thus affecting the human eye's perception of the brightness of the virtual image surface; Third, the ambient light intensity near the HUD virtual image surface is obtained through sensors and modeled with the incident optical engine light intensity to initially obtain the fused light intensity; Fourth, the distance between the current vehicle and the brightness change area is calculated through navigation signals, and the brightness adjustment weight factor is calculated; Fifth, based on the obtained fused light intensity and weight factor, the final brightness adjustment value is obtained to ensure that the HUD brightness adjustment is completed a certain distance before the change point.

[0321] The calculation of the fused light intensity can be achieved through one of the following optional methods:

[0322] To more accurately reproduce the brightness of the virtual image plane observed by the driver, it is necessary to calculate the degree of influence of the incident light intensity on human visual perception. Therefore, it is necessary to first calculate the sunlight intensity and incident angle of the incident light into the optical engine. The light rays entering the optical engine can be divided into sunlight rays that directly enter the optical engine and sunlight rays that enter the optical engine after being reflected by high-reflectivity buildings near the car.

[0323] Figure 35 A schematic diagram showing the angle between sunlight and a vehicle is provided. Figure 35 The middle value is the driver's forward angle while in the vehicle, where the yellow arrow indicates the current direction of the sun's rays, θ. s Let θ be the solar altitude angle at the current moment. s′ is the angle between the projection of sunlight onto the ground and the direction in which the car is moving forward.

[0324] First, calculate the incident angle of sunlight directly entering the HUD optical engine. Calculating the intensity of the light directly entering the optical engine requires calculating the included angle θ. s ′ and solar altitude angle θ s Since the angle between sunlight and the vehicle body cannot be directly obtained, this embodiment first calculates the angle between the projection of sunlight on the ground and the due north direction, and then calculates the angle between the vehicle body and the due north direction, thereby calculating θ. s ′.

[0325] Solar altitude angle θ s The calculation formula is as follows:

[0326]

[0327] in, Figure 36 It is an abstract diagram of the relationship between sunlight and the earth. Assume that the car is driving at point A. h is the hour angle in the equatorial coordinate system, which is the angle between the longitude of point A and the right ascension; δ is the current declination of the sun, which is the angle between the subsolar point and the equator; φ is the angle between the latitude of the car's location and the equator. Figure 37 This is a schematic diagram showing the angle between the sunlight projection and the meridian.

[0328] exist Figure 36 In the diagram, the Earth's center is O. Since sunlight shining on the Earth can be considered parallel, and point B is the intersection of the line connecting the Sun and the Earth's center with the Earth's surface, sunlight passing through point A is parallel to OB and intersects plane OAB. Therefore, sunlight passing through point A must lie on plane OAB. Thus, finding the angle between the projection of sunlight onto the ground and longitude, which is the angle between the projection of sunlight passing through A onto the ground and EF, is equivalent to finding the angle between plane OAB and plane OEF.

[0329] do On plane OEF and perpendicular to do Perpendicular to the OAB plane, therefore angle θ s ′ and ∠COD are complementary, where:

[0330]

[0331]

[0332]

[0333] because Perpendicular to plane OAB, therefore It can be by and The cross product yields:

[0334]

[0335] Therefore, angle θ s The final formula is:

[0336]

[0337] Using θ h The angle θ represents the angle between the emitted ray from the HUD and the horizontal plane. h ′ represents the angle between the projection of the emitted ray onto the horizontal plane and the vehicle body. If the light intensity obtained by the brightness sensor is E1, then the light intensity directly incident on the optical engine is:

[0338]

[0339] Where k and w represent the light contraction intensity in each of the two dimensions, and in this embodiment, both k and w are 1.

[0340] The next step is to calculate the angle between the reflected light from nearby high-reflection buildings and the direction of the car's movement. Figure 38 This is a diagram illustrating the angle between the reflected light and the vehicle, such as... Figure 38 As shown, where θ r Let θ be the angle between the reflected sunlight and the ground at the current moment. r ′ is the angle between the projection of the reflected light onto the ground and the forward direction of the car.

[0341] At a certain moment, the system obtains from the navigation signal the angle Θ = {θ} between the walls of n high-altitude buildings near the vehicle and due north. i} i＝1:n Assuming the positive direction of the meridian is due north, and the positive direction of the wall vector is the left direction when facing the wall, then θ is defined as the angle between the wall vector and the meridian in the right-hand coordinate system.

[0342] Since the building is perpendicular to the ground, it is easy to conclude that:

[0343] θ r =θ s

[0344] θ′ r =(2θ) i -θ′ s mod360

[0345] Therefore, the light intensity entering the optical engine after being reflected by a highly reflective building is:

[0346]

[0347] Combining the intensity of the light directly incident on the optical engine with the intensity of the light reflected from the optical engine yields the fused light intensity E entering the optical engine.s ,

[0348]

[0349] The system then combines the light intensity E near the virtual image plane obtained by the sensor. d The combined light intensity is obtained as follows:

[0350] E = E d +E s

[0351] Quick adjustment of brightness in special road sections

[0352] When passing through special road sections with sudden changes in brightness, it is necessary to adjust the brightness before reaching the point of change. However, due to the high speed of the car, traditional adjustment technology cannot meet the requirements. The brighter virtual image surface will block the field of vision in darker road sections such as tunnels, which greatly increases the risk of driving.

[0353] Figure 39 Revise the flowchart for special road sections, such as Figure 39 As shown, during driving, signals from the navigation system are acquired in real time. If there is a sudden change in light intensity ahead, such as in a tunnel or under an overpass, special road correction is activated. When the car is m meters away from the sudden change in light intensity, the distance between the car body and the sudden change point is periodically acquired. Since the frame rate of navigation data is usually low, it is difficult to meet the requirements. Therefore, frame interpolation is needed between two signal inputs to ensure the acquisition of the car body position above 60Hz. The IMU can acquire the car's linear and angular acceleration in real time, and the acceleration can be used to interpolate the car body position. Assume that at a certain moment, the distance between the car position and the sudden change point from the navigation data is S. t Then the distance after IMU data compensation at time t+1 is:

[0354]

[0355] Where 'a' is the car's acceleration obtained from the accelerometer.

[0356] Use S M and L M S represents the distance between the correction start point and the abrupt change point, and the brightness of the HUD. N and L N Let the distance from the abrupt change point and the brightness of the HUD represent the end of the adjustment. Then, the weighting factor at the distance of S meters from the abrupt change point is:

[0357]

[0358] When the car is in S M When the car is at position S, s is 1, meaning the original brightness is maintained. NAt this point, s is 0, meaning the correction is complete, ensuring the car is at a distance of S from the abrupt change point. N At a distance of 1 meter, the brightness has already reached a low level; the specific correction formula can be found in section 3.

[0359] HUD brightness adjustment

[0360] In this embodiment, the automatic brightness adjustment function is given using a calibration and correction method. The brightness adjustment curve for non-special road sections is as follows:

[0361]

[0362] MIN_VALUE and MAX_VALUE are the minimum and maximum brightness values ​​that the HUD virtual image surface can achieve, respectively.

[0363] When passing through special road sections, the currently calculated weight factor is s, and the brightness adjustment function is:

[0364] L = L N +(L M -L N )*s

[0365] The brightness value is transmitted to the vehicle's hardware via the brightness adjustment module, and the HUD's optical parameters are ultimately adjusted by the underlying software.

[0366] In this embodiment, the brightness is adjusted by combining the geographic location information with the ambient light intensity of the virtual image surface and the light intensity of the incident optical engine. The adjustment result is more accurate and closer to the driver's actual perception.

[0367] In this embodiment, the distance between the vehicle body position and the area of ​​sudden change in light intensity is considered to perform pre-adjustment of the brightness of the HUD virtual image surface, so as to avoid the light window from obstructing the view due to the lag in adjustment, which greatly reduces driving danger and ensures the safety of passengers.

[0368] In this embodiment, a special road segment management module is used to calculate the distance between the vehicle body and the abrupt change point in real time, and the brightness adjustment is weighted and corrected based on the distance. This allows the adjustment to be completed outside the specified distance from the abrupt change point, avoiding lag in adjustment that could obstruct the view.

[0369] In this embodiment, the light intensity near the virtual image surface is obtained while the light intensity of the incident optical engine is calculated. The two parts of light are combined to provide a basis for subsequent brightness adjustment. This allows for a more comprehensive consideration of the light intensity source, making the brightness adjustment of the HUD virtual image surface more consistent with the real perception of the human eye and more accurate.

[0370] Some abbreviations used in the embodiments of this application include: Augmented Reality (AR), Head-Up Display (HUD), Global Positioning System (GPS), and Inertial Measurement Unit (IMU).

[0371] This application also provides a computer-readable storage medium storing a computer program thereon, which, when executed by a computer, implements the method flow of any of the above method embodiments.

[0372] This application also provides a computer program or a computer program product including a computer program, which, when executed on a computer, will cause the computer to implement the method flow in any of the above method embodiments.

[0373] This application also provides a chip, including: a processing module and a communication interface, wherein the processing module is capable of executing the method flow in any of the above method embodiments.

[0374] It should be understood that the processor mentioned in the embodiments of this application can be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor can be a microprocessor or any conventional processor.

[0375] It should also be understood that the memory mentioned in the embodiments of this application can be volatile memory or non-volatile memory, or may include both volatile and non-volatile memory. The non-volatile memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. The volatile memory can be random access memory (RAM), which is used as an external cache. By way of example, but not limitation, many forms of RAM are available, such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDR SDRAM), Enhanced Synchronous DRAM (ESDRAM), Synchlink DRAM (SLDRAM), and Direct Rambus RAM (DR RAM).

[0376] It should be noted that the memories described herein are intended to include, but are not limited to, these and any other suitable types of memories.

[0377] It should also be understood that the use of the terms "first," "second," and various numerical designations in this document is merely for descriptive convenience and is not intended to limit the scope of this application.

[0378] It should be understood that the term "and / or" in this article is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, or B existing alone. Additionally, the character " / " in this article generally indicates that the preceding and following related objects have an "or" relationship.

[0379] It should be understood that in the various embodiments of this application, the order of the above processes does not imply the order of execution. Some or all steps may be executed in parallel or sequentially. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0380] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0381] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0382] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0383] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0384] In addition, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0385] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, network device, or terminal device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0386] The relevant parts of the various method embodiments in this application can be referenced to each other; the apparatus provided in each device embodiment is used to execute the method provided in the corresponding method embodiment, so each device embodiment can be understood by referring to the relevant parts of the relevant method embodiment.

[0387] The device structure diagrams given in the various device embodiments of this application only show simplified designs of the corresponding devices. In practical applications, the device can include any number of transmitters, receivers, processors, memories, etc., to achieve the functions or operations performed by the device in the various device embodiments of this application.

[0388] The names of messages / frames / indication information, modules, or units provided in the embodiments of this application are merely examples, and other names may be used as long as the function of the messages / frames / indication information, modules, or units is the same.

[0389] The terminology used in the embodiments of this application is for the purpose of describing particular embodiments only and is not intended to be limiting of this application. The singular forms “a,” “the,” and “the” used in the embodiments of this application and the appended claims are also intended to include the plural forms unless the context clearly indicates otherwise. It should also be understood that the term “and / or” as used herein refers to and includes any or all possible combinations of one or more associated listed items. The character “ / ” in this document generally indicates that the preceding and following objects are in an “or” relationship.

[0390] Depending on the context, the words “if” or “suppose” as used here can be interpreted as “when” or “in response to determination” or “in response to detection.” Similarly, depending on the context, the phrase “if determination” or “if detection (of the condition or event of the statement)” can be interpreted as “when determination” or “in response to determination” or “when detection (of the condition or event of the statement)” or “in response to detection (of the condition or event of the statement).”

[0391] Those skilled in the art will understand that all or part of the steps in the methods of the above embodiments can be implemented by a program instructing related hardware. The program can be stored in a readable storage medium of a device. When the program is executed, it includes all or part of the above steps. The storage medium may be, for example, FLASH, EEPROM, etc.

Claims

1. A display method, characterized in that, The method includes: The system acquires environmental information corresponding to the vehicle. The environmental information includes location information and light intensity information. The location information includes the vehicle's position and the position of the brightness abrupt change area, which is the area where ambient light is blocked in the vehicle's direction of travel. The light intensity information includes the intensity of ambient light corresponding to the imaging position of the display device and the intensity of ambient light corresponding to at least one imaging area of ​​the display device. The intensity of ambient light corresponding to at least one imaging area of ​​the display device is determined based on image information in front of the vehicle. The image information includes the grayscale value of the ground background corresponding to at least one imaging area of ​​the display device, which is determined based on the human eye position. Based on the environmental information, the display mode of the vehicle's display device is adjusted before the vehicle enters or leaves the area of ​​sudden brightness change; The display method includes display brightness and display position. The display brightness is positively correlated with the intensity of ambient light corresponding to the imaging position of the display device, and negatively correlated with a first distance between the vehicle and the brightness change area. The display position is related to the intensity of ambient light corresponding to at least one imaging area of ​​the display device.

2. The method according to claim 1, characterized in that, The step of adjusting the display mode of the vehicle's display device before the vehicle enters or leaves the area of ​​sudden brightness change based on the environmental information includes: The first distance is determined based on the position of the vehicle and / or the position of the area where the ambient light is blocked; The display mode of the display device is adjusted according to the first distance.

3. The method according to claim 2, characterized in that, Adjusting the display mode of the display device according to the first distance includes: If the first distance is less than the preset distance, the display mode of the display device is adjusted.

4. The method according to any one of claims 1-3, characterized in that, The display method includes a first display brightness; the light intensity information also includes: the intensity of ambient light received by the optical elements of the display device; The step of adjusting the display mode of the vehicle's display device before the vehicle enters or leaves the area of ​​sudden brightness change based on the environmental information further includes: The first display brightness of the display device is adjusted based on the intensity of ambient light received by the optical elements of the display device and the intensity of ambient light corresponding to the imaging position of the display device; wherein the first display brightness is positively correlated with the intensity of ambient light received by the optical elements of the display device.

5. The method according to claim 4, characterized in that, The light intensity information includes the intensity of ambient light corresponding to at least one imaging area of ​​the display device, and the display method includes the display position; The step of adjusting the display mode of the vehicle's display device before the vehicle enters or leaves the area of ​​sudden brightness change based on the environmental information further includes: The target imaging area is determined based on the intensity of ambient light corresponding to at least one imaging area of ​​the display device; Adjust the display position of the display device according to the target imaging area.

6. The method according to claim 5, characterized in that, The display device includes a head-up display (HUD) optical engine, and the light intensity information further includes the intensity of ambient light received by the optical elements of the HUD optical engine. The acquisition of environmental information corresponding to the vehicle includes: The incident angle of the ambient light received at the output port of the HUD optical engine, the output angle of the HUD output light, and the intensity of the ambient light received at the output port of the HUD optical engine are obtained. The intensity of ambient light received by the optical element of the HUD optical engine is determined based on the incident angle, the exit angle, and the intensity of ambient light received at the light exit port; wherein the intensity of ambient light received by the optical element of the HUD optical engine is positively correlated with the intensity of ambient light received at the light exit port and negatively correlated with the difference between the incident angle and the exit angle.

7. The method according to claim 5, characterized in that, The display device includes a HUD optical engine, and the light intensity information includes the intensity of ambient light received by the optical elements of the HUD optical engine; The acquisition of environmental information corresponding to the vehicle also includes: Determine the first angle between the ambient light and the horizontal plane, and the second angle between the projection of the ambient light onto the horizontal plane and the vehicle's direction of travel; determine the third angle between the HUD's emitted light rays and the horizontal plane, and the fourth angle between the projection of the HUD's emitted light rays onto the horizontal plane and the vehicle's direction of travel; Determine a first difference between the first included angle and the third included angle, and a second difference between the second included angle and the fourth included angle; The intensity of ambient light received by the optical element of the HUD optical engine is determined based on the first difference, the second difference, and the intensity of ambient light received at the output port of the HUD optical engine; wherein the intensity of ambient light received by the optical element of the HUD optical engine is positively correlated with the intensity of ambient light received at the output port of the HUD optical engine, negatively correlated with the first difference, and negatively correlated with the second difference.

8. The method according to any one of claims 1-3 and 5-7, characterized in that, The method further includes: Acquire the image information of the front of the vehicle and the position of the human eye. The image information of the front of the vehicle includes the grayscale value of each pixel in the image of the front of the vehicle. Based on the position of the human eye, the ground background corresponding to at least one imaging area of ​​the display device is determined, and the ground background corresponding to at least one imaging area of ​​the display device is included in the image in front of the vehicle; Based on the image information, the grayscale value of the ground background corresponding to at least one imaging area of ​​the display device is obtained; The intensity of ambient light corresponding to at least one imaging area of ​​the display device is determined based on the grayscale value of the ground background corresponding to at least one imaging area of ​​the display device.

9. The method according to claim 8, characterized in that, The ambient light includes direct sunlight and / or sunlight reflected by reflective objects.

10. The method according to claim 3, characterized in that, The method further includes: Obtain the distance between the marker point corresponding to the area where the ambient light is blocked and the area where the ambient light is blocked, wherein the marker point is set outside the area where the ambient light is blocked; The step of adjusting the display mode of the display device according to the first distance further includes: The display mode of the display device is adjusted based on the first distance, the preset distance, and the distance between the marker point and the area where the ambient light is blocked.

11. The method according to any one of claims 1-3, 5-7, 9, and 10, characterized in that, The display method also includes at least one of the following: display content, display position, display color, display style, and display size.

12. An electronic device, characterized in that, include: The acquisition module is used to acquire environmental information corresponding to the vehicle. The environmental information includes location information and light intensity information. The location information includes the position of the vehicle and the position of the brightness change area. The brightness change area is the area where the ambient light is blocked in the direction of the vehicle's travel. The light intensity information includes the intensity of the ambient light corresponding to the imaging position of the display device and the intensity of the ambient light corresponding to at least one imaging area of ​​the display device. The intensity of the ambient light corresponding to at least one imaging area of ​​the display device is determined based on the image information in front of the vehicle. The image information includes the grayscale value of the ground background corresponding to at least one imaging area of ​​the display device. The ground background corresponding to at least one imaging area of ​​the display device is determined based on the position of the human eye. An adjustment module is used to adjust the display mode of the vehicle's display device before the vehicle enters or leaves the brightness abrupt change area, based on the environmental information. The display method includes display brightness and display position. The display brightness is positively correlated with the intensity of ambient light corresponding to the imaging position of the display device, and negatively correlated with a first distance between the vehicle and the brightness change area. The display position is related to the intensity of ambient light corresponding to at least one imaging area of ​​the display device.

13. The apparatus according to claim 12, characterized in that, The adjustment module is further configured to: determine a first distance between the vehicle and the area where the ambient light is blocked, based on the position of the vehicle and / or the position of the area where the ambient light is blocked; and adjust the display mode of the display device based on the first distance.

14. The apparatus according to claim 13, characterized in that, The adjustment module is further configured to: adjust the display mode of the display device when the first distance is less than a preset distance.

15. The apparatus according to any one of claims 12-14, characterized in that, The display method includes a first display brightness; the light intensity information also includes: the intensity of ambient light received by the optical elements of the display device; The adjustment module is further configured to: determine the display brightness based on the intensity of ambient light received by the optical element of the display device and the intensity of ambient light corresponding to the imaging position of the display device; wherein the first display brightness is positively correlated with the intensity of ambient light received by the optical element of the display device.

16. The apparatus according to claim 15, characterized in that, The light intensity information also includes the intensity of ambient light corresponding to at least one imaging area of ​​the display device, and the display method includes the display position; The adjustment module is further configured to: determine a target imaging area based on the intensity of ambient light corresponding to at least one imaging area of ​​the display device; and adjust the display position of the display device based on the target imaging area.

17. The apparatus according to any one of claims 12-14, 16, characterized in that, The adjustment module is further configured to: adjust the second display brightness according to the first distance.

18. The apparatus according to claim 17, characterized in that, The display device includes a head-up display (HUD) optical engine, and the light intensity information includes the intensity of ambient light received by the optical elements of the HUD optical engine. The acquisition module is further configured to: acquire the incident angle of the ambient light received at the light output port of the HUD optical engine, the exit angle of the emitted light from the HUD, and the intensity of the ambient light received at the light output port of the HUD optical engine; determine the intensity of the ambient light received by the optical element of the HUD optical engine based on the incident angle, the exit angle, and the intensity of the ambient light received at the light output port; wherein the intensity of the ambient light received by the optical element of the HUD optical engine is positively correlated with the intensity of the ambient light received at the light output port and negatively correlated with the difference between the incident angle and the exit angle.

19. The apparatus according to claim 17, characterized in that, The display device includes a HUD optical engine, and the light intensity information includes the intensity of ambient light received by the optical elements of the HUD optical engine; The acquisition module is further configured to: determine a first angle between the ambient light and the horizontal plane, and a second angle between the projection of the ambient light onto the horizontal plane and the vehicle's direction of travel; determine a third angle between the HUD emitted light beam and the horizontal plane, and a fourth angle between the projection of the HUD emitted light beam onto the horizontal plane and the vehicle's direction of travel; determine a first difference between the first angle and the third angle, and a second difference between the second angle and the fourth angle; and determine the intensity of the ambient light received by the optical element of the HUD optical engine based on the first difference, the second difference, and the intensity of the ambient light received at the light output port of the HUD optical engine; wherein the intensity of the ambient light received by the optical element of the HUD optical engine is positively correlated with the intensity of the ambient light received at the light output port of the HUD optical engine, negatively correlated with the first difference, and negatively correlated with the second difference.

20. The apparatus according to any one of claims 12-14, 16, 18, and 19, characterized in that, The acquisition module is further configured to: acquire image information of the front of the vehicle and the position of the human eye, wherein the image information of the front of the vehicle includes the grayscale value of each pixel in the image of the front of the vehicle; The adjustment module is further configured to: determine the ground background corresponding to at least one imaging area of ​​the display device based on the position of the human eye, wherein the ground background corresponding to at least one imaging area of ​​the display device is included in the image in front of the vehicle; Based on the image information, the grayscale value of the ground background corresponding to at least one imaging area of ​​the display device is obtained; based on the grayscale value of the ground background corresponding to at least one imaging area of ​​the display device, the intensity of the ambient light corresponding to at least one imaging area of ​​the display device is determined.

21. The apparatus according to claim 20, characterized in that, The ambient light includes direct sunlight and / or sunlight reflected by reflective objects.

22. The apparatus according to claim 14, characterized in that, The acquisition module is further configured to: acquire the distance between the marker point corresponding to the ambient light occluded area and the ambient light occluded area, wherein the marker point is located outside the ambient light occluded area; The adjustment module is further configured to: adjust the display mode of the display device according to the first distance, the preset distance, and the distance between the marker point and the area where the ambient light is blocked.

23. The apparatus according to any one of claims 12-14, 16, 18, 19, 21, and 22, characterized in that, The display method also includes at least one of the following: display content, display position, display color, display style, and display size.

24. An electronic device, characterized in that, include: processor; Memory used to store processor-executable instructions; The processor is configured to implement the method described in any one of claims 1-11 when executing the instructions.

25. A display system, characterized in that, include: Display devices; Data acquisition equipment, used to collect environmental information; The electronic device as described in any one of claims 12-23.

26. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores program code that, when executed by an electronic device or a processor in an electronic device, implements the display method as described in any one of claims 1 to 11.

27. A computer program product, characterized in that: When the program code contained in the computer program product is executed by an electronic device or a processor in an electronic device, it implements the display method as shown in any one of claims 1 to 11.

Images