HUD high-contrast display mode switching method, system and device, and medium

Abstract

The invention belongs to the technical field of vehicle head-up display, and particularly relates to an HUD high-contrast display mode switching method, system and device for automatically detecting the environment state and a medium, and the method comprises the steps: obtaining a video image in front of a vehicle; calibrating an HUD virtual image display range in the video picture, and identifying background color information in the HUD virtual image display range in the video picture; and adjusting the overall color of the HUD virtual image display picture according to the background color information so as to switch the high-contrast display mode of the HUD according to the current environment state. According to the method, the display mode of the HUD can be adaptively adjusted according to the environment where the vehicle is located, the requirement of a user for observing HUD driving information in different scenes during driving is met under the condition that the cost of the whole vehicle is not additionally increased, the display attractiveness is guaranteed, the use complexity of the user is reduced, the driving safety is greatly improved, and the user experience is improved. And an intelligent vehicle use service is provided for the user.

Description

Technical Field

[0001] The present invention belongs to the technical field of vehicle head-up display, and in particular relates to a method, system, device, and medium for automatically detecting an environmental state to switch a HUD high-contrast display mode. Background Art

[0002] With the development of electronic technology, electrification, intelligence, networking and sharing are gradually becoming the development trend and strategic direction of the automotive industry. As a new way of information interaction, the head-up display system HUD (Head-Up Display) is equipped in more and more car models.

[0003] HUD is a technology that uses a screen to refract and reflect the screen content through an optical lens to form a virtual image projection, and then presents it to the user on the front windshield of the car. The virtual image is directly suspended on the road and displayed with the road as the background.

[0004] Since the road is usually dark, in order to make the display more aesthetically pleasing, the content displayed in the HUD is usually mainly light-colored, forming a contrast with the dark background, making it easier for users to observe its content. When a vehicle is driving on a snowy environment or other light-colored road surface, the ground color becomes white or light-colored, and the contrast of the light-colored content on the HUD virtual image becomes extremely low, making it difficult for users to recognize the HUD display content, making it difficult for users to observe key driving information, which greatly threatens driving safety.

[0005] At present, the traditional approach is to make a high-contrast display mode, such as snow mode. After the user manually turns on the snow mode, the light-colored part of the HUD display content will be replaced with orange for display, which can effectively solve the problem of insufficient information color contrast.

[0006] However, since the setting items are manually set by the user and the high contrast mode setting is very seldom used, the setting items are usually hidden deep, making it difficult for users to find the high contrast mode switch while driving, which is very inconvenient and seriously affects driving safety. Summary of the invention

[0007] In view of the shortcomings of the prior art mentioned above, the purpose of the present invention is to provide a method for automatically detecting environmental conditions and adaptively switching HUD high-contrast display modes, which meets the needs of users to observe HUD driving information while driving in different scenarios without increasing the cost of the entire vehicle. It not only ensures the aesthetics of the display, but also reduces the complexity of user use, greatly improves driving safety, and provides users with intelligent vehicle use services.

[0008] To achieve the above-mentioned purpose and other related purposes, the present invention provides a method for switching a HUD high-contrast display mode by automatically detecting an environmental state, comprising: acquiring a video screen in front of a vehicle; calibrating a HUD virtual image display range in the video screen, and identifying background color information within the HUD virtual image display range in the video screen; and adjusting the overall color of the HUD virtual image display screen according to the background color information, so as to switch the HUD high-contrast display mode according to the current environmental state.

[0009] According to a specific embodiment of the present invention, the step of calibrating the HUD virtual image range in the video screen includes: calibrating the HUD virtual image display range corresponding to the driver's position in the video screen according to a preset size of the HUD virtual image display screen of the vehicle.

[0010] According to a specific embodiment of the present invention, the step of identifying background color information within the HUD virtual image display range in the video screen includes: dividing the HUD virtual image display range in the video screen into a plurality of rectangular areas; and calculating the background color information within the HUD virtual image display range based on the pixel color data of all rectangular areas.

[0011] According to a specific embodiment of the present invention, the step of identifying the background color information within the HUD virtual image display range in the video screen includes: dividing the HUD virtual image display range in the video screen into a plurality of rectangular areas; calculating the background color information within the HUD virtual image display range based on the pixel color data of some rectangular areas; wherein some rectangular areas are obtained by means of interval extraction.

[0012] According to a specific embodiment of the present invention, the step of calculating the background color information within the HUD virtual image display range includes: performing mean processing on all pixel color data according to the encoding format of the video picture.

[0013] According to a specific embodiment of the present invention, the step of adjusting the overall color of the HUD virtual image display screen according to the background color information to switch the HUD to a high contrast display mode according to the current environmental state includes: comparing the color information of the HUD virtual image display screen with the background color information and calculating the contrast; and confirming whether to switch to a high contrast display mode according to the contrast value to adapt to the current environmental state.

[0014] According to a specific embodiment of the present invention, the step of confirming whether to switch to a high contrast display mode based on the contrast value to adapt to the current environmental state includes: when the contrast value is lower than a preset threshold, switching to a high contrast display mode; when the contrast value is higher than or equal to the preset threshold, switching to a normal display mode.

[0015] A HUD high-contrast display mode switching system for automatically detecting environmental conditions comprises: a picture shooting module for acquiring a video picture in front of a vehicle; a picture processing module for calibrating a HUD virtual image display range in the video picture and identifying background color information within the HUD virtual image display range in the video picture; and a HUD display module for adjusting the overall color of the HUD virtual image display picture according to the background color information, so as to switch the HUD high-contrast display mode according to the current environmental conditions.

[0016] An electronic device includes a processor, wherein the processor is coupled to a memory, and the memory stores program instructions. When the program instructions stored in the memory are executed by the processor, the above-mentioned method is implemented.

[0017] A computer-readable storage medium includes a program. When the program is run on a computer, the computer is enabled to execute the method described above.

[0018] The present invention provides a HUD high-contrast display mode switching method for automatically detecting environmental conditions, which utilizes existing on-board camera equipment to identify the content of a video screen in front of a vehicle, thereby determining the vehicle's environment, and further adjusting the display color of the HUD screen to improve the contrast of the display screen.

[0019] The present invention can realize intelligent HUD display mode adjustment, avoid tedious manual settings by users, and greatly improve convenience and driving safety. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 A flowchart of a specific embodiment of a method for switching a HUD high-contrast display mode for automatically detecting an environmental state provided by the present invention; Figure 2 It is a schematic diagram of the camera shooting screen, the HUD virtual image display screen and the corresponding background screen; Figure 3 This is a schematic diagram of the HUD virtual image display range in the camera image; Figure 4 A structural schematic diagram of a specific embodiment of a HUD high-contrast display mode switching system for automatically detecting environmental conditions provided by the present invention; Figure 5 The present invention provides a structural block diagram of a specific embodiment of an electronic device. DETAILED DESCRIPTION

[0021] In order to facilitate understanding of the present application, the present application will be described more fully below with reference to the relevant drawings. Embodiments of the present application are provided in the drawings. However, the present application can be implemented in many different forms and is not limited to the embodiments described herein. On the contrary, the purpose of providing these embodiments is to make the disclosure of the present application more thorough and comprehensive.

[0022] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein in the specification of this application are only for the purpose of describing specific embodiments and are not intended to limit this application.

[0023] The following describes the embodiments of the present invention by specific examples, and those skilled in the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification. The present invention can also be implemented or applied through other different specific embodiments, and the details in this specification can also be modified or changed in various ways based on different viewpoints and applications without departing from the spirit of the present invention. It should be noted that the following embodiments and features in the embodiments can be combined with each other without conflict.

[0024] In the following description, numerous details are discussed to provide a more thorough explanation of the embodiments of the present invention. However, it is obvious to those skilled in the art that the embodiments of the present invention can be implemented without these specific details. In other embodiments, well-known structures and devices are shown in the form of block diagrams rather than in detail to avoid making the embodiments of the present invention difficult to understand.

[0025] Example 1 See also Figure 1 A method for switching a HUD high-contrast display mode by automatically detecting an environmental state is shown, comprising: Step S100, obtaining a video image in front of the vehicle.

[0026] To this end, the vehicle's existing dashcam camera or smart front camera can be used to capture real-time road images of the vehicle and identify the current environmental status in turn. Therefore, the video images captured in front of the vehicle need to be transmitted to the vehicle terminal for processing.

[0027] Step S200, calibrating the HUD virtual image display range in the video screen, and identifying background color information in the HUD virtual image display range in the video screen.

[0028] First, the ground range covered by the HUD virtual image needs to be mapped to the image captured by the camera, so as to calibrate the HUD virtual image display range in the image. Figure 2 As shown, the HUD device can project the display screen onto the front windshield of the vehicle, thereby forming a virtual image on the glass. In this regard, the area where the extension line of the light from the human eye to the picture on the glass intersects with the ground is the background of the HUD virtual image display screen, that is, the road area where the vehicle is currently located. The picture in front of the vehicle taken by the camera covers the area in front of the vehicle, which includes not only the background area of ​​the HUD virtual image display screen, but also other picture areas. Therefore, it is necessary to calibrate the corresponding virtual image display range in the captured video screen according to the projection position and preset size of the vehicle with respect to the HUD virtual image display screen.

[0029] Usually, the HUD virtual image display needs to be facing the driving position so that the driver can observe the real-time projected image of the vehicle while driving, avoiding the risk of blind driving caused by frequently looking down at the instrument or the in-vehicle navigation, thereby improving driving safety. ‌For this reason, the HUD device needs to project the display image onto the front windshield of the vehicle facing the driver's position. Correspondingly, this requires first calibrating the HUD virtual image display range corresponding to the driver's position in the video image, and then intelligently identifying the background content within the HUD virtual image display range, that is, the road image where the vehicle is currently located, to confirm the content of the HUD virtual image display screen that needs to be projected, thereby assisting the driver in driving.

[0030] It should be noted here that, in actual applications, the HUD virtual image display screen is mostly projected according to the driver's direction, but this is not used to limit the scope of application of this application. For example, in order to facilitate the driver to better control the vehicle, the auxiliary driving trajectory of the vehicle will be projected, and it is necessary to project it directly towards the driver's direction. However, the HUD with other functional functions of the vehicle can also adopt the method provided by this application. By identifying the background color information within the HUD virtual image display range, the overall color of the HUD virtual image display screen can be adjusted to make the HUD virtual image display screen more eye-catching relative to the background. Without departing from the spirit of the present invention, the modifications and embellishments made to the embodiments of the present invention by those skilled in the art still fall within the scope of the invention application patent of the present invention.

[0031] It should also be added that there are no excessive restrictions on the method of calibrating the HUD virtual image display range in the video screen, that is, calibrating a target area in a screen, and it can be applied to various existing technical means. The modifications and embellishments made to the embodiments of the present invention by those skilled in the art without departing from the spirit of the present invention still fall within the scope of the invention patent application of the present invention.

[0032] Furthermore, after the HUD virtual image display range in the video screen is calibrated, the background color information in the HUD virtual image display range can be identified accordingly. Figure 3As shown, with the upper left corner of the screen as the coordinate origin, the range from (X1, Y1) to (X2, Y2) in the screen is the HUD virtual image display range, which can also be considered as the background area of ​​the HUD virtual image display screen.

[0033] The HUD virtual image display range can be divided into several rectangular areas according to actual needs. By identifying the pixel color data in the rectangular area, the pixel color data of the picture within the HUD virtual image display range can be identified, and the color of the HUD virtual image display screen can be adjusted according to the background color of the picture. Therefore, the more areas there are, the finer the color change recognition will be, and the corresponding computing power consumption will be greater. The number of rectangular area divisions can be customized, and there is no limit on this.

[0034] Specifically, according to the picture resolution within the HUD virtual image display range, the pixel color data of all rectangular areas can be obtained, or the pixel color data of some rectangular areas can be extracted at intervals, and all the original pixel color data are averaged according to the encoding format of the picture to obtain the average value within the HUD virtual image display range, thereby representing the overall brightness of the picture background within the HUD virtual image display range, that is, the background color information.

[0035] It is understandable that pixel color data refers to the color information of each pixel in an image or video frame. Pixels are the basic units that make up an image, and the color data of each pixel is usually determined by the values ​​of the three color channels: red (R), green (G), and blue (B). These values ​​are usually integers from 0 to 255, where 0 represents the minimum brightness of the color and 255 represents the maximum brightness of the color. By mixing these colors in different proportions, a variety of different colors can be generated.

[0036] Therefore, the overall brightness of the background image within the HUD virtual image display range mentioned above specifically refers to the brightness of each of the three primary colors, and the color information of the background image within the HUD virtual image display range is represented by the three primary colors with different brightness ratios.

[0037] Step S300, adjusting the main color of the HUD virtual image display screen according to the background color information, so as to switch the high contrast display mode of the HUD according to the current environment state.

[0038] Based on the background color information within the HUD virtual image display range obtained above, the color information of the current vehicle's environment can be represented. Of course, the color information of the environment represented here is only the color information of the environment of the HUD projection area. In order to make the HUD virtual image display screen more eye-catching relative to the background, it is necessary to adjust the overall color of the HUD virtual image display screen according to the background color information within the HUD virtual image display range.

[0039] In this regard, by comparing the color information of the HUD virtual image display screen with the corresponding background color information and calculating the contrast, if the background brightness within the HUD virtual image display range is high and the contrast with the HUD virtual image display screen is lower than a certain threshold, then the HUD can be switched to a high-contrast display mode, thereby switching the HUD virtual image display screen to a more eye-catching color relative to the background, such as orange, or switching to an inverted color according to the background color within the HUD virtual image display range, which can also improve the contrast. There are no excessive restrictions on the high-contrast display mode, and the settings can be customized according to actual needs. If the background brightness within the HUD virtual image display range is low, and the contrast with the HUD virtual image display screen is higher than or equal to a certain threshold, it means that the contrast is sufficient, then there is no need to enable the high-contrast display mode, and it can be switched to the normal display mode to ensure aesthetics.

[0040] It should also be added here that in high-contrast display mode, if the HUD virtual image display screen needs to be switched to the inverse color of the background color within the HUD virtual image display range, then the HUD virtual image display range needs to be divided into enough rectangular areas to be able to accurately identify the pixel color data within the entire HUD virtual image display range, thereby providing technical support for the inverse color display.

[0041] It should be noted that the step division of the above methods is only for clear description. When implemented, they can be combined into one step or some steps can be split and decomposed into multiple steps. As long as they contain the same logical relationship, they are all within the scope of protection of this application; adding insignificant modifications to the algorithm or process or introducing insignificant designs without changing the core design of the algorithm and process are all within the scope of protection of this application.

[0042] Example 2 See also Figure 4 As shown, this embodiment also provides a HUD high contrast display mode switching system for automatically detecting environmental conditions, characterized in that it includes: The picture shooting module 10 is used to obtain the video picture in front of the vehicle.

[0043] The picture processing module 20 is used to calibrate the HUD virtual image display range in the video picture and identify the background color information in the HUD virtual image display range in the video picture.

[0044] The HUD display module 30 is used to adjust the main color of the HUD virtual image display screen according to the background color information, so as to switch the high contrast display mode of the HUD according to the current environmental status.

[0045] It should be noted that the HUD high-contrast display mode switching system for automatically detecting environmental status provided in the above embodiment and the HUD high-contrast display mode switching method for automatically detecting environmental status provided in the above embodiment 1 belong to the same concept, wherein the specific manner in which each module and unit performs the operation has been described in detail in the method embodiment, and will not be repeated here. In actual application, the HUD high-contrast display mode switching method for automatically detecting environmental status provided in the above embodiment 1 can allocate the above functions to different functional modules as needed, that is, divide the internal structure of the device into different functional modules to complete all or part of the functions described above, and this is not limited here.

[0046] Example 3 See also Figure 5 As shown, an embodiment of the present application further provides an electronic device, comprising a memory 2, a processor 1, and a program stored in the memory and executable on the processor, wherein the processor implements the steps of any of the above methods when executing the program.

[0047] Among them, the memory includes at least one type of readable storage medium, and the readable storage medium includes flash memory, mobile hard disk, multimedia card, card-type memory (for example: SD or DX memory, etc.), magnetic memory, disk, optical disk, etc. In some embodiments, the memory can be an internal storage unit of the electronic device, such as a mobile hard disk of the electronic device. In other embodiments, the memory can also be an external storage device of the electronic device, such as a plug-in mobile hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. equipped on the electronic device. Further, the memory can also include both an internal storage unit of the electronic device and an external storage device. The memory can not only be used to store application software and various types of data installed in the electronic device, but also can be used to temporarily store data that has been output or is to be output.

[0048] In some embodiments, the processor may be composed of an integrated circuit, for example, a single packaged integrated circuit, or a plurality of packaged integrated circuits with the same or different functions, including one or more central processing units (CPUs), microprocessors, digital processing chips, graphics processors, and a combination of various control chips. The processor is the control core (Control Unit) of the electronic device, which connects the various components of the entire electronic device using various interfaces and lines, and executes various functions of the electronic device and processes data by running or executing programs or modules stored in the memory, and calling data stored in the memory.

[0049] The processor executes the operating system of the electronic device and various installed application programs. The processor executes the application programs to implement the steps in the above method embodiment.

[0050] Exemplarily, the program may be divided into one or more modules, which are stored in the memory and executed by the processor to complete the present invention. The one or more modules may be a series of program instruction segments capable of completing specific functions, which are used to describe the execution process of the program in the electronic device.

[0051] The above-mentioned integrated unit implemented in the form of software function modules can be stored in a computer-readable storage medium. The above-mentioned software function modules are stored in a storage medium and include several instructions for enabling a computer device (which can be a personal computer, a computer device, or a network device, etc.) or a processor to perform part of the functions of various embodiments of the present invention.

[0052] In summary, the present invention provides a HUD high-contrast display mode switching method that automatically detects environmental conditions, which utilizes the existing on-board camera equipment to identify the content of the video screen in front of the vehicle, thereby determining the vehicle's environment, and then adjusting the display color of the HUD screen to improve the contrast of the display screen.

[0053] The present invention can realize intelligent HUD display mode adjustment, avoid tedious manual settings by users, and greatly improve convenience and driving safety.

[0054] The above embodiments are merely illustrative of the principles and effects of the present invention, and are not intended to limit the present invention. Anyone familiar with the art may modify or alter the above embodiments without departing from the spirit and scope of the present invention. Therefore, all equivalent modifications or alterations made by a person of ordinary skill in the art without departing from the spirit and technical concept disclosed by the present invention shall still be covered by the claims of the present invention.

Claims

1. A method for switching a HUD high-contrast display mode by automatically detecting an environmental state, characterized in that: include: Get the video image in front of the vehicle; Determine the HUD virtual image display range in the video screen, and identify background color information within the HUD virtual image display range in the video screen; The overall color of the HUD virtual image display screen is adjusted according to the background color information to switch the high contrast display mode of the HUD according to the current environmental status.

2. The HUD high contrast display method for automatically detecting environmental conditions according to claim 1, characterized in that: The step of calibrating the HUD virtual image range in the video screen includes: According to the preset size of the HUD virtual image display screen of the vehicle, the HUD virtual image display range corresponding to the driver's position in the video screen is calibrated.

3. The HUD high contrast display method for automatically detecting environmental status according to claim 1, characterized in that: The step of identifying background color information within the HUD virtual image display range in the video screen includes: Dividing the HUD virtual image display range in the video screen into a plurality of rectangular areas; The background color information within the HUD virtual image display range is calculated based on the pixel color data of all rectangular areas.

4. The HUD high contrast display method for automatically detecting environmental conditions according to claim 1, characterized in that: The step of identifying background color information within the HUD virtual image display range in the video screen includes: Dividing the HUD virtual image display range in the video screen into a plurality of rectangular areas; Calculate the background color information within the HUD virtual image display range according to the pixel color data of the partial rectangular area; Among them, some rectangular areas are obtained by interval extraction.

5. The HUD high contrast display method for automatically detecting environmental status according to claim 3 or 4, characterized in that: The step of calculating the background color information within the HUD virtual image display range comprises: According to the encoding format of the video picture, all pixel color data are averaged.

6. The HUD high contrast display method for automatically detecting environmental status according to claim 1, characterized in that: The step of adjusting the overall color of the HUD virtual image display screen according to the background color information to switch the high contrast display mode of the HUD according to the current environment state includes: Compare the color information of the HUD virtual image display screen with the background color information and calculate the contrast; According to the contrast value, it is determined whether to switch to a high contrast display mode to adapt to the current environment state.

7. The HUD high contrast display method for automatically detecting environmental conditions according to claim 6, characterized in that: The step of determining whether to switch to a high contrast display mode according to the contrast value to adapt to the current environment state includes: When the contrast value is lower than a preset threshold, switching to a high contrast display mode; When the contrast value is higher than or equal to a preset threshold, the display mode is switched to a normal display mode.

8. A HUD high contrast display mode switching system that automatically detects environmental conditions, characterized in that: include: A picture shooting module is used to obtain the video picture in front of the vehicle; A picture processing module, used to calibrate the HUD virtual image display range in the video picture, and identify the background color information within the HUD virtual image display range in the video picture; The HUD display module is used to adjust the overall color of the HUD virtual image display screen according to the background color information, so as to switch the high contrast display mode of the HUD according to the current environmental status.

9. An electronic device, characterized in that: The method comprises a processor, wherein the processor is coupled to a memory, wherein the memory stores program instructions, and when the program instructions stored in the memory are executed by the processor, the method according to any one of claims 1 to 7 is implemented.

10. A computer-readable storage medium, characterized in that: The invention comprises a program, which, when being executed on a computer, causes the computer to execute the method according to any one of claims 1 to 7.

Images