Display control method and device, display equipment, storage medium and vehicle

Abstract

The invention relates to the technical field of projection display, in particular to a display control method and device, display equipment, a storage medium and a vehicle. When the original projection image provided by the cabin system is verified, the display content in the original projection image is divided into the static elements and the dynamic elements according to decoration and function mechanisms, and different comparison mechanisms are adopted for the static elements and the dynamic elements to find that the data reaching the HUD display device is abnormal. And the final display content on the image source is ensured to be correct. According to the method, when the display content provided by the cabin system is abnormal, backup processing of projection display can be carried out in time to ensure normal watching of a user, the robustness is high, and the reliability is higher.

Description

Technical Field

[0001] The present application relates to the technical field of projection display, and in particular, to a display control method, device, display device, storage medium, and vehicle. Background Art

[0002] HUD (Head Up Display) is a new way of realizing in-vehicle display by reflecting on the vehicle windshield. Specifically, the light engine of the HUD display device emits display light, and projects it onto the windshield through corresponding optical lenses to generate corresponding virtual images, forming an enhanced display effect with the real world outside the windshield. Currently, the content projected and displayed by the HUD display device mainly depends on the cockpit system to provide. However, the video link between the cockpit system and the HUD display device is not necessarily absolutely reliable. Once a failure occurs, it will cause abnormalities in the content finally projected by the HUD display device for the user to view, and in severe cases, it will also affect the driving safety of the user. Summary of the Invention

[0003] The purpose of the present application is to provide a display control method, device, display device, storage medium, and vehicle, which solves the technical problem that in the prior art, the HUD display device relies relatively simply on the display content provided by the cockpit system, the projection display is unreliable, and it is impossible to achieve timely processing in case of a failure.

[0004] To solve the above technical problems, the present application adopts the following technical solutions.

[0005] In a first aspect, the present application provides a display control method, including: Obtain the original projection image provided by the cockpit system, and perform verification on at least some of the display blocks in the original projection image to determine whether to directly provide the original projection image to the image source; Among them, the static elements in the display block are compared and judged according to a pre-stored template, and the dynamic elements in the display block are compared and judged according to the real-time data provided by the vehicle system; In response to at least one of the static element and the dynamic element being judged as abnormal, generate a corrected projection image in at least the display block according to the pre-stored template and / or the real-time data.

[0006] In an optional implementation manner of the first aspect, the step of generating a corrected projection image in at least the display block according to the pre-stored template and / or the real-time data in response to at least one of the static element and the dynamic element being judged as abnormal includes: Keep verifying the new original projection image provided by the cockpit system.

[0007] According to the above description, in an alternative embodiment, based on the original projection image, the incorrect content in the display block is directionally corrected according to the pre-stored template and real-time data, etc., which not only reduces the pressure on the rendering computing power of the HUD display device, but also ensures the user's viewing experience.

[0008] In an alternative embodiment of the first aspect, the display control method includes: In response to both the static element and the dynamic element being determined to be normal, directly output the original projection image to the image source for display.

[0009] In an alternative embodiment of the first aspect, the step of in response to both the static element and the dynamic element being determined to be normal, directly output the original projection image to the image source for display includes: Maintain the verification of the original projection image newly provided by the cockpit system.

[0010] According to the above description, in an alternative embodiment, when the verification is consistent, the video circulation path between the cockpit system and the image source can be opened, and the original projection image that meets the display requirements of the image source is directly provided to the image source, avoiding excessive control of the HUD display device.

[0011] In an alternative embodiment of the first aspect, the display control method includes: The static elements and dynamic elements in the display block are determined according to the extended markup file.

[0012] In an alternative embodiment of the first aspect, the extended markup file is an XML file or a JSON file.

[0013] In an alternative embodiment of the first aspect, the extended markup file includes at least one of the size, position, arrangement order of the static elements and dynamic elements, and the font, paragraph, and appearance style of the text fields therein.

[0014] According to the above description, in an alternative embodiment, the correct format in the original projection image can be recorded through the extended markup file to assist in the verification of the original projection image. At the same time, the unified standard rules improve the compatibility of integrated communication and local verification.

[0015] In an alternative embodiment of the first aspect, the display control method includes: The pre-stored template and / or the extended markup file are pre-stored locally in the HUD display device.

[0016] In an alternative embodiment of the first aspect, the step of the pre-stored template and / or the extended markup file being pre-stored locally in the HUD display device includes: When there is an update in the pre-stored template and / or the extended markup file, receive the new version provided by the cockpit system and replace the old version locally.

[0017] In an alternative implementation of the first aspect, when there is an update in the pre-stored template and / or the extended markup file, receiving the new version provided by the cockpit system and replacing the old version locally includes: The version number is included in the pre-stored template and / or the extended markup file locally stored in the HUD display device, and it is determined whether there is an update in the pre-stored template and / or the extended markup file through the version number.

[0018] According to the above description, the alternative implementation can ensure that the extended markup file locally stored in the HUD display device records the latest format information through version control, ensuring the adaptability of local verification.

[0019] In an alternative implementation of the first aspect, the comparison and judgment of the dynamic elements in the display block according to the real-time data provided by the vehicle system include: Extract the data content represented according to the pixel distribution of the dynamic element in the display block.

[0020] In an alternative implementation of the first aspect, the extracting the data content represented according to the pixel distribution of the dynamic element in the display block includes: When the data content represented cannot be extracted, it is directly determined as abnormal.

[0021] According to the above description, the alternative implementation determines the corresponding data content through image analysis, thereby verifying possible information anomalies and timely discovering problems such as rendering existing in the cockpit system itself.

[0022] In an alternative implementation of the first aspect, the comparison and judgment of the static elements in the display block according to the pre-stored template include: The static element is the first identifier and the pixel value difference from other areas in the display block is less than the first threshold, making it impossible for the human eye to normally recognize it.

[0023] In an alternative implementation of the first aspect, the first identifier includes at least one of vehicle identity information, video stream source information, timestamp information, and verification icon.

[0024] According to the above description, the alternative implementation expands the dimension of verification through the first identifier hidden in the original projection image, improves the accuracy of verification, and at the same time, since the first identifier will not be noticed by the user after projection, it will not affect the viewing experience.

[0025] In an alternative implementation of the first aspect, the comparison and determination of the static elements in the display block according to the pre-stored template include: The static element is a second identifier for decoration or marking or a color block for background display.

[0026] According to the above description, in the alternative implementation, since the pre-stored template records standard normal graphics, etc., the static elements in the display block can be directly compared with the pre-stored template, and these elements are used as the main verification objects, which can improve the verification efficiency.

[0027] In an alternative implementation of the first aspect, the generation of at least the corrected projection image in the display block according to the pre-stored template and / or the real-time data includes: In response to the data content represented by the dynamic element having a priority lower than the second threshold, the data content with a priority higher than the third threshold is replaced at the position of the dynamic element.

[0028] In an alternative implementation of the first aspect, the generation of at least the corrected projection image in the display block according to the pre-stored template and / or the real-time data includes: In response to the data content represented by the dynamic element having a priority lower than the second threshold and the dynamic element being abnormal, the data content with a priority higher than the third threshold is replaced at the position of the dynamic element.

[0029] According to the above description, the alternative implementation can utilize the characteristic of being directly connected to the vehicle system and being able to obtain multi-dimensional data, and directly replace the unimportant or abnormal data content in the original projection image locally on the HUD display device, which can not only solve the problem that the cockpit system cannot meet the adaptive display in specific scenarios, but also avoid the difficulty of requiring the HUD display device to implement overall rendering.

[0030] In an alternative implementation of the first aspect, the generation of at least the corrected projection image in the display block according to the pre-stored template and / or the real-time data includes: Performing real-time rendering according to the real-time data to generate at least the dynamic element part in the corrected projection image.

[0031] In an alternative implementation of the first aspect, the generation of at least the corrected projection image in the display block according to the pre-stored template and / or the real-time data includes: Performing real-time rendering according to the real-time data and the extended markup file to generate at least the dynamic element part in the corrected projection image.

[0032] According to the above description, the HUD display device in the optional implementation can bypass the cockpit system and directly correct some rendering problems in the cockpit system based on the real-time data provided by the vehicle system, ensuring the accuracy of the data provided to the user. Combining with the rendering of the extended markup file can also ensure the same rendering effect as the cockpit system.

[0033] In an optional implementation of the first aspect, generating at least the corrected projection image in the display block according to the pre-stored template and / or the real-time data includes: The display content triggered to be output to the image source includes an animated transition from the original projection image to the corrected projection image.

[0034] In an optional implementation of the first aspect, the display content triggered to be output to the image source including an animated transition from the original projection image to the corrected projection image includes: The original projection image in the display block fades out, and the corrected projection image in the display block fades in.

[0035] According to the above description, the optional implementation can ensure that when the HUD display device takes over the display output of the image source and switches the projection, it avoids unnecessary lags, improves the fluency of the whole process, and makes the user unable to perceive the switching process.

[0036] In an optional implementation of the first aspect, verifying at least some display blocks in the original projection image includes: Performing full-pixel verification on static or dynamic elements for information display; Performing pixel sampling verification on static elements for background display.

[0037] In an optional implementation of the first aspect, performing full-pixel verification on static or dynamic elements for information display or performing pixel sampling verification on static elements for background display includes: If the pixel value of a single pixel exceeds the normal range, it is determined as abnormal.

[0038] According to the above description, the optional implementation can analyze abnormal pixel displays within elements, correct possible abnormalities such as color filling, etc., with higher verification efficiency, and at the same time perform classification processing to reduce the workload of verification.

[0039] In an optional implementation of the first aspect, in response to at least one of the static element and the dynamic element being determined as abnormal, generating at least the corrected projection image in the display block according to the pre-stored template and / or the real-time data includes: Sending an anomaly notification to the cockpit system.

[0040] According to the above description, the optional implementation manner can notify the cockpit system in a timely manner, and on the premise that the cockpit system supports self-checking, try to achieve self-repair.

[0041] In a second aspect, the present application provides a display control device, including a projection main control chip, an interface conversion chip, and an image source; The interface conversion chip is configured to forward the original projection image provided by the cockpit system to the projection main control chip; The projection main control chip is configured to perform verification on at least some of the display blocks in the original projection image to determine whether to directly provide the original projection image to the image source. For the static elements in the display blocks, comparison and judgment are made according to a pre-stored template, and for the dynamic elements in the display blocks, comparison and judgment are made according to the real-time data provided by the vehicle system; The image source is configured to receive the corrected projection image provided by the projection main control chip for display when at least one of the static element and the dynamic element is determined to be abnormal.

[0042] In an optional implementation manner of the second aspect, the display control device further includes a decoding chip. The interface conversion chip is connected to the decoding chip to receive the original projection image forwarded by the decoding chip, and forward it to the projection main control chip and / or the image source.

[0043] In an optional implementation manner of the second aspect, the image source is configured to receive the original projection image provided by the interface conversion chip for display when both the static element and the dynamic element are determined to be normal.

[0044] In an optional implementation manner of the second aspect, the projection main control chip is configured with an extended marker file for determining the static element and the dynamic element.

[0045] In an optional implementation manner of the second aspect, the projection main control chip is configured with a pre-stored template and / or an extended marker file, and updates the local storage according to the file version provided by the cockpit system.

[0046] In an optional implementation manner of the second aspect, the projection main control chip is configured to extract the data content represented according to the pixel distribution of the dynamic element in the display block, so as to make a comparison and judgment between the dynamic element and the real-time data.

[0047] In an optional implementation manner of the second aspect, the projection main control chip is configured to extract static elements that cannot be normally recognized by the human eye according to the pixel distribution in the display block.

[0048] In an alternative embodiment of the second aspect, the projection master chip is configured to replace the data content at the position of the dynamic element with data content having a priority higher than a third threshold in response to the data content represented by the dynamic element having a priority lower than a second threshold.

[0049] In an alternative embodiment of the second aspect, the projection master chip is configured to replace the data content at the position of the dynamic element with data content having a priority higher than a third threshold in response to the data content represented by the dynamic element having a priority lower than a second threshold and the dynamic element being abnormal.

[0050] In an alternative embodiment of the second aspect, the projection master chip is configured to perform real-time rendering based on the real-time data to at least generate a dynamic element part in the corrected projection image.

[0051] In an alternative embodiment of the second aspect, the projection master chip is configured to perform real-time rendering based on the real-time data and an extended markup file to at least generate a dynamic element part in the corrected projection image.

[0052] In an alternative embodiment of the second aspect, the projection master chip is configured to trigger that the display content output to the image source includes an animated transition from the original projection image to the corrected projection image in response to at least one of the static element and the dynamic element being determined to be abnormal.

[0053] In an alternative embodiment of the second aspect, the projection master chip is configured to perform full-pixel verification for static or dynamic elements for information display and pixel sampling verification for static elements for background display.

[0054] In an alternative embodiment of the second aspect, the projection master chip is configured to send an abnormality notification to the cockpit system.

[0055] In an alternative embodiment of the second aspect, the projection master chip is configured to send an abnormality notification externally through a decoding chip.

[0056] In a third aspect, the present application provides a display device, including a memory, a processor, and a computer program stored on the memory and running on the processor. When the processor executes the computer program, the steps of the display control method described in the first aspect are implemented.

[0057] In a fourth aspect, the present application provides a computer-readable storage medium storing a computer program. When the computer program is executed by a processor, the steps of the display control method described in the first aspect are implemented.

[0058] Fifth aspect, the present application provides a vehicle, including the display control device described in the second aspect, the display device described in the third aspect, or the computer-readable storage medium described in the fourth aspect.

[0059] Compared with the prior art, when verifying the original projection image provided by the cockpit system, the present application divides the display content in the original projection image into static elements and dynamic elements according to the decoration and function mechanism, and adopts different comparison mechanisms for the static elements and dynamic elements respectively to detect data anomalies in the data reaching the HUD display device, ensuring the correctness of the final display content on the image source. When the display content provided by the cockpit system is abnormal, the present application can timely perform backup processing of the projection display to ensure normal viewing by users, with high robustness and stronger reliability. BRIEF DESCRIPTION OF THE DRAWINGS

[0060] In order to more clearly illustrate the technical solutions of the present application, the accompanying drawings required for the description of the technical solutions will be briefly introduced below. Obviously, the accompanying drawings in the following description are only some examples recorded in the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0061] Figure 1 It is a schematic diagram of HUD projection display in some examples of the present application.

[0062] Figure 2 It is a schematic diagram of the HUD display device module in some examples of the present application.

[0063] Figure 3 It is a schematic diagram of the projection control of the HUD display device in some examples of the present application.

[0064] Figure 4 It is a schematic diagram of the corresponding display information of the original projection image in some examples of the present application.

[0065] Figure 5 It is a schematic diagram of the verification display block selection in some examples of the present application.

[0066] Figure 6 It is a schematic diagram of the generation of static elements and dynamic elements in some examples of the present application.

[0067] Figure 7 It is a schematic diagram of the embedding of the first identifier in some examples of the present application.

[0068] Figure 8 It is a schematic diagram of the sub-region verification of the display block in some examples of the present application.

[0069] Figure 9 It is a schematic diagram of the data providing structure of the vehicle system in some examples of the present application.

[0070] Figure 10 Schematic diagram of the replacement method of the calibrated projection image in some examples of the present application.

[0071] Figure 11 Schematic diagram of the composition of the HUD display device in some examples of the present application.

[0072] Figure 12 Schematic diagram of the projection display in a vehicle in some examples of the present application. Detailed implementation manners

[0073] The present application will be described in detail below with reference to the accompanying drawings. However, the described content is only some examples recorded in the present application and does not limit the present application. Any changes in structure, method, function, etc. made by those of ordinary skill in the art based on these examples are included in the protection scope of the present application.

[0074] It should be noted that in different examples, the same reference numerals or marks may be used, but these do not represent an absolute connection relationship in terms of structure or function. Moreover, the "first", "second", etc. that may be mentioned in each example are only for the convenience of description and do not represent an absolute distinction relationship in terms of structure or function, nor can they be understood as indicating or implying relative importance or the quantity of the corresponding objects. Unless otherwise specified, the "at least one" that may be involved in the description refers to one or more, and the "multiple" refers to two or more.

[0075] In addition, when representing features, the character " / " can represent the relationship of existence or between the associated objects before and after. For example, head-up display / windshield display can represent head-up display or windshield display. When representing operations, the character " / " can represent the relationship of division between the associated objects before and after. For example, the magnification factor M = L / P can be expressed as L (size of the virtual image) divided by P (size of the image source). Moreover, the "and / or" in different examples is only for describing the association relationship of the associated objects before and after, and this association relationship can include three cases. For example, concave mirror and / or convex mirror can represent the case of a concave mirror alone, the case of a convex mirror alone, and the case of both a concave mirror and a convex mirror existing simultaneously.

[0076] The HUD projection display mainly uses the optical reflection principle to reflect the imaging light to be displayed through a transparent surface into the viewer's eyes. The viewer can view the virtual image information along the reverse direction of the light. Correspondingly, the transparent surface can be the windshield of the vehicle, and the windshield can be used as a display screen to display the vehicle's navigation instructions, vehicle driving speed, etc. As Figure 1As shown, the HUD display device may at least include an optical engine 1, a first mirror 2, a second mirror 3, etc. Among them, the optical engine 1 includes a backlight source and an image source (not shown in the figure). The backlight source is used to provide illumination light and adjust the brightness of the illumination light according to control. For example, the backlight source can be an LED (Light Emitting Diode), a laser, etc. The image source adjusts the corresponding display content according to control under the illumination light provided by the backlight source and projects the display light out from the surface of the image source. For example, the image source can be an LCD (Liquid Crystal Display), a DMD (Digital Micromirror Devices), a MEMS (Micro-Electro-Mechanical System) micromirror, an LCOS (LiquidCrystal on Silicon), etc. The first mirror 2 and the second mirror 3 can project the display light projected by the optical engine 1 onto the windshield 4, realizing optical path customization in a small space and meeting different projection display requirements at the same time. The first mirror 2 and the second mirror 3 can be set as concave mirrors, convex mirrors, concave lenses, convex lenses, etc. according to the requirements of optical planning, and the surface shape of the lens can adopt a free-form surface. Optionally, at least one of the first mirror 2 and the second mirror 3 can also be adjusted by a certain angle, so as to change the projection position of the display light on the windshield 4 to meet viewers of different heights. The display light of the optical engine 1 finally reflects on the windshield 4 of the vehicle to form a virtual image 5. When the human eye 6 observes the virtual image 5 facing the windshield 4, a certain sense of depth can be felt, just like observing a real object at a specific distance outside the windshield. The virtual image 5 can be navigation indication content, vehicle driving speed, etc. as described above. It should be added that for the characteristics of different optical engines, the HUD display device can also be provided with an astigmatic lens. In some examples, the HUD display device can also include a Fresnel lens, a waveguide optical device, a diffractive optical device, a holographic optical device, a tapered optical fiber, etc.

[0077] In some examples, such as Figure 2As shown, when the HUD display device in the above example is integrated into a vehicle, it can serve as the display device of the vehicle cockpit system. Information that was traditionally viewed through the center console screen will be directly projected in front of the driver's field of vision, making information viewing more convenient. Accordingly, the power supply and data of the HUD display device can be provided by the vehicle computer 92, or the HUD display device can also supply its own power and generate data. The HUD display device may specifically include a processor 91, an Ethernet interface 901, a CAN (Controller Area Network) interface 902, a power management module 903, a running memory 904, a storage memory 905, a temperature detector 906, a motor 907, a backlight 908, an image source 909, a positioning module 910, a radar 911, a camera 912, etc. It should be noted that Figure 2 The modules listed are merely exemplary descriptions and do not constitute any limitations. In some examples, the HUD display device may also include other modules. Additionally, the above modules may be implemented in one or more hardware components in different examples, or a single module may be implemented by a combination of multiple hardware components.

[0078] Among them, the processor 91 serves as the control center of the HUD display device and includes any type of one or more processing units, including but not limited to a microcontroller unit, a microcontroller, a DSP (Digital Signal Processor), or any combination thereof. The processor 91 is used to generate operation control signals according to a computer program to achieve control of other modules and cooperate with the corresponding modules to process the acquired data, instructions, etc., or the data and instructions it itself has.

[0079] The Ethernet interface 901 is the network data connection port for local area network communication, defining a series of software and hardware standards. Through the Ethernet interface 901, multiple electronic devices can be connected together. In this example, the processor 91 can interact with the vehicle computer 92 through the Ethernet interface 901, such as sending data to the vehicle computer 92 or receiving data sent by the vehicle computer 92.

[0080] The CAN interface 902 is the network data connection port for the controller area network, providing a standard bus for the control systems inside the vehicle and embedded industrial control to achieve communication and interaction between control nodes. In this example, the processor 91 can also interact with the vehicle computer 92 through the CAN interface 902. Optionally, the processor 91 can also be connected to other external devices through the CAN interface 902. In some examples, the processor 91 may also be provided with a GPIO (General-purpose input / output) interface to improve the compatibility of peripheral connections.

[0081] The power management module 903 is connected to the in-vehicle computer 92 and can receive the power provided by the in-vehicle computer 92 to supply a regulated power supply for each module of the HUD display device, ensuring that the processor 91 and each module operate under normal voltage supply and avoiding damage under overvoltage.

[0082] The operating memory 904 is used to store the computer programs executed by the processor 91, as well as the operation data temporarily stored, the data exchanged with the storage memory, etc. The operating memory 904 can be a memory such as SDRAM (Synchronous Dynamic Random-access Memory).

[0083] The storage memory 905 is used to store resources such as relevant display content of the HUD display device, as well as the operating programs and data stored in the long term. The storage memory 905 can be a memory such as Flash (flash memory). In some examples, the processor 91 can also provide an interface to access an external memory.

[0084] The temperature detection 906 is used to detect the temperature inside the HUD display device. Specifically, it can include several temperature sensors. Since the resistance value of the temperature sensor changes with the temperature, the processor 91 can determine the resistance value of the temperature sensor at the corresponding temperature according to the voltage change between each temperature sensor and the voltage-dividing resistor under a fixed power supply voltage, and then inversely deduce the temperature at the position where the temperature sensor is located. In some examples, the processor 91 can control several temperature sensors through the GPIO interface. The several temperature sensors can be set at different positions inside the HUD display device, and the processor 91 can use the time-sharing detection method to respectively obtain the temperature values fed back by the several temperature sensors.

[0085] The motor 907 is used to drive the optical lens in the HUD display device to rotate under the control of the processor 91, thereby realizing the change of the corresponding optical path. For example, when sunlight backflows and causes a temperature rise on the surface of the image source, the optical lens can be driven by the motor to prevent external sunlight from reaching the surface of the image source. In some examples, the processor 91 can also drive the fan provided on the HUD display device through the motor 907 to improve the speed of air exchange inside and outside the HUD display device to achieve heat dissipation. Specifically, the motor 907 is connected to the processor 91 through a motor driver chip. The motor driver chip provides high-performance power output for the motor 907 and can also communicate and control with the processor 91 through interfaces such as SPI (Serial Peripheral Interface).

[0086] A backlight 908 is used to provide illumination light and adjust the brightness of the illumination light according to the control of a processor 91, so as to adjust the projection display brightness of the entire HUD display device. The backlight 908 cooperates with an image source 909 to implement the main functions of optical engine projection display. The backlight 908 can be an LED (Light Emitting Diode), a laser, etc. Specifically, the backlight 908 is connected to the processor 91 through a backlight driving chip. The backlight driving chip provides a driving voltage for the backlight 908 and controls the brightness of the backlight 908 under the pulse width signal output by the processor 91.

[0087] An image source 909 is used to display an image of corresponding content according to the control of the processor 91 and project the display light corresponding to the image. The image source 909 can be an LCD (Liquid Crystal Display), a DMD (Digital Micromirror Devices), a MEMS (Micro-Electro-Mechanical System) micromirror, an LCOS (Liquid Crystal on silicon), etc.

[0088] A positioning module 910 is used to monitor the positions of the HUD display device and the corresponding vehicle. The positioning module 910 can be a global navigation satellite system such as a GPS (Global Positioning System) or a Beidou satellite navigation system. By measuring the distances between satellites and the receiver on the positioning module 910 at different positions, corresponding position and orientation data can be determined. In some examples, the positioning module 910 can also include an inertial navigation system. Based on Newton's laws of motion, by measuring the acceleration of the positioning module 910 in an inertial reference frame, integrating it over time, and transforming it into a navigation coordinate system, data such as velocity, yaw angle, and position in the navigation coordinate system can be obtained. Optionally, the inertial navigation system can assist the global navigation satellite system to achieve more accurate positioning and provide corresponding position information for the processor 91.

[0089] A radar 911 is used to determine the position of a target object through electromagnetic waves and can usually determine the distance between the target object and the vehicle where the radar 911 is located.

[0090] The camera 912 includes a vehicle body camera and an in-vehicle camera. Among them, the vehicle body camera is used to determine the position of the target object through visual recognition. The vehicle body camera can be a monocular camera or a binocular camera. The biggest difference between a monocular camera and a binocular camera is that the binocular camera can capture images from two different perspectives, so as to obtain distance information in three-dimensional space. The in-vehicle camera is used to identify the behavior states of the driver and passengers in the vehicle, including fatigue detection, distraction detection, facial expression recognition, gesture recognition, eye gaze tracking, etc. In this example, the in-vehicle camera can also specifically implement eye movement tracking.

[0091] In some examples, the positioning module 910, the radar 911, and the camera 912 can also be directly connected to the vehicle head unit 92 without being directly connected to the processor 91 of the HUD display device. For example, the vehicle head unit 92 corresponding to the vehicle itself integrates a positioning module for position tracking, a radar, and a camera for autonomous driving. The HUD display device can then obtain the acquisition data of the positioning module, the radar, and the camera in real time through communication with the vehicle head unit 92. In some examples, the real-time data obtained by the positioning module 910, the radar 911, and the camera 912 can be obtained through a directly connected vehicle system, bypassing the cockpit system corresponding to the vehicle head unit, to prevent data communication loss caused by the processing power of the cockpit system itself. This will be described in detail below.

[0092] As Figure 3 shown, the projection display of the HUD display device mainly interacts with the cockpit system. Correspondingly, reference can also be made to Figure 2, the cockpit system mainly provides the video stream projected by the HUD display device. In a specific example, the MCU201 in the cockpit system renders the original projection image output to the HUD display device. Further, the original projection image is converted into the content of a specific video image transmission protocol by the encoding chip 202 and transmitted. For example, the connection for video stream transmission between the cockpit system and the HUD display device is a GMSL (Gigabit Multimedia Serial Link) link. Accordingly, the encoding chip 202 converts the original projection image provided to the HUD display device into signals such as MIPI (Mobile Industry Processor Interface) and FPD-Link (Flat Panel Display Link), and transmits them through the GMSL link. At the HUD display device end, the decoding chip 203 is used to receive the original projection image, which can convert the received signal into an LVDS (Low Voltage Differential Signaling) signal and forward it to the LVDS selection chip 204. The LVDS selection chip 204 controls the forwarding to the MCU205 and / or the image source 206. More specifically, the MCU205 is the projection control center of the HUD display device, responsible for the link control and reprocessing of the video stream, and even directly stores and manages the intermediate data for verification. Accordingly, it can also refer to Figure 2Processor 91. In this example, the MCU 205 can also send a control signal to the LVDS selection chip 204 through an SPI (Serial Peripheral Interface) link to determine whether the LVDS selection chip 204 forwards the original projection image to the image source 206. For example, if the MCU 205 determines through verification that the original projection image is not suitable for directly providing to the image source 206 for projection display, the LVDS link between the LVDS selection chip 204 and the image source 206 will be correspondingly closed. Optionally, there will also be low-speed communication between the cockpit system (encoding chip 202) and the HUD display device (encoding chip 203) through an IIC (Inter-Integrated Circuit) link. For example, the cockpit system can send pre-stored templates, extended markup files, etc. to the HUD display device through its link, and after receiving these data, the decoding chip 203 will forward them to the MCU 205 after decoding as verification data parameters. At the same time, the MCU 205 can also feedback messages such as anomaly notifications to the cockpit system through the IIC link between the decoding chip 203 and the encoding chip 202. In this example, the MCU 205 of the HUD display device is also directly connected to the vehicle system 207. Specifically, a data link can be established through a CAN bus or a LIN (Local Interconnect Network) bus. In this way, the HUD display device can independently obtain various types of status data provided by the vehicle system 207, so as to provide a data basis for the backup display of the image source 206. For example, the MCU 205 can provide a corrected projection image to the image source 206 based on real-time data to replace the original projection image provided by the cockpit system. It should be noted that according to the positioning of the cockpit system and the HUD display device products respectively, although both the MCU 201 and the MCU 205 can render the display video stream of the image source, but considering cost, the configuration of the MCU 205 is generally lower than that of the MCU 201, which results in the MCU 205 not very supporting the normal global rendering work. This is one of the reasons why the HUD display device generally receives the video stream from the cockpit system. However, as the last gatekeeper of projection display, the quality of projection display is often considered the responsibility of the HUD display device by users, even if it is caused by the cockpit system. Therefore, the HUD display device needs to actively verify the original projection image provided by the cockpit system and eliminate anomalies when there are anomalies, and try to avoid users perceiving anomalies to improve the overall viewing experience, and at the same time prevent the lack of important information from causing driving safety problems, which will be described in detail below.

[0093] In some examples, such as Figure 4 shown, for the display information formed by the HUD display device projected on the windshield 4, that is, the content in the projection area 50, refer toFigures 1 - 3 , based on the optical projection mechanism, under normal circumstances, the display information formed by its projection directly corresponds to the original projection image provided by the cockpit system to the image source. In this example, the original projection image can be analyzed to include speed information 51, speed limit information 52, gear information 53, and decoration information 541, 542, background color block 55, etc. For the speed information 51, speed limit information 52, and gear information 53, they can be determined according to the data of the sensing system of the whole vehicle system when the cockpit system generates rendering, and will also dynamically display changes according to the actual vehicle state changes. While the decoration information 541, 542, and background color block 55 can be pre-determined according to the configuration file of the designer before the cockpit system generates rendering, relatively fixed, and less likely to change with the vehicle state changes, and usually only change under the user's settings. For example, the user can update the background color block 55 by changing the wallpaper picture or adjusting the color filling. Correspondingly, when there is an abnormality in the original projection image provided by the cockpit system, it is generally divided into two situations. One mainly occurs when there are problems in information processing and image rendering during the generation of the cockpit system, such as stuttering caused by multiple application processes running simultaneously. The other mainly occurs during the process of the cockpit system sending to the HUD display device, such as frame loss caused by unstable links. Once these incomplete or incorrect original projection images are directly output to the image source, they will be reflected in the projection area 50 and thus be perceived by the user. Refer to Figure 3 , in order to verify the original projection image, a signal will be split by the LVDS selection chip 204 (supporting different display driver protocols, which can include interface conversion chips in more cases) to the MCU205 for processing. The MCU205 decides the content that the image source 206 finally needs to display according to the verification situation, and needs to take active processing for the abnormal original projection image.

[0094] In a specific example, when the MCU205, as the projection master chip, analyzes the original projection image, it will generally divide the display information therein into two types, namely static elements and dynamic elements. Static elements can be the relatively fixed information as described above, generally not changing with the vehicle state changes. For example Figure 4 the decoration information 541, 542, and background color block 55 in. When there are problems with such elements, it is generally related to rendering, error codes, frame loss, etc. It should be noted that if the static elements change along with the animation effect composed of the original projection image, they still belong to static elements. For example, the decoration information 541, 542 will have different highlighted positions over time, because this change does not follow the vehicle state changes, so it is still recognized as a static element. While dynamic elements are more inclined to real-time changes, generally changing with the vehicle state changes. For example Figure 4The speed information 51 and gear information 53 in it are more complex when problems occur in the elements they have. In addition to being possibly related to rendering, error codes, dropped frames, etc., they may also be related to the received vehicle status information and processing delay, etc. Therefore, different verification methods will be adopted for the identified dynamic elements and static elements during verification. Optionally, for a single icon, it may also have both static elements and dynamic elements. Correspondingly, some parts are relatively fixed and some change in real time. For example Figure 4 The speed limit information 52 in it. The outer circle belongs to static elements, and the speed limit value number in the middle belongs to dynamic elements. During the verification process, different verification methods will also be separately adopted according to the different characteristics of static elements and dynamic elements to achieve as fast and efficient as possible on the basis of verification accuracy. In some examples, when the projection main control chip is responsible for verification, it will have both the pre-stored template sent by the cockpit system under normal circumstances in advance and the real-time data just provided by the vehicle system. And the corresponding verification will identify the category to which different elements belong one by one. If it is a static element, the corresponding pre-stored template will be called to compare with it. When they are consistent, it is determined to be normal, and when they are inconsistent, it is determined to be abnormal. For example Figure 4 The background color block 55 in it is marked as globally transparent in the pre-stored template, but there are many noise points in the original projection image, indicating an abnormality. And if it is a dynamic element, the data content represented by the dynamic element will be identified first. Taking Figure 4 The speed information 51 in it as an example. Specifically, semantic recognition can be performed according to the pixel distribution. After extracting the specific speed value of 17 km / h, it will be numerically compared with the speed value provided by the vehicle system. When the speed value provided by the vehicle system is also 17 km / h, it is determined to be normal. When the speed value provided by the vehicle system is not 17 km / h, such as 20 km / h, it is determined to be abnormal. And for the speed limit information 52 and the like that have both static elements and dynamic elements, they will be split and compared. The static element as the circle is generally defined by laws and regulations and serves as a marker, and will be compared with the corresponding pre-stored template. The pre-stored template has the standard shape, color, etc. defined by laws and regulations. By direct comparison, it can be determined whether it is normal. And for the dynamic element as the specific speed limit value, it cannot be directly compared with the pre-stored template. It is necessary to extract the speed limit value in it and compare it with the navigation information provided by the vehicle system. The navigation information has the speed limit information of the current road, so it can be determined whether it is normal.

[0095] In some examples, in order to save the computing power pressure on the projection main control chip caused by verification, such as Figure 5As shown, not all information in the original projection image is verified. Verification can be performed on the display blocks where anomalies often occur or that users are more concerned about when viewing. In this example, verification can be performed on the middle display block of the original projection image, that is, only the speed information 51 and the background color block 55 are verified one by one, while the decoration information, speed limit information, gear information, etc. outside the middle display block are skipped. Referring to the above example, the background color block 55 is identified as a static element and compared and judged according to the pre-stored template. The speed information 51 is identified as a dynamic element and compared and judged according to the real-time data provided by the vehicle system. Further, in order to improve the recognition efficiency of static and dynamic elements, rapid positioning is performed by expanding the format information recorded in the tag file, which can also be sent by the cockpit system to the projection main control chip and stored by the projection main control chip under normal circumstances. Specifically, the extended tag file can be an XML file or a JSON file. The extended tag file specifically describes the dimensions, positions, arrangement orders, etc. of all elements or elements to be verified in the original projection image through structured hierarchical data. Each element is specifically marked in the extended tag file as a static element or a dynamic element. Therefore, when verifying and analyzing the original projection image, the category of the corresponding element can be determined according to the existing position and arrangement order, etc., and it is also clear what method to use for verification. Optionally, the extended tag file can also include the font, paragraph, appearance style, etc. of specific text fields. For example, which font, paragraph, and appearance style the dynamic element specifically uses to render the corresponding data content will be clearly marked in the extended tag file. This can be used not only for verifying the dynamic element but also as the format basis for the projection main control chip to perform local rendering. In more examples, the above-mentioned pre-stored template and extended tag file are files with low-frequency updates. Therefore, they can be directly saved locally in the projection main control chip and may only change when the user changes the projection settings. For example, when a new icon is added to the projection area according to the user's needs, since the distribution or appearance of the elements has changed, accordingly, the pre-stored template and extended tag file also need to be adaptively modified. In some examples, the user can send new settings through the central control screen corresponding to the cockpit system, and the pre-stored template and / or extended tag file will change. The cockpit system will send the new pre-stored template and / or extended tag file to the projection main control chip to update the local storage. Specifically, it can be sent when the cockpit system is idle or before initiating the transmission of the original projection image.To better implement the local version management of the above files by the projection master chip and ensure that the projection master chip always uses the latest version for verification, the cockpit system also embeds a version number in the pre-stored template and / or extended markup file sent. When the projection master chip receives a new pre-stored template and / or extended markup file, it also extracts the version number therein and compares it with the local version number. When the local version number is still the latest, the received file will be directly discarded. When the local version number is not the latest, the received file will be saved locally, the original file will be deleted, and the file call address for verification will also point to the newly saved file.

[0096] Referring to Figure 3 , after the projection master chip determines the verification result, it will control the interface conversion chip. When the verification is normal, that is, any static element and dynamic element are normal, it will open the video link between the interface conversion chip and the image source, or maintain the previous open state, and the image source directly uses the normal original projection image for display output. When the verification is abnormal, that is, at least one of the static element and dynamic element is judged to be abnormal, it will close the video link between the interface conversion chip and the image source, or maintain the previous closed state. At the same time, the projection master chip can perform local processing on the received original projection image, so that the processed corrected projection image can be sent to the image source for display. The projection master chip plays a role in processing and forwarding, which will be described in detail below. Optionally, regardless of whether the original projection image provided by the cockpit system is determined to be normal or abnormal at present, the newly provided original projection image of the cockpit system will be continuously verified. Specifically, the projection master chip will remain connected to the interface conversion chip, continuously receive the video stream forwarded by the interface conversion chip, and maintain real-time monitoring of the original projection image in the video stream. When the verification result changes, it will trigger the interface conversion chip to change the link state of the image source. As Figure 6 shown, when verifying the speed limit information in the original projection image, if there is an abnormality, the original projection image will not be directly output to the image source for display. Instead, after the projection master chip receives the original projection image, it uses the pre-stored template to generate a correct static element image in the form of a circle, and uses the real-time data provided by the vehicle system to render a correct dynamic element image corresponding to the speed limit value. For example Figure 6 in, the original speed limit value in the original projection image was originally 50, and after verification, it was determined to be incorrect. It can be modified to render 60, and the correct speed limit value is superimposed on the center of the circle. Optionally, the font rendered by the dynamic element and attributes such as its position relative to the static element can be rendered and generated with the help of the above extended markup file. Correspondingly, the newly rendered image of only the speed limit information part can be replaced at the corresponding position in the original projection image to generate a corrected projection image for correct display, and then it can be provided to the image source for display.

[0097] In some examples, such as Figure 7 shown, in the display block that supports verification of the original projection image, in addition to static elements and dynamic elements for normal user viewing, a first identifier 56 that is not easily perceptible to the user can be set. The first identifier 56 is additionally embedded in the original projection image by the cockpit system according to the interaction rules. Since the pixel value of the first identifier 56 has little difference from the surrounding pixel values, the human eye cannot perceive this difference, and it feels like a whole with the surrounding. For example, a first threshold can be used to control the setting range of the pixel value of the first identifier 56. The first threshold can be the maximum difference that the human eye cannot perceive the hue change. In this way, the dimension of verification is expanded, so that possible anomalies can be accurately detected through all-round verification, and at the same time, the user experience will not be affected by these verification elements without viewing value. Specifically, these static elements hidden in the original projection image can be set at specific positions according to the needs of verification. For example, large background color blocks are sometimes difficult to show rendering anomalies, so the verification dimension can be expanded by embedding the first identifier 56, and at the same time, the user can only see the content of the background color block. Another example is that the position where the first identifier 56 is embedded avoids the positions of dynamic elements and animation effects, excluding some verification problems caused by the change of the picture, and at the same time avoiding being perceived by the user. Further, specific content can also be set according to the needs of verification. The first identifier 56 can include vehicle identity information, video stream source information, timestamp information, verification icons, etc. Among them, vehicle identity information, video stream source information, etc. can assist the projection main control chip to trace the source of anomalies. Timestamp information can verify the time attribute of the original projection image, determine whether the time delay matches or infer whether the cockpit system is running smoothly, etc. For example, when verifying, the corresponding time point real-time data for comparison is determined according to the timestamp information. The verification icon can use a specific appearance to detect specific rendering problems, such as a shape with jagged edges or a combination of complex filled colors. Further, although the embedded first identifier 56 is not easily perceptible to the human eye, the projection main control chip can easily determine the existence and position and other attributes of the element according to the extended marker file, and analyze the pixel distribution according to the pixel difference, so as to extract the first identifier 56 or the data content represented by the first identifier 56, and its verification method can also refer to the above-mentioned static elements or dynamic elements.

[0098] In some examples, such as Figure 8As shown, it will also divide the corresponding area into a first area 571 for information display. For example, the first area 571 includes static elements and dynamic elements such as speed information, speed limit information, gear information, and decoration information. And a second area 572 for background display. For example, the second area 572 includes static elements such as background color blocks. Since the first area 571 is significantly more important than the second area 572, full-pixel verification can be performed on the elements in the first area 571. That is, the static elements are compared and judged using a complete pre-stored template, and the dynamic elements are compared and judged based on the real-time data provided by the vehicle system. In the second area 572, since the similarity of each position is relatively high, pixel sampling verification can be used. That is, the static elements are compared and judged using a pre-stored template corresponding to the sampled pixel distribution, thus reducing the time and computing power pressure of verification. Optionally, a more simple method can also be used for verification in the second area 572, specifically detecting whether the pixel value of a single pixel exceeds the normal range. For example, if a point with a full-zero pixel value is detected, it is directly determined as abnormal.

[0099] As Figure 9As shown in the figure, the MCU205 of the HUD display device (which can be the projection master chip of the HUD display device) has higher autonomy because it is connected to the vehicle system 207. As described above, it can comprehensively verify dynamic elements based on the real-time data provided by the vehicle system 207. In this example, the vehicle system 207 and the cockpit system are relatively independent. The cockpit system is more inclined to be the display and entertainment control center of the vehicle, emphasizing efficiency under multi-process operation, and its reliability is not as good as that of the vehicle system 207. The vehicle system 207 is specifically connected to multiple sensors on the entire vehicle, such as ECUs (Electronic Control Units) distributed at various positions on the vehicle. Through acquisition and other means, various types of current vehicle status parameters can be obtained in real time. Since these sensors play an important role in driving safety, generally more stable hardware is used to ensure reliability. Specifically, the vehicle speed sensor can collect the current driving speed of the vehicle, and the gear sensor can collect the current gear of the vehicle. These are all information that users highly concern. The ABS status can indicate the use of the braking system or the working status of relevant sensors. The radar can detect objects around the vehicle. The camera can not only detect objects around the vehicle but also support the provision of driving videos. In more examples, the user configurations of all systems in the vehicle can also be accessed. It should be noted that the real-time data that the vehicle system can obtain is not limited to the above, and more-dimensional data can be obtained according to other sensors of the vehicle. When the projection master chip has an abnormality in verifying the original projection image provided by the cockpit system, the original projection image can be further processed. Accordingly, different elements in the original projection image can be locally replaced as needed. The image to be replaced can be rendered based on the real-time data provided by the vehicle system, and this part of the real-time data is more credible. In some examples, the projection master chip not only supports the correction and replacement of abnormal elements in the original projection image but also can replace elements with lower priority to try to meet the viewing needs of users. Optionally, the premise for replacing elements with lower priority is that the elements with lower priority are themselves verified to be abnormal, so that more important information can be rendered and supplemented exactly at the position where they are located. Refer to Figure 9, after receiving the real-time data of each dimension provided by the vehicle system 207, the projection master chip will perform a step of priority judgment to determine which data is lower than the second threshold and is considered relatively low, and which data is higher than the third threshold and is considered relatively high. The second threshold and the third threshold will be set in advance according to the evaluation feedback of actual users, etc. Specifically, the current state of the vehicle can be judged first based on at least part of the real-time data. For example, when the vehicle speed is less than 5 kilometers per hour and in reverse gear, it is determined that the vehicle is in the parking state, and when the vehicle speed is greater than 80 kilometers per hour and in forward gear, it is determined that the vehicle is in the high-speed driving state. When the radar detects an obstacle ahead and the vehicle speed drops rapidly and the ABS is activated, it is determined that the vehicle is in the emergency braking state. Different states have different priorities of real-time data set in advance. This priority can be the factory default or stored after user configuration. For example, when the vehicle is determined to be in high-speed driving, the priority of its speed information is the highest, and the navigation information, holographic image, entertainment information, etc. decrease in turn. In some examples, if the entertainment information in the original projection image is verified as abnormal, the entertainment information will be replaced. In this example, since the entertainment information has the lowest priority, it can be replaced with high-priority information in the corrected projection image, such as speed information and navigation information are both considered relatively high. Since the speed information already exists in the original projection image, the navigation information can be rendered in real time to replace it in the corrected projection image, so that the abnormal entertainment information will no longer be displayed in the projected display content, but the correct navigation information will be directly displayed. Similarly, when the vehicle is in other states such as the parking state and the emergency braking state, different priorities of real-time data will be called to process the abnormal original projection image.

[0100] As described above, when an abnormality is detected in the original projection image, it is equivalent to the HUD display device taking over the entire video stream. That is, the projection main control chip can dominate the whole process, and the display content of the image source is no longer directly provided by the cockpit system. To ensure that the correct display content is still output in the image source, the projection main control chip will also provide a corrected projection image to the image source. The corrected projection image can be a video stream image processed based on the original projection image, and relatively little rendering computing power is required. The intervention pressure on the projection main control chip corresponding to the HUD display device is not too great. Further, when the projection main control chip takes over the output of the display content of the image source, to ensure the coherence before and after the switch and minimize the user's perception of stuttering changes in the projection content, when the projection main control chip ensures the switch of the image source from the projection display image to the corrected projection image, an animation will be inserted during the switch. Before the animation process is the original projection image, and during the animation process, the original projection image fades out gradually while the corrected projection image fades in gradually. This can be a transition design by the projection main control chip based on the original projection image and the corrected projection image materials. Optionally, other coherent transition animations can also be used. After the animation process, the corrected projection image provided by the projection main control chip is directly adopted. As Figure 10 shown, when the speed information 51 is found to have a numerical error during the verification of the original projection image, a correct speed value image is re-rendered based on real-time data as the corrected projection image. When the projection main control chip takes over the display of the image source, the projection main control chip can provide the image source with the original projection image for a period of time, including the image of 17 Km / h. After the projection main control chip renders the corrected projection image, it will first provide the generated transition animation to the image source for display, including the gradual change from 17 Km / h to 20 Km / h, and then provide the correct image of 20 km / h for display on the image source. In some examples, while the HUD display device replaces the original projection image with the corrected projection image, it will also send an abnormality notification, such as an error code, to the cockpit system. Specifically, different abnormality causes have different error codes, and the abnormality cause can be traced and the corresponding error code can be determined through the verification of static elements and dynamic elements. If the cockpit system can respond to the abnormality notification normally, it can perform targeted self-repair based on the error code. If the original projection image provided in the cockpit system returns to normal, the HUD display device can detect it in time, and thus switch again to directly provide these original projection images to the image source by the cockpit system.

[0101] In some examples, such as Figure 11As shown in the figure, the display device for implementing the above display control method may specifically include a processor 931, a memory 932, an input device 933, and an output device 934. Among them, the input device 933 may include operation buttons integrated on the display device, etc. The display device may receive input control instructions and data through the input device 933. The output device 934 may include an image source integrated on the display device, etc. The display device may output corresponding instructions or data to the output device 934. Further, a computer program running on the processor 931 is stored on the memory 932. When the processor 931 executes the computer program, the above-described display control method is implemented. In some examples, a computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the above-described display control method is implemented.

[0102] As Figure 12 shown, a vehicle may be provided with the above-described HUD display device. Specifically, the HUD display device is integrated inside the center console 10, for example, in the front position of the steering wheel. Through the projection window 102 of the HUD display device, corresponding display light is projected onto the vehicle windshield 4 directly in front. What the viewer observes from inside the cockpit in front of the windshield 4 is that they can directly see the virtual image in the projection area 50. The content of the virtual image may include not only basic information such as the vehicle speed, but also navigation information that fits the actual road surface, etc. More importantly, the projection content in the projection area 50 can be directly provided by the cockpit system or provided by the HUD display device as needed. In some examples, the vehicle may also obtain the program of the above-described display control method through the above-described computer-readable storage medium, so as to enable the in-vehicle HUD display device to achieve convenient updates and upgrades. At the same time, it also supports the update of pre-stored templates and extended markup files, ensuring that the rendering effect of the HUD display device involved in the rendering is consistent with the rendering effect of the cockpit system, and users cannot perceive the changes from the outside, improving the user experience. It should be noted that the above vehicle is not limited to a car as a means of transportation, and may also include buses, trucks, excavators, motorcycles, trains, high-speed rails, ships, yachts, airplanes, spaceships, etc. The projected windshield is not limited to the front windshield of a car, and may also be a transparent surface at other positions.

[0103] Combined with the above examples, the technical solutions involved in this application can be directly embodied as hardware, software modules executed by a control unit, or a combination of both, that is, one or more steps and / or one or more combinations of steps, which can correspond to each software module in the computer program flow, or can also correspond to each hardware module, such as an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or any suitable combination thereof. For the convenience of description, in the above description, various modules are described separately according to their functions. Of course, when implementing this application, the functions of each module can be implemented in the same or multiple software and / or hardware.

[0104] Through the description of the above examples, those skilled in the art can clearly understand that this application can be implemented by means of software plus a necessary general hardware platform. Based on such an understanding, the technical solutions involved in this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This software is executed by a microcontrol unit and depends on the required configuration, and can include any type of one or more microcontrol units, including but not limited to microcontrol units, microcontrollers, DSPs (Digital Signal Processors), or any combination thereof. This software is stored in a memory, for example, a volatile memory (such as a random access memory, etc.), a non-volatile memory (such as a read-only memory, a flash memory, etc.), or any combination thereof.

[0105] To sum up, when this application verifies the original projection image provided by the cockpit system, the display content in the original projection image will be divided into static elements and dynamic elements according to the decoration and functional mechanism, and different comparison mechanisms will be adopted for the static elements and dynamic elements respectively to detect data anomalies in the data reaching the HUD display device and ensure the correctness of the final display content on the image source. When the display content provided by the cockpit system is abnormal, this application can promptly perform backup processing of the projection display to ensure normal viewing by users, with high robustness and stronger reliability.

[0106] It should be understood that although this specification includes some examples, none of these examples contains only an independent technical solution. This narrative way of the specification is only for the purpose of clarity. Those of ordinary skill in the art should regard the specification as a whole, and the technical solutions in each example can also be appropriately combined to form other implementation manners understandable to those of ordinary skill in the art.

[0107] The series of detailed descriptions listed above are only specific descriptions of the feasible implementation manners of this application, and they are not intended to limit the protection scope of this application. Any equivalent implementation manners or variations made without departing from the teaching content of this application shall be included within the protection scope of this application.

Claims

1. A display control method, characterized in that: include: Acquire an original projection image provided by a cockpit system, and verify at least a portion of a display block in the original projection image to determine whether to directly provide the original projection image to an image source; The static elements in the display block are compared and judged according to the pre-stored templates, and the dynamic elements in the display block are compared and judged according to the real-time data provided by the vehicle system; In response to at least one of the static element and the dynamic element being judged to be abnormal, a corrected projection image in at least the display block is generated according to the pre-stored template and / or the real-time data.

2. The display control method according to claim 1, characterized in that: The display control method comprises: In response to the static elements and the dynamic elements being judged to be normal, the original projection image is directly output to the image source for display.

3. The display control method according to claim 1, characterized in that: The display control method comprises: The static elements and dynamic elements in the display block are determined according to the extended markup file.

4. The display control method according to claim 1, characterized in that: The static elements in the display block are compared and judged according to the pre-stored templates, including: The static element is a first identifier and the difference between the pixel value of the static element and other regions in the display block is less than a first threshold value, so that the static element cannot be normally recognized by human eyes.

5. The display control method according to claim 1, characterized in that: Generating at least the corrected projection image in the display block according to the pre-stored template and / or the real-time data comprises: In response to the data content represented by the dynamic element having a priority lower than a second threshold, the position of the dynamic element is replaced with data content having a priority higher than a third threshold.

6. The display control method according to claim 1, characterized in that: Generating at least the content in the display block according to the pre-stored template and / or the real-time data comprises: The display content triggered to be output to the image source includes fading out of the original projection image in the display block and fading in of the corrected projection image in the display block.

7. A display control device, characterized in that: Including projection main control chip, interface conversion chip and image source; The interface conversion chip is configured to forward the original projection image provided by the cockpit system to the projection main control chip; The projection main control chip is configured to check at least part of the display block in the original projection image to determine whether to directly provide the original projection image to the image source, compare and judge the static elements in the display block according to the pre-stored template, and compare and judge the dynamic elements in the display block according to the real-time data provided by the vehicle system; The image source is configured to receive and display a corrected projection image provided by the projection main control chip when at least one of the static element and the dynamic element is judged to be abnormal.

8. A display device, characterized in that: The method comprises a memory, a processor and a computer program stored in the memory and running on the processor, wherein the processor implements the steps of the display control method according to any one of claims 1 to 6 when executing the computer program.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the display control method according to any one of claims 1 to 6 are implemented.

10. A means of transport, characterized in that: It includes the display control device according to claim 7, the display device according to claim 8 or the computer-readable storage medium according to claim 9.

Images