Display control method, electronic equipment, storage medium and vehicle

Abstract

The invention relates to the technical field of projection display, in particular to a display control method, electronic equipment, a storage medium and a vehicle. Based on the principle of user priority, when the cabin domain cannot normally provide the displayed first data for the display device, resources are automatically re-planned according to trigger conditions such as the display instruction of the user under the function target of not influencing user experience, and the cabin domain provides the second data for the display device by using the extended resources, so that the user experience is improved. The display device can perform processing based on the second data so as to realize corresponding display. According to the method and the device, the reliability of the display equipment matched with cabin domain display can be improved, the expandability of the display capability is enhanced under the condition that the processing capability or the communication capability of the cabin domain is constrained, and the watching experience of a user is ensured not to be reduced.

Description

Technical Field

[0001] The present application relates to the field of projection display technology, and in particular to a display control method, electronic equipment, storage medium and transportation vehicle. Background Art

[0002] HUD (Head Up Display) is a new way to realize in-vehicle display by using reflection on the vehicle windshield. Specifically, the display light is emitted by the optical machine of the HUD display device, and is projected on the windshield through the corresponding optical lens to produce a corresponding virtual image, which forms an enhanced display effect with the real world outside the windshield. For HUD display devices used in vehicles, the projection information is generally provided by the cockpit domain. However, when the operating resources of the cockpit domain are insufficient or the video link between the cockpit domain and the HUD display device fails, the cockpit domain cannot normally output the real-time rendered video stream projection information to the HUD display device, resulting in the limitation of the projection function of the HUD display device. Summary of the invention

[0003] The purpose of this application is to provide a display control method, an electronic device, a storage medium and a vehicle, which solve the technical problem in the prior art that the projection function of the HUD display device is limited by the cockpit domain processing capability or communication capability and cannot reliably meet the user's real-time projection needs.

[0004] In order to solve the above technical problems, this application adopts the following technical solutions.

[0005] In a first aspect, the present application provides a display control method, comprising: The display device is connected to the cockpit domain to cooperate with the information display of the cockpit domain, and the display image output by the display device is at least partially based on the first data provided by the cockpit domain; When the display device receives the first data provided by the cockpit domain, outputting the display image according to the first data; When the display device cannot receive the first data provided by the cockpit domain, the display image is output according to second data, wherein the second data is provided by the cockpit domain using extended resources in response to a display instruction input by a user, and the second data corresponds to at least part of the first data.

[0006] In an optional implementation of the first aspect, the display image output by the display device includes: The display device is a HUD display device, and the image source projection of the HUD display device includes reflecting the display light of the display image on the windshield to form a virtual image viewed by human eyes.

[0007] In an optional implementation of the first aspect, the display device is a vehicle-mounted screen.

[0008] In an optional implementation of the first aspect, the first data is a display image generated by rendering in the cockpit domain.

[0009] In an optional implementation of the first aspect, the first data is the same as the second data.

[0010] In an optional implementation of the first aspect, the first data is different from the second data.

[0011] According to the above description, when the cockpit domain cannot directly provide display data to the display device, an optional implementation method can be implemented by expanding resources on the premise of meeting user needs, and the display device can adaptively take further processing measures based on the resources of the cockpit domain.

[0012] In an optional implementation manner of the first aspect, the display image is output according to second data, the second data is provided by the cockpit domain using a backup resource in response to a display instruction input by a user, and the second data corresponds to at least a portion of the first data and includes: The display device determines first data previously stored in the display device according to the second data.

[0013] According to the above description, an optional implementation method can ensure that only pre-agreed communication codes are transmitted between the cockpit domain and the display device by pre-storing materials in the display device, thereby reducing the transmission pressure between the two and providing the possibility of selecting a low-speed communication link to achieve target information transmission.

[0014] In an optional implementation manner of the first aspect, the display image is output according to second data, the second data is provided by the cockpit domain using a backup resource in response to a display instruction input by a user, and the second data corresponds to at least a portion of the first data and includes: The display image is generated by direct rendering in the display device according to the second data.

[0015] In an optional implementation manner of the first aspect, the display image is directly rendered and generated in the display device according to the second data, including: The display image style generated by rendering of the display device is different from the display image style generated by rendering of the cockpit domain.

[0016] According to the above description, in an optional implementation manner, when the display device cooperates with the cockpit domain for display, the rendering processing of the cockpit domain is at least partially transferred to the display device for completion, which on the one hand reduces the operating resource requirements of the cockpit domain, and on the other hand reduces the communication link requirements for sending data from the cockpit domain to the display device.

[0017] In an optional implementation of the first aspect, the second data is sensor data detected by a vehicle-mounted sensor device, and the first data is a display image rendered corresponding to the sensor data.

[0018] In an optional implementation of the first aspect, the second data is positioning data of the vehicle, and the first data is a position marking pattern of the vehicle in a map.

[0019] In an optional implementation of the first aspect, the second data is navigation indication data of the vehicle, and the first data is a navigation arrow icon generated based on the navigation indication data.

[0020] According to the above description, in an optional implementation mode, the display device only receives text data sent from the cockpit domain, and the display device generates image data required for display in a self-built manner based on the text data, thereby reducing dependence on the cockpit domain and meeting the real-time requirements of users.

[0021] In an optional implementation of the first aspect, the second data is index data for querying the first data.

[0022] In an optional implementation of the first aspect, the second data is the name of the music played in the cockpit domain, and the first data is the cover of the music played in the cockpit domain.

[0023] In an optional implementation manner of the first aspect, the second data is a name of a material to be displayed, and the first data is a material file to be displayed.

[0024] According to the above description, an optional implementation method caches the relevant data required for display inside the display device, and when displaying, it only needs to receive the index data of the cockpit domain to realize the display through its own resources, thereby reducing the complete dependence on the cockpit domain and improving the control efficiency between the two.

[0025] In an optional implementation of the first aspect, the extended resource is a temporarily released operating resource in the cockpit domain.

[0026] In an optional implementation manner of the first aspect, the extended resource is a temporarily released operating resource in the cockpit domain including: In response to a display instruction input by a user, determining the running resources occupied by the program with a low priority; The number of programs to be closed is determined according to the operating resources required by the cockpit domain to provide the first data to the display device.

[0027] In an optional implementation manner of the first aspect, determining the number of closed programs according to the operating resources required by the cockpit domain to provide the first data to the display device includes: In response to the display device cooperating with the cockpit domain to finish displaying the information or the idle running resources satisfying the running resources required by the closed program, the closed program is restarted.

[0028] In an optional implementation of the first aspect, determining the running resources occupied by the low-priority program includes: Driving assistance programs have a higher priority than entertainment and leisure programs, and warning prompt programs have a higher priority than driving assistance programs.

[0029] In an optional implementation of the first aspect, determining the running resources occupied by the low-priority program includes: The priority of the program presented in the foreground is higher than the priority of the program running in the background.

[0030] According to the above description, an optional implementation method replans the operating resources in the cockpit domain, forcibly vacates unimportant operating resources while maximally meeting user needs, and provides them for use in information display tasks of the control display device.

[0031] In an optional implementation of the first aspect, the extended resource is a second link between the display device and the cockpit domain, which is a backup of the first link. The first link is a default link for the display device to receive the first data, and the second link is functionally limited relative to the first link.

[0032] In an optional implementation of the first aspect, the first link is a high-speed video link, and the second link is a low-speed data link.

[0033] According to the above description, an optional implementation method can use the second link to transmit the second data when the first link fails, and the display device can maintain the richness of the display based on the backup link communication. At the same time, when the second link cannot directly send video stream data and other functions are limited, the agreed text data, index data and other interactions are used to enable the display device to build its own map.

[0034] In an optional implementation manner of the first aspect, the second data is provided by triggering the cockpit domain to use extended resources in response to a display instruction input by a user, and includes: The display instruction input by the user is received through the input device connected to the cockpit domain or the input device connected to the display device.

[0035] In an optional implementation of the first aspect, the input device connected to the cockpit domain or the input device connected to the display device includes at least one of a button, a voice recognition module, and a gesture recognition module.

[0036] In an optional implementation of the first aspect, the display instruction includes instructions for the display device to display more content.

[0037] According to the above description, the optional implementation method can receive personalized control from the user and is not subject to the resource limitations of the cockpit domain. The display instructions can be specific to display ADAS information, vehicle speed information, navigation information, music playback information and other expressions.

[0038] In an optional implementation of the first aspect, receiving a display instruction input by a user through an input device connected to the display device includes: In response to a display instruction input by a user, the display device sends a trigger instruction to the cockpit domain so that the cockpit domain activates the extended resource.

[0039] According to the above description, the optional implementation mode supports receiving user control instructions through the display device when cockpit domain resources are tight, and triggering re-planning of resources in the cockpit domain.

[0040] In an optional implementation manner of the first aspect, when the display device cannot receive the first data provided by the cockpit domain, outputting the display image according to the second data includes: The display device outputs the high-priority portion of the second data as the display image according to its own operating resources and / or information display capabilities.

[0041] According to the above description, in the optional implementation mode, when the cockpit domain processing capacity or communication capacity is constrained, the display device will also arrange the high-priority information for display as much as possible according to its own capabilities, so as to meet the user's display instruction requirements as much as possible.

[0042] In an optional implementation manner of the first aspect, the display device outputting a high-priority portion of the second data to the display image according to its own operating resources and / or information display capability includes: The display device releases part of the existing operating resources and / or the information display occupied position according to the priority.

[0043] According to the above description, the optional implementation manner re-plans the resources in the display device by vacating them, and displays as much high-priority information as possible in the limited location of the projection area to meet the special needs of the user.

[0044] In an optional implementation manner of the first aspect, when the display device cannot receive the first data provided by the cockpit domain, outputting the display image according to the second data includes: The second data includes the first part of the first data and text data or index data corresponding to the second part of the first data.

[0045] According to the above description, the optional implementation method enables the cockpit domain to cooperate with the display device to jointly share the operating resources for generating the required display images, thereby alleviating the pressure of vacating resources in the cockpit domain.

[0046] In a second aspect, the present application provides a display control method, characterized by comprising: The cockpit domain is connected to a display device so that the display device cooperates with the information display of the cockpit domain, and the cockpit domain provides first data to the display device so that a display image output by the display device is at least partially based on the first data; In response to the cockpit domain being unable to provide the first data to the display device due to limited operating resources, the cockpit domain releases operating resources occupied by low-priority programs so that the cockpit domain has operating resources to provide the first data to the display device.

[0047] In an optional implementation of the second aspect, the first data is a display image itself output by the display device through an image source.

[0048] According to the above description, in an optional implementation mode, when the operating resources of the cockpit domain are limited, the information display task of the display device is set to a high priority, and low-priority programs are automatically temporarily closed to prioritize the data processing required for the display device to perform display, thereby reducing the impact of other programs on it.

[0049] In an optional implementation manner of the second aspect, in response to the cockpit domain having limited operating resources and being unable to provide the first data to the display device, the cockpit domain releasing operating resources occupied by programs with low priority includes: When the display instruction input by the user is obtained, the running resources occupied by the program with low priority are released; When no display instruction input by the user is obtained, the information display of the display device is temporarily suspended.

[0050] According to the above description, in an optional implementation mode, when there is a display instruction input by the user, the information display task takes priority, and when there is no display instruction input by the user, the cockpit domain's own program takes priority, thereby improving the overall user experience.

[0051] In an optional implementation of the second aspect, the display instruction input by the user is acquired through an input device connected to the cockpit domain or an input device connected to the display device.

[0052] In an optional implementation of the second aspect, the input device connected to the cockpit domain or the input device connected to the display device includes at least one of a button, a voice recognition module, and a gesture recognition module.

[0053] In an optional implementation of the second aspect, the display instruction includes instructions for the display device to display more content.

[0054] In an optional implementation manner of the second aspect, the display instruction input by the user is obtained through an input device connected to the display device, including: The cockpit domain monitors the trigger instruction sent by the display device, and the trigger instruction is sent when the display device receives the display instruction input by the user; In response to the trigger instruction, the running resources occupied by the programs with low priority begin to be released.

[0055] In an optional implementation of the second aspect, the cockpit domain monitoring the trigger instruction sent by the display device includes: The priority of monitoring the trigger instruction sent by the display device is set to prohibit the release of the occupied running resources.

[0056] In an optional implementation manner of the second aspect, the display instruction input by the user is obtained through an input device connected to the cockpit domain, including: In response to a display instruction input by a user, a notification message is sent to the display device.

[0057] In an optional implementation of the second aspect, the cockpit domain releasing the running resources occupied by the low-priority program includes: In response to a display instruction input by a user, determining the running resources occupied by the program with a low priority; The number of programs to be closed is determined according to the operating resources required by the cockpit domain to provide the first data to the display device.

[0058] In an optional implementation manner of the second aspect, determining the number of closed programs according to the operating resources required by the cockpit domain to provide the first data to the display device includes: The number of closed programs at least satisfies the operating resources required for the cockpit domain to provide the first part of the first data to the display device, and the operating resources required for the cockpit domain to send text data or index data corresponding to the second part of the first data to the display device.

[0059] In an optional implementation of the second aspect, the display control method further includes: The first part of the first data is sent through a high-speed link between the cockpit domain and the display device, and the text data or index data corresponding to the second part of the first data is sent through a low-speed link between the cockpit domain and the display device.

[0060] In an optional implementation manner of the second aspect, determining the number of programs to be closed according to the operating resources required by the cockpit domain to provide the first data to the display device includes: In response to the display device cooperating with the cockpit domain to finish displaying the information or the idle running resources satisfying the running resources required by the closed program, the closed program is restarted.

[0061] In an optional implementation of the second aspect, determining the running resources occupied by the low-priority program includes: Driving assistance programs have a higher priority than entertainment and leisure programs, and warning prompt programs have a higher priority than driving assistance programs.

[0062] In an optional implementation of the second aspect, determining the running resources occupied by the low-priority program includes: The priority of the program presented in the foreground is higher than the priority of the program running in the background.

[0063] In a third aspect, the present application provides a display control method, characterized by comprising: The cockpit domain is connected to a display device so that the display device cooperates with the information display of the cockpit domain, and the cockpit domain provides first data to the display device so that a display image output by the display device is at least partially based on the first data; In response to the cockpit domain being unable to send the first data to the display device using a default first link, switching to sending second data to the display device using a second link, where the second data corresponds to at least a portion of the first data.

[0064] According to the above description, the optional implementation method makes full use of multiple links between the cockpit domain and the display device, and can also use the agreed simplified interaction information to reduce the amount of interaction between the two and reduce the dependence on the default link.

[0065] In an optional implementation of the third aspect, the first data is rendered in the cockpit domain by default.

[0066] In an optional implementation of the third aspect, the first link is a high-speed video link, and the second link is a low-speed data link.

[0067] In an optional implementation manner of the third aspect, the switching to send second data to the display device by using a second link, wherein the second data corresponds to at least a portion of the first data and includes: When a display instruction input by the user is obtained, triggering switching to the second link to send second data to the display device; When no display instruction input by the user is obtained, the information display of the display device is temporarily suspended.

[0068] In an optional implementation of the third aspect, the display instruction input by the user is acquired through an input device connected to the cockpit domain or an input device connected to the display device.

[0069] In an optional implementation of the third aspect, the input device connected to the cockpit domain or the input device connected to the display device includes at least one of a button, a voice recognition module, and a gesture recognition module.

[0070] In an optional implementation of the third aspect, the display instruction includes instructions for the display device to display more content.

[0071] In an optional implementation manner of the third aspect, the display instruction input by the user is acquired through an input device connected to the display device, including: The cockpit domain monitors the trigger instruction sent by the display device, and the trigger instruction is sent when the display device receives the display instruction input by the user; In response to the trigger instruction, start switching to the second link to send second data to the display device.

[0072] In an optional implementation of the third aspect, the cockpit domain monitors a trigger instruction sent by the display device, and the trigger instruction is sent when the display device receives the display instruction input by the user, including: The cockpit domain receives a trigger instruction through the second link.

[0073] In an optional implementation manner of the third aspect, the cockpit domain monitoring the trigger instruction sent by the display device includes: The priority of monitoring the trigger instruction sent by the display device is set to prohibit the release of the occupied running resources.

[0074] In an optional implementation manner of the third aspect, the display instruction input by the user is obtained through an input device connected to the cockpit domain, including: In response to a display instruction input by a user, a notification message is sent to the display device.

[0075] In an optional implementation of the third aspect, the display control method further includes: In response to the first link returning to normal, switching back to using the first link to send the first data to the display device.

[0076] In an optional implementation manner of the third aspect, the second data corresponding to at least a portion of the first data includes: The second data includes basic information for causing the display device to output a display image, so that the display device generates the first data in its own device according to the second data.

[0077] In an optional implementation of the third aspect, the second data is sensor data detected by an on-board sensor device, and the first data is a displayed image rendered corresponding to the sensor data.

[0078] In an optional implementation of the third aspect, the second data is positioning data of the vehicle, and the first data is a position marking pattern of the vehicle in a map.

[0079] In an optional implementation of the third aspect, the second data is navigation indication data of the vehicle, and the first data is a navigation arrow icon generated based on the navigation indication data.

[0080] In an optional implementation of the third aspect, the display device has its own renderer for generating display images.

[0081] In an optional implementation manner of the third aspect, the second data is index data for querying the first data.

[0082] In an optional implementation of the third aspect, the second data is the name of the music played in the cockpit domain, and the first data is the cover of the music played in the cockpit domain.

[0083] In an optional implementation of the third aspect, the second data is a name of a material to be displayed, and the first data is a material file to be displayed.

[0084] In an optional implementation of the third aspect, the first data stored in the display device supports online updating.

[0085] In an optional implementation of the third aspect, the display control method further includes: When the cockpit domain normally sends the first data to the display device through the first link, the display device is prompted to automatically store the first data for later use.

[0086] In a fourth aspect, the present application provides an electronic device comprising a memory, a processor, and a computer program stored in the memory and running on the processor, wherein the processor implements the steps of the display control method described in the first aspect, the second aspect, or the third aspect when executing the computer program.

[0087] In a fifth aspect, the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the display control method described in the first aspect, the second aspect or the third aspect are implemented.

[0088] In a sixth aspect, the present application provides a means of transportation, comprising the electronic device described in the fourth aspect or the computer-readable storage medium described in the fifth aspect.

[0089] Compared with the prior art, this application is based on the principle of user priority. When the cockpit domain cannot normally provide the first display data to the display device, it automatically re-plans resources according to the user's display instructions and other triggering conditions without affecting the functional goals of the user experience. The cockpit domain uses extended resources to provide the second data to the display device, and the display device can process based on the second data to achieve the corresponding display. This application can improve the reliability of the display device in cooperating with the cockpit domain display, enhance the scalability of the display capability under the constraints of the cockpit domain processing capacity or communication capacity, and ensure that the user's viewing experience is not impaired. BRIEF DESCRIPTION OF THE DRAWINGS

[0090] In order to more clearly illustrate the technical solution of the present application, the following is a brief introduction to the drawings required for use in the description of the technical solution. Obviously, the drawings described below are only some examples recorded in the present application, and a person of ordinary skill in the art can obtain other drawings based on these drawings without creative work.

[0091] Figure 1 Schematic diagram of HUD projection display in some examples of this application.

[0092] Figure 2 Schematic diagram of HUD display device module in some examples of this application.

[0093] Figure 3 Schematic diagram of the interaction between the cockpit domain and the HUD display device in some examples of this application Figure 4 This is a schematic diagram of the connection between the cockpit domain and the HUD display device in some examples of this application.

[0094] Figure 5 This is a schematic diagram of the projection of the cockpit domain control HUD display device in some examples of this application.

[0095] Figure 6 Schematic diagram of cockpit domain and HUD display device control input in some examples of this application.

[0096] Figure 7 Schematic diagram of cockpit domain and HUD display device control input in some examples of this application.

[0097] Figure 8 This is a schematic diagram of the self-built HUD display device in some examples of this application.

[0098] Fig. 9 This is a schematic diagram of the self-built HUD display device in some examples of this application.

[0099] Fig.10 This is a schematic diagram of the self-built HUD display device in some examples of this application.

[0100] Fig.11 This is a schematic diagram of the electronic device composition in some examples of this application.

[0101] Fig.12 This is a schematic diagram of projection display in a vehicle in some examples of the present application. DETAILED DESCRIPTION

[0102] The present application will be described in detail below in conjunction with the accompanying drawings, but the content of the description is merely some examples recorded in the present application and does not limit the present application. Changes in structure, method, function, etc. made by ordinary technicians in this field based on these examples are included in the protection scope of the present application.

[0103] It should be noted that the same reference numerals or marks may be used in different examples, but these do not represent an absolute connection in structure or function. In addition, the "first", "second", etc. mentioned in each example are only for the convenience of description, and do not represent an absolute distinction in structure or function, nor can they be understood as indicating or implying the relative importance or the number of corresponding objects. Unless otherwise specified, the "at least one" that may be involved in the description refers to one or more, and "more than one" refers to two or more.

[0104] In addition, when expressing a feature, the character " / " can indicate that there is an or relationship between the front and back associated objects. For example, head-up display / head-up display can be expressed as head-up display or head-up display. When expressing an operation, the character " / " can indicate that there is a division relationship between the front and back associated objects. For example, the magnification M=L / P can be expressed as L (virtual image size) divided by P (image source size). Moreover, the "and / or" in different examples is only to describe the association relationship between the front and back associated objects. This association relationship can include three situations. For example, a concave mirror and / or a convex mirror can be expressed as the existence of a concave mirror alone, the existence of a convex mirror alone, and the existence of both a concave mirror and a convex mirror.

[0105] HUD projection display mainly uses the optical reflection principle to reflect the imaging light to be displayed through a transparent surface into the viewer's eyes. The human eye can see the virtual image information in the opposite direction of the light. Correspondingly, the transparent surface can be the windshield of the vehicle, and the windshield can be used as a display screen to display the navigation instructions of the vehicle, the vehicle's driving speed, etc. Figure 1 As shown, the HUD display device may include at least an optical machine 1, a first reflector 2, a second reflector 3, etc., wherein the optical machine 1 includes a backlight source and an image source (not shown), the backlight source is used to provide illumination light and adjust the brightness of the illumination light according to control, for example, the backlight source may be an LED (Light Emitting Diode), a laser, etc. Under the illumination light provided by the backlight source, the image source adjusts the corresponding display content according to control and projects the display light from the surface of the image source, for example, the image source may be an LCD (Liquid Crystal Display), a DMD (Digital Micromirror Devices), a MEMS (Micro-Electro-Mechanical System) micromirror, a LCOS (Liquid Crystal on Silicon), etc. The first reflector 2 and the second reflector 3 can project the display light projected by the optical machine 1 onto the windshield 4, so as to customize the optical path in a smaller space and meet different projection display requirements. The first reflector 2 and the second reflector 3 can be set as a concave mirror, a convex mirror, a concave lens, a convex lens, etc. according to the requirements of optical planning, and the surface shape of the lens can adopt a free-form surface. Optionally, at least one of the first reflector 2 and the second reflector 3 can also be adjusted to a certain degree of angle, so as to change the projection position of the display light on the windshield 4 to meet the needs of viewers of different heights. The display light of the optical machine 1 is finally reflected on the windshield 4 of the vehicle to form a virtual image 5. When the human eye 6 observes the virtual image 5 facing the windshield 4, it can feel a certain sense of depth, just like watching a real object at a specific distance outside the windshield. The virtual image 5 can be the navigation instruction content, vehicle speed, etc. as described above. It should be added that, according to the characteristics of different optical machines, the HUD display device can also be provided with a diffuser. In some examples, the HUD display device can also include Fresnel lenses, waveguide optical devices, diffractive optical devices, holographic optical devices, tapered optical fibers, etc.

[0106] In some examples, such as Figure 2As shown, when the HUD display device of the above example is integrated into the vehicle computer 92, it can serve as a display device in the vehicle cockpit domain. Information that traditionally needs to be viewed through the central control screen will be directly projected in front of the driver's field of vision, making information viewing more convenient. Accordingly, the HUD display device can be powered and data provided by the vehicle computer 92, or the HUD display device itself can provide power and generate data. The HUD display device may specifically include a processor 91, an Ethernet interface 901, a CAN (Controller Area Network) interface 902, a power management module 903, a running memory 904, a storage memory 905, a temperature detection 906, a motor 907, a backlight source 908, an image source 909, a positioning module 910, a radar 911, a camera 912, and the like. It should be noted that Figure 2 The modules listed in the description are merely exemplary and do not constitute any limitation. In some examples, the HUD display device may further include other modules. In addition, the above modules may be implemented in one or more hardware in different examples, or a single module may be implemented by a combination of multiple hardware.

[0107] The processor 91 serves as the control center of the HUD display device, and includes one or more processing units of any type, including but not limited to a microcontroller, a microcontroller, a DSP (Digital Signal Processor) or any combination thereof. The processor 91 is used to generate operation control signals according to a computer program, realize the control of other modules, and cooperate with corresponding modules to process the acquired or inherent data, instructions, etc.

[0108] The Ethernet interface 901 is a network data connection port for local area network communication, which defines a series of software and hardware standards. Multiple electronic devices can be connected together through the Ethernet interface 901. In this example, the processor 91 can exchange information with the vehicle computer 92 through the Ethernet interface 901, such as sending data to the vehicle computer 92 or receiving data sent by the vehicle computer 92.

[0109] The CAN interface 902 is a network data connection port of the controller area network, which provides a standard bus for the control system and embedded industrial control inside the car, and realizes the communication interaction between the control nodes. In this example, the processor 91 can also exchange information with the vehicle computer 92 through the CAN interface 902. Optionally, the processor 91 can also connect to other external devices through the CAN interface 902. In some examples, the processor 91 can also be provided with a GPIO (General-purpose input / output) interface to improve the compatibility of peripheral connections.

[0110] The power management module 903 is connected to the vehicle computer 92 and can receive the power provided by the vehicle computer 92 to provide a stabilized power supply for each module of the HUD display device, thereby ensuring that the processor 91 and each module operate under normal voltage supply and avoid damage due to overvoltage.

[0111] The running memory 904 is used to store computer programs executed by the processor 91, temporarily stored calculation data, data exchanged with the storage memory, etc. The running memory 904 can be a memory such as SDRAM (Synchronous Dynamic Random-access Memory).

[0112] The storage memory 905 is used to store resources such as display content related to the HUD display device, and long-term storage of running programs and data, etc. The storage memory 905 can be a memory such as Flash (flash memory). In some examples, the processor 91 can also provide an interface to access an external memory.

[0113] Temperature detection 906 is used to detect the temperature inside the HUD display device, and may specifically include several temperature sensors. Since the resistance value of the temperature sensor changes with the change of temperature, the processor 91 can determine the resistance value of the temperature sensor at the corresponding temperature according to the voltage change between each temperature sensor and the voltage divider resistor under a fixed power supply voltage, thereby reversely deducing the temperature at the location of the temperature sensor. In some examples, the processor 91 can control several temperature sensors through the GPIO interface, and several temperature sensors can be set at different locations inside the HUD display device. The processor 91 can use time-sharing detection to obtain the temperature values ​​fed back by several temperature sensors respectively.

[0114] Motor 907 is used to drive the optical lens in the HUD display device to rotate under the control of processor 91, so as to achieve the change of the corresponding optical path. For example, when the backflow of sunlight causes the temperature rise on the surface of the image source, the motor can be used to drive the optical lens to prevent the external sunlight from reaching the surface of the image source. In some examples, the processor 91 can also drive the fan provided on the HUD display device through motor 907 to increase the speed of air exchange between the inside and outside of the HUD display device to achieve heat dissipation. Specifically, the motor 907 is connected to the processor 91 through a motor driver chip, and the motor driver chip provides high-performance power output for the motor 907, and can also communicate and control with the processor 91 through interfaces such as SPI (Serial Peripheral Interface).

[0115] The backlight source 908 is used to provide illumination light and adjust the brightness of the illumination light according to the control of the processor 91, so as to adjust the projection display brightness of the entire HUD display device. The backlight source 908 cooperates with the image source 909 to realize the main function of optical machine projection display. The backlight source 908 can be an LED (Light Emitting Diode), a laser, etc. Specifically, the backlight source 908 is connected to the processor 91 through a backlight driver chip, and the backlight driver chip provides a driving voltage for the backlight source 908 and controls the brightness of the backlight source 908 under the pulse width signal output by the processor 91.

[0116] The image source 909 is used to display an image of corresponding content and project the display light corresponding to the image according to the control of the processor 91. The image source 909 can be an LCD (Liquid Crystal Display), a DMD (Digital Micromirror Devices), a MEMS (Micro-Electro-Mechanical System) micromirror, a LCOS (Liquid Crystal on silicon), etc.

[0117] The positioning module 910 is used to monitor the position of the HUD display device and the corresponding vehicle. The positioning module 910 can be a global navigation satellite system such as GPS (Global Positioning System) and Beidou Satellite Navigation System. By measuring the distance between the satellite and the receiver on the positioning module 910 at different positions, the corresponding position and orientation data are determined. In some examples, the positioning module 910 may also include an inertial navigation system, which is based on Newton's laws of mechanics. By measuring the acceleration of the positioning module 910 in the inertial reference system, integrating it over time, and transforming it into the navigation coordinate system, the speed, yaw angle, and position data in the navigation coordinate system are obtained. Optionally, the inertial navigation system can assist the global navigation satellite system to achieve more accurate positioning and provide the processor 91 with corresponding position information.

[0118] The radar 911 is used to determine the position of a target object through electromagnetic waves, and can usually determine the distance of the target object from the vehicle where the radar 911 is located.

[0119] Camera 912 includes a vehicle body camera and an in-vehicle camera, wherein the vehicle body camera is used to determine the position of the target object through visual recognition, and the vehicle body camera can be a monocular camera or a binocular camera. The biggest difference between a monocular camera and a binocular camera is that a binocular camera can capture images from two different perspectives, thereby obtaining distance information in three-dimensional space. The in-vehicle camera is used to identify the behavior status of the driver and passengers in the vehicle, including fatigue detection, distraction detection, expression recognition, gesture recognition, sight tracking, etc. In this example, the in-vehicle camera can also implement eye tracking.

[0120] In some examples, the positioning module 910, radar 911 and camera 912 can also be directly connected to the vehicle computer 92, and are not directly connected to the processor 91 of the HUD display device. For example, the vehicle computer 92 itself is integrated with a positioning module for position tracking and a radar and camera for automatic driving. The HUD display device can obtain the collected data of the positioning module, radar and camera in real time through communication with the vehicle computer 92.

[0121] like Figure 3 As shown, the architecture of the vehicle-mounted HUD display device in the above example can be simply abstracted into two parts: the cockpit domain 11 and the HUD display device 12. The cooperation of these two parts can improve the user's overall cockpit experience. It should be noted that the display control method of the present application can also be the cooperation between the cockpit domain 11 and other display devices, such as various vehicle-mounted screens. Accordingly, in the cockpit domain 11, the overall control is implemented by the cockpit control unit 9200, such as an independent ECU (Electronic Control Unit), and in the HUD display device 12, the projection control unit 9100 (for details, please refer to Figure 2 The overall control can be realized by the processor 91 in the cockpit control unit 9200, such as the MCU (Microcontroller Unit). The cockpit control unit 9200 and the projection control unit 9100 can realize communication connection through the communication interface 9210 and the communication interface 9110 respectively owned by each. The HUD display device 12 is used as the display device of the cockpit domain 11. The cockpit control unit 9200 can provide the rendered display image to the image source 909 in the HUD display device 12 for directional optical control, and the image source 909 projects the required display light under the illumination provided by the backlight source 908. For details, please refer to Figure 2 At the same time, the cockpit control unit 9200 and the projection control unit 9100 can also realize the interaction of related control instructions by means of the connection between the communication interface 9210 and the communication interface 9110, which will not be described in detail here. Figure 4 As shown, between the cockpit domain and the HUD display device, there may be two links, namely, Figure 3The communication interface 9210 and the communication interface 9110 can realize communication of multiple links through multiple communication protocols to meet different information transmission requirements. Figure 2 In the embodiment, Ethernet and CAN bus can be two parallel links. In actual applications, link connection combinations of different protocol standards will be constructed according to different interface configurations of the cockpit domain 11 and the HUD display device 12. Accordingly, the cockpit control unit 9200 and the projection control unit 9100 respectively include a video link 9101 and a data link 9102. The video link 9101 is a dedicated link for transmitting video streams relative to the data link 9102, and its speed is faster than the data link 9102. Optionally, the video link 9101 can be GMSL (Gigabit Multimedia Serial Link), which supports multiple video and image transmission protocols, such as MIPI (Mobile Industry Processor Interface), FPD-Link (Flat Panel Display Link), etc. The data link 9102 can be a CAN bus or a LIN (Local Interconnect Network) bus, which can be responsible for simple data and command interaction. In more examples, it can also include vehicle Ethernet and other serial ports such as RS232. When the cockpit control unit 9200 is ready to output the required projected display image to the optical machine 1 corresponding to the HUD display device, the video stream can be transmitted through the video link 9101, and the video stream can be directly provided to the optical machine 1 through the selection unit 913. The selection unit 913 is used as a video source detection module to receive the real-time rendering image of the cockpit control unit 9200 and output it to the image source 909 for display. At the same time, the video link 9101 is also connected to the projection control unit 9100. The projection control unit 9100 can also obtain the video stream data sent by the cockpit control unit 9200 through the video link 9101, and send the display image required for projection to the optical machine 1 integrated with itself through the selection unit 913. At the same time, there is also regular data interaction between the cockpit control unit 9200 and the projection control unit 9100, which can be transmitted through the video link 9101 or the data link 9102.

[0122] like Figure 5 As shown, in Figure 4In the example connection circuit, when the HUD display device cooperates with the display of the cockpit domain, the video stream can be transmitted through line 1, that is, the display image output by the cockpit control unit 9200 reaches the image source 909 through the video link 9101 and the selection unit 913. However, due to hardware failure, it is very likely that the video link 9101 and the like will be blocked in the corresponding data communication, and normal data transmission cannot be achieved. At this time, it may lead to the inability to control the display of the HUD display device. At the same time, in the solution of displaying via line 1, it is necessary to render the required output display image in real time in the cockpit control unit 9200, which will inevitably occupy a large amount of operating resources of the cockpit control unit 9200. The operating resources of the cockpit control unit 9200 will also be shared with other functional programs in the cockpit domain, and sometimes resource conflicts may occur, resulting in the cockpit control unit 9200 not having enough operating resources for image rendering and data transmission. In some examples, when the cockpit control unit 9200 cannot provide video stream data to the HUD display device through line 1, it can switch to line 2, and specifically the cockpit control unit 9200 sends corresponding data to the projection control unit 9100 through the data link 9102. After the projection control unit 9100 processes the received data in a certain manner, the processing content at least includes forwarding processing, and then outputs the display image required for projection to the image source 909 of the optical machine 1 through the selection unit 913. In the case where the data link 9102 can support video stream transmission, the data link 9102 is a backup link that is exactly the same as the video link 9101, and the video stream output by the cockpit control unit 9200 can be directly transmitted to the image source 909 through the data link 9102, the projection control unit 9100, and the selection unit 913, so that the hardware failure problem that may exist in actual operation can be solved by redundant backup. However, if the data link 9102 is a low-speed link, it generally cannot support direct transmission of the video stream. At this time, the cockpit control unit 9200 cannot send the rendered video stream to the projection control unit 9100. Instead, it can send basic information representing the image to be projected and displayed. The projection control unit 9100 can execute the function of the renderer, at least the rendering processing originally implemented on the cockpit control unit 9200 can be transferred to the projection control unit 9100 for processing, avoiding the problem that the video stream cannot be transmitted between the two. This will be described in detail below.

[0123] As described above, when the default line 1 fails to work properly, it is necessary to switch to line 2. At this time, the cooperation between the cockpit control unit 9200 and the projection control unit 9100 will be completely different. Both need to switch to the mode corresponding to the transmission of line 2 synchronously. For example, when the cockpit control unit 9200 determines that line 1 has failed, in addition to triggering the switch to the mode corresponding to the transmission of line 2, it also automatically notifies the projection control unit 9100 to switch to the same mode, otherwise normal display cannot be performed. In some examples, if the projection control unit 9100 does not normally receive the video stream sent by the cockpit control unit 9200, and does not normally receive the mode switching instruction, it can also default to enter the suspended mode of information display, which can specifically be to turn off the projection display or to play its own default display image. In some examples, in order to trigger the cockpit control unit 9200 and the projection control unit 9100 to switch to the mode corresponding to line 2 when the corresponding mode of line 1 cannot be operated, an interface for actively inputting display instructions can be provided for the user. For example, when the user sees that the HUD display device does not project the display or the displayed information does not meet the user's needs, the user can input display instructions to achieve personalized control, such as displaying ADAS information, vehicle speed information, navigation information, music playback information and other instructions. Optionally, when the cockpit control unit 9200 has tight operating resources, the display instructions input by the user can also trigger the re-planning of operating resources that prioritize user needs, which will be described in detail below. Figure 6 As shown, the cockpit control unit 9200 can be connected to the microphone 9211, and the projection control unit 9100 can also be connected to the microphone 9111. The microphones 9211 and 9111 can simultaneously receive the voice of the user inside the vehicle, recognize the user's display instructions, such as a sentence containing the keyword "display ADAS information", and then trigger the entire mode switching action. Optionally, when either microphone 9211 or microphone 9111 recognizes a corresponding display instruction, it will send the corresponding information to the other party. For example, when the projection control unit 9100 receives a display instruction input by the user through the microphone 9111, it will also send it to the cockpit control unit 9200 through the communication interface 9110 and the communication interface 9210. Figure 5, when the video link 9101 fails, the information of the display instruction recognized can be sent through the data link 9102. In this way, when any one of the cockpit control unit 9200 and the projection control unit 9100 is short of operating resources and cannot perform normal voice recognition, the other one can implement the corresponding voice recognition and notify the party that has not been recognized. Optionally, the cockpit control unit 9200 and the projection control unit 9100 can also share a microphone. After receiving the user's voice input recognition, the microphone sends the recognized result to the cockpit control unit 9200 and the projection control unit 9100 at the same time. After receiving the recognition result, the cockpit control unit 9200 and the projection control unit 9100 can also send it to the other party again through the communication interface 9210 and the communication interface 9110 to prevent the other party from failing to receive the recognition result provided by the microphone. It should be noted that the display instruction input by the user is not limited to the above-mentioned voice input, but also includes gesture input, that is, the cockpit control unit 9200 and the projection control unit 9100 may be connected to a corresponding gesture recognition module, such as a camera. Figure 7 As shown, the display instruction input by the user can also be received by means of the button 13 connected to the cockpit control unit 9200 and the projection control unit 9100. The button 13 can send the user operation signal to the cockpit control unit 9200 and the projection control unit 9100 respectively. The user can control the cockpit domain by operating the button 13. When the video stream cannot be provided to the HUD display device, the extended resources are used to realize the corresponding information display. Among them, the button 13 can be not only a press button, but also a knob button. These buttons 13 can be set not only on the steering wheel or interior of the vehicle, but also virtual buttons on the vehicle's integrated touch screen. Optionally, the cockpit control unit 9200 and the projection control unit 9100 can be connected to independent buttons respectively to increase the hardware redundancy capability and improve reliability.

[0124] In some examples, for a display device integrated in a vehicle to be connected to a cockpit domain to coordinate information display in the cockpit domain, specific reference may be made to Figure 3-Figure 5, the cockpit domain provides the display image required to be displayed in the display device according to the configuration scheme of the vehicle display. Specifically, it is sent to the display device through the video link by default. In this example, the video stream corresponding to the display image is the first data. Correspondingly, after receiving the first data, the display device will eventually output it to the image source to output the content, and the user can see the required display information through the display device. If the display device cannot receive the first data provided by the cockpit domain, as mentioned above, it may be because the video link fails, or the cockpit domain’s own running resources are occupied by other open programs and are not idle. At this time, the cockpit domain cannot normally output the display video stream to the display device. At this time, the display device can automatically enter the suspend mode, or it can trigger the cockpit domain to use extended resources to provide the second data to the display device, such as referring to Figure 5 Switch to the data link for the second data transmission, and the display device can perform real-time rendering based on the second data and finally output the required video stream to the image source. For another example, the corresponding extended resource is that the cockpit domain automatically vacates the resources occupied by low-priority programs to ensure that the task of displaying information on the high-priority display device can be started. The second data generated by the vacated resources can be directly the originally generated video stream. In this way, if the video link is communicating normally, the line 1 corresponding to the video link will still be used to drive the display device for display, and the display device does not need to occupy resources for rendering. If the video link also fails at the same time, the second data generated by the vacated resources is the text data or index data corresponding to the first data. After the display device receives the above text data or index data through the data link, it can perform certain processing, including image rendering, material query, etc., and then output it to the image source for display.

[0125] In the above example, when the cockpit domain is unable to provide the first data, it automatically triggers the activation of the extended resources. The disadvantage is that it sacrifices some of the original functions of the cockpit domain and the display device to a certain extent. For example, the original programs on the cockpit domain are automatically closed. Another example is the limitation of data transmission on the data link, which results in the display device being able to process and display content that may not be completely consistent with that provided by the cockpit domain. In terms of actual user experience, users will feel out of control or experience display abnormalities. In order to provide flexibility in user control, it is adaptively adjusted based on the user's choice in the event of a fault, enhancing the user's viewing experience in a user-first manner. Accordingly, refer to Figure 6 , Figure 7For example, the user can input the corresponding display instructions to any one of the cockpit domain and the display device through the corresponding input device. When a fault occurs, since the display device is in the suspended mode, the user is not satisfied with the display content in the suspended mode, and initiates a display instruction to display specific content to at least one of the cockpit domain and the display device to meet the user's demand for displaying more content. After receiving the corresponding display instruction, the cockpit domain and the display device will trigger the activation of the extended resources. In this way, the user has more flexible personalized settings and can meet the user's real-time viewing needs.

[0126] In some examples, the video link and data link between the cockpit domain and the display device are normal, and the fault is only that there are not enough operating resources in the cockpit domain, so the video stream required for the display device to display cannot be generated normally. At this time, it can be automatically triggered when the cockpit domain recognizes the fault, or it can be triggered by an external user in accordance with the above example. Specifically, the cockpit domain can monitor the input device connected to itself, or it can monitor the trigger instruction sent by the display device. The trigger instruction can be determined by the input device connected to the display device. Optionally, the cockpit domain must ensure that the operating resources occupied by the monitoring are not affected by other programs. Further, in order to ensure the normal generation of the video stream, the cockpit domain releases the operating resources occupied by the low-priority program according to the importance of the currently running program, that is, temporarily closes the less important program to ensure that the cockpit domain has enough operating resources to generate the required video stream. When the operating resources released by temporarily closing a single program are still insufficient, the second lowest priority program will be temporarily closed until there are enough idle operating resources to provide the display device with the first data corresponding to the video stream. Accordingly, the importance of different running programs is divided according to their necessity for driving safety and the user's perception ability. Generally, the priority of driving assistance programs is higher than that of entertainment and leisure programs, the priority of warning prompt programs is higher than that of driving assistance programs, and the priority of programs presented in the foreground is higher than that of programs running in the background. It should be noted that the priority of the above-mentioned program that listens to the user input display command is the highest, and it is prohibited to be released, so as to ensure the basic principle of user priority. In some examples, in order to minimize the number of temporarily closed programs, part of the task of generating the first data will be delivered to the display device to complete, that is, the operating resources of the cockpit domain and the display device are combined for division of labor. Accordingly, part of the rendering will be realized in the cockpit domain through the operating resources released by the temporarily closed program, and the generation of the other part will be achieved by sending the basic information required for rendering to the display device, and then the display device will render it. The division of labor is allocated according to the ratio of idle operating resources between the cockpit domain and the display device. Optionally, the video stream part directly generated by the cockpit domain is sent to the display device through the video link, and the text data or index data corresponding to the generated basic information is sent to the display device through the data link. After receiving these data, the display device processes them as needed and outputs them to the image source for display. Furthermore, if the cockpit domain has completed the information display task through the display device or has additional idle running resources due to the natural closure of other programs, the temporarily closed program will be restarted to ensure the sustainability of the operation on the cockpit domain.

[0127] In some examples, there is a fault in the video link between the cockpit domain and the display device. At this time, no data can be sent to the display device through the video link, so it is necessary to play the backup role of the data link. Optionally, if the data link can also send video streams to the display device, then the line can be switched directly. If there is a shortage of operating resources in the cockpit domain, the backup link can be combined with the above example to generate and transmit data. Optionally, if the data link does not support the transmission of video streams, it is necessary to switch the information sending type of the cockpit domain, that is, to send the second data with basic information to ensure that the display device can receive the relevant data through the data link, and finally the display device generates the video stream required by the image source. Figure 8 As shown, the display device needs to display display element 51 (vehicle speed information), display element 52 (gear information), display element 53 (speed limit sign), display element 54 (navigation information), etc. in the display area 50. These display requirements can be display instructions input by the user, or they can be the original display content of the display device before the fault, and the cockpit domain automatically triggers the display of these contents when the fault is recognized. Due to the limited function of the data link, the cockpit domain only sends the text data corresponding to display element 51, display element 52, display element 53 and display element 54 to the display device, such as character data of 60Km / h, and description data of left traffic, and does not include direct video stream data, and the display device renders and generates corresponding display images according to these text data. Optionally, the rendering method of the display image can be generated according to the configuration of the display device itself, and the specific display image style generated by its rendering can be different from the display image style generated by the cockpit domain rendering, such as the rendered fonts are different, and the rendered navigation arrow icons use different shapes to indicate specific directions. In more examples, various sensor data obtained by sensors connected to the cockpit domain can be sent to the display device, and the display device renders the received sensor data into a specified display image for display. For example, it can be directly ADAS (Advanced Driving Assistance System) data. In order to display the ADAS data in the form of an image on the display device, the display device will render in a specified form according to the ADAS data. Fig. 9 As shown, a display element 55 is also displayed in the display area 50 as required. The display element 55 not only needs to be rendered based on the positioning data directly sent from the cockpit domain, but also calls the map material owned by the display device itself for comprehensive rendering before rendering, thereby generating a display image corresponding to the display element 55, which includes the location of the vehicle in the map and the navigation route in the map.

[0128] like Fig.10As shown, for the display element 56 that needs to be displayed in the display area 50, such as the album cover of the currently playing music, due to the limited function of the data link, the cockpit domain cannot directly provide it to the display device, but it is not generated by the real-time rendering of the display device, but is realized by calling the material stored in advance by the display device. Accordingly, the display device only needs to receive the index data sent by the cockpit domain for query, and the index data can be transmitted through the data link. In this example, if the music program in the cockpit domain is playing music, in order to normally display its current album cover display when the video link of the display device is in a fault, the cockpit domain can send the name of the playing music to the display device through the data link, and the display device stores the cover material indexed by the music name as a keyword, and the display device can generate the required video stream for display to the image source through calling. In more examples, the display device pre-stores more types of material files, and these material files themselves cannot be simply transmitted through the data link. The cockpit domain only needs to send index data (second data) such as the material name to the display device, and the display device can perform corresponding material positioning according to these index data, ensuring that the cockpit domain and the display device do not need to directly send the material file itself, reducing the functional requirements for the communication link. Optionally, the material files in the above example can be resources cached when the cockpit domain normally sends the first data to the display device, such as the transmission realized through the video link when the video link is fault-free. The storage of the material files includes not only the cached resources themselves, but also the corresponding index data, which can be used as search keywords when querying. Optionally, the material files in the above example can also be updated and stored regularly, such as being downloaded through an interface connected to the network within a fixed time period. In order to further optimize the storage efficiency of the display device, the resources stored in advance will be managed in a rolling manner, and the materials with low call frequency will be automatically deleted to reduce the storage pressure of the display device. Furthermore, the cockpit domain and the display device will continuously detect the status of the video link. If the video link returns to normal, it will switch from sending the second data from the data link to sending the first data from the video link, and the default method will be used for information display to ensure sustainability. It should be noted that the fact that the second data corresponds to at least a portion of the first data does not necessarily mean that the second data is completely identical to the first data in form. The corresponding portion may also be extended content other than the first data itself. For the first data obtained by rendering based on the second data, the corresponding portion may be part of the first data represented by pixel information, which is identical to the content of the second data. For querying the first data based on the second data, the corresponding portion may be part of the keywords in the metadata of the first data, which is identical to the content of the second data.

[0129] In some examples, for partial or all data sent via a data link and needing to be processed in a display device before being output to an image source, the display device will also arrange whether the second data sent needs to generate all information display based on its own operating resources and / or information display capabilities. Fig. 9 The second data sent includes the corresponding second data of five display elements. Under normal circumstances, the display device needs to perform rendering and other processing to generate the display images corresponding to the five display elements. However, due to the limitation of the internal operating resources of the display device, the five display elements cannot be generated at the same time. Accordingly, the five display elements can be generated according to their functional priorities. The display elements with low priorities will not generate corresponding display images, saving the occupation of operating resources. Optionally, refer to Figure 8 , assuming that there are a total of 4 information display positions in the display area 50, and the data sent from the cockpit domain contains more than 4 display element contents, the display device cannot arrange all display elements into the priority display area 50 at this time. Similarly, the display device may not render the display elements with low priority. At the same time, the display device may also release its already occupied operating resources or occupied information display positions as needed to meet new information display requirements. Optionally, the display device may also feed back its own operating resources and / or information display capabilities to the cockpit domain, and the cockpit domain makes adaptive adjustments based on the feedback information.

[0130] In some examples, such as Fig.11 As shown, the electronic device implementing the above display control method may specifically include a processor 931, a memory 932, an input device 933 and an output device 934, wherein the input device 933 may include operation buttons integrated on electronic devices such as display devices and cockpit domains, and the electronic device may receive input control instructions and data through the input device 933. The output device 934 may include an image source integrated on the electronic device, and the electronic device may output corresponding instructions or data to the output device 934. Further, the memory 932 stores a computer program running on the processor 931, and the processor 931 implements the display control method of the above example when executing the computer program. In some examples, a computer-readable storage medium, a computer-readable storage medium stores a computer program, and the display control method of the above example is implemented when the computer program is executed by the processor.

[0131] like Fig.12As shown, the vehicle can be provided with the above-mentioned HUD display device. Specifically, the HUD display device is integrated inside the center console 10, such as in front of the steering wheel. The corresponding display light is projected onto the opposite vehicle windshield 4 through the projection window 102 of the HUD display device. The effect of the viewer observing the front of the windshield 4 from the cockpit is that the virtual image in the display area 50 can be directly seen. Specifically, the HUD display device is also connected to the cockpit domain in the vehicle. The video streams corresponding to these virtual images are normally provided by the cockpit domain. When a fault occurs, the HUD display device can have a certain fault tolerance capability to reduce the damage to the user experience. In some examples, the vehicle can also distribute the program of the display control method in the above example through the computer-readable storage medium of the above example, so that the vehicle-mounted HUD display device can be conveniently updated and upgraded. It should be noted that the above-mentioned vehicle is not limited to cars as a means of transportation, but can also include buses, trucks, excavators, motorcycles, trains, high-speed railways, ships, yachts, airplanes, spacecraft, etc. The projected windshield is not limited to the front windshield of the car, but can also be a transparent surface in other locations.

[0132] In combination with the above examples, the technical solutions involved in the present application can be directly embodied as hardware, a software module executed by a control unit, or a combination of the two, that is, one or more steps and / or one or more step combinations, which can correspond to various software modules of a computer program flow, or to various hardware modules, such as ASIC (Application Specific Integrated Circuit), FPGA (Field-Programmable Gate Array) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or any appropriate combination thereof. For the convenience of description, the above description is divided into various modules and described separately according to their functions. Of course, when implementing the present application, the functions of each module can be implemented in the same or more software and / or hardware.

[0133] Through the description of the above examples, those skilled in the art can clearly understand that the present application can be implemented by means of software plus a necessary general hardware platform. Based on this understanding, the technical solution involved in the present application can be essentially or partly contributed to the prior art in the form of a software product. The software is executed by a microcontroller unit and, depending on the required configuration, may include one or more microcontroller units of any type, including but not limited to a microcontroller unit, a microcontroller, a DSP (Digital Signal Processor) or any combination thereof. The software is stored in a memory, such as a volatile memory (such as a random access memory, etc.), a non-volatile memory (such as a read-only memory, a flash memory, etc.) or any combination thereof.

[0134] In summary, this application is based on the principle of user priority. When the cockpit domain cannot normally provide the first display data to the display device, it automatically re-plans resources according to the user's display instructions and other triggering conditions without affecting the functional goals of the user experience. The cockpit domain uses extended resources to provide the second data to the display device, and the display device can process based on the second data to achieve the corresponding display. This application can improve the reliability of the display device in cooperating with the cockpit domain display, enhance the scalability of the display capability under the constraints of the cockpit domain processing capability or communication capability, and ensure that the user's viewing experience is not impaired.

[0135] It should be understood that although this specification includes some examples, none of these examples contains only one independent technical solution, and this description of the specification is only for the purpose of clarity. A person skilled in the art should take the specification as a whole, and the technical solutions in each example can also be appropriately combined to form other implementation methods that can be understood by a person skilled in the art.

[0136] The series of detailed descriptions listed above are only specific descriptions of feasible implementation methods of the present application. They are not intended to limit the scope of protection of the present application. All equivalent implementation methods or modifications that do not deviate from the teachings of the present application should be included in the scope of protection of the present application.

Claims

1. A display control method, characterized in that: include: The display device is connected to the cockpit domain to cooperate with the information display of the cockpit domain, and the display image output by the display device is at least partially based on the first data provided by the cockpit domain; When the display device receives the first data provided by the cockpit domain, outputting the display image according to the first data; When the display device cannot receive the first data provided by the cockpit domain, the display image is output according to second data, wherein the second data is provided by the cockpit domain using extended resources in response to a display instruction input by a user, and the second data corresponds to at least part of the first data.

2. The display control method according to claim 1, characterized in that: The display image is output according to second data, wherein the second data is provided by the cockpit domain using a backup resource in response to a display instruction input by a user, and the second data corresponds to at least a part of the first data and includes: The display device determines first data previously stored in the display device according to the second data.

3. The display control method according to claim 1, characterized in that: The display image is output according to second data, wherein the second data is provided by the cockpit domain using a backup resource in response to a display instruction input by a user, and the second data corresponds to at least a part of the first data and includes: The display image is generated by direct rendering in the display device according to the second data.

4. The display control method according to claim 1, characterized in that: The extended resources are temporarily released operating resources in the cockpit domain.

5. The display control method according to claim 1, characterized in that: The extended resource is a second link between the display device and the cockpit domain that backs up the first link. The first link is a default link for the display device to receive the first data, and the second link has limited functionality relative to the first link.

6. A display control method, characterized in that: include: The cockpit domain is connected to a display device so that the display device cooperates with the information display of the cockpit domain, and the cockpit domain provides first data to the display device so that the display image output by the display device is at least partially based on the first data; In response to the cockpit domain being unable to provide the first data to the display device due to limited operating resources, the cockpit domain releases operating resources occupied by low-priority programs so that the cockpit domain has operating resources to provide the first data to the display device.

7. A display control method, characterized in that: include: The cockpit domain is connected to a display device so that the display device cooperates with the information display of the cockpit domain, and the cockpit domain provides first data to the display device so that the display image output by the display device is at least partially based on the first data; In response to the cockpit domain being unable to send the first data to the display device using a default first link, switching to sending second data to the display device using a second link, where the second data corresponds to at least a portion of the first data.

8. An electronic device, characterized in that: The method comprises a memory, a processor and a computer program stored in the memory and running on the processor, wherein the processor implements the steps of the display control method according to any one of claims 1 to 7 when executing the computer program.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the display control method according to any one of claims 1 to 7 are implemented.

10. A means of transport, characterized in that: Includes the electronic device of claim 8 or the computer-readable storage medium of claim 9.

Images