Method for displaying graphical elements, computer program product, storage medium, data carrier signal, device, and vehicle
A dual-processing unit system for vehicle displays addresses the challenge of safety-critical graphical information display by generating reduced elements during malfunctions, ensuring continuous and error-free operation.
Patent Information
- Application Number
- PCT/EP2025/069870
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-07-30
- Filing Date
- 2025-07-11
- Publication Date
- 2026-02-05
AI Technical Summary
Vehicles using generic SoCs for display devices face challenges in ensuring safety-critical graphical information display due to insufficient computing power and high data rates, leading to potential malfunctions and increased costs with redundant systems.
Implement a dual-processing unit system where a first unit generates normal graphic elements and a second unit generates reduced elements based on safety criticality and dynamics, switching to reduced elements upon detection of malfunctions to maintain display integrity.
Ensures seamless transition from normal to reduced display modes without perceptible errors, maintaining safety-critical information availability and reducing computational load during faults.
Smart Images

Figure EP2025069870_05022026_PF_FP_ABST
Abstract
Description
[0001] METHOD FOR REPRESENTING GRAPHIC ELEMENTS, COMPUTER PROGRAM PRODUCT, STORAGE MEDIUM, DATA CARRIER SIGNAL, DEVICE AND VEHICLE
[0002] Technical field
[0003] The present invention relates to the reliability of graphic display devices. In particular, the present invention relates to a computer-implemented method for displaying graphic elements of a vehicle display device. Furthermore, the present invention relates to a device, a computer program product, a computer-readable storage medium, a data carrier signal, and a vehicle.
[0004] Technical background and task
[0005] Increasingly, vehicles are using fewer generic central processing units (CPUs) instead of many small, specialized electronic units. These CPUs typically employ generic standard computing units (SoCs; Systems-on-a-Chip). SoCs typically offer numerous connection options for various inputs and outputs, particularly for display devices such as monitors and cameras.
[0006] These SoCs are often not specifically designed for safe applications with regard to functional safety, which is a crucial requirement, especially for the automotive industry. Conversely, SoCs with extended safety features are frequently limited to software environments not designed for safe functions, such as Linux. Due to the high development costs associated with multimedia functions, these less secure software environments are still used.
[0007] Therefore, in typical, safety-critical automotive applications, specialized, highly secure, but less powerful microcontrollers with specially qualified software are used. However, the graphical representation of safety-relevant information requires increasingly significant computing power, as modern display devices place ever higher demands in this regard, for example, due to increasingly higher resolutions. The small, specialized microcontrollers are not designed for the high graphics processing power and correspondingly high data rates required for this.
[0008] While solutions exist that can guarantee safety, or at least detect violations of safety requirements, by monitoring the correct display of safety-relevant indicators, these solutions also necessitate a significant restriction of the display to allow for reliable verification within the microcontroller. Furthermore, in the event of a fault, these solutions implement safety measures that are noticeably disruptive to the driver, such as a system restart or a display showing only minimal information. High safety and availability of the indicators can be achieved through redundant central processing units, but this leads to significantly increased costs.
[0009] It is therefore an object of the present invention to provide computer-implemented methods for displaying graphic elements of a vehicle's display device, which overcomes at least one of the aforementioned disadvantages. Furthermore, it is an object of the invention to provide a device, a computer program product, a computer-readable storage medium, a data carrier signal, and a vehicle.
[0010] Disclosure of the invention
[0011] The problem is solved according to the invention by the features of the main claims. Advantageous embodiments can be found in the dependent claims.
[0012] According to a first aspect of the invention, a computer-implemented method for displaying graphic elements on a vehicle display device includes a step of monitoring a first computing unit with respect to a reduction condition. The graphic elements are assigned a safety criticality and a dynamic behavior. The display device can be a screen, for example, a head-up display (HUD), a liquid crystal display (LCD), an organic light-emitting diode display (OLED display), or the like. The display device can also be a touch-sensitive screen. The vehicle can be a motor vehicle, a truck, a motorcycle, a bicycle, a scooter, an airplane, a helicopter, a train, or the like.
[0013] The display device shows graphical elements. These can consist of characters or geometric shapes, for example. Typically, information regarding the vehicle's status or the journey undertaken is displayed to a passenger or driver using these graphical elements. For example, arrows are displayed to indicate a navigation route. A time or temperature is often displayed in text form. Digital graphical representations of a speedometer show the current speed. Speed limits can be represented as a combination of characters and geometric shapes, for example, by replicating the corresponding traffic sign (e.g., black lettering on a white, round background with a red border). These are just a few examples of graphical elements.
[0014] Each graphic element is assigned a safety criticality and a dynamic level. The safety criticality indicates how important the graphic element is for the safe operation of the vehicle. Safety criticality can be specified, for example, as a numerical value, with higher numbers corresponding to higher safety criticality. For instance, the graphic element for a speed limit might have a higher safety criticality value than one for the time.
[0015] The dynamics assigned to each graphical element describe how frequently the corresponding graphical element is updated, or how frequently the information represented by the graphical element changes. For example, a graphical element displaying hours and minutes can be updated once per second. This is sufficient to accurately represent the time. However, a graphical element displaying speed must be updated more frequently, for example, five times per second.
[0016] Furthermore, in this step, a first processing unit is monitored with respect to a reduction condition. This first processing unit can be a separate physical unit or, for example, within a software system, separated from other parts of the software system by a hypervisor or a container environment. The first processing unit generates the graphical elements that are to be displayed during normal, i.e., unrestricted, ferry operation without any errors (such as a frozen image).
[0017] However, malfunctions can occur, preventing the timely or error-free display of graphical elements. This can happen, for example, if the system components involved (display device, memory, central processing unit, etc.) are overloaded or if the system is attacked. Programming errors or system damage can also lead to incorrect rendering of the graphical elements. Furthermore, transient errors, such as bit errors in data storage caused by electromagnetic interference or during data communication, can result in faulty, delayed, or missing rendering. The reduction condition is a measure of the point at which the first processing unit is no longer able to render the graphical elements correctly.For example, the reduction condition may consist of a checksum being incorrect over a range of the display device.
[0018] Furthermore, the method includes a step in which the first processing unit generates the graphical elements and displays them on the display device. Through this step, the first processing unit fulfills its purpose of generating the graphical elements necessary for proper ferry operation and making them available to the display device. The method also includes a step in which a second processing unit generates at least one reduced graphical element, with each reduced graphical element being assigned to a corresponding graphical element. The representation of a reduced graphical element is based on the safety criticality and dynamics of the graphical element to which it is assigned.
[0019] The second processing unit can be a separate physical unit or, for example, separated from other parts of a software system by a hypervisor or a container environment. The second processing unit generates the simplified graphical elements that are displayed in the event of a restricted ferry operation due to an error. The first and second processing units can be implemented as partitions on a hypervisor or in containers. They can be implemented on physically separate CPU clusters in a system-on-a-chip (SoC) or as separate processes within an operating system.
[0020] For every graphic element, a reduced graphic element can be generated. A reduced graphic element is characterized by the fact that less computational effort is required to generate and display it than the graphic element to which it is assigned.
[0021] A simplified graphical element is generated, taking into account the safety criticality and dynamics of the graphical element it represents. A graphical element with high safety criticality and a simple representation, such as warning lights or turn signals, can be generated unchanged and in its entirety by the second processing unit. The simplified graphical element then corresponds to the original graphical element. A graphical element with high safety criticality and a complex representation, such as a speedometer, can be generated by the second processing unit in a less complex form, for example, as a simple text display. Graphical elements displaying information that changes only slowly, such as a fuel gauge, time, or temperature reading, can be generated less frequently.If the first processing unit generates the graphical elements every 100 ms, for example, graphical elements with low dynamic range can be generated only every 1 second. The most recent generation of the reduced graphical element is then used for display on the display device. Graphical elements with low safety criticality can also be omitted entirely.
[0022] Upon fulfillment of the reduction condition, the process includes a step in displaying the reduced graphical elements on the display device instead of their corresponding graphical elements. In other words, the complex graphical elements generated by the first processing unit are replaced by the less complex reduced graphical elements generated by the second processing unit in the event of a malfunction. The reduced graphical elements display the same information as their corresponding graphical elements (unless they are omitted entirely due to low safety criticality), but in a less computationally intensive form.
[0023] In an optional embodiment, the reduced display can also be shown even if the reduction condition is not set. For example, a driver of a vehicle can select a corresponding setting via an infotainment system.
[0024] In an advantageous implementation, for graphic elements with high safety criticality, the reduced graphic element corresponds to the graphic element. This is useful when the graphic element is already simple in design, but the information it conveys is highly safety-relevant. A warning light is an example of such a graphic element.
[0025] In an advantageous embodiment, a snapshot of graphical
[0026] Elements with low dynamic range are generated, and the reduced graphic element corresponds to the snapshot. For graphic elements with low dynamic range, such as a temperature display, the reduced graphic elements can be generated less frequently. Instead of regenerating them, the previously taken snapshot is used. In this case, the original graphic element is even perceived without any reduction in its appearance.
[0027] In an advantageous embodiment, the display of the reduced graphical elements generated by the second processing unit continues until the first processing unit restarts. In other words, the display of the reduced graphical elements persists only until the original graphical elements can be reliably generated again by the first processing unit. This is particularly advantageous because a driver of the vehicle might not even notice that a malfunction has occurred.
[0028] Snapshots of the graphic elements can be generated and stored at regular intervals, for example, every 2 seconds. These snapshots can then be used, in whole or in part, to generate the reduced graphic elements, for example, to display slowly changing or static but complex graphic elements unchanged even during and after switching in the display device.
[0029] In an advantageous embodiment, the reduction condition corresponds to a safety level, readability, a checksum over an image area, or the correctness of the image area. For example, if the readability is deemed unacceptable, the first processing unit should be restarted. In the meantime, the second processing unit takes over the rendering of critical graphical elements. Furthermore, a cyclic redundancy check can provide a test value in the form of a checksum, which must be correct. Otherwise, the reduction condition is considered to have been met. The safety level can, for example, be specified by the Automotive Safety Integrity Level (ASIL). According to a second aspect of the invention, a computer program product includes instructions that, when the program is executed by a computer, cause it to perform a procedure as described above.The computer program product can be written in a programming language, for example Python or C++.
[0030] According to a third aspect of the invention, a computer-readable storage medium comprises instructions that, when the program is executed by a computer, cause it to perform a method as described above. The computer-readable storage medium can, for example, be implemented as an SSD (solid-state disk) or as flash memory. The computer-readable storage medium can also store other data, such as sensor data and / or data that is (temporarily) stored during the execution of the method.
[0031] According to a fourth aspect of the invention, a data carrier signal transmits the computer program product as described above. The data carrier signal can be transmitted via cable, for example using a CAN (Controller Area Network), FlexRay, Ethernet, LIN (Local Interconnect Network), or MOST (Media Oriented Systems Transport). It can also be transmitted wirelessly, for example using Wi-Fi, Bluetooth, mobile networks, or the like.
[0032] According to a fifth aspect of the invention, a device for displaying graphic elements on a display device of a vehicle has a first computing unit which is configured to generate graphic elements.
[0033] Furthermore, the device has a second computing unit which is designed to generate reduced graphic elements.
[0034] The first and second processing units can be separated from each other in various ways. For example, through different partitions on a hypervisor, as separate processes within an operating system, on physically separate processors, or in different containers.
[0035] Furthermore, the device has a display output which is communicatively connected to the first and second processing units. The display output can be implemented, for example, as HDMI, VGA, DVI, DisplayPort, USB, or similar.
[0036] Furthermore, the device includes a display unit which is communicatively connected to the display output. The device itself is designed to perform a procedure as described above. The display unit receives an image to be displayed via the display output, which is composed of the graphic elements in normal operation and the reduced graphic elements in faulty operation.
[0037] In an advantageous embodiment, the first computing unit and the second computing unit are implemented within a computing system using a hypervisor.
[0038] In an advantageous embodiment, the first computing unit and the second computing unit within a computing system are implemented on different processors.
[0039] In an advantageous embodiment, at least one first graphics layer and one second graphics layer are provided to the display output. The first graphics layer is provided by the first processing unit and assigned a high priority before the reduction condition is met. The second graphics layer is provided by the second processing unit and assigned a low priority before the reduction condition is met. Upon meeting the reduction condition, the first graphics layer is assigned a low priority and the second graphics layer a high priority. The display output always provides the graphics layer with the high priority to the display device. Many typical SoCs have a display output that reads multiple graphics layers from memory and combines them into a single image before displaying them.The invention utilizes this by initially storing the graphic elements on a high-priority graphics layer and the reduced graphic elements on a low-priority graphics layer. During normal operation, only the high-priority graphics layer is used for display. If the reduction condition is met in the event of a malfunction, it is sufficient to swap the priorities of the graphics layers.
[0040] The overall image can also be assembled using software called a compositor. The compositor can, for example, be part of the second processing unit.
[0041] In an advantageous embodiment, the first computing unit is assigned to the display output until the reduction condition occurs, and the second computing unit is assigned to the display output once the reduction condition occurs.
[0042] The display output must therefore be exclusively assigned to either the first or the second processing unit at any given time. This assignment can remain with the first processing unit until the reduction condition is met, thus displaying the graphical elements. Upon meeting the reduction condition, the assignment is then switched to the second processing unit, so that the simplified representation in the form of the reduced graphical elements is now displayed.
[0043] In an advantageous embodiment, monitoring of the first computing unit with respect to the reduction condition is implemented by means of at least one of the following possibilities:
[0044] - Monitoring of a computer program executed on the first computing unit with a third computing unit, wherein the third computing unit is implemented in a computing system together with the first computing unit and the second computing unit, - Monitoring of a computer program executed on the first computing unit with a fourth computing unit, wherein the fourth computing unit is not implemented in a computing system together with the first computing unit and the second computing unit,
[0045] - Monitoring of a display area with a fifth computing unit, wherein the fifth computing unit is implemented with the first computing unit and the second computing unit in a computing system.
[0046] According to a sixth aspect of the invention, a vehicle has a device as described above.
[0047] An advantage of the present invention is that a user, such as a driver of a vehicle, does not perceive the switch between the normal display mode and the reduced display mode as an error.
[0048] Summary of the characters
[0049] The invention is explained in more detail below using exemplary embodiments and the accompanying figures. The figures show:
[0050] Figure 1: A flowchart of an embodiment of a computer-implemented method for displaying graphic elements on a vehicle display device;
[0051] Figure 2: A display device with an application example of the method from Figure 1; and
[0052] Figure 3: An embodiment of a device for displaying graphic elements on a vehicle display device; and
[0053] Figure 4: A vehicle with the device from Figure 3.
[0054] Detailed description of the figures Figure 1 shows a flowchart of an embodiment of a computer-implemented method 100 for displaying graphic elements 122, 124, 126, 128, 130, 132, 134, 136, 138 on a display device 120 of a vehicle 160.
[0055] In a first step of procedure 100, startup step 102, a device 140 with all components required for procedure 100 is initialized and started.
[0056] In the next step, monitoring step 104, the monitoring of a first computing unit 150 with regard to a reduction condition is initiated. This step is executed continuously, as indicated by the circular arrow at monitoring step 104. The reduction condition can, for example, be the result of a cyclic redundancy check over a defined area of the display device 120. Alternatively, the reduction condition can be met if a limit value of a safety level calculated according to ASIL (Automotive Safety Integrity Level) or ISO 26262 is exceeded.
[0057] In a first generation step 106, graphic elements 122, 124, 126, 128, 130, 132, 134, 136, 138 are generated. These are, for example, geometric shapes such as circles, rectangles, lines, points, and the like, or shapes composed of these, which represent, for example, a road, a road sign, a hazard warning light, a speedometer, vehicle parts, or the like. The graphic elements 122, 124, 126, 128, 130, 132, 134, 136, 138 can also be characters used to represent information such as speed, temperature, engine speed, time, or the like.
[0058] The graphic elements 122, 124, 126, 128, 130, 132, 134, 136, 138 are then displayed on a display device 120 in a first display step 112. A driver of the vehicle 160 is informed of important information via this display. Furthermore, at regular intervals (for example, every 500 ms), snapshots of the graphic elements 122, 124, 126, 128, 130, 132, 134, 136, 138 are generated in a second generation step 108. A snapshot can simply correspond to a redundant copy of a graphic element 122, 124, 126, 128, 130, 132, 134, 136, 138 at a specific point in time. In the event of a malfunction of the first computing unit 150, the snapshots are used to display graphical elements 122, 124, 126, 128, 130, 132, 134, 136, 138 without regenerating 106.
[0059] Validation step 110 checks whether the reduction condition is met. In other words, it checks whether the first processing unit 150 correctly generates the graphical elements 122, 124, 126, 128, 130, 132, 134, 136, 138. If the reduction condition is not met, meaning the graphical elements 122, 124, 126, 128, 130, 132, 134, 136, 138 are correctly generated, then the first display step 112 can be executed as planned (f-branch in validation step 110).
[0060] However, if the reduction condition is met, the graphical elements 122, 124, 126, 128, 130, 132, 134, 136, 138 are not correctly generated by the first processing unit 150 (t-branch at validation step 110). In this case, reduced graphical elements 122', 124', 126', 128', 130", 132', 134', 136', 138' are generated in a third generation step 114.
[0061] The simplified graphical elements 122', 124', 126', 128', 130', 132', 134', 136', 138' are based on the graphical elements 122, 124, 126, 128, 130, 132, 134, 136, 138, as they contain the same information / input information (e.g., speed, fuel level, navigation instructions), but in a simplified or less complex representation. This can be achieved by adjusting both the generation frequency (e.g., every 2 seconds instead of every 0.1 seconds) and the representation itself (omitting complex graphics, replacing graphics with text). In the example of Figure 1, some graphic elements 122, 124, 126, 128, 130, 132, 134, 136, 138 are at least partially replaced by the snapshots generated in the second generation step 108.For example, a graphic element 122, 124, 126, 128, 130, 132, 134, 136, 138, which displays a time as text with a clock as a symbol, can simply be replaced by the last snapshot of this graphic element 122, 124, 126, 128, 130, 132, 134, 136, 138. To do this, it only needs to be read from a memory 146 instead of being generated by the second processing unit 158.
[0062] In a second display step 116, the reduced graphic elements 122', 124', 126', 128', 130', 132', 134', 136', 138' are now displayed on the display device 120 instead of their respective corresponding graphic elements 122, 124, 126, 128, 130, 132, 134, 136, 138. Ideally, a driver of the vehicle 160 will not notice the malfunction at all.
[0063] To rectify the malfunction of the first computing unit 150, the first computing unit 150 is restarted in a restart step 118. Once this has occurred, the first computing unit 150 can again assume the generation of the graphical elements 122, 124, 126, 128, 130, 132, 134, 136, 138, which can then be displayed on the display device 120 in full complexity.
[0064] Figure 2 shows a display device 120 with an application example of the method 100 from Figure 1.
[0065] In the example of Figure 2a), a variety of graphic elements 122, 124, 126, 128, 130, 132, 134, 136, 138 are shown: a speedometer 122 with text and animated geometric shapes (needle, scale), a speed limiter 124 with text elements, a tachometer 126, a clock display 128, a gear indicator 130, a range indicator 132, a display 134 with general information such as fuel consumption, distance traveled and driving time, a navigation display 136 and a temperature display. The respective graphic elements 122, 124, 126, 128, 130, 132, 134, 136, 138 are shown with a border which symbolizes how frequently the respective graphic element 122, 124, 126, 128, 130, 132, 134, 136, 138 is updated, i.e., how high the dynamics of the graphic element 122, 124, 126, 128, 130, 132, 134, 136, 138 is. A dotted line (see e.g.
[0066] Speed limit (124) correlates with high dynamics; the graphic element (122, 124, 126, 128, 130, 132, 134, 136, 138) is updated, i.e., regenerated for display, every 33 ms. A dashed line (see, e.g., navigation display 136) correlates with lower dynamics; the graphic element (122, 124, 126, 128, 130, 132, 134, 136, 138) is updated, for example, every 500 ms.
[0067] Figure 2b) shows the display device 120 in the event of a malfunction, when the reduction condition has occurred. Reduced graphic elements 122', 124', 126', 128', 130', 132', 134', 136', 138' are now displayed on the display device 120 instead of their respective corresponding graphic elements 122, 124, 126, 128, 130, 132, 134, 136, 138. The speed indicator 122' is now displayed only as text. This is far less complex to generate than the animated needle with the scale. However, the dynamics remain unchanged, as the speed indicator 122, 122' is highly critical for safety, since it is important for the driver to know the current speed of the vehicle 160. The speed limit 124' is displayed completely unchanged, as it already had a very simple representation.
[0068] The tachometer 126' has also been reduced in its complex representation to purely textual displays. Furthermore, the tachometer 126,126' is not as safety-critical and therefore its dynamics are reduced; that is, the reduced graphic element 126' of the tachometer 126' is generated less frequently, for example, once per second (the semicolon outline symbolizes the reduced dynamics). The time display 128* and the temperature display 138* have been replaced by the latest snapshots (symbolized by a semicolon-dot outline). They do not need to be generated anew for the time being, but only read from a memory location 146. The gear indicator 130* has been completely omitted (symbolized by a long semicolon-dot outline).
[0069] In the range indicator 132*, the symbol was omitted, and only the text was retained. The indicator 134*, containing general information, is identical in appearance, but its dynamic response has been reduced. The navigation indicator 136* remains unchanged; it is generated by the second processing unit 158 in the same way as the navigation indicator 136 of the first processing unit 150. The appearance and generation frequency of the reduced graphical elements 122', 124*, 126*, 128', 130', 132*, 134*, 136', 138* are thus adapted to the dynamic response and safety criticality of the respective graphical elements 122, 124, 126, 128, 130, 132, 134, 136, 138.
[0070] Figure 3 shows an embodiment of a device 140 for displaying graphic elements 122, 124, 126, 128, 130, 132, 134, 136, 138 on a display device 120 of a vehicle 160.
[0071] The device 140 includes a system-on-a-chip (SoC) 142, i.e., an integrated circuit in which a multitude of functions of a programmable electronic system are implemented. The SoC 142, in turn, includes a processor 144, a memory 146, and a display output 148. The device also includes a display device 120.
[0072] In the example shown in Figure 3, a first computing unit 150 is separated from a second computing unit 158 on the processor 144 by a hypervisor. This separation, which can be important for the functionality of the method 100 to reduce its susceptibility to errors, can also be achieved in other ways. For example, the first computing unit 150 and the second computing unit 158 could be implemented on different processors 144 or in different containers on the processor 144.
[0073] Furthermore, the SoC 142 has an image layer unit 152. The first processing unit 150 and the second processing unit 158 each transmit the graphic elements 122, 124, 126, 128, 130, 132, 134, 136, 138 or the reduced graphic elements 122', 124', 126', 128', 130', 132', 134', 136', 138' to the image layer unit 152. In this process, graphic elements 122, 124, 126, 128, 130, 132, 134, 136, 138 and the reduced graphic elements 122', 124', 126', 128', 130', 132', 134', 136', 138' are stored separately on different layers. Typically, individual graphic elements 122, 124, 126, 128, 130, 132, 134, 136, 138 or their reduced graphic elements 122', 124', 126', 128', 130', 132', 134', 136', 138' are no longer stored, but rather an overall image composed of these elements. Each layer is assigned a priority.In normal operation, the layer on which the graphical elements 122, 124, 126, 128, 130, 132, 134, 136, 138 are stored has a higher priority than the layer on which the reduced graphical elements 122', 124', 126', 128', 130', 132', 134', 136', 138' are stored.
[0074] In a snapshot unit, 154 snapshots are generated from the graphic elements 122, 124, 126, 128, 130, 132, 134, 136, and 138, and then stored in memory 146. The graphic elements 122, 124, 126, 128, 130, 132, 134, 136, and 138 themselves are also stored in memory 146. The display output 148 can then read the graphic elements 122, 124, 126, 128, 130, 132, 134, 136, and 138 from memory and make them available to the display device 120 for display.
[0075] A checksum unit 156, implemented as a computer program on processor 144, calculates checksums across image areas of the overall image. The result is forwarded to the second processing unit 158, which, in addition to generating 114 of the reduced graphic elements 122', 124', 126', 128', 130', 132', 134', 136', 138', also monitors 104 of the first processing unit 150. If an incorrect checksum is determined by the checksum unit 156, the second processing unit 158 initiates a restart of the first processing unit 150 after the layer priorities on the image layer unit 152 have been swapped.
[0076] If the priorities are reversed, the layer with the reduced graphic elements 122', 124', 126', 128', 130', 132', 134', 136', 138' and, if applicable, the snapshots are displayed on the display device 120. After the first processing unit 150 is restarted, the device can return to normal operation.
[0077] Figure 4 shows a vehicle 160 with the device from Figure 3.
[0078] Display device 120 is designed as a display. However, it is also possible that display device 120 corresponds to, for example, a head-up display. The SoC 142 is installed in the instrument panel of vehicle 160 and is therefore shown with a dashed outline.
[0079] Reference symbol list
[0080] 100 procedures
[0081] 102 Startup Steps
[0082] 104 Monitoring step
[0083] 106 First generation step (gr. elements, 1.
[0084] (computing unit)
[0085] 108 Second generation step (snapshots)
[0086] 110 Validation step (of the monitoring, is there an error?)
[0087] 112 First display step (no error)
[0088] 114 Third generation step (reducing large elements, 2nd processing unit in case of error)
[0089] 116 Second display step
[0090] 118 Restart Step
[0091] 120 Display device
[0092] 122 First graphic element
[0093] 122' First reduced graphic element
[0094] 124 Second graphic element
[0095] 124 ' Second reduced graphic element
[0096] 126 Third graphic element
[0097] 126' Third reduced graphic element
[0098] 128 Fourth graphic element
[0099] 128' Fourth reduced graphic element
[0100] 130 Fifth graphic element
[0101] 130' Fifth reduced graphic element
[0102] 132 Sixth graphic element
[0103] 132' Sixth reduced graphic element
[0104] 134 Seventh graphic element
[0105] 134 ' Seventh reduced graphic element
[0106] 136 Eighth graphic element
[0107] 136' Eighth reduced graphic element
[0108] 138 Ninth graphic element
[0109] 138' Ninth reduced graphic element
[0110] 140 Device
[0111] 142 System-on-a-Chip
[0112] 144 Processor Memory Display Output First Processing Unit Image Layer Unit Snapshot Unit Checksum Units Second Processing Unit Vehicle
Claims
Patent claims 1. A computer-implemented method (100) for displaying graphic elements (122, 124, 126, 128, 130, 132, 134, 136, 138) on a display device (120) of a vehicle (160), wherein the graphic elements (122, 124, 126, 128, 130, 132, 134, 136, 138) are assigned a safety criticality and a dynamic, wherein the method (100) comprises the following steps: a) monitoring (104) a first computing unit (150) with respect to a reduction condition, b) generating (106) the graphic elements (122, 124, 126, 128, 130, 132, 134, 136, 138) by the first computing unit (150) and display (112) of the graphic elements (122, 124, 126, 128, 130, 132, 134, 136, 138) on the display device (120), c) generating (114) at least one reduced graphic element (122', 124', 126', 128", 130', 132', 134', 136', 138') by a second computing unit (158), wherein each reduced graphic element (122', 124', 126', 128', 130', 132', 134', 136',138') is assigned to a graphic element (122, 124, 126, 128, 130, 132, 134, 136, 138), wherein a representation of a reduced graphic element (122', 124', 126', 128', 130', 132', 134', 136', 138') is based on the safety criticality and dynamics of the graphic element (122, 124, 126, 128, 130, 132, 134, 136, 138) assigned to it, and upon fulfillment of the reduction condition, d) display (116) of the reduced graphic elements (122', 124', 126', 128', 130', 132', 134', 136', 138') instead of their associated graphic elements (122, 124, 126, 128, 130, 132, 134, 136, 138) on the display device (120)., 2. Method according to claim 1, characterized in that for graphic elements (122, 124, 126, 128, 130, 132, 134, 136, 138) with a high safety criticality, the reduced graphic element (122', 124', 126', 128', 130', 132', 134', 136', 138") corresponds to the graphic element (122, 124, 126, 128, 130, 132, 134, 136, 138).
3. Method according to claim 1 or 2, characterized in that a snapshot of graphic elements (122, 124, 126, 128, 130, 132, 134, 136, 138) with low dynamic range is generated and the reduced graphic element (122', 124', 126', 128', 130', 132', 134', 136', 138') of the A snapshot in time.
4. Method according to one of the preceding claims, characterized in that the display (116) of the reduced graphic elements (122', 124', 126', 128', 130', 132', 134', 136', 138') generated by the second computing unit (158) is carried out until a restart of the first computing unit (150).
5. Method according to one of the preceding claims, characterized in that the reduction condition corresponds to a security level, a readability, a checksum over an image area or a correctness of an image area.
6. Computer program product comprising instructions which, when the program is executed by a computer, cause the computer to execute a method (100) according to one of the preceding claims.
7. Computer-readable storage medium (146) comprising instructions which, when the program is executed by a computer, cause it to execute a method (100) according to any one of claims 1 to 5.
8. Data carrier signal that transmits the computer program product according to claim 6.
9. Device (140) for displaying graphic elements (122, 124, 126, 128, 130, 132, 134, 136, 138) on a display device (120) of a vehicle (160), comprising: a) A first processing unit (150) configured to generate graphic elements (122, 124, 126, 128, 130, 132, 134, 136, 138), b) A second processing unit (158) configured to generate reduced graphic elements (122', 124', 126', 128', 130", 132', 134', 136', 138'), c) A display output (148) communicative with the first processing unit (150) and the second computing unit (158), and d) A display device (120) which is communicatively connected to the display output (148), wherein the device (140) is configured to perform a method (100) according to any one of claims 1 to 5.
10. Device according to claim 9, characterized in that the first computing unit (150) and the second computing unit (158) are implemented within a computing system with a hypervisor.
11. Device according to claim 9 or 10, characterized in that the first computing unit (150) and the second computing unit (158) are implemented on different processors (144) within a computing system.
12. Device according to one of claims 9 to 11, characterized in that at least a first graphics layer and a second graphics layer are provided to the display output (148), wherein the first graphics layer is provided by the first computing unit (150) and is assigned a high priority before the reduction condition occurs, wherein the second graphics layer is provided by the second computing unit (158) and is assigned a low priority before the reduction condition occurs, wherein, upon the occurrence of the reduction condition, a low priority is assigned to the first graphics layer and a high priority is assigned to the second graphics layer, wherein the display output (148) provides the graphics layer with high priority to the display device (120) for display.
13. Device according to one of claims 9 to 12, characterized in that the first computing unit (150) is assigned to the display output (148) until the reduction condition occurs and the second computing unit (158) is assigned to the display output (148) upon occurrence of the reduction condition.
14. Device according to one of claims 9 to 13, characterized in that the monitoring (104) of the first computing unit (150) with respect to the reduction condition is realized by means of at least one of the following possibilities: a) monitoring of a computer program executed on the first computing unit (150) with a third computing unit, wherein the third computing unit is realized with the first computing unit (150) and the second computing unit (158) in a computing system, b) monitoring of a computer program executed on the first computing unit (150) with a fourth computing unit, wherein the fourth a) a computing unit is not implemented with the first computing unit (150) and the second computing unit (158) in a computing system, c) monitoring of a display area with a fifth computing unit, wherein the fifth computing unit is implemented with the first computing unit (150) and the second computing unit (158) in a computing system.
15. Vehicle (160) comprising a device (140) according to any one of claims 9 to 14.
Citation Information
Patent Citations
Method and device for displaying a notice to a user and work device
DE102017200915A1
Separate operating systems for dashboard display
US20200219469A1